Skip to main content

YC-backed Observant uses the iPhone’s infrared depth sensors to analyze user emotions

Observant has found a new way to use the fancy infrared depth sensors included on the iPhone X, XS and XR: analyzing people’s facial expression in order to understand how they’re responding to a product or a piece of content.

Observant was part of the winter batch of startups at accelerator Y Combinator, but was still in stealth mode on Demo Day. It was created by the same company behind bug reporting product Buglife, and CEO Dave Schukin said his team created it because they to find better ways to capture user reactions.

We’ve written about other startups that try to do something similar using webcams and eye tracking, but Schukin (who co-founded the company with CTO Daniel DeCovnick) argued that those approaches are less accurate than Observant’s — in particular, he argued that they don’t capture subtler “microexpressions,” and they don’t do as well in low-light settings.

In contrast, he said the infrared depth sensors can map your face in high levels of detail regardless of lighting, and Observant has also created deep learning technology to translate the facial data into emotions in real-time.

Observant has created an SDK that can be installed in any iOS app, and it can provide either a full, real-time stream of emotional analysis, or individual snapshots of user responses tied specific in-app events. The product is currently invite-only, but Schukin said it’s already live in some retail and ecommerce apps, and it’s also being used in focus group testing.

Observant

Of course, the idea of your iPhone capturing all your facial expressions might sound a little creepy, so he emphasized that as Observant brings on new customers, it’s working with them to ensure that when the data is collected, “users are crystal clear how it’s being used.” Plus, all the analysis actually happens on the users’ device, so no facial footage or biometric data gets uploaded.

Eventually, Schukin suggested that the technology could be applied more broadly, whether that’s by helping companies to provide better recommendations, introduce more “emotional intelligence” to their chatbots or even detect sleepy driving.

As for whether Observant can achieve those goals when it’s only working on three phones, Schukin said, “When we started working on this almost a year go, the iPhone X was the only iPhone [with these depth sensors]. Our thinking at the time was, we know how Apple works, we know how this technology propagates over time, so we’re going to place a bet that eventually these depth sensors will be on every iPhone and every iPad, and they’ll be emulated and replicated on Android.”

So while it’s too early to say whether Observant’s bet will pay off, Schukin pointed to the fact that these sensors have expanded from one to three iPhone models as a sign that things are moving in the right direction.



from Mobile – TechCrunch https://ift.tt/2PritHA

Comments

Popular posts from this blog

The future of Magic Leap's promising AR efforts dim after layoffs

The Magic Leap Two is now further away than ever, unfortunately. Today in a blog post the augmented reality pioneer announced major layoffs and has decided to cut up to half of its workforce, according to some reports. The original Magic Leap One was supposed to be one of the first mainstream augmented reality headsets when it launched in 2018, but a high price point and lack of interest from developers left the headset high and dry after launch. According to the blog post, Magic Leap says it will be focusing its efforts on enterprise solutions (a statement HTC has made recently as well) and shift its focus away from consumer technology… at least for the time being.  The company has been open about creating a second headset that would offer improved specs for some time, but how that work will now have to go forward without half of the team , according to some estimates, remains to be seen. Is the window closing on augmented reality?  Although it’s just one company, Magic...

Du offers new roaming bundle for summer

UAE-based telecom operator du is offering roaming bundle for travelers valid for seven days. The summer bundle features unlimited calling and 2.5GB of data to 174 destinations - all from their own UAE number. Priced at AED 300 (per week) this latest addition to du’s roaming bundles will be available for customers travelling to 174 countries, including GCC countries, UK, US, European destinations, and Egypt, starting from May 30. The postpaid mobile subscribers can subscribe to the roaming bundle by sending the SMS U to 5102. Fahad Al Hassawi, Deputy CEO – Telco Services at EITC, the parent company of du, said that the roaming bundle will enhance the subscribers’ connectivity while travelling overseas and minimise their current pain points. Etisalat doubles internet speeds for eLife Unlimited subscribers from TechRadar - All the latest technology news http://bit.ly/2KbK1O8

Airship acquires SMS commerce company ReplyBuy

Airship is announcing that it has acquired mobile commerce startup ReplyBuy . The startup (which was a finalist at TechCrunch’s 1st and Future competition in 2016) works with customers like entertainment venues and professional and college sports teams to send messages and sell tickets to fans via SMS. It raised $4 million in funding from Sand Hill Angels, Kosinski Ventures, SEAG Ventures, Enspire Capital, MRTNZ Ventures and others, according to Crunchbase . Airship, meanwhile, has been expanding its platform beyond push notifications to cover customer communication across SMS, email, mobile wallets and more. But CEO Brett Caine said this is the first time the company is moving into commerce. While sports and concerts tickets might not be a booming market right now, Caine suggested that the company is actually seeing increased purchasing activity “in and around the Airship platform” as businesses try to drive more in-app purchases. He also suggested that both the COVID-19 pandem...