Affectiva
| Company type | Private |
|---|---|
| Industry | Artificial intelligence software |
| Founded | 2009 |
| Founder | Rana el Kaliouby, Rosalind W. Picard |
| Fate | Acquired by SmartEye in 2021 |
| Headquarters | United States |
Key people | Rana el Kaliouby (CEO from May 25, 2016), Rosalind W. Picard (Chairman and Chief Scientist until 2013), Graham Page (Global Managing Director of Media Analytics from September 5, 2019) |
| Products | Emotion AI technology, Affectiva Automotive AI |
| Parent | SmartEye |
Affectiva was a company specializing in artificial intelligence software, acquired by SmartEye in 2021. Emerging from the MIT Media Lab, it focused on AI technologies that interpret human emotions, cognitive conditions, behaviors, and object interactions by analyzing facial and vocal expressions. Affectiva was a trailblazer in the development of Emotion AI, a branch of technology dedicated to decoding emotional reactions.
History
The company was co-founded by Rana el Kaliouby, who assumed the role of chief executive officer on May 25, 2016, and Rosalind W. Picard, who held the positions of chairman and Chief Scientist until 2013. Affectiva’s initial products were the result of joint research efforts at the MIT Media Lab aimed at supporting individuals on the autism spectrum.
SmartEye, a Swedish competitor, acquired Affectiva through a predominantly stock-based transaction valued at $73.5 million.
Technology
Affectiva’s Emotion AI technology surpasses simple facial expression recognition by identifying intricate emotions, cognitive states such as fatigue and distraction, as well as activities and objects through analysis of facial cues, vocal tones, and body language.
Leveraging deep learning, computer vision, and extensive datasets gathered from real-world environments, Affectiva’s AI utilizes optical sensors like webcams or smartphone cameras for instant face detection. Computer vision techniques pinpoint critical facial landmarks, which deep learning algorithms then classify into expressions associated with specific emotions. Research indicates that Affectiva’s facial expression recognition software performs on par with facial Electromyography. The system also recognizes objects including mobile phones and car seats while monitoring body joints to evaluate posture and movement.
Affectiva has compiled one of the most extensive emotion-related data collections globally, analyzing more than 10 million face videos from 90 countries. Furthermore, it has gathered over 19,000 hours of automotive in-cabin data from 4,000 participants to enhance algorithm accuracy across varying camera perspectives, lighting conditions, and vehicle interiors.
Applications
The primary focus of Affectiva’s AI was Media Analytics, with additional implementations in sectors such as automotive, healthcare, mental health, robotics, conversational interfaces, education, and gaming. Its technology has been utilized to boost emotional intelligence in Softbank Robotics’ Pepper robot, identify early Parkinson’s disease signs within healthcare settings, improve chatbot interactions, and tailor gaming experiences based on user emotions. These varied use cases highlight Affectiva’s strategic engagement across multiple rapidly expanding markets through emotion AI.
Media analytics
Initially, Affectiva’s technology was applied within media analytics for market research purposes, analyzing over 53,000 advertisements across 90 countries. Brands, advertising agencies, and market research firms employed the company’s Emotion AI to capture unbiased emotional reactions from consumers viewing video ads and movie trailers. These insights helped optimize brand messaging and media content while predicting critical advertising outcomes such as increases in sales, purchase intent, and content virality. The technology also supported qualitative research methodologies.
Affectiva collaborated with leading insights organizations including Kantar, LRW, Added Value, and Unruly. Through these partnerships, its Emotion AI reached 28 percent of Fortune Global 500 companies and was used by 70 percent of the world’s largest advertisers.
On September 5, 2019, Affectiva named Graham Page—a seasoned Kantar executive—as Global Managing Director of Media Analytics to expand the company’s footprint within this industry segment.
Automotive
On March 21, 2018, Affectiva introduced Affectiva Automotive AI, the pioneering multi-modal in-cabin sensing platform designed to evaluate driver, occupant, and cabin conditions in real time. This innovation allowed automotive manufacturers, fleet operators, and ridesharing services to boost road safety and create sophisticated driver monitoring systems by identifying hazardous behaviors such as fatigue, distraction, and anger. Additionally, it enhanced passenger experience through analysis of responses to in-cabin stimuli.
In addition to detecting emotional and cognitive states, Affectiva Automotive AI provided contextual insights including the number of passengers, their seating arrangements, and the presence of objects within the cabin.
Affectiva collaborated with prominent automotive and transportation technology firms such as Aptiv, Cerence, Hyundai Kia, Faurecia, Porsche, BMW, GreenRoad Technologies, and Veoneer to embed its in-cabin AI technology into future vehicle platforms.
Acquisition
In June 2021, Smart Eye acquired Affectiva, broadening its expertise in emotion recognition AI and driver monitoring technologies.