Human Insight AI is the technology that understands, supports, and predicts human behavior in complex environments. Today, Human Insight AI is powering solutions in many fields and industries. Smart Eye’s multi-modal software and hardware solutions can capture more than a person’s head position, eye gaze or attentiveness, but also identifying everyone’s mood and emotional state to get a high-definition view of the big picture and provide unprecedented human insight in automotive and behavioral research.
Smart Eye’s Human Insight AI draws on multiple data sources in an unobtrusive, non-invasive manner, providing real-time analysis with a high level of computational accuracy. Designed to be reliable, scalable, robust, and able to run on any platform.
Our multimodal approach is also unique: we are the first to combine different sensor technologies to discover more than what meets the eye. Through multiple sensors, we measure multiple several aspects of human behavior: from our reactions and interactions to the objects we use and the activities we engage in.
The foundation of our Human Insight AI and all our core technologies are images captured by a camera or other optical sensors and algorithms. To train and validate these algorithms, we use machine learning and computer vision methods.
Human Insight AI is powering solutions in a vast number of fields and industries — including Automotive, Aviation & Aerospace, Assistive Technology, Media & Marketing, Psychology and Neuroscience, and more.
In automotive, Smart Eye’s road-ready Driver Monitoring Systems and advanced Interior Sensing technology is embedded in next-generation vehicles and available as a standalone aftermarket solution for existing vehicles, fleet, and small-volume OEMs (original equipment manufacturers).
In behavioral research, our industry-leading eye tracking systems and biosensor software enable advanced research and training in academic and commercial sectors, while our Emotion AI provides deeper consumer insights to the world’s largest brands and market researchers.
Smart Eye’s Human Insight AI consists of different core technologies, including head, eye and gaze tracking, Emotion AI and facial expression analysis, activity and body pose tracking, and object detection. These foundational features combined with novel deep learning methodologies and massive amounts of data provide accurate, scalable, and repeatable analysis of human behavior to many areas.
Smart Eye is the global leader in Human Insight AI — our multi-modal software and hardware solutions provide unprecedented human insight in automotive and behavioral research, and we are also supported by Affectiva and iMotions, companies we acquired in 2021.
Built on two decades of technical experience, our technology is powering customers like NASA, Nissan, Boeing, Honeywell, Volvo, GM, BMW, Geely, Polestar, Harvard University, over 1,300 research organizations around the world, 70% of the world’s largest advertisers and 28% of the Fortune Global 500 companies.
Eye tracking is process of capturing and measuring a person’s gaze and eye movements to generate insights. By using sensors that detect the human eye in a given environment, Smart Eye is able to collect and analyze the data to assess a person’s alertness, attentiveness and focus to create a clear picture of overall mood and awareness level.
To make sense of the wealth of real-time data provided by our systems, we support our software and algorithms by using AI. Artificial intelligence is a necessary component in achieving our high standard for accuracy, predictability, and stability. It is also a critical success factor for eye tracking when it is used in challenging environments, where light conditions vary, or the subject’s eyes are partly covered.
In the automotive industry, Smart Eye’s head, eye, and gaze tracking are employed in advanced Driver Monitoring and Interior Sensing systems. In the world of psychology and neuroscience, it is used in research that can help diagnose neurological conditions and increase our understanding of the human mind. The aviation and aerospace industries study eye and gaze movements for research, development, and educational purposes. Eye tracking can also be used to interact with computers in a more intuitive way; having applications also for Assistive Technology. Which, if you know our history, is the original idea that made everything else possible.
There are many notable features and capabilities to consider before purchasing an eye tracking system for a research project.
Here’s some things to consider in order to assess the quality of an eye tracker and select the right system for your upcoming projects: works in various lighting conditions, simple and fast calibration and profiling process, head position / rotations and pupillometry, low data loss and latency, high accuracy (with movement), freedom of movement (large headbox), scalable to environment, works in multiple use cases, includes advanced features (i.e. 3D World Model, XYZ data coordinates), and supports integration of data feeds.
Smart Eye’s main customer categories in the behavioral research space are Automotive, Aviation and Aerospace, and Assistive Technologies. In addition, we provide Training & Education focused on the aviation and railroad industries.
Our solutions are used around the world by more than 800 prestigious partners and customers, including NASA, BMW, Audi, Boeing, Airbus, Volvo Cars, GM, SmartBox, Toyo, iMotions, Universal Studios Media Lab, Johns Hopkins University, and Harvard University.
A basic explanation of the complex process of eye tracking is that infrared light is used to create a reflection in the eye’s cornea, that can be captured by a camera. To get a more accurate and robust tracking performance, Smart Eye’s solutions track each eye separately. Intelligent algorithms then identify the iris and pupil of each eye and weigh the two monocular feeds into a consensus gaze. Simultaneously, the software also detects, tracks, and interprets the person’s facial features and head movements.
Eye tracking reliability depends on the accuracy and the gaze-tracking precision of the eye tracker. Ideally, an eye tracker with an accuracy between 0.5° & 1.0° is reliable. However, you should always aim to have an accuracy that is below 0.5°, if possible. We are happy to say that, under ideal conditions, you can get a head and gaze accuracy of > 0.5° with our Smart Eye Pro.
Smart Eye sells the world’s most advanced remote eye tracking systems. We have a large portfolio of multimodal software and hardware products to help researchers in academia and various industries reach new insights.
The versatility of our products, combined with a stellar performance in all conditions, is why the Smart Eye Pro or XO is the preferred research eye trackers for car and flight simulators, vehicle studies, psychology & neuroscience, media & marketing, multi-screen or control room environments, long-range tracking, mobiles, tablets, and single screens around the world.
Our products offer exceptional robustness and data availability, features the smallest form factor, enhanced resolution, larger headbox ensures the best in the industry data availability, and reduced setup and configuration time by letting the camera determine the correct exposure (new autoexposure feature).
Smart Eye product prices can change according to the problem you are trying to solve. Some of our eye trackers have a fixed price, but if you wish to buy our Smart Eye Pro eye tracker, the price will change according to the number of cameras you need. To get an accurate quote, contact our sales team.
Emotion AI is novel technology that measures people’s unfiltered and unbiased emotional and cognitive responses, unobtrusively and at scale. Affectiva’s industry-leading artificial emotional intelligence technology develops algorithms that can identify not only basic human emotions such as happiness, sadness, and anger but also more complex cognitive states such as fatigue, attention, interest, confusion, distraction, and more.
Using an optical sensor, like a webcam or a smartphone camera, our AI identifies a human face in real-time. Computer vision algorithms then identify key features on the face, which are analyzed by deep learning algorithms to classify facial expressions. These facial expressions are then mapped back to emotional states.
Emotion AI is designed to detect and quantify facial expressions and emotional states of the face. At Smart Eye, Affectiva’s Emotion AI technology is incorporated into their Automotive Interior Sensing solution to assess the state of the driver, cabin and occupants.
The technology is also the core of the Affectiva Media Analytics team who provide the technology to research partners for video creative testing, SDK integration and qualitative research. And lastly, our subsidiary iMotions has Affectiva’s Emotion SDK available as a facial expression analysis module on their platform to assist researchers all around the globe with next-level behavioral research insights.
Facial Coding is the process of understanding human emotion through capturing expressions of the face. Facial coding or facial expression analysis is based on validated academic research and is the ground truth of Affectiva’s Emotion AI software that we have built and continue to improve upon.
Because we understand that what people say is not always how they really feel, facial coding can give added insight into how people are nonconsciously responding to stimuli. At Smart Eye, utilizing facial coding in cars gives nuanced insight into the emotional states of the driver and passengers to improve safety and enhance the automotive experience. For Media Analytics, this technology helps research agencies and advertisers get a deeper understanding as to how viewers are responding to video content or experiences.
Understanding the meaning of facial signals is an evolving field and we encourage industry and academia to include signals from multiple modalities for the most accurate picture. But we continue to find that automated facial expression analysis, if conducted with consent, is both ethical, accurate, and can meaningfully tell us something about human responses. Contextual awareness is necessary to avoid simplistic conclusions, but as a tool to understand people, unobtrusively and at scale, this technology has enormous power and value.
We live in a world full of hyper-connected devices and advanced AI systems, with amazing cognitive capabilities. These technologies have a lot of IQ, but are severely lacking in EQ, or emotional intelligence. As a result, our interactions with AI systems that are designed to engage with humans, are transactional, superficial and often ineffective.
These technologies are significantly hindered without a deep understanding of what’s happening with the people they interact with. If we want AI to be truly useful, it needs to be able to understand us, complex humans, on a deeper level. What’s more, some future innovations will simply not be possible without Emotion AI. This is especially true as AI takes on roles that were traditionally held by humans.
With Emotion AI technology, Affectiva Media Analytics helps media, entertainment, and market research companies gain a deeper understanding of how consumers and audiences engage with their content, products and services. Today, our Media Analytics solutions are used by 70 percent of the world’s largest advertisers, and 28 percent of the Fortune Global 500 companies — including Kantar, Unruly, Qualtrics, and others.
Smart Eye’s Driver Monitoring Systems (DMS) uses sensors, such as in-car cameras, computer vision, and artificial intelligence to bring insight into the driver’s state and behavior. With their ability to detect driver distraction and drowsiness, driver monitoring systems have become a key technology for preventing accidents and improving road safety.
Through eye, head and gaze tracking software and an infrared camera, a driver monitoring system can detect whether a driver is inattentive or drowsy. The system can then generate impulses to alert the driver’s attention, and if this fails, take control of the vehicle and bring it to a stop. A DMS with eye tracking also enables the driver to remotely control some of the car’s functions with gaze and gestures, which can improve safety and comfort for the driver and passengers.
Every 24 seconds a human life is lost in traffic. Most of these accidents are caused by human error — drivers that are distracted or fatigued. Driver Monitoring Systems can detect driver impairment and enable appropriate interventions for several types of road safety risks: road or in-car distractions, driver fatigue or drowsiness, unresponsive driver, etc.
Smart Eye’s AI-based DMS technology enables a wide variety of features for improved road safety and driver convenience. These include driver identification, distraction detection, drowsiness detection, attention detection, dangerous behavior detection, object detection, seatbelt detection, activity detection, body posture, facial expression analysis — using Affectiva’s Emotion AI that captures nuanced emotions, reactions, and facial expressions in real time — face mask and glasses detection, and unresponsive driver detection.
Smart Eye’s Driver Monitoring System software has been installed in more than 1 million cars on roads globally – saving lives every day. A majority of the 1M+ cars produced with Smart Eye’s DMS software are manufactured by BMW, with series production initiated in late 2018. These car models all include Driver Monitoring as an optional add-on.
The other car models in production are produced by leading global manufacturers, including one of US largest automakers, two of China’s largest automakers, a Japanese-European multinational car alliance and a South Korean multination automobile manufacturer. Smart Eye’s DMS will also be included in the new Polestar 3, the Swedish brand’s electric performance SUV.
The European New Car Assessment Programme (Euro NCAP) is one of the world’s most well-established safety rating systems for new car models. Since the latest update of Euro NCAP’s new car assessment protocol, receiving a five-star rating from Euro NCAP will be very difficult without an active safety system that monitors the state of the driver – also known as a Driver Monitoring System.
Smart Eye is a member of two of the expert groups that are helping Euro NCAP formulate the tests and assessment protocol which will be used to rate Driver Monitoring Systems by 2023. With our 20+ years of experience developing Driver Monitoring System software for the automotive industry, we know what separates a mediocre system from a really good system.
We feel confident that our Driver Monitoring solution is fully prepared to be tested by Euro NCAP – and receive a top rating. Our AI-powered driver monitoring technology includes the most advanced eye tracking available and delivers accurate, reliable results independent of illumination or face occlusion.
At Smart Eye, we have always been guided by our ambition to improve road safety and save lives through technology. Including Driver Monitoring technology in Euro NCAP’s next assessment protocol is an initiative that can save thousands of lives every year. And if you ask us, the sooner Driver Monitoring Systems become a natural part of every new European vehicle, the better.
Our Driver Monitoring software is flexible and hardware-agnostic – allowing for easy integration in any new or existing vehicle. Contact us to learn more about our automotive products and how to install our DMS solutions into personal cars, commercial vehicles, and vehicle fleets.
Interior Sensing, or In-Cabin Sensing, is the natural evolution of driver monitoring systems. Interior Sensing turns the car’s sensors inwards, pairing driver monitoring with cabin monitoring for deep, human-centric insight into what is happening in a vehicle.
Smart Eye Automotive Interior Sensing sees beyond the driver and extends the intelligence to the entire cabin. Interior Sensing identifies all types of occupants, their activities, and the objects they use, enabling greater customization of the car’s interior systems and features — from seats that automatically adjust to a registered user to infotainment systems that make content suggestions based on the driver’s mood and emotions.
Smart Eye’s Interior Sensing is powered by subsidiary Affectiva’s pioneering Emotion AI. Affectiva’s Emotion AI is key in Smart Eye’s Interior Sensing solutions, offering even deeper insight into what is happening with people in a vehicle.
Emotion AI helps the car understand complex moods, emotions, and behaviors of the people in the car, in real time. Detecting emotions like driver anger or surprise, Emotion AI can help mitigate dangerous driving situations and improve road safety. It also analyzes how the people in the car react to their environment and to content, such as music or video. Combining this type of information with other interior sensing data, the in-vehicle system can adapt temperature, lighting, seats, or entertainment to provide a personalized mobility experience.
Smart Eye Automotive Interior Sensing unlocks features and services that enhance wellness, comfort, and entertainment, while always putting safety first. These include face recognition, occupancy detection, driver and passenger state, pet detection, child seat detection or child left behind, object classification or object left behind, facial expression analysis — including Affectiva’s Emotion AI that captures nuanced emotions, reactions, and facial expressions in real time for all passengers — and activity detection, such as cell phone usage, eating, drinking, smoking or other activities.
From preventing fatal heatstroke in children or pets left in a hot car, to adapting traditional security functions like the activation of airbags or use of seatbelts, Interior Sensing will become a safety essential in new cars. Not to mention the thousands of accidents that can be prevented by detecting distraction or drowsiness in drivers. Through its complete view of what is happening in the entire cabin, an Interior Sensing system does not only help catch distraction but understand what might be stealing the driver’s attention away from the road ahead.
By fine-tuning things like temperature, lighting, seats, and entertainment in real-time based on the individual preferences of the people in the cabin, Interior Sensing helps the car do more than get its passengers to their destination safely. In an environment customized to enhance the comfort, wellness, and entertainment of all passengers, riding in a car becomes as much about the journey as the destination.
Driver Monitoring Systems (DMS) have become an increasingly important safety feature in newer passenger cars. But the need for technology that monitors the driver’s state and behavior is just as great in trucks, buses and in the millions of cars already on the road.
Using Smart Eye’s proven automotive-grade DMS software that has already been implemented in more than 1 million cars on the road, our fleet & aftermarket solution, AIS, combines high intelligence with great flexibility, and superior performance — increasing overall road safety for every installation.
AIS is Smart Eye’s end-to-end Driver Monitoring System for small-volume car manufacturers, fleets and the aftermarket. Combining high intelligence with great flexibility, the plug-and-play system is easy to install and very cost-effective. Our solution is also scalable and developed with several different output options for alarming the driver. Easily upgraded and integrated with other systems, AIS can be connected to a vehicle CAN bus for HMI (Human Machine Interaction) integration.
Developed to make every trip a safer journey, our AIS has superior performance and intelligent features, including drowsiness detection, distraction detection, dangerous behavior detection, and high-accuracy recognition of all kinds of faces, including those wearing a face mask and sunglasses.
AIS is built on more than 20 years of automotive experience, using Smart Eye’s proven, automotive-grade DMS software for car manufacturers — which has already been implemented in more than 1 million cars on the road. Uniting our world-leading computer vision and AI algorithms with qualified automotive hardware, AIS delivers a complete plug-and-play DMS solution that is easy to install, scalable, and very cost-effective.
Our AI-powered software detects early signs of drowsiness or distraction to prevent dangerous situations. Helping protect drivers, passengers, pedestrians, and all road-users, AIS is developed to make every trip a safer journey.
The cost of Smart Eye’s AIS system depends on which system version, camera sizing, fleet sizing, and add-ons best fit your needs. To get an accurate quote, contact our sales team.
Eye tracking is a valuable tool in aviation — by helping enhance aviation and aerospace research, pilot monitoring, and pilot training, remote eye trackers can offer unique insight into human behavior and enable the aviation industry to further increase their safety standards.
Aviation and aerospace are both highly automated fields, relying on successful and efficient human-machine interaction. By analyzing how pilots perceive and respond to automation, Smart Eye’s eye trackers are furthering human factors research for smoother and safer air travel. With the precision our technology offers, researchers can analyze human factors like spatial disorientation and performance, accurately and without danger.
Smart Eye’s systems are also used to train tomorrow’s pilots by helping them correct their scanning techniques for future flights. Up in the air, eye tracking can improve flight safety by making sure pilots are alert and attentive while monitoring instruments. In Aerospace, our technology is installed in NASA’s Flight Deck Simulators and Research Flight deck to monitor pilot state and behavior.
Inadequate monitoring of critical parameters by pilots is a factor in 48% of accidents and incidents in commercial aviation. As a key tool for improving flight safety and enhancing pilot training sessions, eye tracking technology, when used along with simulators, can identify problems with pilots’ instrument scans and help them correct their techniques for future flights.
Smart Eye’s trackers can analyze the movement and rotation of a pilot’s head, eyelids, and pupil size measurements in real time; these are all calculated and analyzed to give conclusions about the pilot’s condition. The insight tells the trainer if the pilot is flying optimally, or if they are struggling due to potential distraction or drowsiness. Together with the instructor, the pilots increase their awareness of their monitoring behaviors they might never have noticed on their own.
Almost half of today’s aviation accidents are due to inadequate scanning of important parameters in the cockpit. By analyzing the pilots’ gaze movement, head pose, pupillometry and eyelid movements, Smart Eye’s eye trackers help detect distraction and drowsiness. Our eye tracking technology is a central part of pilot monitoring systems, detecting scanning errors and improving flight safety in any aircraft.
A highly skilled pilot is essential to safe air travel. In flight training or flight simulators, Smart Eye’s technology is used to enhance the scanning techniques of future pilots. The real-time data offered by our eye trackers can be analyzed to detect the strengths and weaknesses of a pilot recruit – effectively improving performance.
Affectiva’s facial coding technology can be applied to multiple types of content — from advertising to entertainment content like trailers, TV episodes and feature films — our core media analytics platform is optimized for seamless and automated analysis of viewer response to video creative.
Affectiva’s technology has validated exclusive measures to give confidence in market performance. Our facial coding AI analyzes how target consumers respond to animatic and finished film video material using the emotion insight to answer campaign development, creative, media and ROI challenges. You’ll get clear guidance on how to improve story flow, create cut-downs, test voice overs and understand the emotional role of your brand.
With Affectiva Emotion AI, Qualitative Researchers can now accurately and authentically understand the emotional responses, subtleties and shared feelings of participants during in-depth interview and focus groups — in both traditional physical settings and online environments. Our cloud-based service used for analyzing images and videos of humans expressing emotion is an easily administered technology that supports qualitative research. Simply send a video for processing and our detailed emotion metrics are quickly delivered to you.
With qualitative research, much of the focus is on what is being said and gathering verbatim data. And using Emotion AI for qualitative analysis can add deeper insights into participants’ emotional responses and give confidence in user experience. Our technology can be deployed to assist, complement and enhance creative & concept development, interviews and in-video verbatim feedback.
Yes! Our software development kit enables developers to seamlessly incorporate our emotion sensing technology to their apps and digital experiences — getting access to Affectiva’s globally validated Emotion AI metrics delivered in real-time.
Cost and accessibility of Affectiva’s Emotion SDK depends on your project scope and research needs. To get an accurate quote, contact our sales team.
Affectiva’s Emotion AI is designed to be a tech layer that can be seamlessly integrated into a survey or platform as an analysis component. Within our quantitative solution is the capability for survey breaks whereby analysts can parse out data by segment or custom survey question, and easily export out Emotion AI traces to supplement client deliverables. And our qualitative research offering can be easily integrated as another level of emotional analysis.
We are strong believers in multimodal research. Combining our facial expression analysis technology with other methodologies can assist in adding color into gaining a deeper understanding of human behavior.
Although Affectiva’s software development kit is available to developers to incorporate emotion sensing into their apps and digital experiences, academic researchers should contact iMotions for their research project needs. iMotions has both Affectiva’s facial coding technology and Smart Eye’s suite of eye trackers integrated into their multimodal human behavior research platform, enabling users to conduct more advanced research for next-level insights.
Founded in 2005 and headquartered in Copenhagen with offices in Boston, Singapore and Berlin, iMotions has successfully developed the world’s leading human behavior software solution. The software combines data from +50 sensors – eye tracking, facial expressions, sweat gland activity, brain activity and more — in one easy-to-use software that uniquely and in real-time tracks, aggregates and analyses nonconscious emotional, cognitive and behavioral data providing research teams a deeper, more comprehensive understanding of human behaviors.
On October 26, 2021, it was announced that Smart Eye, the global leader in Human Insight AI was to acquire iMotions, the leading provider of human behavior software. iMotions is part of the Smart Eye Group but continues to operate as an independently run, standalone company.
iMotions Lab synchronizes data from physiological biosensors such as eye trackers, EEG or GSR sensors and make it easy to visually explore the data in relation to the study via a timeline interface. Studies can be setup in iMotions Lab as well as management of respondents. Built in R script notebooks makes it easy to do common data analysis tasks related to each type of modality and the methods used are always 100% transparent and customizable making it a valuable asset for researchers.
iMotions is a true multimodal software solution and a highly specialized software platform. The three main iMotions platforms are available in two different payment options. The first is a license-based model (academia) and the second is as a subscription-based model.
iMotions does not offer a free or a “light” solution at this point. But they do offers student licenses linked to an academic “parent” account. If you are a student in need of the iMotions platform, please get in touch with the appropriate department at your educational institution.
iMotions Lab, iMotions proprietary multimodal software suite, is the most comprehensive human insights tool currently available on the market and an invaluable companion for both commercial and academic research entities to measure human responses and experiences in real time.
By synthesizing response data from a range of sources into a single intuitive platform, iMotions is simplifying workstreams, study design, visualization, and analysis to help you hone in on the insights that are important to you and your research.
By joining forces with iMotions, Smart Eye and subsidiary Affectiva create a true, integrated powerhouse in delivering unparalleled insights into human behavior in automotive, research and beyond. iMotions adds the software layer that enables fusion of multiple sensor data and the required analytics – taking the next vital step towards unlocking the potential for multimodal human behavioral research.
iMotions is a true multimodal software platform as well as hardware agnostic. It integrates several different biosensors, such as EEG, ECG, EMG, GSR/EDA, Facial Expression Analysis (FEA), and Eye Trackers for screen-based, glasses, webcam and VR eye tracking. They also partner with many of the leading manufacturers to offer easy setup and deep integration with the hardware out of the box.
iMotions Lab is a modular software. That means that aside from the main analytical module (CORE), which is mandatory, you only need to buy the modules that you need for your research. This means that it is difficult to give a precise price overview because every quote is unique. To get a quote for the setup you need, please contact the iMotions Solutions Team.
Affectiva, now part of the Smart Eye group, is on a mission to humanize technology. Founded by visionary scientists Dr. Rana el Kaliouby and Dr. Rosalind Picard, Affectiva spun out of the MIT Media Lab in 2009. Affectiva created and defined the new technology category of Emotion AI, and evangelized its many uses across industries.
Affectiva was venture-backed and raised $53 million in capital from leading investors including Kleiner Perkins Caufield Byers, Horizon Ventures, Fenox Venture Capital and WPP.
On May 25th 2021, it was announced that Smart Eye would be acquiring Affectiva. By merging the two companies, we created a transatlantic AI juggernaut that will lead and accelerate the growth and development of the rapidly evolving automotive Interior Sensing market, as well as the Media Analytics and Behavioral Research markets.
Affectiva’s industry leading Emotion AI detects nuanced human emotions, complex cognitive states, activities, interactions and objects people use. The technology has been built on deep expertise in machine learning, computer vision, and the acquisition and annotation of massive amounts of real-world data. Always done with a focus on the ethical development and deployment of AI. As a startup, Affectiva focused on productizing its technology for the following markets: Media Analytics and Automotive.
Affectiva Media Analytics helps media, entertainment, and market research companies gain a deeper understanding of how consumers and audiences engage with their content, products and services. Today, our Media Analytics solutions are used by 70 percent of the world’s largest advertisers, and 28 percent of the Fortune Global 500 companies. In automotive, Affectiva’s AI is part of Smart Eye’s interior sensing solutions, enabling leading car manufacturers to build next-generation vehicles that understands the state of the driver and occupants in it.
Now as part of the Smart Eye Group, Affectiva will continue to invest in the many applications of Emotion AI in media analytics, automotive, and beyond.