A future in which AI can recognize a person’s unspoken “that’s not what I meant” response from brain signals and adjust its behavior on its own is coming closer. KAIST researchers have developed a technology that detects cognitive mismatch between humans and AI through brainwaves, enabling AI systems to revise their actions in real time according to human goals. The achievement is expected to accelerate the shift from AI that follows explicit commands to AI that can infer human intent.

KAIST announced that a research team led by Endowed Chair Professor Sang Wan Lee from the Department of Brain and Cognitive Sciences, in collaboration with Microsoft Research Asia (MSRA), has developed Neural Value Alignment (NVA), a next-generation brain–computer interface (BCI) technology that uses human brainwaves to align AI behavior with human intent in real time.

For AI to collaborate naturally with people, it must accurately understand what a person actually wants. Until now, however, AI systems have largely inferred human intent from externally observable information such as speech, actions, or gestures. The challenge is that the same action can reflect different goals, and the same goal can also be achieved through different actions. For example, when a person picks up a cup, it may be unclear whether they intend to drink from it or hand it to someone else. Because of this two-sided “goal–action ambiguity,” when AI misunderstands human intent, users often have to correct it through additional commands or actions.

To address this problem, the research team focused on the “prediction error” signals that arise unconsciously in the brain when a person encounters an unexpected situation. In simple terms, the team used the brain’s instant “that’s not what I meant” response when AI performs the wrong action or pursues the wrong goal.

The researchers distinguished between two types of brain responses. The first is reward prediction error (RPE), which appears when AI misunderstands the person’s ultimate goal. The second is state prediction error (SPE), which appears when the goal is correct but the process or method of action differs from what the person expected.

The team measured real-time electroencephalography (EEG) signals from people as they observed AI performing tasks. They found that the brain produced different signals depending on whether the AI misunderstood the goal itself or chose the wrong method while pursuing the correct goal. By applying deep learning to these brain signals, the team developed a technology that can determine, from EEG alone, how a person is interpreting the AI’s behavior.

The team then proposed a Neural Value Alignment-based human–AI synergy algorithm, which feeds these decoded brain signals back to the AI in real time so that it can correct its own behavior. When the AI detects an SPE signal, it interprets the situation as “the desired goal is correct, but the method is wrong” and adjusts its action strategy. When it detects an RPE signal, it understands that “the goal itself was misunderstood” and searches again for what the person truly intended.

Simulation results showed that the proposed method adapted more quickly than existing approaches even in uncertain situations, such as when a person’s goal suddenly changed or some human neural feedbacks were missing.

As the technology advances, it could be applied to physical AI robots in homes and industrial settings, autonomous vehicles that quickly reflect driver judgment, medical and rehabilitation robots for patients who have difficulty speaking or moving, and educational AI systems that adapt to a student’s cognitive state.

Professor Sang Wan Lee, who led the international collaboration, said, “This research is meaningful because it shows that AI can move beyond inferring human intent only from visible behavioral outcomes and instead directly use cognitive signals generated in the brain during collaboration with AI.” He added, “The technology can be expanded to a wide range of fields where human judgment and AI behavior must be closely connected, including physical AI, BCI, autonomous driving, precision personalized education, medical robotics, and human–computer interaction.”

Miran Lee, Director, Microsoft Research Accelerator at Microsoft Research, said, “This achievement is the result of the ongoing international collaboration between KAIST and Microsoft Research Asia. We look forward to continuing this partnership to develop world-class BCI technologies that enable humans and AI to communicate and collaborate more naturally.”

The study’s first author is Xin Xu, a Ph.D. student in KAIST’s Department of Brain and Cognitive Sciences. Researchers from Microsoft Research Asia, including Yansen Wang, Dongqi Han, and Dongsheng Li, also participated in the study.

Journal: IEEE Transactions on Cybernetics
DOI: 10.1109/TCYB.2026.3722605
Article Title: Neural Value Alignment: Human–AI Collaboration Under Goal–Action Ambiguity
Article Publication Date: August 2026
Authors: Xin Xu (first author); Yansen Wang, Dongqi Han, Dongsheng Li (Microsoft Research Asia)
Funding: Institute of Information & Communications Technology Planning & Evaluation (IITP), Ministry of Science and ICT
Institution: Korea Advanced Institute of Science and Technology (KAIST); Microsoft Research Asia

Source: EurekAlert