The goal of the KARLI project is to develop an adaptive, responsive and level-compliant interaction in the vehicles of the future. To this end, customer-relevant AI functions are being developed in KARLI that detect driver states and design interactions for different automation levels.

These AI functions are developed in KARLI from empirical and synthetically generated data. The data will be collected and used in KARLI in such a way that the project results are scalable to Big Data from production vehicles available in the future.

In the KARLI project, the research department of paragon semvox will apply competencies in the area of dialog management and affective interaction with the use of rule- and statistically-based methods on the basis of its own geni:OS interaction platform and speech technologies (ASR,TTS).

Go to KARLI-Website

The joint project "MITHOS" (Mixed-Reality Interactive Training for Dealing with Heterogeneity and Conflict Situations in Schools) researches and develops a mixed reality system for the acquisition of socio-emotional competencies. The training is based on a novel combination of VR and sensor technologies and methods for simulating interactive virtual agents. It aims to equip school teaching staff to deal with challenging social situations.

In an exemplary scenario, a teacher in a virtual environment faces students who are simulated by the system and represented as virtual agents. They may have different linguistic and cultural backgrounds, or special needs in the areas of language and/or emotional development. The teacher practices dealing with different (simulated) challenges, such as aggression towards classmates, withdrawal from the classroom, rejection of the work assignment, or attention seeking. The system evaluates the teacher's conflict management based on language and other signals and is able to provide guidance on how to handle the situation via a virtual agent (tutor).

Technically, the demonstrator should combine several communicative modalities: The virtual characters (student and tutor) show non-verbal behavior (gestures, facial expressions) and speak to the teacher, who in turn can express himself linguistically and whose physical behavior is tracked with suitable sensor technology. The usable language should be as free as possible - without using rigid grammar.

Go to MITHOS-Website

Do you know Paul, the assistance robot? He is able to make out if there is a human being calling for his attention.

The ASARob (Attention Sensitive Assistance Robot) project was set up as a cooperation between Bremen university, Fraunhofer Institute, Mojin Robotics, Unity Robotics and paragon semvox. Aiming at developing an assistant robot for the use in domestic care, the Care-O-Bot® is not only featured with kinematic abilities but also captures and directs user attention. By interpreting behavior, actions and language context, Paul enables a natural human-machine-interaction.

Using its paragon semvox ODP S3 platform, paragon semvox assists in language processing and the development of new dialog interactions between man and machine. In the realization process, learning modes from Artificial Intelligence are applied. The ASARob is equipped with adaptive behavior which underlies continuous enhancement in the course of the project.

More about the ASARob project: ASARob