Multimodal Analysis of Opinions in Interactions

WHAT IS MAOI?

Opinion mining is a progressing domain. Recently, a lot of effort has been dedicated to the development of methods able to analyze opinion data available on the social Web. At the same time, companies that are developing companion robots and virtual vocal assistants (Siri, Google Now, Cortana, etc.) show a growing interest for the integration of the social component in the interaction. The development of social relationships between the agent and the user relies on socio-emotional interaction strategies requiring a deep understanding of the user. The proposed project tackles the latter issue - analysis of users’ preferences as expressed in users’ utterances in order to build social user profiles.

Learn More

This project is funded by the French National Research Agency (ANR JCJC project).

Img

People of the project

Main contributors

Chloé Clavel

Chloé Clavel

Télécom ParisTech

Chloé Clavel is an associate professor in Affective Computing in the GRETA Team belonging to the MM (multimedia) group of the Signal and Image Processing Department of Telecom-ParisTech. Her research focuses on two issues: acoustic analysis of emotional speech and opinion mining through natural language processing. After her PhD, she worked in the laboratories of two big French companies that are Thales Research and Technology and EDF R&D where she developed her research around audio and text mining applications. At Telecom-ParisTech, she is currently working on interactions between humans and virtual agents, from user’s socio-emotional behavior analysis to socio-affective interaction strategies.

Emile Chapuis

Emile Chapuis

Télécom ParisTech

Johannes Wagner graduated as a Master of Science in Informatics and Multimedia from the University of Augsburg, Germany, in 2007. He is currently employed as a research assistant at the lab of Human Centered Multimedia (HCM) and has been working in several European projects including Humaine, Callas, Ilhaire and CEEDs. His main research focus is the integration of Social Signal Processing (SSP) in real-life applications. He is the founder of the Social Signal Interpretation (SSI) framework, a general framework for the integration of multiple sensors into multimedia applications.

Collaborators

Valentin Barrière

Valentin barrière

Télécom ParisTech

Valentin Barriere is a PhD student working in the S2A (Signal, Statistics and Learning) and GRETA teams of Telecom ParisTech since october 2015, under the supervision of Chloé Clavel and Slim Essid. he works on the detection and analysis of opinion in oral interactions. He uses probabilistic graphical models for opinion mining, using hybrid techniques recognizing linguistic patterns with Machine Learning methods in order to characterize an expression of opinion.

Caroline Langlet

Caroline Langlet

Télécom ParisTech

Chloé Clavel is an associate professor in Affective Computing in the GRETA Team belonging to the MM (multimedia) group of the Signal and Image Processing Department of Telecom-ParisTech. Her research focuses on two issues: acoustic analysis of emotional speech and opinion mining through natural language processing. After her PhD, she worked in the laboratories of two big French companies that are Thales Research and Technology and EDF R&D where she developed her research around audio and text mining applications. At Telecom-ParisTech, she is currently working on interactions between humans and virtual agents, from user’s socio-emotional behavior analysis to socio-affective interaction strategies.

Slim Essid

Slim Essid

Télécom ParisTech

Slim Essid is Full Professor of Télécom ParisTech and the coordinator of the Audio Data Analysis and Signal Processing team. He received the state engineering degree from the École Nationale d’Ingénieurs de Tunis in 2001; the M.Sc. (D.E.A.) degree in digital communication systems from the École Nationale Supérieure des Télécommunications, Paris, France, in 2002; the Ph.D. degree from the Université Pierre et Marie Curie (UPMC) in 2005 and the habilitation (HDR) degree from UPMC in 2015. He has been involved in various French and European research projects among which are Quaero, EU Networks of Excellence FP6-Kspace and FP7-3DLife, and collaborative projects FP7-REVERIE and FP7-LASIE. On a regular basis he serves as a reviewer for various machine learning, signal processing, audio and multimedia conferences and journals, for instance various IEEE transactions, and as an expert for research funding agencies.

Ebenge Usip

Ebenge Usip

Télécom ParisTech

Ebenge Usip is a Research Engineer at Télécom ParisTech supporting research on spoken language datasets and transformer-based models.