*** THIS SITE IS NOT UPDATED SINCE 6 DECEMBER 2015 - PLEASE REFER TO THE NEW HOMEPAGE. ***

Bjoern Schuller

  Prof.Dr. habil.  

  Björn W. Schuller

Contact: University of Passau
Chair of Complex and Intelligent Systems, Innstrasse 43, 94032 Passau, Germany

Imperial College London
Machine Learning Group, 180 Queens' Gate, Huxley Bldg., London SW7 2AZ, UK

+44-207-59-48357 (UK) OR +49-851-509-3350 (Germany)
schuller at ieee.org
Follow on Twitter: @BjoernSchuller
Visit at ORCID: 0000-0002-6478-8699
Recent Keynotes: WEF BetaZone@Summer Davos 2015 or IEEE ICCE 2013
Recent Media Presence: Listen or listen
Fields: Machine Learning, Complex Systems, Audiovisual Signal Processing, Human-Computer/Robot-Interaction, Affective Computing
Institutions: University of Passau, Imperial College London, Harbin Institute of Technology, University of Geneva, Joanneum Research, audEERING UG
Alma Mater: Technische Universität München
Selected Activities: Editor in Chief IEEE Transactions on Affective Computing
Associate Editor IEEE Transactions on Neural Networks and Learning Systems, IEEE Signal Processing Letters, IEEE Transactions on Cybernetics, Computer Speech and Language
Guest Editor IEEE Intelligent Systems Magazine, Neural Networks, Cognitive Computation, Knowledge-Based Systems, Speech Communication, Image and Vision Computing, Journal on Advances in Signal Processing, ACM Transactions on Interactive Intelligent Systems
General Chair ACM ICMI 2014
Program Chair IEEE/AAAC ACII 2015 and 2011, ACM ICMI 2013, IEEE SocialCom 2012
Area Chair IEEE ICTAI 2015, EURASIP EUSIPCO 2015, ACM Multimedia 2014, IEEE ICASSP 2016, 2015, 2014 and 2013, IEEE/HUMAINE ACII 2013, ACM ICMI 2012
Coordinator European Project ASC-Inclusion
Principal Investigator ERC Starting Grant iHEARu
President-Emeritus (Secretary) of the AAAC
Google Scholar: Profile (currently >9500 citations, h-index = 46)
Code and Resources: openaudio.eu
Publications: (currently >500, >60 in journals) .bib File or PDF in ACM format, IEEE format, APA format, ALPHA format
Five Recent Publications: F. Weninger, J. Bergmann, and B. Schuller, “Introducing CURRENNT – the Munich Open-Source CUDA RecurREnt Neural Network Toolkit,” Journal of Machine Learning Research, vol. 16:547-551, 2015.

G. Trigeorgis, K. Bousmalis, S. Zafeiriou, and B. Schuller, “A Deep Semi-NMF Model for Learning Hidden Representations,” in Proceedings 31st International Conference on Machine Learning, ICML 2014 , (Beijing, China), International Machine Learning Society, IMLS, June 2014. 9 pages.

J. Deng, Z. Zhang, F. Eyben, and B. Schuller, “Autoencoder-based Unsupervised Domain Adaptation for Speech Emotion Recognition,” IEEE Signal Processing Letters, 2014. 4 pages.

F. Ringeval, F. Eyben, E. Kroupi, A. Yuce, J.-P. Thiran, T. Ebrahimi, D. Lalanne,B. Schuller, “Prediction of Asynchronous Dimensional Emotion Ratings from Audiovisual and Physiological Data,” Pattern Recognition Letters, Elsevier, 2014. 10 pages.

M. Wöllmer and B. Schuller, “Probabilistic Speech Feature Extraction with Context-Sensitive Bottleneck Neural Networks,” Neurocomputing, Special Issue on Machines learning for Non-Linear Processing, vol. 132, pp. 113–120, May 2014.

Quick Access to Details: Current Activities Current Positions Short Biography Academic Genealogy Lecture Publications Invited Talks Keynotes, Tutorials, and Panels Organisation, Chairing, and Committee Memberships Awards Reviewing and Editorship Memberships and Listings Visitors and Team Projects

Current Activities

Current Professional Positions and Affiliations

  • Head of the Chair of Complex and Intelligent Systems (formerly Complex Systems Engineering), University of Passau, Germany.
  • Reader (Associate Professor) in Machine Learning, Machine Learning Group, Department of Computing, Imperial College London, London/U.K.
  • Visiting Professor, School of Computer Science and Technology, Harbin Institute of Technology, Harbin/P.R. China.
  • Chief Executive Officer (CEO) and Legal Entity Appointed Representative (LEAR), audEERING UG, Gilching/Germany.
  • Consultant, JOANNEUM RESEARCH, DIGITAL - Institute for Information and Communication Technologies, Graz/Austria.
  • Associate, Centre Interfacultaire en Sciences Affectives (CISA), Université de Genève, Geneva/Switzerland.

    Short Biography (IEEE Style)

    Björn W. Schuller received his diploma in 1999, his doctoral degree for his study on Automatic Speech and Emotion Recognition in 2006, and his habilitation (fakultas docendi) and was entitled Adjunct Teaching Professor (venia legendi) in the subject area of Signal Processing and Machine Intelligence for his work on Intelligent Audio Analysis in 2012 all in electrical engineering and information technology from TUM in Munich/Germany.

    At present, he is Full Professor and head of the Chair of Complex and Intelligent Systems at the University of Passau/Germany where he previously headed the Chair of Sensor Systems in 2013. At the same time he is a Reader (Associate Professor) in Machine Learning in the Department of Computing at Imperial College London/UK since 2015, being a Senior Lecturer since 2013. Further, he is the co-founding CEO of audEERING UG – a TUM start-up on intelligent audio engineering. Previously, he headed the Machine Intelligence and Signal Processing Group at TUM from 2006 to 2014. In 2013 he was also invited as a permanent Visiting Professor in the School of Computer Science and Technology at the Harbin Institute of Technology, Harbin/P.R. China and a Visiting Professor at the Université de Genève in Geneva/Switzerland in the Centre Interfacultaire en Sciences Affectives and remains an appointed associate of the institute. In 2012 he was with Joanneum Research, Institute for Information and Communication Technologies in Graz/Austria, working in the Research Group for Remote Sensing and Geoinformation and the Research Group for Space and Acoustics - currently he is an expert consultant of the institute. In 2011 he was guest lecturer at the Università Politecnica delle Marche (UNIVPM) in Ancona/Italy and visiting researcher in the Machine Learning Research Group of NICTA in Sydney/Australia. From 2009 to 2010 he lived in Paris/France and was with the CNRS-LIMSI Spoken Language Processing Group in Orsay/France, and was a visiting scientist at Imperial College. Best known are his works advancing Machine Learning for the Engineering of Intelligent Audiovisual and Complex Information Systems, and Affective Computing for Human-Computer/Robot Interaction and Multimedia Retrieval.

    Dr. Schuller is an elected member of the IEEE Speech and Language Processing Technical Committee, Senior Member of the IEEE, and member of the ACM and ISCA. Before, he was President of the Association for the Advancement of Affective Computing (AAAC, former HUMAINE Association, registered Charity in the UK, 2013-2015), and Honorary Fellow and member of the TUM Institute for Advanced Study (IAS). He (co-)authored 5 books and more than 500 publications in peer reviewed books (>20), journals (>60), and conference proceedings in the field leading to more than 9500 citations (h-index = 46). He was co-founding member and secretary of the steering committee and guest editor, and still serves as associate editor and Editor in Chief of the IEEE Transactions on Affective Computing, associate and repeated guest editor for the Computer Speech and Language, associate editor for the IEEE Signal Processing Letters, IEEE Transactions on Cybernetics and the IEEE Transactions on Neural Networks and Learning Systems, and guest editor for the IEEE Intelligent Systems Magazine, Neural Networks, Speech Communication, Image and Vision Computing, Cognitive Computation, and the EURASIP Journal on Advances in Signal Processing, reviewer for 100 leading journals and 70 conferences in the field, co-general chair of ACM ICMI 2014, and as workshop and challenge organizer including the first of their kind INTERSPEECH 2009-2015 annual Computational Paralinguistics Challenges and the 2011-2015 annual Audio/Visual Emotion Challenge and Workshop and program chair of the ACM ICMI 2013, IEEE SocialCom 2012, and ACII 2011 and 2015, area chair of the ACM Multimedia, IEEE ICASSP, IEEE ICTAI, EURASIP EUSIPCO and program committee member of more than 150 international workshops and conferences. He won several awards including the IEEE ACII 2009 Best Technical Demonstration and the ICASSP CHiME Speech Separation and Recognition Challenge winning system/best paper in 2013, further best paper awards such as from the Audio Engineering Society annual meeting in 2014, first places in research challenges such as MIREX and MediaEval, and honourable mentioning such as in the ACM Multimedia Open-Source Software Competition in 2010 and 2013. In 2015, he has additionally been honoured as one of 40 extraordinary scientists under the age of 40 by the World Economic Forum and speaker at the Annual Meeting of the New Champions 2015. His research has garnered over 7 million EUR in extramural funding: He is recipient of an ERC Starting Grant 2013 (9% acceptance rate) for the iHEARu project dealing with Intelligent systems' Holistic Evolving Analysis of Real-life Universal speaker characteristics. In the European Community (EC) Horizon 2020 programme, he is a beneficiary in the (R)IA projects ARIA-VALUSPA, De-ENIGMA, MixedEmotions, and SEWA (9/12/9% acceptance rate) and the ERC Proof-of-Concept grant VocEmoApI. Former steering and involvement in research projects includes the EC funded ASC-Inclusion STREP project as coordinator and the awarded SEMAINE project and the ERC Advanced Grant PROPEREMO as beneficiary, and projects funded by the German Research Foundation (DFG), BMBF, and companies such as BMW, Continental, Daimler, HUAWEI, Siemens, Toyota, and VDO. Advisory board activities comprise his role as consultant of start-ups such as SensAura Tech and fluent.ai and chair of the W3C Linked Data Models for Emotion and Sentiment Analysis Community Group and as an invited expert in the W3C Emotion Incubator and Emotion Markup Language Incubator Groups.

    2015 Reader in Machine Learning (Associate Professor) in the Department of Computing, Logic and Artificial Intelligence Section, Imperial College London, London/UK.
      Honoured as one of 40 extraordinary scientists under the age of 40 by the World Economic Forum and Speaker at the Annual Meeting of the New Champions.
    2014 Chair (tenured Full Professor, Univ.-Prof., W3) heading the Chair of Complex and Intelligent Systems (initially Complex Systems Engineering), University of Passau, Passau/Germany.
      Appointed Editor in Chief of the IEEE Transactions on Affective Computing (2015-2016 term).
    2013 Honorary Fellow and member of the TUM Institute for Advanced Study (TUM-IAS) and TUM Junior Fellow.
      Recipient of an ERC Starting Grant (9% acceptance rate, iHEARu project).
      President (elected) of the Association for the Advancement of Affective Computing (former HUMAINE Association, registered charity in the UK, 2013-2015 term).
      Senior Lecturer in Machine Learning in the Department of Computing, Logic and Artificial Intelligence Section, Machine Learning Group, Imperial College London, London/UK.
      Interim Chair (Univ.-Prof., W3) heading the Institute for Sensor Systems, University of Passau, Passau/Germany.
      Senior Lecturer (Akad. Oberrat, A14) heading the Machine Intelligence and Signal Processing Group (MISP) at Technische Universität München (TUM) in Munich/Germany.
      Associate of the Centre Interfacultaire en Sciences Affectives (CISA), Université de Genève, Geneva/Switzerland.
      Visiting Professor at the CISA, Université de Genève, Geneva/Switzerland.
      Consultant of the Institute for Information and Communication Technologies, Joanneum Research, Graz/Austria.
      Co-founder and CEO of audEERING UG in Gilching/Germany.
      Visiting Professor (permanent) from the School of Computer Science and Technology, Harbin Institute of Technology, Harbin/P.R. China.
    2012 TUM Adjunct Teaching Professor (Privatdozent).
      Guest Scientist (wiss. Angestellter) at the Institute for Information and Communication Technologies, Joanneum Research, Graz/Austria.
      Habilitation (Dr. habil.) in Electrical Engineering and Information Technology, Subject Area Signal Processing and Machine Intelligence, from TUM.
    2011 Visiting Researcher in the Machine Learning Research Group, NICTA, Sydney/Australia.
      Visiting Lecturer (Erasmus Teaching Assignment) at the Università Politecnica delle Marche (UNIVPM), Ancona/Italy.
    2010 Visiting Researcher in the Department of Computing, Imperial College London, London/UK.
      Researcher (Chercheur en Informatique, CDD) in the Spoken Language Processing Group, CNRS-LIMSI in Orsay/France.
    2009 – 2010 Research Engineer (Ingénieur Informaticien, CDD) in the Spoken Language Processing Group, CNRS-LIMSI in Orsay/France.
    2008 – 2013 Lecturer (Akad. Rat, A13) at the Institute for Human-Machine Communication at TUM.
    2006 Doctoral Degree (Dr.-Ing.) in Electrical Engineering and Information Technology from TUM.
    2002 – 2008 Research Associate (Wiss. Assistent, C1) at the Institute for Human-Machine Communication at TUM.
    1999 – 2002 Research Assistant (Wiss. Mitarbeiter, BAT IIa) at the Institute for Human-Machine Communication at TUM.
    1999 Diploma (Dipl.-Ing.) in Electrical Engineering and Information Technology from TUM.

    Academic Genealogy

    Advisor (year of doctoral degree):
    Friedrich Leibniz
    Jakob Thomasius (1643)
    Otto Mencke (1665)
    Johann Christoph Wichmannshausen (1685)
    Christian August Hausen (1713)
    Abraham Gotthelf Kästner (1739)
    Johann Friedrich Pfaff (1786)
    Carl Friedrich Gauß (1799)
    Christoph Gudermann (1841)
    Karl Theodor Wilhelm Weierstraß (1854)
    Georg Ferdinand Frobenius (1870)
    Issai Schur (1901)
    Wilhelm Specht (1932)
    Hermann Haken (1951)
    Manfred Lang (1969)
    Björn Wolfgang Schuller (2006)
    Martin Wöllmer (2013), Florian Eyben (2015), Zixing Zhang (2015), Felix Weninger (2015)

    Lecture

    WiT: Winter Term, SpT: Spring Term, SuT: Summer Term
    WS: Winter Semester, SS: Summer Semester

      Current Lecture Activity:

    1. Computer Hardware
      (18 lectures, since WiT 2013) held at Imperial College London/UK with Prof. Duncan Fyfe Gillies
    2. Computing Topics
      (8 sessions, since SpT 2015) held at Imperial College London/UK with others
    3. Intelligent Audio Analysis
      (5 ECTS, since SS 2015) held at the University of Passau in Passau/Germany
    4. Blockseminar Intelligent Systems
      (3 ECTS, since SS 2015) held at the University of Passau in Passau/Germany
    5. Lab Course Intelligent Systems
      (5 ECTS, since SS 2015) held at the University of Passau in Passau/Germany
    6. Lab Course Mobile Embedded Systems
      (since WS 2015) held at the University of Passau in Passau/Germany
    7. Master Seminar on Complex and Intelligent Systems
      (Seminar Komplexe und Intelligente Systeme)
      (4 ECTS, since SS 2015) held at the University of Passau in Passau/Germany
    8. Bachelor Seminar on Complex and Intelligent Systems
      (Seminar Komplexe und Intelligente Systeme)
      (4 ECTS, since SS 2015) held at the University of Passau in Passau/Germany
    9. Seminar on Complex and Intelligent Systems
      (Oberseminar Komplexe und Intelligente Systeme)
      (4 ECTS, since WS 2015) held at the University of Passau in Passau/Germany
    10. Complex Systems Engineering
      (7 ECTS, since WS 2014/15) held at the University of Passau in Passau/Germany
    11. Lab Course Programming in Java
      (Übung Programmierung in Java)
      (5 ECTS, since WS 2014/15) held at the University of Passau in Passau/Germany

      Former Lecture Activity:

    1. PMT Logic, Reasoning about Programs, and Discrete Mathematics
      (10 sessions, since SpT 2014) held at Imperial College London/UK
    2. Academic Writing for Computer Science
      (8 sessions, since SpT 2014) held at Imperial College London/UK with others
      Supervised students:
      Akara Supratak (SpT 14): Transfer Learning
    3. Statistical Communication Techniques: Filtering - Estimation - Decision
      (Statistische Informationstechnik: Filtern - Schätzen - Entscheiden)
      (28 hours, 18.-20.06.2013, 19.-21.06.2012) held at the Carl-Cranz-Gesellschaft in Oberpfaffenhofen/Germany with Prof. Kristian Kroschel and Prof. Gerhard Rigoll
    4. Machine Speech Signal Processing
      (Maschinelle Sprachsignalverarbeitung)
      (6 ECTS, SS 2014) held at TUM in Munich/Germany
    5. Direction Hauptseminar on Current Questions in Human-Machine-Communication
      (Hauptseminar Mensch-Maschine-Kommunikation)
      (5 ECTS, SS 2013 - SS 2014) held at TUM in Munich/Germany
    6. Direction Seminar on Human-Machine Communication
      (Oberseminar Mensch-Maschine-Kommunikation)
      (3 ECTS, SS 2010 - SS 2014) held at TUM in Munich/Germany
    7. Direction Seminar on Work in Progress In Human-Machine Communication
      (Oberseminar Laufende Arbeiten zur Mensch-Maschine-Kommunikation)
      (3 ECTS, SS 2002 - SS 2014) held at TUM in Munich/Germany
    8. Computer Architecture
      (Rechnerarchitektur)
      (5 ECTS, SS 2013) held at the University of Passau in Passau/Germany
    9. Fundamentals of Information Technology
      (Grundlagen der Informationstechnik)
      (7 ECTS, SS 2013) held at the University of Passau in Passau/Germany
    10. Seminar on Intelligent Mobile Sensing
      (Seminar Intelligente Mobile Sensorik)
      (4 ECTS, SS 2013) held at the University of Passau in Passau/Germany
    11. Automatic Pattern Recognition in Speech Processing
      (Mustererkennung in der Sprachverarbeitung)
      (3 ECTS, SS 2009 - SS 2011) held at TUM in Munich/Germany
    12. Digital Processing of Speech Signals
      (Digitale Verarbeitung von Sprachsignalen)
      (3 ECTS, SS 2009 - SS 2011) held at TUM in Munich/Germany
    13. Intelligent Audio Analysis
      (20 hours, 11.-15.04.2011) held at the Università Politecnica delle Marche in Ancona/Italy (ERASMUS lecturer mobility programme)
    14. Pattern Recognition
      (4.5 ECTS, SS 2008)
    15. Electrical Engineering (Elektrotechnik) at the Munich University of Applied Sciences (Hochschule München) in Munich/Germany, Faculty 05
      (7.5 ECTS, SS 2008)
    16. Participant Two-year Program PROLEHRE Intensiv
      (WS 2006/07 - SS 2009)
    17. Assistance (WS 2005/06 - WS 2008/09) Lecture Automatic Pattern Recognition in Speech Processing (Mustererkennung in der Sprachverarbeitung)
    18. Assistance (WS 2005/06 - WS 2008/09) Lecture Data Analysis and Information Reduction (Datenanalyse und Informationsreduktion)
    19. Assistance (WS 2005/06 - WS 2008/09) Lecture Digital Processing of Speech Signals (Digitale Verabeitung von Sprachsignalen)
    20. Direction (WS 99/00 - SS 07) Main Tutorial Signal Representation (Zentralübung Signaldarstellung)
    21. Direction (WS 99/00 - SS 07) Tutorial Signal Representation (Tutorübung Signaldarstellung)
    22. Introduction and Direction (WS 99/00 - SS 07) English Tutorial Signal Representation
    23. Direction (WS 03/04) Hauptseminar on Current Questions in Human-Machine-Communication ( Hauptseminar Mensch-Maschine-Kommunikation)
      Supervised students:
      Norbert Binder (WS 00/01): Fehlerrobuste Mensch-Maschine-Interaktion
      Stephan Reiter (SS 01): Usability Engineering - Potential und Technik
      Florian Hörger (WS 01/02): Grundfrequenz F0 eines Sprachsignals - Potenzial und Schätzung
      Philipp Huber (SS 02): Automatische Emotionserkennung aus dem Sprachsignal
      Ronald Müller (WS 02/03): Query by humming als musikalische Benutzerschnittstelle
      Philippe Dupraz (WS 03/04): Emotionserkennung in natürlichsprachlichen Äußerungen
      Michael Höchstetter (SS 06): Verfahren zur automatischen Transkription von Musikstücken
      Florian Eyben (SS 07): Rhythmusmerkmale in der Musiksuche
      Benedikt Gollan (SS 08): Automatische Erkennung der Tonart in MP3 Audiostücken
    24. Direction (WS 99/00 - SS 02) Laboratory Course on System and Circuit Design 1
      ( Praktikum System- und Schaltungstechnik 1)
      V2: Signalerfassung und -analyse
    25. Direction (WS 99/00 - SS 02) Laboratory Course on System and Circuit Design 2
      (Praktikum System- und Schaltungstechnik 2)
      V9: Entwurf und Realisierung analoger und digitaler Filter
    26. Experiment Direction Laboratory Practical Aspects of Human-Machine Communication ( Praktikum Praxis der Mensch-Maschine-Kommunikation)
      Adaption von emotionaler Sprache (SS 05)
      Automatische Multimodale Emotionserkennung (SS 04)
      Emotionale Mensch-Maschine-Interaktion (SS 02)
      Design eines natürlichsprachlichen MMIs (SS 01, WS 01/02)
      Experimente mit einem Spracherkennungssystem (WS 00/01)
    27. Organisation of Lecture
      (WS 2001/2002 - WS 2009/2010)
    28. Social Secretary (WS 03/04)

    Publications


    Download the full publication list as LaTeX .bib File or as PDF in ACM format, IEEE format, APA format, ALPHA format.

      Theses (3):

    1. Björn Schuller: "Intelligent Audio Analysis - Speech, Music, and Sound Recognition in Real-Life Conditions", Habilitation Thesis, Technische Universität München, Germany, July 2012.
    2. Björn Schuller: "Automatische Emotionserkennung aus sprachlicher und manueller Interaktion", Doctoral Thesis, Technische Universität München, Germany, June 2006.
    3. Björn Schuller: "Automatisches Verstehen gesprochener mathematischer Formeln", Diploma Thesis, Institute for Human-Machine Communication, Technische Universität München, Germany, October 1999.

      Books:

    1. Björn Schuller: "Intelligent Audio Analysis", Signals and Communication Technology, Springer, ISBN: 978-3642368059, 2013.

    2. Björn Schuller, Anton Batliner: "Computational Paralinguistics: Emotion, Affect and Personality in Speech and Language Processing", to appear, Wiley, ISBN: 978-1119971368, 2013.

    3. Björn Schuller: "Mensch, Maschine, Emotion - Erkennung aus sprachlicher und manueller Interaktion", VDM Verlag Dr Müller, Saarbrücken, ISBN: 978-3-8364-1522-4, 239 pages, 2007.

    4. Alexandra Balahur-Dobrescu, Maite Taboada, Björn Schuller: "Computational Methods for Affect Detection from Natural Language", to appear, Computational Social Sciences, Springer, ISBN: 978-3319006017, 2014.

    5. Kristian Kroschel, Gerhard Rigoll, Björn Schuller: "Statistische Informationstechnik", 5. Neuauflage, Springer Verlag, Berlin/Heidelberg, ISBN: 978-3-642-15953-4, 382 pages, 2011.


      Open Source Code Releases:

    1. Shahin Amiriparian, Björn Schuller: "The Passau open Complex Systems Environment (openCoSy)", GPL licensed, JAVA, University of Passau, Germany, December 2015.
    2. Simone Hantke, Tobias Appel, Florian Eyben, Björn Schuller: "iHEARu-PLAY: a game for crowdsourced data collection", GPL, JAVA, University of Passau, Germany, December 2015.
    3. Felix Weninger, Johannes Bergmann, Björn Schuller: "The Munich Open-Source CUDA RecurREnt Neural Network Toolkit (CURRENT)", GPL licensed, C++, Technische Universität München, Germany, http://sourceforge.net/projects/currennt/, October 2013.
    4. Florian Eyben, Martin Wöllmer, Björn Schuller: "Open Emotion and Affect Recognition (openEAR)", GPL licensed, C++, Technische Universität München, Germany, http://sourceforge.net/projects/openear/, September 2009.
    5. Alexander Lehmann, Felix Weninger, Björn Schuller: "Blind Source Separation for Audio Recognition Tasks (openBlissART)", GPL licensed, C++, Technische Universität München, Germany, http://github.com/openBliSSART/, May 2009.
    6. Florian Eyben, Martin Wöllmer, Björn Schuller: "Open Speech and Music Interpretation by Large-Space Extraction (openSMILE)", GPL licensed, C++, Technische Universität München, Germany, http://sourceforge.net/projects/opensmile/, December 2008.

    More information on my open source projects is found at openaudio.eu.
    Publication download (selected)

      Presence in the Public Media:

    1. Björn Schuller: "Emotionally literate tech to help treat autism", in Horizon - the EU Research & Innovation Magazine, Sophie Hebden, 19.10.2015.
    2. Björn Schuller: "Emotionen als Forschungsobjekt - Neues Forschungsprojekt vom Lehrstuhl für Complex and Intelligent Systems", in Passauer Neue Presse, No. 233, p. 22, 08.10.2015.
    3. Björn Schuller: "Computer lernt menschliches Verhalten", in Passauer Neue Presse, Carsten Ruge, p. 8, 10.09.2015.
    4. Björn Schuller: "Can a computer tell what you’re thinking?", in blog series with Young Scientists ahead of the Annual Meeting of the New Champions 2015, World Economic Forum, 01.09.2015.
    5. Björn Schuller: "Grosse Gefühle - Robotik und Emotionen", radio interview broadcast on radiobremen/Nordwestradio , "Glauben und Wissen", Tina Würfel, 11:00 - 13:00, 22.02.2015.
    6. Björn Schuller "Maschinen und Emotionen", live radio interview broadcast on DRadio Wissen, Deutschlandradio, "Roboter wir fühlen mit dir", 19:10-19:20, 27.01.2015.
    7. Björn Schuller "Maschinen mit Herz und Seele", Boris Hänssler, in FOCUS Magazin, Auto und Technik, Nr. 51, p. 2, 2014.
    8. Björn Schuller "Vom Computer zum Hörgerät. Spracherkennung und Schallforschung im 21. Jahrhundert.", radio interview broadcat on OE1, Österreichischer Rundfunk, "Dimensionen - die Welt der Wissenschaft", Marlene Nowotny, 19:05-19:30, 27.10.2014.
    9. Björn Schuller "Neue Gesichter unter den Passauer Professoren", in Passauer Neue Presse, pnp-campus, 15.10.2014.
    10. Björn Schuller "Wie sich Gefühle berechnen lassen", radio interview broadcast on WDR 5, "Der vermessene Mensch (5/10)", Uwe Springfeld, 14.09.2014.
    11. Björn Schuller "Wie sich Gefühle berechnen lassen", radio interview broadcast on SWR 2, "Der vermessene Mensch (7/10)", Uwe Springfeld, 08:30-09:00, 14.06.2014.
    12. Björn Schuller "Das Wörterbuch "Mensch-Maschine" wird dicker", Johannes Wendt, DIE ZEIT, Zeitverlag Gerd Bucerius, 19.07.2014.
    13. Björn Schuller "Scanner für Gefühle", Christian J. Meier, Technology Review 03/2014, pp. 74-75, Heise Zeitschriften Verlag, 2014.
    14. Björn Schuller "Zwischentöne für Computer", radio interview broadcat on Deutschlandfunk, "Forschung Aktuell", Ralf Krauter, 06.11.2013.
    15. Björn Schuller "pracherkennung wird menschlich(er)", in FERCHAU Engineering, 13.09.2013.
    16. Björn Schuller "Das Auto als Kumpel", Interview in Automobil-Industrie, Barbara Stumpp, Volume 5, pp. 44-45, Vogel Business Media 2013.
    17. Björn Schuller Spracherkennung und -steuerung im Einsatz bei Industriellen/Healthcare-Anwendungen, Bernd Seidel (ed.), to appear, 2013.
    18. Björn Schuller "Spracherkennungssoftware - wo sie inzwischen überall angewendet wird", radio interview broadcast on Zweiter Bayerischer Rundfunk (BR2), "Radiowelt", Thomas Kempe, 07:00, 22.03.2012.
    19. Björn Schuller "Mit Stimme ankommen: Wie weit ist Spracherkennung per Computer gediehen", radio interview broadcat on Zweiter Bayerischer Rundfunk (BR2), "Notizbuch", Christian Schiffer, 11:00, 22.07.2011.
    20. Björn Schuller "Stand und Möglichkeiten der Spracherkennung", radio interview broadcat on Bayern 5 Aktuell (BR5), "Computermagazin", Christian Schiffer, 16:35, 24.07.2011.
    21. Björn Schuller "Vom Labor auf den Markt - Hilfe für Radiosender", in Rhein-Neckar-Zeitung, Peter Saueressig, 28.11.2007.
    22. Björn Schuller "Zukunftsmusik per Computer", in Mannheimer Morgen, Dr. Haas-Gruppe, 28.11.2007.
    23. Björn Schuller "Extraktion von Refrains in Musik", radio interview broadcast on Südwestdeutscher Rundfunk 4 (SWR4), 28.11.2007.
    24. Björn Schuller "Intimität im Sprachgebrauch", TV interview broadcast in RTL Explosiv, RTL, 2004.
    25. Björn Schuller "Automatische Erkennung von Emotion aus Sprache und Mimik", TV technical demonstration broadcast in 1,2 oder 3, Jubiläumssendung 30 Jahre, 30 Länder "Ohne Worte", ZDF, 29.09.2007, 8:25 AM.
    26. Björn Schuller "Automatische Erkennung von Emotion aus Sprache und Mimik", TV technical demonstration broadcast in 1,2 oder 3, Jubiläumssendung 30 Jahre, 30 Länder "Ohne Worte", ORF, 29.09.2007, 8:25 AM.
    27. Björn Schuller "Automatische Erkennung von Emotion aus Sprache und Mimik", TV technical demonstration broadcast in 1,2 oder 3, Jubiläumssendung 30 Jahre, 30 Länder "Ohne Worte", Kinderkanal, 30.09.2007, 4:05 PM.

      Technical Demonstrations:

    1. Björn Schuller, Erik Marchi, Stefano Piana: "ASC-INCLUSION project", 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.02.2014.
    2. Björn Schuller et al.: "ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions (ASC)", ICT 2013 - Create, Connect, Grow, Vilnius, Lithunia, 25.10.2013.
    3. Erik Marchi, Björn Schuller: "Interactive software to help children with Autism understand and express emotions through tone-of-voice", Festival della Scienza, Genoa, Italy, 25.10.2013.
    4. Erik Marchi, Björn Schuller: "ASC-Inclusion: Vocal Emotion Games", Proc. 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), ACM, SASDG Digital Library, Chania, Crete, Greece, 14.05.2013.
    5. Cyril Joder, Felix Weninger, Florian Eyben, David Virette, Björn Schuller: "Real-time Speech Separation by Semi-Supervised Nonnegative Matrix Factorization", 10th International Conference on Latent Variable Analysis and Signal Separation (LVA ICA 2012), Tel Aviv, Israel, 12.-15.03.2012.
    6. Marc Schröder, Sathish Pammi, Hatice Gunes, Maja Pantic, Michel Valstar, Roddy Cowie, Gary McKeown, Dirk Heylen, Mark ter Maat, Florian Eyben, Björn Schuller, Martin Wöllmer, Elisabetta Bevacqua, Catherine Pelachaud, Etienne de Sevin: "Come and Have an Emotional Workout with Sensitive Artificial Listeners!", International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.-23.03.2011.
    7. Marc Schröder, Sathish Pammi, Roddy Cowie, Gary McKeown, Hatice Gunes, Maja Pantic, Michel Valstar, Dirk Heylen, Mark ter Maat, Florian Eyben, Björn Schuller, Martin Wöllmer, Elisabetta Bevacqua, Catherine Pelachaud, Etienne de Sevin: "Demo: Have a Chat with Sensitive Artificial Listeners", 36th Annual Convention of the Society for the Study of Artificial Intelligence and Simulation of Behaviour (AISB’10), Symposium "Towards a Comprehensive Intelligence Test (TCIT)", AISB, Leicester, UK, 29.-30.03.2010.
    8. Marc Schröder, Elisabetta Bevacqua, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne de Sevin, Michel Valstar, Martin Wöllmer: "A Demonstration of Audiovisual Sensitive Artificial Listeners", Proc. 3rd International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, ISBN: 978-1-4244-4799-2, Vol. I, pp. 263-264, 10.-12.09.2009. (T)
    9. Florian Eyben, Björn Schuller, Martin Wöllmer, Sathish Pammi, Marc Schröder, Mark ter Maat: "Talk to the Machine", Interspeech (2009), The First INTERSPEECH Conversational Systems Challenge, ISCA, Brighton, UK, 06.09.2009. (T)

    Invited Talks

    (T): Talks given in person

    1. Björn Schuller: "Sound Affects.", invited talk, LIRIS Workshop on Emotion, Ecole Centrale de Lyon/Technicolor, Lyon, France, 12.11.2015. (T)
    2. Björn Schuller: "Emotions in the Voice: Making them Accessible for Consumer Research", invited talk, "Orange Hour", GfK, Hamburg, Germany, 22.10.2015. (T)
    3. Björn Schuller: "Audio and textual analysis of sentiment", invited talk, Cognitive Computing Workshop 2015, London, UK, 02.10.2015. (T)
    4. Björn Schuller: "Emotion Detection, Sentiment Analysis", invited talk, Chase IT Services, London, UK, 01.10.2015. (T)
    5. Björn Schuller: "How to Build an Intelligent Machine", invited talk, Annual Meeting of the New Champions 2015 (AMNC, "Summer Davos"), BetaZone Session, World Economic Forum (WEF), DaLian, P.R. China, 11.09.2015. (T)
    6. Björn Schuller: "Machines' Learning on Social Behaviour Sensing", invited talk, SMART School on Computational Social and Behavioral Sciences, Paris, France, 31.08.-04.09.2015. (T)
    7. Björn Schuller: "Intelligent Systems", invited talk, WiN:TeLeKT, University of Passau, Passau, Germany, 30.06.2015. (T)
    8. Björn Schuller: "A.E.I.: Artificial Emotional Intelligence", invited inaugural lecture, University of Passau, Passau, Germany, 09.06.2015. (T)
    9. Björn Schuller: "Sounds of Autism and Depression: On Recognition and Feedback Generation", invited tele-talk, Applied Signal Processing in Mental Health Workshop, University of Southern California, Los Angeles, CA, 04.-05.05.2015. (T)
    10. Björn Schuller: "What the Voice tells about the Face and the Heart", invited talk, International Symposium on Companion-Technology (ISCT 2015, Expert Workshop of the SFB-TR 62 "Companion-Technologie für kognitive technische Systeme"), Session "Multimodalität"), Ulm, Germany, 23.-25.09.2015. (T)
    11. Björn Schuller: "Subject, Emotion & Sentiment Analysis “in the Wild”", invited talk, GfK, Nürnberg, Germany, 14.04.2015. (T)
    12. Björn Schuller: "Rich Multi-sensorial Human State, Trait, and Behaviour Analysis for Computational Psychophysiology", invited talk, 2015 International Symposium on Computational Psychophysiology, Jinan, Shandong Province, China, 03.-06.04.2015. (T)
    13. Björn Schuller: "Help Your Robot Understand You: Cooperative Learning for Computational Paralinguistics", invited talk, NII Shonan Meeting: The Future of Human-Robot Spoken Dialogue: from Information Services to Virtual Assistants, Seminar 059, Shonan Village Center, Japan, 25.–28.03.2015. (T)
    14. Björn Schuller: "Implicit Consumer Tagging: The Voice", invited talk, "Orange Hour", GfK, Munich, Germany, 16.04.2015. (T)
    15. Björn Schuller: "Introduction W3C Community Group", invited talk, “Emotion representation and modelling in Human-Computer-Interaction-Systems” (ERM4HCI 2014) held in conjunction with the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), ACM, Istanbul, Turkey, 16.11.2014. (T)
    16. Björn Schuller and Hatice Gunes: "Organising Challenges: Achievements, Experiences, and the Future", invited talk, The first international audio/visual Mapping Personality Traits Challenge & Workshop (MAPTRAITS 2014), held in conjunction with ACM ICMI 2014, ACM, Istanbul, Turkey, 12.11.2014. (T)
    17. Björn Schuller: "Multimodal Human State and Trait Recognition: Quo plures, eo feliciores?", invited talk, Turkish German Multimodal Interaction Summit (TGMIS), pre-conference event of ACM ICMI 2014, Istanbul, Turkey, 11.11.2014. (T)
    18. Björn Schuller: "Professoren Persönlich: Björn Schuller", invited talk, "Professoren Persönlich", IEEE Student Branch, University of Passau, Germany, 06.11.2014. (T)
    19. Björn Schuller: "On Autism, Beats of the Heart, Cancer, Depression, Eye-contact and the Voice", invited talk, MindTech network for research on mental health solutions and the School of Computer Science, University of Nottingham, Nottingham, UK, 16.07.2014. (T)
    20. Björn Schuller: "Deep Learning the Blues", invited talk, Computing Lunch Talks, Imperial College London, London, UK, 11.06.2014. (T)
    21. Björn Schuller: "Joining Maths & Music for DJ Computer", invited talk, How maths drives computing, Imperial College London, London, UK, 11.06.2014. (T)
    22. Björn Schuller: "Towards Big Data Customer Profiling & Sentiment Analysis", invited talk, GfK's Tech & Trend Scouting Event, GfK, Berlin, Germany, 28.04.2014. (T)
    23. Björn Schuller: "Medizintechnische Sprachanalyse: Beginn einer neuen Ära?", invited talk, "Elektronik für ein gesundes Leben", AKML (VDE Arbeitskreis Medizintechnik & LifeScience Electronic im Bezirksverein Südbayern), Munich, Germany, 15.07.2014. (T)
    24. Björn Schuller: "Grasping Players' Emotions: A Serious Game?", invited talk, GaME 2014: Imperial College's Games and Media Event, London, UK, 06.06.2014. (T)
    25. Björn Schuller: "Deep for Big: Life-Long Cooperative Learning for Intelligent Sequential Data Analysis", invited talk, Universität Marburg, Marburg, Germany, 06.06.2014. (T)
    26. Björn Schuller: "En Route to Holistic Intelligent Connected Mobility", invited talk, Technische Universität München, Garching, Germany, 31.03.2014. (T)
    27. Björn Schuller: "A Holistic Perspective on Complex Systems, Machine Learning & Signal Processing: Emergence Inherent.", invited talk, University of Passau, Passau, Germany, 24.01.2014. (T)
    28. Björn Schuller: "Au Courant Computer Audition", invited talk, RWTH Aachen, Aachen, Germany, 22.01.2014. (T)
    29. Björn Schuller: "ERC-Starting Grants in Horizon 2020 - Erfahrungsbericht", invited talk, TUM, Garching, 11.02.2014. (T)
    30. Björn Schuller: "Affective Audio Analysis: A Status Quo", invited talk, Affective Computing and Social Signal Processing in the UK (AC@UK 2013), London, UK, 16.12.2013. (T)
    31. Björn Schuller: "Affective Information & Communication Technology – Horizon 2020", invited talk, ICT LEIT in H2020 Info Day & International Brokerage Event Koc University, Istanbul, 05.-06.12.2013. (T)
    32. Björn Schuller: "Acoustic Cues of Human Personality Traits", invited talk, Queen Mary University London, London, UK, 04.12.2013. (T)
    33. Björn Schuller: "Approaching Cross-Audio Computer Audition", invited talk, Computational Audio Analysis, Seminar 13451, Dagstuhl, Germany, 04.-08.11.2013. (T)
    34. Björn Schuller: "Interactive software to help children with Autism understand and express emotions through facial expressions, tone-of-voice and body gestures", invited talk, Festival della Scienza, Genoa, Italy, 25.10.2013. (T)
    35. Björn Schuller: "Acoustic Features in Affective Speech Analysis: History and a Dash of Future", invited talk, Workshop on Measuring affect and emotion in vocal communication via acoustic feature extraction: State of the art, current research, and benchmarking, Geneva, Switzerland, 01.-02.09.2013. (T)
    36. Björn Schuller: "Machine Learning 4 Holistic Evolutionary Audio Recognising", invited talk, Symposium Machine Learning, Carl von Ossietzky University Oldenburg, Oldenburg, Germany, 04.04.2013.(T)
    37. Björn Schuller: "Approaching Active and Autonomous Automatic Audiovisual Affect Analysis", invited talk, University College London, London, UK, 06.03.2013. (T)
    38. Björn Schuller: "Active, Semi-Supervised, and Transfer Learning and other Tricks to Reduce Labeling Costs", invited tele-talk, Affectiva, Waltham, MA, 10.12.2012. (T)
    39. Björn Schuller: "Towards Holistic Autonomus Machines' Learning", invited talk, Imperial College London, London, UK, 09.11.2012. (T)
    40. Björn Schuller: "Acoustic Geo- and Emotion-Sensing: Streets of Graz", invited talk, Joanneum Research, Graz, Austria, 23.10.2012. (T)
    41. Björn Schuller: "Affective and Social Computing: Audivi, Vidi, ..., Vici?", invited talk, Graz University of Technology (TUG), Graz, Austria, 11.10.2012. (T)
    42. Björn Schuller: "Computer Audition – Next Stop: Universality", invited talk, Technical University of Denmark (DTU), Kongens Lyngby, Denmark, 04.09.2012. (T)
    43. Björn Schuller: "Intelligent Audio Analysis - Innovative Verfahren der Signalverarbeitung und Maschinellen Intelligenz", invited talk, Joanneum Research, Graz, Austria, 10.07.2012. (T)
    44. Björn Schuller: "Intelligent and Social Audio Processing", invited talk, Heriot-Watt University, Edinburgh, UK, 03.07.2012. (T)
    45. Björn Schuller: "Machines Recognising Our Emotion", invited talk, Harbin Institute of Technology, Harbin, China, 03.04.2012. (T)
    46. Björn Schuller: "Machine Listening & Learning", invited talk, Harbin Institute of Technology, Harbin, China, 04.04.2012. (T)
    47. Björn Schuller: "Recent Intelligent Audio Analysis", invited talk, Harbin Institute of Technology, Harbin, China, 04.04.2012. (T)
    48. Björn Schuller: "Huanyíng dào mìníhei jìshù dàxué", invited talk, Harbin Institute of Technology, Harbin, China, 05.04.2012. (T)
    49. Björn Schuller: "Intelligente multisensorische Systeme zur sozial kompetenten Interaktion", invited talk, University of Bremen, Bremen, Germany, 24.04.2012. (T)
    50. Björn Schuller: "The Machine Listening Challenge", invited talk, Honda Research Institute Europe, Offenbach am Main, Germany, 06.03.2012. (T)
    51. Björn Schuller: "Virtual Companions: Socially Competent Input Analysis", invited talk, SFB Kollogium SFB "Eine Companion Technologie für kognitive technische Systeme", University of Ulm, Germany, 20.02.2012. (T)
    52. Björn Schuller: "ASC-Inclusion - The “Case”, Initiatives and Impact", invited talk, Digital Games for Empowerment and Inclusion (DGEI) Expert Workshop, JRC-IPTS, Seville, Spain, 23.-24.01.2012. (T)
    53. Björn Schuller: "When Machines Open Ears: Speech, Music, and Sound Analysis", invited talk, Centre Interfacultaire en Sciences Affectives, University of Geneva, Switzerland, 09.12.2011. (T)
    54. Björn Schuller: "Injecting Memory into Semantic Signal Processing", invited talk, NICTA, Sydney/Canberra, Australia, 01.12.2011. (T)
    55. Björn Schuller: "Computational Affect Analysis: Voice, Words, and the Face", invited talk, University of New South Wales, Sydney, Australia, 29.11.2011. (T)
    56. Björn Schuller: "Machines Learning to Listen", invited talk, NICTA, Sydney, Australia, 28.11.2011. (T)
    57. Björn Schuller: "Engineering Paralinguistics: And Next ... the Transparent Speaker?", invited talk, Zentrum für interdisziplinäre Sprachforschung (ZefiS), Bergische Universität Wuppertal, Wuppertal, Germany, 21.12.2011. (T)
    58. Björn Schuller: "Semantic Speech, Music, and Sound Processing in the Real Life", invited talk, Frierich Alexander University / Fraunhofer IIS within the Seminar "Elektrotechnik", Erlangen, Germany, 20.09.2011. (T)
    59. Björn Schuller: "Support Vector Machines ... in a Nutshell", invited talk, Promotionsprogramm "Empirische Sprachverarbeitung", Institut für Phonetik und Sprachverarbeitung, Ludwig-Maximilians-Universität München, Munich, Germany, 01.07.2011. (T)
    60. Björn Schuller: "Communication Homme-Machine - Machine ou Compagnon?", invited talk, Université Pierre et Marie Curie – Paris 6, Paris, France, 05.04.2011. (T)
    61. Björn Schuller: "Audiovisual Recognition of Affect and Non-verbals - Experiences and Directions", invited talk, University of California San Diego (UCSD), Computer Vision and Robotics Research (CVRR) Group, San Diego, CA, USA, 28.03.2011. (T)
    62. Björn Schuller: "Next Gen Music Analysis: Some Inspirations from Speech", invited talk, Multimodal Music Processing, Seminar 11041, Dagstuhl, Germany, 23.-28.01.2011. (T)
    63. Björn Schuller: "Long Short Term Memory Neural Networks for Audio and Video Analysis - An Introduction and Recent Successes", invited talk, Imperial College London, Department of Computing, London, UK, 15.09.2010. (T)
    64. Björn Schuller: "Emotion in Speech: A Look Around the Corner", invited talk, Carnegie Mellon University, Language Technologies Institute, Pittsburgh, PA, USA, 21.06.2010. (T)
    65. Björn Schuller: "Paralinguistics in Real-life Speech: On the Way to Unified Analysis", invited talk, CNRS-LIMSI, Orsay, France, 23.03.2010. (T)
    66. Björn Schuller: "Processing Conversational Speech - About Joy, Interest, and Laughter", invited talk, CNRS-LTCI, Institut TELECOM - TELECOM ParisTech, Paris, France, 21.01.2010. (T)
    67. Björn Schuller: "New Avenues for Sensing Affect in Spoken Language", invited talk, University of Augsburg, Multimedia Concepts and Applications, Institute of Computer Science, Augsburg, Germany, 25.09.2009. (T)
    68. Björn Schuller: "Intelligent Audio Signal Analysis: From Learning to Features", invited talk, Frierich Alexander University within the Seminar "Elektrotechnik", Lehrstuhl für Multimediakommunikation und Signalverarbeitung, Erlangen-Nürnberg, Germany, 28.07.2009. (T)
    69. Björn Schuller: "Audiovisual Data Processing for Robust Human-Machine-Communication and Media Retrieval" , invited talk, Max Planck Institut Informatik (MPI-Inf), Saarbrücken, Germany, 17.03.2009. (T)
    70. Björn Schuller: "Maschinelles Lernen in der Analyse Kognitiver Daten", invited talk, Universität der Bundeswehr München, Institut für Arbeitswissenschaft, Neubiberg, Germany, 12.02.2009. (T)
    71. Björn Schuller: "Capturing and Processing of Multimodal Data for Interaction, Segmentation and Surveillance Tasks", invited talk, Otto-von-Guericke University, Chair for Cognitive Systems / Speech Recognition, Magdeburg, Germany, 17.11.2008. (T)
    72. Björn Schuller: "Speech and Emotion: Hvor skal du hen? - History and Future of Automatic Emotion Recognition", invited talk, Christian-Albrechts-Universität zu Kiel, Forschungszentrum Stimme und Emotion, Institut für Psychologie, Kiel, Germany, 15.05.2008. (T)
    73. Björn Schuller: "Quickskip: Robustes Audiothumbnailing - Effiziente Extraktion von Songteasern", invited talk at the Press Conference of the 5. Heidelberg Innovation Forum, MFG Baden-Württemberg mbH, Villa Bosch, Heidelberg, Germany, 27.11.2007. (T)
    74. Björn Schuller: "Musical Mood Matching", invited talk, 5. Heidelberg Innovation Forum, Panel Session Interface Technology, MFG Baden-Württemberg mbH, Villa Bosch, Heidelberg, Germany, 27.11.2007. (T)
    75. Björn Schuller: "Quickskip: Robust Audiothumbnailing for Fast Music Browsing", invited talk, 5. Heidelberger Innovationsforum, Panel Session Interface Technology, MFG Baden-Württemberg mbH, Villa Bosch, Heidelberg, Germany, 27.11.2007. (T)
    76. Björn Schuller: "Laugh, Cough, Cry: Recognition of Non-linguistic Vocalizations", invited talk, 5. Heidelberg Innovation Forum, Panel Session Semantic Technologies & Speech Recognition, MFG Baden-Württemberg mbH, Villa Bosch, Heidelberg, Germany, 28.11.2007. (T)
    77. Björn Schuller: "Audiovisual Recognition of Spontaneous Interest", invited talk, Toyota Motor Corporation, Toyota City, Japan, 09.11.2007. (T)
    78. Björn Schuller: "Audiovisual Emotion Recognition - Towards Real Life Usage", invited talk, National Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences, Beijing, China, 02.07.2007. (T)
    79. Björn Schuller: "Audiovisuelle Emotionserkennung - Grundlagen und aktuelle Entwicklungen", invited talk, Fraunhofer IITB, Karlsruhe, Germany, 06.06.2007. (T)
    80. Björn Schuller: "Automatic Multimodal Emotion Recognition in Spoken and Manual Interaction", invited talk, Chair for Cognitive Systems / Speech Recognition, Otto-von-Guericke University, Magdeburg, Germany, 20.10.2006. (T)
    81. Björn Schuller: "Automatische Emotionserkennung aus sprachlicher und manueller Interaktion", invited lecture within the course for graduate students on Communications Engineering, Technische Universität München, Institute for Communications Engineering, Munich, Germany, 18.01.2006. (T)
    82. Björn Schuller: "Inhaltsbasierte Musiksuche in einer multimodalen Systemarchitektur", GI-Jahrestagung 2005, Symposium Musikinformatik, Bonn, Germany, 21.09.2005. (T)
    83. Björn Schuller: "Integration of semantic and prosodic aspects in the recognition of emotions in natural language", invited lecture within the course for graduate students on Communication and Emotion, Bielefeld University, Bielefeld, Germany, 03.07.2003. (T)
    84. Björn Schuller: "Sprachverarbeitung im Fahrzeug", invited talk, AUDI AG Vorentwicklung, Ingolstadt, Germany, 13.11.2003. (T)
    85. Björn Schuller: "Natürlichsprachliche Interaktion und Emotionserkennung im Fahrzeug", invited talk and technical demonstration, "Bedienkonzepte 2010: Multimodal - fehlerrobust - adaptiv", BMW Group, FIZ, Munich, Germany, 27.03.2002. (T)

    Keynotes, Tutorials, and Panels

      Keynote Speeches and Invited Lectures:

    1. Björn Schuller: Keynote "`Less Input': Cooperative Learning for Emotionally Intelligent Systems", 4th Machine Learning for Interactive Systems Workshop (MLIS 2015) held at the International Conference on Machine Learning (ICML'15), Lille, France, 11.07. 2015. (T)
    2. Björn Schuller: Keynote "Computational Paralinguistics: Breaking the Voice", UK SPEECH 2015 - 4th Meeting of the UK and Irish Speech Science and Technology Research Community, Norwich, UK, 01.-02.07.2015. (T)
    3. Björn Schuller: Keynote "Speech Analysis in the Big Data Era", 18th International Conference on Text, Speech and Dialogue (TSD 2015), Springer LNCS/LNAI, Plzen, Czech Republic, 14.-17.09.2015. (T)
    4. Björn Schuller: Keynote "What more can you hear behind the voice?", 3rd Huawei Technology Engineering Summit 2014 (TES 2014), Shenzhen, P.R. China, 24.-25.10.2014. (T)
    5. Björn Schuller: Keynote "Machine Learning for Machine Listening: A new Era?", 6th Congress of the Alps Adria Acoustics Association, AAA/AES/EAA, Austria, 16.-17.10.2014. (T)
    6. Björn Schuller: Plenary Talk "Deep Learning our Everyday Emotions", Special Session on Emotional expressions and daily functional activities, annual workshop on Neural Networks (WIRN 2014), Vietri, Italy, 15.-16.05.2014. (T)
    7. Björn Schuller: Keynote "Digital Games to Change Players' Behaviour: Intelligent Yet?", 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.02.2014. (T)
    8. Björn Schuller: Keynote "Latest Advances in Machine Listening - Time to Get Excited", 3rd IEEE International Conference on Consumer Electronics (ICCE 2013), IEEE, Berlin, Germany, 08.-11.09.2013. (T)
    9. Björn Schuller: Keynote "Representation and Modelling of Human Emotion for Computers: Psychological Foundations vs. Machine Learning", Workshop on “Emotion representation and modelling in Human-Computer-Interaction-Systems” (ERM4HCI 2013) held in conjunction with the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), ACM, Springer LNCS, Sydney, Australia, 09.-13.12.2013. (T)
    10. Björn Schuller: Invited Plenary "Memories of Artificial Neural Networks", 32nd Pattern Recognition and Computer Vision Colloquium, Czech Pattern Recognition Society (CPRS), Czech Technical University, Prague, Czech Republic, 25.04.2013. (T)
    11. Björn Schuller: Keynote "Learning Context in Affect Recognition", Second International Workshop on Context Based Affect Recognition (CBAR 2013), held in conjunction with Affective Computing and Intelligent Interaction (ACII 2013), IEEE, Geneva, Switzerland, 02.09.2013. (T)
    12. Björn Schuller: Keynote "Presidential & Audio/Visual Emotion Challenges", Festschrift for Roddy Cowie & Ellen Douglas-Cowie, held in conjunction with Affective Computing and Intelligent Interaction (ACII 2013), IEEE, Geneva, Switzerland, 02.09.2013. (T)
    13. Björn Schuller: Keynote "Speech Processing - When it gets emotional", 6th International Non-Linear Speech Processing Workshop (NOLISP 2013), Springer LNAI, Mons, Belgium, 19.-21.06.2013. (T)
    14. Björn Schuller: Keynote "(A) Machine Learning Behaviour", The 1st International Workshop on Brain and Cognitive Computation (BCC 2013), Harbin, China, 12.-13.01.2013. (T)
    15. Björn Schuller: Plenary Talk "Speech Emotion Recognition on the Go", International Workshop on Affective Computing for Mobile HCI (AC4MobHCI 2012), Istanbul, Turkey, 17.-18.09.2012. (T)
    16. Björn Schuller: Keynote "Semantic Speech Tagging: Towards Combined Analysis of Speaker Traits", AES 42nd Conference on Semantic Audio, Audio Engineering Society (AES), Ilmenau, Germany, 22.-24.07.2011. (T)
    17. Björn Schuller: Keynote "Audiovisual Human Communicative Behavior Analysis: Interest and Emotional Dimensions", Third IEEE Workshop on CVPR for Human Communicative Behaviour Analysis (CVPR4HB), held in conjunction with the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2010 (CVPR 2010), San Francisco, CA, 18.06.2010. (T)
    18. Björn Schuller: Invited Plenary "The Researcher's Guide to Challenge one's Community", Summer School on Social Signal Processing, European Network of Excellence on SSP, Vietri Sul Mare, Italy, 03.-07.06.2013. (T)
    19. Björn Schuller: Invited Plenary "Computational Paralinguistics: Emotion, Affect, and Personality in Speech and Language Processing", University of the Basque Country (UPV/EHU), Bilbao, Spain, 19.12.2012. (T)
    20. Björn Schuller: Invited Plenary "Speaker State and Trait Analysis", Summer School on Pattern Recognition in Multimodal Human Interaction, Spanish Association for Pattern Recognition and Image Analysis (AERFAI), Vigo, Spain, 04.-08.06.2012. (T)
    21. Björn Schuller: Invited Plenary "Ten Trends in the Analysis of Speaker States and Traits", 4th COST 2102 International Training School on Cognitive Behavioural Systems, Jointly organized with EUCogII and SSPNet, Dresden, Germany, 21.-26.02.2011. (T)
    22. Björn Schuller: Invited Plenary "Linguistic and Non-Linguistic Cues of Speaker State - Capturing and Classification", The PINK COST 2102 International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, Jointly organized with the Social Signal Processing Network (NoE), Budapest, Hungary, 07.-10.09.2010. (T)
    23. Björn Schuller: Invited Plenary "Assessing the Voice of Emotion - When it Comes to Engineering", The PINK COST 2102 International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, Jointly organized with the Social Signal Processing Network (NoE), Budapest, Hungary, 07.-10.09.2010. (T)

      Tutorials:

    1. Björn Schuller: Tutorial "Modelling User Affect and Sentiment in Intelligent User Interfaces", The 20th International Conference on Intelligent User Interfaces (IUI 2015), ACM, Atlanta, GA, 29.03.-01.04.2014.
    2. Björn Schuller: Tutorial "User Affect and Sentiment Modelling", The 22nd Conference on User Modelling, Adaptation, and Personalization (UMAP 2014), Springer LNCS, Aalborg, Denmark, 07.-11.07.2014. (T)
    3. Björn Schuller, Anton Batliner: Tutorial "Computational Paralinguistics: Emotion, Affect, and Personality in Speech and Language Processing", INTERSPEECH 2012, ISCA, Portland, OR, USA, 09.-13.09.2012. (T)
    4. Björn Schuller, Florian Metze: Tutorial "Beyond Words in Speech Processing: Speaker States, Traits, and Vocal Behavior", 37th International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE Signal Processing Society, Kyoto, Japan, 25.-30.03.2012. (T)
    5. Björn Schuller: Tutorial "Emotion and Affect in Next-Generation Speech Analysis", 35th International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE Signal Processing Society, Dallas, TX, 14.-19.03.2010. (T)
    6. Björn Schuller: Tutorial "Emotion Recognition in the Next Generation: an Overview and Recent Development", INTERSPEECH 2009, ISCA, Brighton, UK, 06.-10.09.2009. (T)
    7. Hatice Gunes, Björn Schuller: Tutorial "Continuous Analysis of Emotions for Multimedia Applications", ACM Multimedia 2012, ACM, Nara, Japan, 29.10.-02.11.2012. (T)

      Panels:

    1. Panelist Panel Discussion Cognitive Computing Workshop 2015, London, UK, 02.10.2015.
    2. Panel Moderator "Panel Discussion", 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA 2015) held in conjunction with ACII 2015, IEEE, Xian, PR China, 21.09.2015.
    3. Panelist Panel Discussion "Multimodalität", Expert Workshop of the SFB-TR 62 "Companion-Technologie für kognitive technische Systeme", Ulm, Germany, 23.-25.09.2015.
    4. Panelist Panel Discussion "Discussion Session 2", 4th Machine Learning for Interactive Systems Workshop (MLIS 2015) held at the International Conference on Machine Learning (ICML'15), Lille, France, 11.07. 2015.
    5. Panelist Panel Discussion 2015 International Symposium on Computational Psychophysiology, Jinan, Shandong Province, China, 03.-06.04.2015.
    6. Panelist Panel Discussion, Second International Workshop on Context Based Affect Recognition (CBAR 2013), held in conjunction with Affective Computing and Intelligent Interaction (ACII 2013), IEEE, Geneva, Switzerland, 02.09.2013.
    7. Panelist Panel Discussion, International Workshop on Affective Computing for Mobile HCI (AC4MobHCI 2012), Istanbul, Turkey, 17.-18.09.2012.
    8. Panelist Special Session "Audio/Visual Detection of Non-Linguistic Vocal Outbursts", International Conference on Acoustics Speech and Signal Processing (ICASSP) 2011, Prague, IEEE, Czech Republic, 22.-27.05.2011.
    9. Panelist Panel Discussion, International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE (EmoSPACE 2011), held in conjunction with the 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.03.2011.
    10. Panelist Panel Discussion, Third IEEE Workshop on CVPR for Human Communicative Behaviour Analysis (CVPR4HB), held in conjunction with the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2010 (CVPR 2010), San Francisco, CA, 18.06.2010.
    11. Panelist Special Session "O25 - Emotion, Sentiment", 7th International Conference on Language Resources and Evaluation (LREC 2010), ELRA, Valletta, Malta, 19.-21.05.2010.
    12. Panelist 3rd International Workshop on EMOTION: Corpora for Research on Emotion and Affect, Satellite of 7th International Conference on Language Resources and Evaluation (LREC 2010), ELRA, Valletta, Malta, 23.05.2010.
    13. Panelist Special Session "Recognition of Non-Prototypical Emotion from Speech - The final frontier?", 3rd International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, 10.-12.09.2009.

    Organisation, Chairing, and Committee Memberships

      Organisation and Chairing of International Conferences and Workshops:

    1. Co-General Chair of the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), Albert Ali Salah, Jeffrey Cohn, Björn Schuller, ACM, Istanbul, Turkey, 12.-16.11.2014.
    2. Organisation and Co-Chairing 1st International Workshop on ETHics In Corpus Collection, Annotation and Application (ETHI-CA² 2016), satellite of LREC 2016, Laurence Devillers, Bjöorn Schuller, Emily Mower Provost, Peter Robinson, Jeff Hancock, Roddy Cowie, ELRA, Portoroz, Slovenia, 23.-28.05.2016.
    3. Organisation and Co-Chairing 6th International Workshop on Emotion and Sentiment Analysis (ESA 2016), satellite of LREC 2016, Juan Fernando Sanchez-Rada, Carlos A. Iglesias, Björn Schuller, Gabriela Vulcu, Paul Buitelaar, Laurence Devillers, ELRA, Portoroz, Slovenia, 23.-28.05.2016.
    4. Organisation and Co-General Chair of the "Emotion Representations and Modelling for Companion Technologies" (ERM4CT) workshop 2015, joint workshop of the 3rd ERM4HCI (Emotion Representations and Modelling for Human-Computer-Interaction Systems) and the 2nd T2CT (Techniques Towards Companion Technologies) held in conjunction with the 17th ACM International Conference on Multimodal Interaction (ICMI 2015), Kim Hartmann, Ingo Siegert, Björn Schuller, Louis-Philippe Morency, Albert Ali Salah, Ronald Böck, ACM, Seattle, WA, 09.-13.11.2015.
    5. Organisation and Co-Chairing 5th Audio/Visual Emotion Challenge and Workshop (AV+EC 2015) `Audio, Video plus Physiology’, held in conjunction with the 23rd ACM International Conference on Multimedia (MM 2015), Fabien Ringeval, Björn Schuller, Michel Valstar, Roddy Cowie, and Maja Pantic, ACM, Brisbane, Australia, 26.-30.10.2015.
    6. Organisation and Co-Chairing 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA 2015) held in conjunction with ACII 2015, Maja Pantic, Björn Schuller, Gabor Szirtes, Florian Eyben, IEEE, Xian, PR China, 21.09.2015.
    7. Organisation and Co-Chairing 3rd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2015) held in conjunction with the 20th International Conference on Intelligent User Interfaces (IUI 2015), Lucas Paletta, Björn Schuller, Peter Robinson, Nicolas Sabouret, ACM, Atlanta, GA, 29.03.2015.
    8. Organisation and Co-Chairing 3rd International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space – EmoSPACE’15, held in conjunction with the IEEE FG 2015, Ljubljana, Slovenia, 04./08.05.2015.
    9. Co-Chair Turkish German Multimodal Interaction Summit (TGMIS), pre-conference event of ACM ICMI 2014, Albert Ali Salah, Hazim Kemal Ekenel, Björn Schuller, Christian Becker-Asano, Istanbul, Turkey, 11.11.2014.
    10. Organisation and Co-General Chair of the 2nd Workshop on “Emotion representation and modelling in Human-Computer-Interaction-Systems” (ERM4HCI 2014) held in conjunction with the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), Kim Hartmann, Ronald Böck, Björn Schuller, Klaus R. Scherer, ACM, Istanbul, Turkey, 16.11.2014.
    11. Organisation and Co-Chairing The first international audio/visual Mapping Personality Traits Challenge & Workshop (MAPTRAITS 2014), held in conjunction with ACM ICMI 2014, Hatice Gunes, Björn Schuller, Oya Celiktutan, Evangelos Sariyanidi, Florian Eyben, ACM, Istanbul, Turkey, 12.11.2014.
    12. Organisation and Co-Chairing 4th Audio/Visual Emotion Challenge and Workshop (AVEC 2014) `3D Dimensional Affect and Depression’, held in conjunction with the 22nd ACM International Conference on Multimedia (MM 2014), Michel Valstar, Björn Schuller, Jarek Krajewski, Jeffrey Cohn, Roddy Cowie, and Maja Pantic, ACM, Orlando, FL, 07.11.2014.
    13. Organisation and Co-Chairing 5th International Workshop on Emotion Social Signals, Sentiment & Linked Open Data (ES³LOD 2014), satellite of LREC 2014, Björn Schuller, Paul Buitelaar, Laurence Devillers, Catherine Pelachaud, Thierry Declerck, Anton Batliner, Paolo Rosso, Seán Gaines, ELRA, Reykjavik, Iceland, 26.-27.05.2014.
    14. Organisation and Co-Chairing 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), Lucas Paletta, Björn Schuller, Peter Robinson, Nicolas Sabouret, ACM, Haifa, Israel, 24.-27.02.2014.
    15. Organisation and Co-General Chair of the Workshop on “Emotion representation and modelling in Human-Computer-Interaction-Systems” (ERM4HCI 2013) held in conjunction with the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), Kim Hartmann, Ronald Böck, Christian Becker-Asano, Jonathan Gratch, Björn Schuller, Klaus R. Scherer, ACM, Springer LNCS, Sydney, Australia, 09.-13.12.2013.
    16. Organisation and Co-Chairing 7th Workshop "emotion and computing - current research and future impact", workshop at the KI 2013, GI, Koblenz, Germany, 16.09.2013.
    17. Organisation and Co-General Chair of the Workshop on Measuring affect and emotion in vocal communication via acoustic feature extraction: State of the art, current research, and benchmarking, Klaus Scherer, Björn Schuller, Johan Sundberg, Geneva, Switzerland, 01.-02.09.2013.
    18. Organisation and General Chair of the Third International Audio/Visual Emotion Challenge and Workshop (AVEC 2013), Björn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic, Jarek Krajewski, Satellite of the 21st ACM International Conference on Multimedia (MM 2013), ACM, Barcelona, Spain, 21.-25.10.2013.
    19. Organisation and Co-General Chair of the International Symposium on Attention in Cognitive Systems (ISACS 2013) held in conjunction with the 23rd International Joint Conference on Artificial Intelligence (IJCAI 2013), Lucas Paletta, Laurent Itti, Björn Schuller, Fang Fang, Springer LNAI, Beijing, China, 03.-04.08.2013.
    20. Organisation and Co-General Chair of the 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), Björn Schuller, Lucas Paletta, Nicolas Sabouret, ACM, Chania, Crete, Greece, 14.-17.05.2013.
    21. Organisation and Co-General Chair of the Dagstuhl Seminar Computational Audio Analysis, Meinard Müller, Shrikanth Narayanan, Björn Schuller, Schloss Dagstuhl, Germany, 04.-08.11.2013.
    22. Organisation and Co-General Chair of the 2nd International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE (EmoSPACE 2013), Hatice Gunes, Björn Schuller, Maja Pantic, Roddy Cowie, held in conjunction with the 10th International IEEE Conference on Face and Gesture Recognition 2013 (FG 2013), Shanghai, China, 22.-26.04.2013.
    23. Organisation and General Chair of the Second International Audio/Visual Emotion Challenge and Workshop (AVEC 2012), Grand Challenge and Satellite of ACM ICMI 2012, Björn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic, ACM, Santa Monica, CA, 22.-26.10.2012.
    24. Project Leader (Principal Investigator) Socially Aware Many-to-Machine Communication (m2m), Project in the 8th International Summer Workshop on Multimodal Interfaces (eNTERFACE 2012), Metz, France, 02.07.2012-27.07.2012.
    25. Organisation and Co-General Chair of the First International Workshop on Wide Spectrum Social Signal Processing (WS³P 2012), held in conjunction with the ASE/IEEE International Conference on Social Computing (SocialCom 2012), Mohamed Chetouani, Björn Schuller, Peter Robinson, IEEE, Amsterdam, The Netherlands, 03.-06.09.2012.
    26. Organisation and Co-General Chair of the 4th International Workshop on EMOTION SENTIMENT & SOCIAL SIGNALS 2012 (ES³ 2012) - Corpora for Research on Emotion, Sentiment & Social Signals, held in conjunction with LREC 2012, Laurence Devillers, Björn Schuller, Anton Batliner, Paolo Rosso, Ellen Douglas-Cowie, Roddy Cowie, Catherine Pelachaud, ELRA, Istanbul, Turkey, 26.05.2012.
    27. Organisation of the Social Signal Processing IACAPAP 2012 Workshop (SSP IACAPAP 2012), held in conjunction with the 20th World Congress on Brain, Mind and Development (Cerveau, Psyché et Développement), International Association for Child and Adolescent Psychiatry and Allied Professions (IACAPAP), Mohamed Chetouani, David Cohen, Jacqueline Nadel, Björn Schuller, Paris, France, 21.-25.07.2012.
    28. Organisation and General Chair of the First International Audio/Visual Emotion Challenge and Workshop (AVEC 2011), held in conjunction with International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Björn Schuller, Michel Valstar, Roderick Cowie, Maja Pantic, Springer LNCS, Memphis, TN, 09.10.2011.
    29. Organisation and Co-General Chair of the 4th IEEE Workshop on CVPR for Human communicative Behavior analysis (CVPR4HB 2011), Maja Pantic, Jeffrey Cohn, Björn Schuller, Matthew Turk, Roderick Cowie, Thomas S. Huang, held in conjunction with the 24th IEEE Computer Vision and Pattern Recognition (CVPR) 2011, Colorado Springs, CO, 24.06.2011.
    30. Organisation and Co-General Chair of the International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE (EmoSPACE 2011), Hatice Gunes, Björn Schuller, Maja Pantic, Roddy Cowie, held in conjunction with the 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.03.2011.
    31. Organisation and Co-General Chair of the 3rd International Workshop on EMOTION: Corpora for Research on Emotion and Affect, Laurence Devillers, Björn Schuller, Roddy Cowie, Ellen Douglas-Cowie, Anton Batliner, Satellite of 7th International Conference on Language Resources and Evaluation (LREC 2010), ELRA, Valletta, Malta, 23.05.2010.
    32. Organisation and Hosting 1st W3C Emotion Incubator Group F2F Meeting, W3C, Munich, Germany, 26.-27.3.2007.

      Program Chair and Committee Membership:

    1. Program Chair of the 6th International AAAC Conference on Affective Computing and Intelligent Interaction 2015 (ACII 2015), Xian, PR China, 21.-25.09.2015.
    2. Program Chair of the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), ACM, Sydney, Australia, 09.-13.12.2013.
    3. Program Chair of the 4th ASE/IEEE International Conference on Social Computing (SocialCom 2012), IEEE, Amsterdam, The Netherlands, 03.-06.09.2012.
    4. Program Chair of the 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Memphis, TN, 09.-12.10.2011.
    5. Area Chair Speech Processing, 41st International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Shanghai, P.R. China, 20.–25.03.2016.
    6. Area Chair, 27th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2015), IEEE, Salerno, Italy, 09.-11.11.2015.
    7. Area Chair Speech Processing, 40th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Sydney, Australia, 19.–24.04.2015.
    8. Area Chair Speech Processing, 23rd European Signal Processing Conference (EUSIPCO), EURASIP, Nice, France, 31.08.-04.09.2015.
    9. Area Chair Affective and Socially-Aware Multimedia, 22nd ACM International Conference on Multimedia (MM 2014), ACM, Orlando, FL, 03.-07.11.2014.
    10. Area Chair Speech Processing, 39th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Florence, Italy, 04.-09.05.2014.
    11. Area Chair Speech Processing, 38th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Vancouver, Canada, 26.-31.05.2013.
    12. Area Chair ACM 14th International Conference on Multimodal Interfaces (ICMI 2012), ACM, Santa Monica, CA, 22.-26.10.2012.
    13. Area Chair and Senior Program Committee member of the 5th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2013 (ACII 2013), IEEE/HUMAINE Association, Geneva, Switzerland, 02.-05.09.2013.
    14. Technical Program Committee member 2nd Advanced Research in Material Sciences, Manufacturing, Mechanical and Mechatronic Engineering Technology International Conference (AR4MET2016), Batam, Indonesia, 12.-14.04.2016.
    15. Technical Program Committee of the 29th International Florida Artificial Intelligence Research Society Conference (FLAIRS 2016), special track on Big Data (FLAIRS AI4BigData), Association for the Advancement of Artificial Intelligence (AAAI), Key Largo, FL, USA, 17.05.2016.
    16. Technical Program Committee member of the 3rd International Conference on Signal Processing and Integrated Networks (SPIN 2016), IEEE, Noida, India, 11.-12.02.2016.
    17. Program Committee member Multimodal Machine Learning Workshop (MMML 2015), held at the 29th Annual Conference on Neural Information Processing Systems (NIPS 2015), NIPS, Montreal, Canada, 11.-12.12.2015.
    18. Program Committee member 1st International Conference on Complex Information Systems (COMPLEXIS 2016), Rome, Italy, 22.-24.04.2016.
    19. Scientific Committee member 10th Language Resources and Evaluation Conference (LREC 2016), ELRA, Portorož, Slovenia, 23.-28.05.2016.
    20. Technical Program Committee member 2015 International Conference on Computing and Network Communications (CoCoNet'15), IEEE, Trivandrum, India, 16.-19.12.2015.
    21. Technical Program Committee member Workshop on Signal Processing for Wireless and Multimedia Communications (SPWMC'15), satellite of the 2nd International Symposium on Signal Processing and Intelligent Recognition Systems (SIRS'15), ACM, Springer, Trivandrum, India, 16.-19.12.2015.
    22. Program Committee member 8th International Symposium on Attention in Cognitive Systems (ISACS 2015) in conjunction with IROS 2015, IEEE, Hamburg, Germany, 02.10.2015.
    23. Program Committee member 2nd workshop on Computer Vision for Affective Computing (CV4AC 2015), during the IEEE International Conference on Computer Vision (ICCV 2015), IEEE, Santiago, Chile, 13.-16.12.2015.
    24. Technical Program Committee member 12. ITG-Fachtagung Sprachkommunikation (ITG Conference on Speech Communication), IEEE, Paderborn, Germany, 05.-07.10.2016.
    25. Program Committee member Doctoral Consortium 17th ACM International Conference on Multimodal Interaction (ICMI 2015), ACM, Seattle, WA, 09.-13.11.2015.
    26. Program Committee member of the 2015 International Conference on Machine learning and Signal Processing (MALSIP'2015), Springer LNEE, Melaka, Malaysia, 15.–17.12.2015.
    27. Program Committee member of the International Conference on Advanced Technologies for Communications 2015 (ATC 2015), IEEE, Ho Chi Minh City, Vietnam, 14.-16.10.2015.
    28. Program Committee member of the 8th Asian Conference on Intelligent Information and Database Systems (ACIIDS 2016), Springer LNAI, Da Nang, Vietnam, 14.-16.03.2016.
    29. Program Committee member 1st International Workshop on ENgagement in HumaN Computer IntEraction (ENHANCE 2015) held in conjunction with ACII 2015, IEEE, Xian, PR China, 21.09.2015.
    30. Program Committee member 1st International Workshop on Advancements in Social Signal Processing for Multimodal Interaction (ASSP4MI@ICMI2015) held in conjunction with the 17th ACM International Conference on Multimodal Interaction (ICMI 2015), ACM, Seattle, WA, 13.11.2015.
    31. Program Committee member 2015 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), IEEE, Scottsdale, AZ, USA, 13.-17.12.2015.
    32. Program Committee member International Conference on Information and Software Technologies (ICIST), Springer CCIS, Druskininkai, Lithuania, 15.-16.10.2015.
    33. Program Committee member 3rd Workshop on Emotions and Personality in Personalized Systems (EMPIRE) held in conjunction with RecSys 2015, ACM, Vienna, Austria, 19.-20.09.2015.
    34. Program Committee for the Special Session "Special Session on Emotion and Sentiment in Intelligent Systems and Big Social Data Analysis (SentISData)" of the IEEE International Conference on Data Science and Advanced Analytics (IEEE DSAA), IEEE/ACM, Paris, France, 19.-21.10.2015.
    35. Technical Program Committee member 2015 Advancement on Mechanical and Manufacturing Engineering Technology (ADMMET2015) conference, Bandung, Indonesia, 24.–26.11.2015.
    36. Technical Program Committee member 3rd International Conference on Conference on Computing, Management and Educational Tech (ComManTel 2015), Da Nang, Vietnam, 28.-30.12.2015.
    37. Technical Program Committee member 23rd ACM International Conference on Multimedia (MM 2015), ACM, Brisbane, Australia, 26.-30.10.2015.
    38. Program Committee member International Workshop on Affect and Sentiment in Multimedia (ASM2015) held in conjunction with the 23rd ACM International Conference on Multimedia (MM 2015), ACM, Brisbane, Australia, 26.-30.10.2015.
    39. Program Committee member of the 37th German Conference on Pattern Recognition (GCPR) - the German Association for Pattern Recognition (DAGM) Annual Pattern Recognition Symposium, DAGM, Springer LNCS, 06.-09.10.2015, Aachen, Germany.
    40. Scientific Committee member of the INTERSPEECH 2015, ISCA, Dresden, Germany, 06.-10.09.2015.
    41. Program Committee member of the 2nd International Conference on Soft Computing & Machine Intelligence (ISCMI15), INNS, Hong Kong, Hong Kong, 23.-24.11.2015.
    42. Program Committee member of the 5th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2016), Rome, Italy, 24.-26.02.2016.
    43. Technical Program Committee member 2015 IEEE Conference on Energy Conversion (CENCON 2015), IEEE, Johor Bahru, Malaysia, 19.–21.10.2015.
    44. Technical Program Committee member 2015 Advanced Research in Material Sciences, Manufacturing, Mechanical and Mechatronic Engineering Technology International Conference (AR4MET2015), Bali, Indonesia, 02.-04.06.2015.
    45. Technical Program/Steering Committee member International Conference on Green Computing and Internet of Things, Delhi, India, 08.-10.10.2015.
    46. Technical Program Committee member The 2nd NAFOSTED Conference on Information and Computer Science, IEEE, Ho Chi Minh City, Vietnam, 16.-18.09.2015
    47. Program Committee member of the 2015 Afeka Conference for Speech Processing (ACSP 2015), AFEKA, Tel Aviv, Israel, 2015.
    48. Program Committee member of the 2015 IEEE International Conference on Intelligence and Security Informatics (ISI 2015), IEEE, Baltimore, MA, 27.-29.05.2015.
    49. Program Committee member of the 1st International Workshop on Personality and Affect in Multimedia Retrieval (PAMUR), held in conjunction with the ACM International Conference on Multimedia Retrieval (ICMR 2015), ACM, Shanghai, China, 23.-26.06.2015.
    50. Program Committee member of the 2nd International Workshop on Emotion and Sentiment in Social and Expressive Media: opportunities and challenges for emotion-aware multi agent systems (ESSEM 2015), held in conjunction with the 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2015), ACM, Istanbul, Turkey, 04.-08.05.2015.
    51. Program Committee member 6. Studierendenkonferenz Informatik (SKILL 2015), GI, Cottbus, Germany, 01.-02.10.2015.
    52. Technical Program Committee member of The 28th International Florida Artificial Intelligence Research Society Conference (FLAIRS 2015), Association for the Advancement of Artificial Intelligence (AAAI), Hollywood, FL, USA, 18.-20.05.2015.
    53. Program Committee member of the 21st International Conference on Information and Software Technologies (ICIST 2015), Springer CCIS, Kaunas, Lithuania, 2015.
    54. Technical Program Committee member of the IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems 2015 (IEEE SPICES 2015), IEEE, Kozhikode, India, 19.-21.02.2015.
    55. Technical Committee member of the International Symposium on Intelligent Systems Technologies and Applications (ISTA’15), Kochi, India, 10.-13.08.2015.
    56. Program Committee member of the 4th ICDM SENTIRE 2014 (Sentiment Elicitation from Natural Text for Information Retrieval and Extraction), held in conjunction with IEEE International Conference on Data Mining (ICDM 2014), IEEE, Shenzhen, China, 14.-17.12.2014.
    57. Technical Program Committee of the 12th International Conference on Frontiers of Information Technology (FIT 2014), IEEE, Islamabad, Pakistan, 17.-19.12.2014.
    58. Scientific Committee member of the 6th International Workshop on Spoken Dialog Systems (IWSDS 2015), Busan, South Korea, 11.-13.01.2014.
    59. Scientific Committee member of the 3rd international conference on "Cognition, Emotion, and Motivation" (CEM 2015), Hammamet-Tunisia, 04.-07.11.2015.
    60. Program Committee member of the ICMI 2014 Workshop on Understanding and Modeling Multimodal, Multiparty Interactions (UMMMI-ICMI2014), held at the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), ACM, Istanbul, Turkey, 16.11.2014.
    61. Technical Program Committee member of the 2nd International Conference on Signal Processing and Integrated Networks (SPIN 2015), IEEE, Noida, India, 19.-20.02.2015.
    62. Program Committee member of the 7th Asian Conference on Intelligent Information and Database Systems (ACIIDS 2015), Springer LNAI, Bali, Indonesia, 23.-25.03.2015.
    63. Technical Committee member Special Session on Cyber-Physical Systems and Social Computing, 4th International Conference on Advances in Computing, Communications and Informatics (ICACCI 2015), Kerala, India, 10.-13.08.2015.
    64. Technical Committee member 4th International Conference on Advances in Computing, Communications and Informatics (ICACCI 2015), Kerala, India, 10.-13.08.2015.
    65. Program Committee member of the 4th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2015), Lisbon, Portugal, 10.-12.01.2015.
    66. Scientific Review Committee member of the 15th INTERSPEECH 2014, ISCA, Singapore, Singapore, 14.-18.09.2014.
    67. Program Committee member of the 3rd Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM14), an ICML 2014 (International Conference on Machine Learning) workshop, Beijing, China, 25.06.2014.
    68. Program Committee member of the Understanding and Modeling Multiparty, Multimodal Interactions Workshop at the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), ACM, Istanbul, Turkey, 16.11.2014.
    69. Program Committee President, Special Session Soft Computing Techniques for Time-Series Analysis (SCTTSA – SOFA - 2014), 6th International Workshop on Soft Computing Applications (SOFA 2014), IEEE, Springer, Timisoara, Romania, 24.-26.07.2014.
    70. Program Committee member of the 3rd International Conference on Informatics, Electronics & Vision (ICIEV 2014), Dhaka, Bangladesh, 23.-24.05.2013.
    71. Technical Program Committee member 2nd International Symposium on Computational & Business Intelligence (ISCBI14), IEEE/INNS, India, 2014.
    72. Technical Program Committee member of the 1st International Conference on Contemporary Computing and Informatics (IC3I), IEEE, Mysore, India, 27.-29.11.2014.
    73. Program Committee member of 2nd International Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction (MA3HMI 2014), satellite of Interspeech 2014, ISCA, Singapore, Singapore, 13.09.2014.
    74. Program Committee member of the International Workshop on Cyber-Physical Systems and Social Computing (CSSC-2014) affiliated with Third International Conference on Advances in Computing, Communications and Informatics (ICACCI-2014), IEEE, Delhi, India, 24.-27.09.2014.
    75. Technical Program Committee member of the 2014 IEEE Joint Intelligence and Security Informatics Conference (JISIC 2014: ISI + EISIC), IEEE, the Hague, the Netherlands, 24.-26.09.2014.
    76. Technical Program Committee Member of the 22nd European Signal Processing Conference (EUSIPCO 2014), EURASIP, Lisbon, Portugal, 01.-05.09.2014.
    77. Scientific Committee Member of the REVERB Workshop 2014 (REVERB 2014), satellite of IEEE ICASSP 2014 and HSCMA 2014 and part of the IEEE SPS AASP challenge series, Florence, Italy, 10.05.2014.
    78. Program Committee member of The 2nd International Conference on Statistical Language and Speech Processing (SLSP 2014), Grenoble, France, 14.-16.10.2014.
    79. Program Committee member of the 20th International Conference on Information and Software Technologies (ICIST 2014), Springer CCIS, Druskininkai, Lithuania, 09.-10.10.2014.
    80. Program Committee member of the 10th International Conference on Artificial Intelligence Applications and Innovations (AIAI 2014), IFIP, Springer, Island of Rhodes, Greece, 19.-22.09.2014.
    81. Program Committee member of the International Conference on Soft Computing & Machine Intelligence (ISCMI14), INNS, New Delhi, India, 26.-27.09.2014.
    82. Technical Program Committee member of the 2014 IEEE International Conference on Multimedia and Expo (ICME 2014), IEEE, Chengdu, China, 14.-18.07.2014.
    83. Technical Program Committee member of the 2014 IEEE Innovative Smart Grid Technologies Conference - Asia (ISGT ASIA), IEEE, Kuala Lumpur, 20.-23.05.2014.
    84. Technical Program Committee member of the 9th Language Resources and Evaluation Conference (LREC 2014), Reykjavik, Iceland, 26.-31.05.2014.
    85. Technical Program Committee member of the 2014 Speech Processing Conference, Tel Aviv, Israel, 07.-08.07.2014.
    86. Technical Program Committee member of the 2014 International Joint Conference on Neural Networks (IJCNN 2014), IEEE, Beijing, China, 06.-11.07.2014.
    87. Program Committee member of the 2014 IEEE International Conference on Multimedia and Expo (ICME 2014), IEEE, Chengdu, China, 14.-18.07.2014.
    88. Technical Committee member 3rd International Conference on Advances in Computing, Communications and Informatics (ICACCI 2014), Greater Noida, India, 24.-27.09.2014.
    89. Program Committee member of the 5th International Conference on Intelligent Human Computer Interaction (IHCI 2013), Springer LNCS, Sydney, Australia, 03.-05.12.2013.
    90. Program Committee member of ICDM SENTIRE 2013 (Sentiment Elicitation from Natural Text for Information Retrieval and Extraction), held in conjunction with IEEE International Conference on Data Mining (ICDM 2013), IEEE, Dallas, Texas, 07.-10.12.2013.
    91. Program Committee member of the 1st International Symposium on Signal Processing and Intelligent Recognition Systems (SIRS-2014), Trivandrum, India, 13.-15.03.2014.
    92. Program Committee member of the 6th Asian Conference on Intelligent Information and Database Systems (ACIIDS 2014), Springer LNAI, Bangkok, Thailand, 07.-09.04.2014.
    93. Program Committee member of the 5th International Workshop Series on Spoken Dialogue Systems Technology (IWSDS 2014), Napa, CA, 18.-19.01.2014.
    94. Program Committee member Fourth International Joint Conference on Ambient Intelligence (AmI 2013), Springer, Dublin, Ireland, 03.-05.12.2013.
    95. Program Committee member 1st International Workshop on Emotion and Sentiment in Social and Expressive Media (ESSEM 2013), satellite of the 13th Conference of the Italian Association of Italian Artificial Intelligence (AI*IA 2013), Springer LNCS, Turin, Italy, 03.12.2013.
    96. Program Committee member 21st European Signal Processing Conference 2013 (EUSIPCO 2013), EURASIP, IEEE, Marrakech, Morocco, 09.-13.09.2013.
    97. Program Committee member ACM Multimedia Open Source Software Competition (ACMOSS 2013), 21st ACM International Conference on Multimedia (MM 2013), ACM, Barcelona, Spain, 21.-25.10.2013.
    98. Program Committee member International Workshop Conflict and communication, Multimodal Social Signals of conflict and negotiation in humans, animals, and machines, Rome, Italy, 29.-31.10.2013.
    99. Program Committee member of the Emotion Recognition In The Wild Challenge and Workshop (EmotiW 2013), satellite of the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), ACM, Sydney, Australia, 09.-13.12.2013.
    100. Program Committee member of the 2nd International Conference on Advances in Computing, Communications and Informatics (ICACCI 2013), IEEE, Mysore, India, 22.-25.08.2013.
    101. Program Committee member of the International Workshop on Techniques towards Companion Technologies (T2CT 2013), satellite of the Thirteenth International Conference on Intelligent Virtual Agents (IVA 2013), Springer, Edinburgh, UK, 28.08.2013.
    102. Program Committee member of the IVA 2013 Workshop on Multimodal Corpora (MMC 2013), satellite of the Thirteenth International Conference on Intelligent Virtual Agents (IVA 2013), Springer, Edinburgh, UK, 01.09.2013.
    103. Program Committee member of the 11th Asia Pacific Conference on Computer Human Interaction (APCHI 2013), Springer, Bangalore, India, 24.-27.09.2013.
    104. Program Committee member of the WWW13 workshop on Multidisciplinary Approaches to Big Social Data Analysis (MABSDA 2013), satellite of the 22nd World Wide Web conference (WWW 2013), W3C, Rio de Janeiro, Brazil, 13.-17.05.2013.
    105. Program Committee member of the 4th International Workshop on Human Behavior Understanding (HBU 2013), satellite of the 21st ACM International Conference on Multimedia (MM 2013), ACM, Barcelona, Spain, 21.-25.10.2013.
    106. Program Committee member of the 6th International Non-Linear Speech Processing Workshop (NOLISP 2013), Springer LNAI, Mons, Belgium, 19.-21.06.2013.
    107. Program Committee member of the 21st ACM International Conference on Multimedia (MM 2013), ACM, Barcelona, Spain, 21.-25.10.2013.
    108. Program Committee member of the 5th International Workshop on Affective Interaction in Natural Environments (AFFINE 2013), satellite event of ACII 2013, IEEE/HUMAINE Association, Geneva, Switzerland, 02.-05.09.2013.
    109. Program Committee member of the 14th International Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIA²MIS 2013), IEEE, Paris, France, 03.-05.07.2013.
    110. Scientific Review Committee member for Interspeech 2013, ISCA, Lyon, France 24.-29.08.2013.
    111. Program Committee member of the 2nd International Conference on Informatics, Electronics & Vision (ICIEV 2013), IEEE, Dhaka, Bangladesh, 17.-18.05.2013.
    112. Program Committee member of the 2nd Workshop on Innovation in Border Control (WIBC 2013), jointly organized with the European Intelligence and Security Informatics (EISI 2013), Swedish Defence Research Agency, Uppsala, Sweden, 12.-14.08.2013.
    113. Program Committee member of the International Workshop on Affective Analysis in Multimedia (AAM 2013) held in conjunction with the 15th IEEE International Conference on Multimedia and Expo 2013 (ICME 2013), IEEE, San Jose, CA, USA, 15.-19.07.2013.
    114. Program Committee member of the International Symposium on Attention in Cognitive Systems (ISACS 2013) held in conjunction with the 23rd International Joint Conference on Artificial Intelligence (IJCAI 2013), Springer LNAI, Beijing, China, 03.-04.08.2013.
    115. Program Committee member of the 6th international Brain Inspired Cognitive Systems (BICS) conference, IEEE, Beijing, China 09.-11.06.2013.
    116. Program Committee member of Vision(s) on Deception and Non-Cooperation - Workshop held in conjunction with the 10th International IEEE Conference on Face and Gesture Recognition 2013 (FG 2013), Shanghai, China, 22.-26.04.2013.
    117. Technical Program Committee memeber of the Speech Processing Conference, AFEKA, Tel Aviv, Israel, 01.-02.07.2013.
    118. Technical Program Committee member of the 15th IEEE International Conference on Multimedia and Expo 2013 (ICME 2013), IEEE, San Jose, CA, USA, 15.-19.07.2013.
    119. Program Committee member of the 12th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2013), Saint Paul, MN, USA, 06.-10.05.2013.
    120. Program Committee member of the 10th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2013), IEEE, Shanghai, China, 22.-26.04.2013.
    121. Program Committee member of the 5th Asian Conference on Intelligent Information and Database Systems (ACIIDS 2013), Springer LNAI, Kuala Lumpur, Malaysia, 18.-20.03.2013.
    122. Program Committee member Workshop on Face analysis: The intersection of computer vision and human perception, in conjunction with the 11th Asian Conference on Computer Vision (ACCV 2012), Springer LNCS, Daejeon, South Korea, 06.12.2012.
    123. Program Committee member of the 2012 IEEE International Conference on Power and Energy (PECON 2012), IEEE, Malaysia, 02.-05.12.2012.
    124. Program Committee member of the IVA Satellite Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction (MA3 2012), satellite of the 12th International Conference on Intelligent Virtual Agents (IVA 2012), Springer, Santa Cruz, CA, 15.09.2012.
    125. Program Committee member of the 2nd International ACM Workshop on Music Information Retrieval with User-Centered and Multimodal Strategies (MIRUM 2012), held in conjunction with ACM Multimedia, ACM, Nara, Japan, 02.11.2012.
    126. Scientific Committee member of the 4th International Workshop Series on Spoken Dialogue Systems Technology (IWSDS 2012), Paris, France, 28.-30.11.2012.
    127. Scientific Committee member of the 6th Workshop Emotion and Computing - Current Research and Future Impact, Workshop at the KI 2012, Springer LNCS, Saarbrücken, Germany, 24.09.2012.
    128. Program Committee member of the First ACM International Workshop on Audio and Multimedia Methods for Large-Scale Video Analysis (AMVA 2012), satellite of ACM Multimedia, Nara, Japan, 29.10.-02.11.2012.
    129. Program Committee member of the 21st International Conference on Pattern Recognition (ICPR 2012), IAPR, Tsukuba Science City, Japan, 11.11.2012.
    130. Program Committee member of the 2012 IEEE Symposium on Industrial Electronics & Application (ISIEA 2012), IEEE, Bandung, Indonesia, 23.-26.09.2012.
    131. Program Committee member of the Workshop on Exploring Stances in Interactions: Conceptual and Practical Issues in Social Signal Processing Research held within the 4th ASE/IEEE International Conference on Social Computing (SocialCom 2012), IEEE, Amsterdam, The Netherlands, 03.-06.09.2012.
    132. Program Committee member of the Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM) held within the 2012 ACM Conference on Knowledge Discovery and Data Mining (KDD), Beijing, China, 12.-16.08.2012.
    133. Program Committee member of the ICPR 2012 Satellite Workshop Multimodal pattern recognition of social signals in human computer interaction, IAPR, Tsukuba Science City, Japan, 11.11.2012.
    134. Program Committee member of the 9th International Symposium on Computer Music Modeling and Retrieval (CMMR 2012), LNCS, Springer, London, UK, 19.–22.06.2012.
    135. Program Committee member of the Workshop on Innovation in Border Control 2012 (WIBC), jointly organized with the European Intelligence and Security Informatics (EISI 2012), Odense, Denmark, 21.-22.08.2012.
    136. Program Committee member of the 2012 International Conference on Brain Inspired Cognitive Systems (BICS 2012), IEEE, Shenyang, China, 11.-14.07.2012.
    137. Program Committee member of the LREC 2012 Workshop on Multimodal Corpora (MMC 2012), ELRA, Istanbul, Turkey, 22.05.2012.
    138. Program Committee member of the 3rd International Conference on Computer & Communication Technology (ICCCT 2012), IEEE, Allahabad, India, 16.-18.11.2012.
    139. Program Committee member 1st International Conference on Advances in Computing, Communications and Informatics (ICACCI 2012), Springer, Chennai, India, 03.-05.08.2012.
    140. Program Committee member of the International Workshop on Pattern Recognition and Image Processing (PRIP 2012), Chennai, India, 03.-05.08.2012.
    141. Technical Program Committee member of the 13th IEEE International Conference on Multimedia and Expo (ICME 2012), IEEE, Melbourne, Australia, 09.-13.07.2012.
    142. Program Committee member of the 7th ICMI Workshop on Multimodal Corpora for Machine Learning, held in conjunction with the 13th International Conference on Multimodal Interaction (ICMI 2011), ACM, Alicante, Spain, 18.11.2011.
    143. Program Committee member of the SENTIRE 2011 (Sentiment Elicitation from Natural Text for Information Retrieval and Extraction), held in conjunction with IEEE International Conference on Data Mining (ICDM 2011), IEEE, Vancouver, Canada, 11.-14.12.2011.
    144. Program Committee member of the International Conference on Informatics, Electronics & Vision 2012 (ICIEV 2012), IEEE/IAPR, Dhaka, Bangladesh, 04.-05.05.2012.
    145. Program Committee member of the MMCogEmS 2011 Workshop (Inferring Cognitive and Emotional States from Multimodal Measures), held in conjunction with the 13th International Conference on Multimodal Interaction (ICMI 2011), ACM, Alicante, Spain, 17.11.2011.
    146. Program Committee member of the International ACM Workshop on Music Information Retrieval with User-Centered and Multimodal Strategies (MIRUM 2011), held in conjunction with ACM Multimedia, ACM, Scottsdale, Arizona, USA, 28.11.-01.12.2011.
    147. Senior Program Committee member of the 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Memphis, TN, 09.-12.10.2011.
    148. Program Committee member of the Third International Conference on Social Computing (SocialCom 2011), IEEE, MIT Boston, USA, 09.-11.10.2011.
    149. Program Committee member of the International Conference on Advances in Computing (ACC 2011), ACM, Springer, Kochi, Kerala, India, 22.-24.07.2011.
    150. Program Committee member of the Multimodal Audio-based Multimedia Content Analysis (MAMCA), held in conjunction with the 11th IEEE International Conference on Multimedia and Expo (ICME), Barcelona, Spain, 11.-15.07.2011.
    151. Program Committee member of the 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.-23.03.2011.
    152. Program Committee member of the Social Behavior Analysis workshop, held in conjunction with the 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.-23.03.2011.
    153. Program Committee member of the 3rd International Conference on Human Computer Interaction 2011 (India HCI 2011), Bangalore, India, 07.-10.04.2011.
    154. Program Committee member of the Second Workshop on Social Signal Processing 2010 (SSPW 2010), held in conjunction with the ACM Multimedia, Firenze, Italy, 25.-29.10.2010.
    155. Program Committee member of the Third Workshop on Affective Interaction in Natural Environments (AFFINE 2010), held in conjunction with the ACM Multimedia, Firenze, Italy, 25.-29.10.2010.
    156. Program Committee member of the Third IEEE Workshop on CVPR for Human Communicative Behaviour Analysis (CVPR4HB), held in conjunction with the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2010 (CVPR 2010), San Francisco, CA, 18.06.2010.
    157. Program Committee member of the Third International Workshop on EMOTION (satellite of LREC): Corpora for Research on Emotion and Affect, ELRA, Valletta, Malta, 23.05.2010.
    158. Scientific Committee member of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE/10), Amsterdam, The Netherlands, 12.07.-06.08.2010.
    159. Technical Program Committee member of the 1st International Workshop on Human Behaviour Understanding, held in conjunction with the IAPR International Conference on Pattern Recognition (ICPR), Istanbul, Turkey, 22.08.2010.
    160. Program Committee member of the Social Signal Processing Workshop, in conjunction with ACII 2009, IEEE, Amsterdam, The Netherlands, 13.09.2009.
    161. Program Committee member of the Second IEEE Workshop on CVPR for Human Communicative Behaviour Analysis (CVPR4HB), held in conjunction with the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2009 (CVPR 2009), Miami, FL, 25.06.2009.
    162. Program Committee member of the 3rd International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, 10.-12.09.2009.
    163. Program Committee member of the 8th International IEEE Conference on Face and Gesture Recognition 2008 (FG 2008), Amsterdam, The Netherlands, 17.-19.09.2008.
    164. Program Committee member of the First IEEE Workshop on CVPR for Human Communicative Behaviour Analysis (CVPR4HB), held in conjunction with the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008), Anchorage, Alaska, 28.06.2008.
    165. Program Committee member ParaLing'07: International workshop on "Paralinguistic speech - between models and data" in association with the 16th International Conference on Phonetic Sciences (ICPhS07), Saarbrücken, Germany, 02.-03.08.2007.
    166. Program Committee member AI4HC workshop in conjunction with 20th IJCAI 2007, Hyderabad, India, 06.01.2007.

      Conference Organisational Committee Membership:

    1. Advisory Committee Member International Academic Conference on Innovation Engineering & Technology (IACIET-2014), IEEE, Jaipur, India, 26.-27.09.2014.
    2. Special Sessions & Challenges Chair of the 16th INTERSPEECH 2015, ISCA, Dresden, Germany, 06.-10.09.2015.
    3. Workshop Chair of the 5th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2013 (ACII 2013), IEEE/HUMAINE Association, Geneva, Switzerland, 02.-05.09.2013.
    4. Steering Committee member of the 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Memphis, TN, 09.-12.10.2011.
    5. Workshop Chair of the 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Memphis, TN, 09.-12.10.2011.
    6. Workshop Chair of the Fourth IEEE International Conference on Semantic Computing ICSC 2010, IEEE, Pittsburgh, PA, USA, 20.-22.09.2010.
    7. Technical Program, Proceedings, Sponsors, Awards of the DAGM 2008, 30th Annual Symposium of the German Association for Pattern Recognition, Munich, Germany, 10.-13.6.2008.

      Award Committee Membership:

    1. Outstanding Papers Committee member of the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), ACM, Sydney, Australia, 09.-13.12.2013.
    2. Best Paper Committee member of the 10th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2013), IEEE, Shanghai, China, 22.-26.04.2013.
    3. 2011 Outstanding Young Researcher in Automatic Human Behaviour Analysis Award Committee Member, IEEE, 2011.
    4. Best Paper Committee member, 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Springer LNCS, Memphis, TN, 09.-12.10.2011.
    5. Best Student Paper Committee member, 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.-23.03.2011.
    6. Best Student Paper Judge, 159th Meeting of the Acoustical Society of America 2010, ASA, Baltimore, MD, USA, 19.-23.04.2010.
    7. Best Demo Award Committee Member, 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, 10.-12.09.2009.

      Organisation and Chairing of Special Events, Symposia, and Special Sessions:

    1. Organisation Special Session "Computational Intelligence Algorithms for Digital Audio Applications", Stefano Squartini, Aurelio Uncini, Björn Schuller, Francesco Piazza, International Joint Conference on Neural Networks (IJCNN), INNS/IEEE, Vancouver, Canada, IEEE, 25.-29.07.2016.
    2. Organisation and Chairing Special Session "Socio-cognitive Language Processing", Björn Schuller, Michael McTear, The Seventh International Workshop on Spoken Dialogue Systems (IWSDS), Springer, Riekonlinna, Finland, 13.-16.01.2016.
    3. Organisation Symposium "Music Emotion Recognition: Machine Learning and Cognitive Modelling", Eduardo Coutinho, Björn Schuller, 4th International Conference on Music & Emotion (ICME 2015), Geneva, Switzerland, 12.-16.10.2015.
    4. Organisation and Chairing Special Session "INTERSPEECH 2015 Computational Paralinguistics Challenge (ComParE)", Björn Schuller, Stefan Steidl, Anton Batliner, Florian Hönig, Juan Rafael Orozco-Arroyave, INTERSPEECH 2015, ISCA, Dresden, Germany, 06.-10.09.2015.
    5. Organisation and Chairing Special Session "Speech science in end user applications", Felix Burkhardt, Norbert Reithinger, Björn Schuller, Nils Lenke, Diane Hirschfeld, INTERSPEECH 2015, ISCA, Dresden, Germany, 06.-10.09.2015.
    6. Organisation Special Session "Computational Intelligence Algorithms for Digital Audio Applications", Stefano Squartini, Aurelio Uncini, Björn Schuller, Francesco Piazza, International Joint Conference on Neural Networks (IJCNN), INNS/IEEE, Killarney, Ireland 11.-16.07.2015.
    7. Organisation and Chairing Special Session "INTERSPEECH 2014 Computational Paralinguistics Challenge (ComParE)", Björn Schuller, Stefan Steidl, Anton Batliner, Julien Epps, INTERSPEECH 2014, ISCA, Singapore, Singapore, 14.-18.09.2014.
    8. Organisation and Co-Chairing Panel Session "Looking for emotional and social signals in multimedia: Where art thou?", Hayley Hung, Hatice Gunes, Lexing Xie, Björn Schuller, 22nd ACM International Conference on Multimedia (MM 2014), ACM, Orlando, FL, 03.-07.11.2014.
    9. Organisation and Co-Chairing Special Session "Emotional Speech Processing for Human-Machine Interaction", Dong-Yan Huang, Swee Lan See, Björn Schuller, Vidhyasaharan Sethu, Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA-ASC 2014), IEEE, Siem Reap, Cambodia, 09.-12.12.2014.
    10. Organisation Special Session "Computational Intelligence Algorithms for Digital Audio Applications", Stefano Squartini, Aurelio Uncini, Björn Schuller, Francesco Piazza, World Congress on Computational Intelligence (WCCI 2014), IEEE, Beijing, China, 06.-09.07.2014.
    11. Organisation and Chairing Special Session "Speech science in end user applications", Felix Burkhardt, Jürgen Schröter, Björn Schuller, INTERSPEECH 2013, ISCA, Lyon, France, 25.-29.08.2013.
    12. Organisation and Chairing Special Event "INTERSPEECH 2013 Computational Paralinguistics Challenge (ComParE)", Björn Schuller, Stefan Steidl, Anton Batliner, Alessandro Vinciarelli, Klaus Scherer, Fabien Ringeval, Mohamed Chetouani, INTERSPEECH 2013, ISCA, Lyon, France, 25.-29.08.2013.
    13. Organisation and Chairing Special Event "INTERSPEECH 2012 Speaker Trait Challenge", Björn Schuller, Stefan Steidl, Anton Batliner, Elmar Nöth, Alessandro Vinciarelli, Felix Burkhardt, Rob van Son, INTERSPEECH 2012, Portland, OR, USA, 09.-13.09.2012.
    14. Organisation Special Session "Advances in Cognitive and Emotional Information Processing", Stefano Squartini, Francesco Piazza, Björn Schuller, 9th International Symposium on Neural Networks (ISNN 2012), LNCS, Springer, Shenyang, China, 11.-14.07.2012.
    15. Organisation and Chairing Special Event "INTERSPEECH 2011 Speaker State Challenge", Björn Schuller, Anton Batliner, Stefan Steidl, Florian Schiel, Jarek Krajewski, INTERSPEECH 2011, Florence, Italy, 28.-31.08.2011.
    16. Organisation and Chairing Special Session "Audio/Visual Detection of Non-Linguistic Vocal Outbursts", Björn Schuller, Maja Pantic, International Conference on Acoustics Speech and Signal Processing (ICASSP) 2011, Prague, IEEE, Czech Republic, 22.-27.05.2011.
    17. Organisation and Chairing Special Session "Computational Intelligence Algorithms for Advanced Human-Machine Interaction", Jianhua Tao, Stefano Squartini, Björn Schuller, 8th International Symposium on Neural Networks (ISNN 2011), IEEE Computational Intelligence Society, Springer LNCS, Guilin, China, 29.05.-01.06.2011.
    18. Organisation and Chairing Special Session "Conventional, Online, and Robotic Government 2011 (CORG 2011)" with Chaudhary Imran Sarwar, 4th International Conference on Human System Interaction (HSI 2011), IEEE, Yokohama, Japan, 19.-21.05.2011.
    19. Organisation and Chairing Special Session "Conventional, Online, and Robot-Based Information Leadership" with Chaudhary Imran Sarwar, Tariq Mehmood Chaudhry, Adrian Cheok, 3rd Asian Conference on Intelligent Information and Database Systems (ACIIDS 2011), Springer LNAI, Daegu, Korea, 20.-22.04.2011.
    20. Organisation and Chairing Special Session and Challenge "INTERSPEECH 2010 Paralinguistic Challenge", Björn Schuller, Stefan Steidl, Anton Batliner, Felix Burkhardt, Laurence Devillers, Christian Müller, Shrikanth Narayanan, INTERSPEECH 2010, ISCA, Makuhari, Japan, 26.-30.09.2010.
    21. Organisation and Chairing Special Session "Recognition of Non-Prototypical Emotion from Speech - The final frontier?", Björn Schuller, Anton Batliner, Stefan Steidl, Dino Seppi, 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, 10.-12.09.2009.
    22. Organisation and Chairing Special Session and Challenge "INTERSPEECH 2009 Emotion Challenge", Björn Schuller, Stefan Steidl, Anton Batliner, INTERSPEECH 2009, ISCA, Brighton, UK, 06.-10.09.2009.
    23. Organisation Structured Session "Music Processing", DAGA 2010, 36. Deutsche Jahrestagung für Akustik, DEGA, Berlin, Germany, 15.-18.03.2010.
    24. Organisation and Chairing Structured Session "Music Processing", Björn Schuller, Armin Kohlrausch, International Conference on Acoustics (NAG/DAGA 2009), including the 35th German Annual Conference on Acoustics, Acoustical Society of the Netherlands (Nederlands Akoestisch Genootschap, NAG), DEGA, Rotterdam, The Netherlands, 23.-26.03.2009.
    25. Organisation and Chairing Structured Session "Music Processing", DAGA 2008, 34. Deutsche Jahrestagung für Akustik, DEGA, Dresden, Germany, 10.-13.03.2008.
    26. Organisation and Chairing Structured Session "Music Processing", DAGA 2007, 33. Deutsche Jahrestagung für Akustik, DEGA, Stuttgart, Germany, 19.-22.03.2007.
    27. Organisation and Chairing Structured Session "Music Processing", Björn Schuller, Meinard Müller, Frank Kurth, Michael Clausen, DAGA 2006, 32. Deutsche Jahrestagung für Akustik, DEGA, Braunschweig, Germany, 20.-23.03.2006.
    28. Organisation and Chairing Structured Session "Music Processing", Björn Schuller, DAGA 2005, 31. Deutsche Jahrestagung für Akustik, DEGA, München, Germany, 14-17.03.2005.

      Session Chairing and Doctoral Consortium Mentorship:

    1. Doctoral Consortium Mentor, 6th International AAAC Conference on Affective Computing and Intelligent Interaction 2015 (ACII 2015), Xian, PR China, 21.-25.09.2015.
    2. Chairing Session "Keynote Speech 1", 6th International AAAC Conference on Affective Computing and Intelligent Interaction 2015 (ACII 2015), Xian, PR China, 21.-25.09.2015.
    3. Chairing Sessions "Session 3 - In the wild" and "Session 4 - Final remarks", 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA 2015) held in conjunction with ACII 2015, IEEE, Xian, PR China, 21.09.2015.
    4. Chairing Session "Oral Session 2: Multimodal Fusion", 16th International Conference on Multimodal Interfaces (ICMI 2014), ACM, Istanbul, Turkey, 12.11.2014.
    5. Chairing Sessions "Emotion Detection" and "Plenary Discussion", 2nd International Workshop on “Emotion representation and modelling in Human-Computer-Interaction-Systems” (ERM4HCI 2014) held in conjunction with the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), ACM, Istanbul, Turkey, 16.11.2014.
    6. Chairing Sessions "Keynote 1" and "Session 1", The first international audio/visual Mapping Personality Traits Challenge & Workshop (MAPTRAITS 2014), held in conjunction with ACM ICMI 2014, ACM, Istanbul, Turkey, 12.11.2014.
    7. Chairing Session "Signal Processing and Machine Learning", 6th Congress of the Alps Adria Acoustics Association, AAA/AES/EAA, Austria, 16.-17.10.2014.
    8. Chairing Session "Keynote I", 5th International Workshop on Emotion Social Signals, Sentiment & Linked Open Data (ES³LOD 2014), satellite of LREC 2014, ELRA, Reykjavik, Iceland, 26.-27.05.2014.
    9. Doctoral Consortium Mentor, 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.-27.02.2014.
    10. Chairing Session "Emotion & Affect in Serious Games", 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.02.2014.
    11. Chairing Session "Keynote 2", 15th ACM International Conference on Multimodal Interaction (ICMI 2013), ACM, Sydney, Australia, 09.-13.12.2013.
    12. Chairing Session "Session 7 - Affect, Laughter, Voice", 5th biannual Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII 2013), IEEE, Geneva, Switzerland, 02.-05.09.2013.
    13. Chairing Session "SUN-1", Workshop on Measuring affect and emotion in vocal communication via acoustic feature extraction: State of the art, current research, and benchmarking, Geneva, Switzerland, 01.-02.09.2013.
    14. Chairing Session "Human-Device-Interaction", 3rd IEEE International Conference on Consumer Electronics (ICCE 2013), IEEE, Berlin, Germany, 08.-11.09.2013.
    15. Chairing Session "Speech and Audio Analysis", 6th International Non-Linear Speech Processing Workshop (NOLISP 2013), Springer LNAI, Mons, Belgium, 19.-21.06.2013.
    16. Chairing Session "Guest Talks: IDGEI @ FDG 2013", 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), ACM, SASDG Digital Library, Chania, Crete, Greece, 14.05.2013.
    17. Chairing Session "SP-L6 - Pitch Analysis", 38th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vancouver, Canada, 26.-31.05.2013.
    18. Chairing Session SLP-P3 "Paralinguistic, Nonlinguistic Information and Data Mining", 37th International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE Signal Processing Society, Kyoto, Japan, 25.-30.03.2012.
    19. Chairing Session 4 "Audio/Visual Emotion Recognition", 1st International Audio/Visual Emotion Challenge and Workshop (AVEC 2011) held in conjunction with the International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Springer LNCS, Memphis, TN, 09.10.2011.
    20. Chairing Session 9 "Varied Approaches to Affect Detection", International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Springer LNCS 6975, Memphis, TN, 09.-12.10.2011.
    21. Chairing Session 4 "Music Information Retrieval [Part 2]", AES 42nd Conference on Semantic Audio, Audio Engineering Society (AES), Ilmenau, Germany, 22.-24.07.2011.
    22. Chairing Session 2 "Audio-based affect analysis", International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE (EmoSPACE 2011), held in conjunction with the 9th International IEEE Conference on Face and Gesture Recognition 2011 (FG 2011), Santa Barbara, CA, 21.03.2011.
    23. Chairing Session 5, 4th COST 2102 International Training School on Cognitive Behavioural Systems, Jointly organized with EUCogII and SSPNet, Dresden, Germany, 21.-26.02.2011.
    24. Chairing Session Tuesday Afternoon I, The PINK COST 2102 International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, Jointly organized with the Social Signal Processing Network (NoE), Budapest, Hungary, 07.-10.09.2010.
    25. Chairing Session "Oral Session W24-5 - Extended and Multiple Emotion Corpora", 3rd International Workshop on EMOTION: Corpora for Research on Emotion and Affect, Satellite of 7th International Conference on Language Resources and Evaluation (LREC 2010), ELRA, Valletta, Malta, 23.05.2010.
    26. Chairing Session "Oral Session 4-KZ - Emotional Speech Analysis", 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009), IEEE, Amsterdam, The Netherlands, 11.09.2009.
    27. Chairing Session "SDN-TA", Conference Internationale sur Prosodie et Iconicité (ProsIco 2009), Rouen, France, 09.-10.04.2009.
    28. Chairing Session "Automatic Indexing", ICME 2004, International Conference on Multimedia and Expo, IEEE, Taipei, Taiwan, 27.-30.06.2004.
    29. Chairing Session "WA2N Human III", SMC 2002, International Conference on Systems, Man and Cybernetics, IEEE, Hammamet, Tunesia, 6.-9.10.2002.
    30. Chairing Session "Emotion Recognition (SuA3T4)", RO-MAN 2008, 17th IEEE International Symposium on Robot and Human Interactive Communication, IEEE, Munich, Germany, 01.-03.08.2008.

      Conference/Workshop Invitations as Expert:

    1. Invited Young Scientist (one of 40 extraordinary scientists under the age of 40) Annual Meeting of the New Champions 2015 (AMNC, "Summer Davos"), World Economic Forum (WEF), DaLian, P.R. China, 09.-11.09.2015.
    2. Invited Expert "Applied Signal Processing in Mental Health" Workshop, University of Southern California, Los Angeles, USA (remote access), 04.-05.05.2015.
    3. Invited Expert NII Shonan Meeting: The Future of Human-Robot Spoken Dialogue: from Information Services to Virtual Assistants, Seminar 059, Shonan Village Center, Japan, 25.–28.03.2015.
    4. Invited Expert GVA Synchronisation Workshop, CISA, Geneva, Switzerland, 04.-05.02.2015.
    5. Invited Expert Conference on “The Language of Interaction: Quantitative Tools from Engineering, Computer Science, and Clinical Psychology”, Volkswagen Foundation Heidelberg, Germany, 28.07.-01.08.2014.
    6. Invited Expert HARPS Advisory Board Meeting, Humans and Robots in Public Spaces (HARPS, EPSRC project), London, U.K., 04.12.2013.
    7. Invited Expert MASELTOV Advisory Board Meeting, MASELTOV Project (EC STREP), Rome, Italy, 12.-13.12.2012.
    8. Invited Expert BMBF-Fachgespräch Mensch-Technik-Interaktion für den Demografischen Wandel, Potsdam, Germany, 17.10.2012.
    9. Invited Expert within the Dagstuhl Seminar Multimodal Music Processing, Leibniz Zentrum für Informatik, Wadern, Germany, 23.-28.01.2011.
    10. Invited Expert within the W3C Technical Plenary / Advisory Committee Meetings Week (TPAC 2008), W3C, Cannes, France, 23.-24.10.2008.
    11. Invited Expert within the EU-funded CEICES Workshop 2006, Lehrstuhl fuer Mustererkennung (Informatik 5), Universitaet Erlangen-Nuernberg, Germany, 09.-12.12.2006.

    Awards


    Reviewing and Editorship

      Funding and Projects:

    1. Proposal Assessor King's College Cambridge Junior Research Fellowship in Physical and Chemical Sciences, Maths and Engineering, UK, since 2015.
    2. Proposal Reviewer European Research Council (ERC), Starting Grants, since 2015.
    3. Proposal Reviewer Isreal Science Foundation (ISF), since 2015.
    4. Proposal Reviewer Engineering and Physical Sciences Research Council (EPSRC), UK, since 2014.
    5. Proposal Reviewer Natural Sciences and Engineering Research Council of Canada (NSERC), Discovery Grants, since 2014.
    6. Evaluation Committee Member (Membre (Rapporteur, Lecteur) Comité d’évaluation scientifique (CES) ) Agence Nationale de la Recherche (ANR, French National Research Agency), since 2014.
    7. European Project Review Committee member Future and Emerging Technologies (FET), since 2014.
    8. Proposal Reviewer Agence Nationale de la Recherche (ANR, French National Research Agency), since 2013.
    9. Proposal Reviewer Technology Foundation STW, The Netherlands, since 2014.
    10. Proposal Reviewer Research Foundation Flanders – FWO, Belgium, since 2014.
    11. Proposal Reviewer The Royal Academy of Engineering, Research Fellowship Scheme, United Kingom, since 2014.
    12. Proposal Reviewer The Danish Council for Independent Research | Technology and Production Sciences, since 2014.
    13. Proposal Reviewer CHIST-ERA (European Coordinated Research on Long-term Challenges in Information and Communication Sciences & Technologies ERA-Net), since 2013.
    14. Proposal Reviewer 7th Framework Programme, ICT, FET-Open, European Commission (EC), since 2013.
    15. Proposal Reviewer German Academic Exchange Service (Deutscher Akademische Austauschdienst, DAAD), since 2012.
    16. Advisory and Proposal Reviewer German Federal Ministry of Education and Research (BMBF), since 2012/2014.
    17. Proposal Reviewer for The Netherlands Organisation for Scientific Research (NWO), division Physical Sciences, since 2012.
    18. Proposal Reviewer for the Portuguese Foundation for Science and Technology (FCT), since 2012.
    19. Proposal Reviewer for the US National Science Foundation (NSF), since 2012.
    20. Referee Marie Curie Individual Fellowship or Reintegration European Commission's 7th Framework Programme, since 2012.
    21. Proposal Reviewer for the German-Israeli Foundation for Scientific Research and Development (GIF), since 2012.
    22. Reviewer for Supercomputing at the Höchstleistungsrechenzentrum Stuttgart (HLRS), Germany, since 2011.
    23. Proposal Reviewer for the Swiss National Science Foundation (SNF), since 2009.

      Journal Steering and Editorship:

    1. Member of the IEEE Transactions Operations Committee, since 2014.
    2. Ex officio, non-voting member of the IEEE Publications Board, since 2014.
    3. Editor in Chief of the IEEE Transactions on Affective Computing, IEEE, 2015 - 2016. (IF: 3.466, 5-year IF: 3.871 (2013))
    4. Secretary of the Steering Committee IEEE Transactions on Affective Computing, Representative for the Computer Society, IEEE, 2009-2013. (IF: 3.466, 5-year IF: 3.871 (2013))
    5. Member of the Steering Committee IEEE Transactions on Affective Computing, Representative for the Computer Society, IEEE, 2009-2013. (IF: 3.466, 5-year IF: 3.871 (2013))
    6. Associate Editor of the IEEE Signal Processing Letters, 2014 - 2016. (IF: 1.674 (2012))
    7. Associate Editor of the IEEE Transactions on Neural Networks and Learning Systems, since 2012. (IF: 4.291 (2014))
    8. Associate Editor of the IEEE Transactions on Cybernetics (name changed in 2013 - formerly IEEE Transactions on Systems, Man and Cybernetics: Part B Cybernetics, since 2012. (IF: 2.674, 5-year IF: 3.255 (2010))
    9. Associate Editor of the IEEE Transactions on Affective Computing (TAC), IEEE, since 2011. (IF: 3.466, 5-year IF: 3.871 (2013))
    10. Associate Editor of the Computer Speech and Language, ELSEVIER, since 2011.
    11. Editorial Board Member of PeerJ Computer Science, PeerJ, since 2014.
    12. Editorial Board Member of the Scientific World Journal (Signal Processing subject area), Hindawi Publishing Corporation, 2013-2015. (IF: 1.730 (2012))
    13. Editorial Board Member ISRN Artificial Intelligence, Hindawi Publishing Corporation, since 2011.
    14. Advisory Editor of the Cognitive Processing - International Quarterly of Cognitive Science, Springer, since 2013. (IF: 1.567 (2011))
    15. Guest Editor of the Special Issue on "Multimodal Sentiment Analysis and Mining in the Wild", Mohammad Soleymani, Björn Schuller, Shih-Fu Chang, Image and Vision Computing Journal, Elsevier, 2016. (IF: 1.587, 5-year IF: 2.384 (2014))
    16. Guest Editor of the Special Issue on "New Avenues in Knowledge Bases for Natural Language Processing", Erik Cambria, Björn Schuller, Yunqing Xia, Bebo White, Knowledge-Based Systems, Elsevier, 2016. (IF: 3.058, 5-year IF: 2.920 (2013))
    17. Lead Guest Editor of the Special Issue on "Atypical Speech and Voices: Corpora, Classification, Coaching and Conversion", Björn Schuller, Tiago H. Falk, Vijay Parsa, Elmar Nöth, EURASIP Journal on Audio, Speech, and Music Processing, SpringerOpen, 2015. (IF: 0.630 (2012))
    18. Guest Editor of the Special Issue on "Best of ICMI", Albert Ali Salah, Jeff Cohn, Björn Schuller, Oya Aran, Louis-Philippe Morency, Philip R. Cohen, ACM Transactions on Interactive Intelligent Systems, ACM, 2015.
    19. Guest Editor of the Special Issue on "Affective Neural Networks and Cognitive Learning Systems for Big Data Analysis", Erik Cambria, Amir Hussain, Björn Schuller, Newton Howard, Neural Networks, ELSEVIER, 2013. (IF: 2.182, 5-year IF: 2.477 (2012))
    20. Managing Guest Editor of the Special Issue on "Next Generation Computational Paralinguistics", Björn Schuller, Stefan Steidl, Anton Batliner, Alessandro Vinciarelli, Felix Burkhardt, Rob van Son, Computer Speech and Language, ELSEVIER, 2013. (IF: 1.353, 5-year IF: 1.489 (2010))
    21. Guest Editor Special Issue on Concept-Level Opinion and Sentiment Analysis", Erik Cambria, Björn Schuller, Bing Liu, Haixun Wang, Catherine Havasi, IEEE Intelligent Systems Magazine, IEEE, 2012. (IF: 2.570, 5-year IF: 2.632 (2010))
    22. Managing Guest Editor of the Special Issue on "Broadening the View on Speaker Analysis", Björn Schuller, Stefan Steidl, Anton Batliner, Florian Schiel, Jarek Krajewski, Computer Speech and Language, ELSEVIER, 2012. (IF: 1.353, 5-year IF: 1.489 (2010))
    23. Guest Editor of the Special Issue on "Affect Analysis in Continuous Input", Hatice Gunes, Björn Schuller, Image and Vision Computing (IMAVIS), ELSEVIER, 2011. (IF: 1.525, 5-year IF: 1.840 (2010))
    24. Managing Guest Editor of the Special Issue on "Paralinguistics in Naturalistic Speech and Language", Björn Schuller, Stefan Steidl, Anton Batliner, Computer Speech and Language, ELSEVIER, 2011.
    25. Managing Guest Editor of the Special Issue on "Sensing Emotion and Affect - Facing Realism in Speech Processing", Björn Schuller, Stefan Steidl, Anton Batliner, Speech Communication, ELSEVIER, 2011.
    26. Lead Guest Editor of the Special Issue on "Naturalistic Affect Resources for System Building and Evaluation", Björn Schuller, Ellen-Douglas Cowie, Anton Batliner, IEEE Transactions on Affective Computing, IEEE, 2011. (IF: 3.466, 5-year IF: 3.871 (2013))
    27. Guest Editor of the Special Issue on "Cognitive and Emotional Information Processing for Human-Machine Interaction", Stefano Squartini, Amir Hussain, Björn Schuller, Cognitive Computation, Springer, 2011. (IF: 1.000 (2011))
    28. Guest Editor of the Special Issue on "Emotion and Mental State Recognition from Speech", Julien Epps, Roddy Cowie, Shrikanth Narayanan, Björn Schuller, Jianhua Tao, EURASIP Journal on Advances in Signal Processing, SpringerOpen, 2011. (IF: 1.012, 5-Year IF: 1.136 (2010))

      Journal Reviewing:

    1. Journal Reviewer Traitement Automatique des Langues (TAL), Association pour le Traitement Automatique des Langues (ATALA), since 2015.
    2. Journal Reviewer Applied Computing and Informatics, Elsevier, since 2015.
    3. Journal Reviewer ISA Transactions: The Journal of Automation, Elsevier, ISA, since 2015. (IF: 2.984, 5-year IF: 2.815 (2014))
    4. Journal Reviewer Knowledge-Based Systems, Elsevier, since 2015. (IF: 3.058, 5-year IF: 2.920 (2013))
    5. Journal Reviewer Neural Processing Letters (NEPL), Springer, since 2015. (IF: 1.448 (2014))
    6. Journal Reviewer ETRI Journal, Electronics and Telecommunications Research Institute, since 2015. (IF: 0.945 (2013))
    7. Journal Reviewer Psychophysiology, The International Journal of the Society for Psychophysiological Research, Wiley, since 2015. (IF: 3.18 (2013))
    8. Journal Reviewer Machine Learning, Springer, since 2015. (IF: 1.467 (2012))
    9. Journal Reviewer Applied Mathematical Modelling (APM), Elsevier, since 2015. (IF: 2.158, 5-year IF: 2.195 (2013))
    10. Journal Reviewer ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), ACM, since 2015. (IF: 0.90, 5-year IF: 1.59 (2013))
    11. Journal Reviewer International Journal of Computer Systems Science and Engineering, CRL Publishing, since 2015.
    12. Journal Reviewer The World Journal of Biological Psychiatry, World Federation of Societies of Biological Psychiatry (WFSBP), since 2014. (IF: 4.225 (2013))
    13. Journal Reviewer Expert Systems With Applications, Elsevier, since 2014. (IF: 1.965, 5-year IF: 2.254 (2013))
    14. Journal Reviewer Applied Soft Computing, Elsevier, since 2014. (IF: 2.679, 5-year IF: 2.970 (2013))
    15. Journal Reviewer International Journal of Speech Technology, Springer, since 2014.
    16. Journal Reviewer IEEE Transactions on Signal Processing, IEEE, since 2014. (IF: 3.198 (2013))
    17. Journal Reviewer IEEE Transactions on Mechatronics, IEEE, since 2014. (IF: 3.652 (2013))
    18. Journal Reviewer Behavior Research Methods, Springer, since 2014. (IF: 2.458 (2013))
    19. Journal Reviewer Learning and Individual Differences Journal of Psychology and Education, Elsevier, since 2014. (IF: 1.565, 5-year IF: 2.158 (2013))
    20. Journal Reviewer International Journal of Human-Computer Studies, Elsevier, since 2014. (IF: 1.165, 5-year IF: 1.942 (2013))
    21. Journal Reviewer International Journal of Communication Systems, Wiley, since 2014. (IF: 1.106 (2013))
    22. Journal Reviewer IEEE Transactions on Knowledge and Data Engineering, since 2014. (IF: 1.892 (2012))
    23. Journal Reviewer Autism Research, INSAR, Wiley, since 2014. (IF: 3.988 (2012))
    24. Journal Reviewer Neural Computing and Applications (NCAA), Springer, since 2014. (IF: 1.168 (2012))
    25. Journal Reviewer Connection Science, Taylor and Francis, since 2014. (IF: 0.706 (2012))
    26. Journal Reviewer IEEE Transactions on Information Forensics & Security, IEEE, since 2014. (IF: 1.895 (2013))
    27. Journal Reviewer International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing, since 2014. (IF: 3.139 (2010))
    28. Journal Reviewer Information Processing & Management, Elsevier, since 2014. (IF: 0.817, 5-year IF: 1.388 (2013))
    29. Journal Reviewer Proceedings of the National Academy of Sciences, India Section A: Physical Sciences, Springer, since 2014. (IF: 0.171 (2012))
    30. Journal Reviewer Journal of Zhejiang University Science C (Computers & Electronics), since 2014.
    31. Journal Reviewer APSIPA Transactions on Signal and Information Processing, Cambridge University Press, since 2013.
    32. Journal Reviewer IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS), IEEE, since 2013.
    33. Journal Reviewer Revue d'intelligence artificielle (RIA), Lavoisier, since 2013.
    34. Journal Reviewer Biomedical Engineering/Biomedizinische Technik, deGruyter, since 2013. (IF: 1.157 (2012))
    35. Journal Reviewer SpringerPlus, Springer, since 2013.
    36. Journal Reviewer Molecular Autism (MA), BioMed Central / Springer, since 2013.
    37. Journal Reviewer Computational Intelligence Magazine (CIM), IEEE, since 2013. (IF:4.629 (2012))
    38. Journal Reviewer Computers in Biology and Medicine (CBM), Elsevier, since 2013. (IF: 1.162, 5-year IF: 1.359 (2012))
    39. Journal Reviewer Pattern Recognition (PR), Elsevier, since 2013. (IF: 2.632, 5-year IF: 3.219 (2012))
    40. Journal Reviewer Psychological Science, Association for Psychological Science (aps), SAGE, since 2013. (IF: 4.431 (2012))
    41. Journal Reviewer International Journal of Social Robotics (IJSR), Springer, since 2013.
    42. Journal Reviewer Acta Astronautica (AA), Academy of Astronautics, Elsevier, since 2013. (IF: 0.614, 5-year IF: 0.619 (2012))
    43. Journal Reviewer Journal of Intelligent Decision Technologies (IDT), IOS Press, since 2013.
    44. Journal Reviewer TELKOMNIKA Indonesian Journal of Electrical Engineering, IAES, since 2013.
    45. Journal Reviewer Molecular Psychiatry, Nature, since 2012. (IF: 15.470, 5-year IF: 13.253 (2010))
    46. Journal Reviewer Biological Psychiatry, Elsevier, since 2012. (IF: 8.283, 5-year IF: 9.247 (2011))
    47. Journal Reviewer PLOS ONE, Public Library of Science (PLOS), since 2012. (IF:4.092 (2011))
    48. Journal Reviewer IEEE Transactions on Information Technology in BioMedicine (TITB), IEEE, since 2012. (IF: 1.707, 5-year IF: 1.953 (2010))
    49. Journal Reviewer Digital Signal Processing (DSP), Elsevier, since 2012. (IF: 1.435, 5-year IF: 1.633 (2011))
    50. Journal Reviewer Artificial Intelligence in Medicine (AIIM), Elsevier, since 2012. (IF: 1.568, 5-year IF: 1.891 (2010))
    51. Journal Reviewer Computer Methods and Programs in Biomedicine (CMPB), Elsevier, since 2012. (IF: 1.238, 5-year IF: 1.402 (2010))
    52. Journal Reviewer Psychological Methods, American Psychological Association (APA), since 2012. (IF: 3.186 (2010))
    53. Journal Reviewer International Journal of Multimedia Information Retrieval, Springer, since 2012.
    54. Journal Reviewer Signal, Image and Video Processing Journal, Springer, since 2012. (IF: 0.617 (2010))
    55. Journal Reviewer Language Resources and Evaluation (LREV), Springer, since 2012. (IF: 0.615, 5-year IF: 0.683 (2010))
    56. Journal Reviewer Behaviour & Information Technology (BIT), Taylor and Francis, since 2012. (IF: 0.835, 5-year IF: 1.426 (2010))
    57. Journal Reviewer Journal of Applied Mathematics, Hindawi, since 2012. (IF: 0.630 (2010))
    58. Journal Reviewer Archives of Acoustics - A Quaterly Journal, Polish Academy of Sciences, since 2012. (IF: 0.504 (2010))
    59. Journal Reviewer International Journal of Distance Education Technologies (IJDET), IGI Gloabl, since 2012.
    60. Journal Reviewer International Journal of Advanced Robotic Systems, INTECH, since 2012. (IF: 0.375 (2012))
    61. Journal Reviewer IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), IEEE, since 2011. (IF: 5.027, 5-year IF: 7.228 (2010))
    62. Journal Reviewer IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), IEEE, since 2011. (IF: 1.847, 5-year IF: 2.837 (2010))
    63. Journal Reviewer IEEE Transactions on Intelligent Transportation Systems (T-ITS), IEEE, since 2011. (IF: 2.234, 5-year IF: 2.748 (2010))
    64. Journal Reviewer Sensors, MDPI, since 2011. (IF: 1.771, 5-year IF: 1.917 (2010))
    65. Journal Reviewer Journal of Multimedia (JMM), Academy Publisher, since 2011.
    66. Journal Reviewer ISRN Signal Processing, Hindawi Publishing Corporation, since 2011.
    67. Journal Reviewer Interacting with Computers (IWC), Elsevier, since 2011. (IF: 1.698 (2010))
    68. Journal Reviewer International Journal of Electronics and Communications (AEUE), Elsevier, since 2011. (IF: 0.508 5-year IF: 0.497 (2010))
    69. Journal Reviewer Acta Acustica united with Acustica (AAA), European Acoustics Association, S. Hirzel Verlag, since 2011. (IF: 0.552, 5-year IF: 0.744 (2010))
    70. Journal Reviewer ACM Transactions on Information Systems (ToIS), ACM, since 2011. (IF: 1.085, 5-year IF: 2.214 (2010))
    71. Journal Reviewer Journal on Multimodal User Interfaces (JMUI), Springer, since 2011. (IF: 0.833 (2012))
    72. Journal Reviewer Cognitive Processing (COGPRO), Springer, since 2011.
    73. Journal Reviewer ACM Transactions on Intelligent Systems and Technology (TIST), ACM, since 2011.
    74. Journal Reviewer Künstliche Intelligenz (KUIN, German Journal on Artificial Intelligence), Gesellschaft für Informatik e.V., Springer, since 2011.
    75. Editorial Board Member International Journal of Computer Vision & Signal Processing (IJCVSP), since 2011.
    76. Jorunal Reviewer Songklanakarin Journal of Science and Technology, Prince of Songkla University, since 2011.
    77. Journal Reviewer ACM Transactions on Interactive Intelligent Systems (TiiS), ACM, since 2010.
    78. Journal Reviewer Cognitive Computation (COGN), Springer, since 2010. (IF: 1.000 (2011))
    79. Journal Reviewer ACM Transactions on Speech and Language Processing (TSLP), ACM, since 2010.
    80. Journal Reviewer International Journal of Radio Frequency Identification Technology and Applications (IJRFITA), Inderscience, since 2010.
    81. Journal Reviewer User Modeling and User-Adapted Interaction: The Journal of Personalization Research (UMUAI), Springer, since 2010. (IF: 2.345, 5-year IF: 2.942 (2009))
    82. Journal Reviewer IEEE Transactions on Affective Computing (TAC), IEEE, since 2010. (IF: 3.466, 5-year IF: 3.871 (2013))
    83. Journal Reviewer Scientific Research and Essays (SRE), AcademicJournals, since 2010. (IF: 0.324, 5-year IF: 0.378 (2009))
    84. Journal Reviewer IEEE Journal of Selected Topics in Signal Processing, IEEE, since 2009. (IF: 1.200 (2009))
    85. Journal Reviewer IEEE Signal Processing Letters, IEEE, since 2009. (IF: 1.173, 5-year IF: 1.537 (2009))
    86. Journal Reviewer IEEE Transactions on Multimedia, IEEE, since 2009. (IF: 1.822, 5-year IF: 2.372 (2009))
    87. Journal Reviewer Journal of New Music Research, Taylor & Francis, since 2009. (IF: 0.521, 5-year IF: 0.760 (2009))
    88. Journal Reviewer Advances in Human-Computer Interaction (AHCI), Hindawi Publishing Corporation, New York, NY, since 2009.
    89. Journal Reviewer Computer Speech and Language (CSL), ELSEVIER, since 2008. (IF: 1.413, 5-year IF: 1.165 (2008))
    90. Journal Reviewer Pattern Recognition Letters (PatRec), ELSEVIER, since 2008. (IF: 1.303, 5-year IF: 1.772 (2009))
    91. Journal Reviewer Signal Processing (SIGPRO), ELSEVIER, since 2008. (IF: 1.135, 5-year IF: 1.283 (2009))
    92. Journal Reviewer Image and Vision Computing Journal (IVCJ), ELSEVIER, since 2008. (IF: 1.474, 5-year IF: 1.767 (2009))
    93. Journal Reviewer Neurocomputing, ELSEVIER, since 2008. (IF: 1.440, 5-year IF: 1.459 (2009))
    94. Journal Reviewer International Journal of Computers and Applications (IJCA), Int. Society for Computers and their Application (ISCA), ACTA Press, since 2008.
    95. Editorial Review Board Member International Journal of Synthetic Emotions (IJSE), IGI Global, since 2008.
    96. Journal Reviewer International Journal of Pattern Recognition and Artificial Intelligence (IJPRAI), World Scientific Publishing, since 2007. (IF: 0.512, 5-year IF: 0.818 (2009))
    97. Journal Reviewer EURASIP Journal on Audio, Speech, and Music Processing (JASMP), European Association for Signal Processing, SpringerOpen, since 2007. (IF: 0.709 (2011))
    98. Journal Reviewer IEEE Transactions on Systems, Man, and Cybernetics - Part B-Cybernetics, IEEE, since 2007. (IF: 3.007, 5-year IF: 3.513 (2009))
    99. Journal Reviewer Speech Communication, ELSEVIER, EURASIP, ISCA, since 2006. (IF: 1.196, 5-year IF: 1.327 (2009))
    100. Journal Reviewer IEEE Transactions on Audio, Speech, and Language Processing (TASLP), IEEE Signal Processing Society, since 2005. (IF: 1.782, 5-year IF: 1.946 (2009))
    101. Journal Reviewer EURASIP Journal on Advances in Signal Processing (JASP), European Association of Speech, Signal and Image Processing, SpringerOpen, since 2005. (IF: 1.012, 5-Year IF: 1.136 (2010))

      Book Reviewing:

    1. Book Proposal Reviewer, Morgan Kaufmann/Elsevier, since 2015.
    2. Book Chapter Reviewer, Handbook of Affective Computing, Rafael A. Calvo, Sidney D’Mello, Jonathan Gratch, Arvid Kappas (eds.), Oxford University Press, 2013.
    3. Book Chapter Reviewer, Dagstuhl Follow Ups Multimodal Music Processing, Meinard Müller, Masataka Goto (eds.), 2012.
    4. Book Proposal Reviewer, Wiley, since 2010.
    5. Book Chapter Reviewer, Multimedia Information Extraction, Mark Maybury (ed.), IEEE Computer Society Press, 2010.
    6. Book Chapter Reviewer, The Phonetics of Laughing, Jürgen Trouvain, Nick Campbell (ed.), Trends in Linguistics, Mouton de Gruyter, Berlin and New York, 2009.

      PhD Thesis Reviewing:

    1. Habilitation Thesis Rapporteur, Matthieu Geist: "Contrôle optimal et apprentissage automatique, applications aux interactions homme-machine", Université de Lille 1, Lille, France, 2015.
    2. Doctoral Thesis Examiner (Zweitgutachter), Johannes Wagner: "Social Signal Interpretation: Building Online Systems for Multi-modal Behaviour Analysis", Augsburg University, Augsburg, Germany,
    3. Doctoral Thesis Rapporteur, Fan Yang: "Détection de marqueurs affectifs et attentionnels de personnes âgées en interaction avec un robot", Université Paris-Saclay, Paris, France, 2015.
    4. Doctoral Thesis Rapporteur, Baveye Yoann: "Automatic Prediction of Emotions Induced by Movies", Ecole Centrale de Lyon/Technicolor, Lyon, France, 2015.
    5. Doctoral Thesis Internal Examiner, Michael (Mihalis) A. Nicolaou: "Machine Learning for Automatic Analysis of Affective Behaviour", Imperial College London, London, UK, 2014.
    6. Opponent PhD dissertation, Pasi Saari: "Content and Context-based Approaches to Prediction of Mood in Music", University of Jyväskylä, Jyväskylä, Finland, 2014.
    7. Doctoral Thesis Pre-Reviewer, Jouni Pohjalainen: "Robust Feature Extraction of Speech", Aalto University, Aalto, Finland, 2014.
    8. Doctoral Thesis Internal Examiner, Jie Shen: "Synchronisation and integration of modules for audiovisual behaviour understanding", Imperial College London, London, UK, 2014.
    9. Doctoral Thesis Transfer Examinator, Christos Georgakis: "Visual detection of native/non-native speakers", Imperial College London, London, UK, 2014.
    10. Doctoral Thesis Rapporteur, Clément Chastagnol: "Reconnaissance automatique des dimensions affectives dans l’interaction orale homme-machine pour des personnes dépendantes", Université Paris 11, Paris, France, 2013.
    11. Doctoral Thesis Examinateur, Gelareh Mohamed: "Automatic Personality Perception: Inferring Personality Traits from Nonverbal Vocal Behavior", EPFL, Lausanne, Switzerland, 2013.
    12. Doctoral Thesis Examiner (Zweitgutachter), Christian Plahl: "Neural Network based Feature Extraction for Speech and Image Recognition", RWTH Aachen, Aachen, Germany, 2013.
    13. PhD Thesis Examiner Seliz Gülsen Karadogan: "Towards Cognizant Hearing Aids: Modeling of Content, Affect and Attention", Technical University of Denmark, Lyngby, 2012.
    14. PhD Thesis Rapporteur Christophe Vaudable: "Analyse et reconnaissance des émotions lors de conversations de centres d’appels", Université Paris 11, Paris, France, 2012.
    15. PhD Thesis Examinator Tet Fei Yap: "Speech production under cognitive load: Effects and classification", University of New South Wales, Australia, 2011.
    16. PhD Thesis Examinateur Thibaud Senechal: "Ce que le visage révèle : Analyse des mouvements faciaux pour l’interprétation émotionnelle", Université Pierre et Marie Curie – Paris 6, Paris, France, 2011.
    17. PhD Thesis Examinateur Fabien Ringeval: "Ancrages et modèles dynamiques de la prosodie : application à la reconnaissance des émotions actées et spontanées", Université Pierre et Marie Curie – Paris 6, Paris, France, 2011.
    18. PhD Thesis Examinator Gordon James McIntyre: "The Computer Analysis of Facial Expressions: On the Example of Depression and Anxiety", Faculty of Information Sciences & Engineering, University of Canberra, Canberra, Australia, 2010.
    19. PhD Thesis Examinator Julia Sidorova: "Optimization Techniques for Speech Emotion Recognition", Department of Translation and Language Sciences, Universitat Pompeu Fabra, Barcelona, Spain, 2009.

      Conference Reviewing:

    1. Reviewer 41st International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Shanghai, P.R. China, 20.–25.03.2016.
    2. Reviewer 4th International Workshop on Biometrics and Forensics (IWBF 2016), IEEE, Limassol, Cyprus, 03.-04.03.2016.
    3. Reviewer International Conference on Multimedia and Expo (ICME 2016), IEEE, Seattle, WA, 11.-15.07.2016.
    4. Reviewer International Conference on Machine Learning and Signal Processing (MALSIP 2015), Springer, Melaka, Malaysia, 15.-17.12.2015.
    5. Reviewer 2016 International Joint Conference on Neural Networks (IJCNN 2016), Vancouver, Canada, IEEE, 25.-29.07.2016.
    6. Reviewer Affective Social Multimedia Computing 2015 (ASMMC), workshop at ACII 2015, IEEE, XiAn, P.R. China, 21.-24.09.2015.
    7. Reviewer 60th AES International Conference, AES, Leuven, Belgium, 03.-05.02.2016.
    8. Reviewer 17th ACM International Conference on Multimodal Interaction (ICMI 2015), ACM, Seattle, WA, 09.-13.11.2015.
    9. Reviewer 16th International Society for Music Information Retrieval Conference (ISMIR 2015), ISMIR, Malaga, Spain, 26.-30.10.2015.
    10. Reviewer of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015), ACM, Osaka, Japan, 07.-11.09.2015.
    11. Reviewer of the 18th International Conference on Text, Speech and Dialogue (TSD 2015), Springer LNCS/LNAI, Plzen, Czech Republic, 14.-17.09.2015.
    12. Reviewer Southern Management Association Meeting (SMA 2015), SMA, St. Pete Beach, FL, 27.-31.10.2015.
    13. Reviewer of the 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2015), IEEE, Kobe, Japan, 31.08.-03.09.2015.
    14. Reviewer 4th International Conference on Informatics, Electronics & Vision (ICIEV 2015), IEEE, Kitakyushu, Japan, 15.-17.06.2015.
    15. Reviewer International Joint Conference on Neural Networks (IJCNN 2015), INNS/IEEE, Killarney, Ireland, 12.-17.07.2015.
    16. Reviewer 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2015, IEEE, Sydney, Australia, 19.–24.04.2015.
    17. Reviewer 11th IEEE International Conference on Automatic Face and Gesture Recognition 2015 (FG 2015), IEEE, Ljubljana, Slovenia, 04.-08.05.2015.
    18. Reviewer 11th ITG Conference on Speech Communication, ITG, IEEE, Erlangen, Germany, 24.-26.09.2014.
    19. Reviewer 15th International Society for Music Information Retrieval Conference (ISMIR 2014), ISMIR, Taipei, Taiwan, 27.-31.10.2014.
    20. Reviewer of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2014), IEEE, Edinburgh, UK, 25.-29.08.2014.
    21. Referee 23rd IEEE International Symposium on Robot and Human Interactive Communication, IEEE, Edinburgh, UK, 25.-29.08.2014.
    22. Reviewer Southern Management Association Meeting (SMA 2014), SMA, Savannah, GA, 11.-15.11.2014.
    23. Referee 22nd International Conference on Pattern Recognition (ICPR 2014) (Track 4: Document Analysis, Biometrics and Pattern Recognition Applications), IAPR, Stockholm, Sweden, 24.-28.08.2014.
    24. Reviewer 2014 IEEE International Conference on Robotics and Automation (ICRA 2014), IEEE, Hong Kong, China, 31.05.-05.06.2014.
    25. Reviewer 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014), Gothenburg, Sweden, 26.–30.04.2014.
    26. Reviewer ICME 2014 Workshop on Multimedia Affective Computing (MAC 2014), held in conjunction with the IEEE International Conference on Multimedia and Expo (ICME 2014), IEEE, Chengdu, China, 14.-18.07.2014.
    27. Reviewer "Science Behind the AVATAR" Workshop, Homeland Security, Tucson, AZ, 5.-7.11.2013.
    28. Reviewer Doctoral Consortium 5th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2013 (ACII 2013), IEEE/HUMAINE Association, Geneva, Switzerland, 02.-05.09.2013.
    29. Reviewer IEEE Fifth Computer Science and Electronic Engineering Conference 2013 (CEEC 2013), IEEE, Essex, U.K., 17.-18.09.2013.
    30. Reviewer 2013 IEEE Conference on Clean Energy and Technology (CEAT 2013), IEEE, Langkawi, Malaysia, 18.-20.11.2013.
    31. Reviewer 16th International Conference on Text, Speech and Dialogue (TSD 2013), ISCA, Plzen, Czech Republic, 01.-05.09.2013.
    32. Reviewer IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2013), IEEE, Tokyo, Japan, 03.-07.11.2013.
    33. Reviewer 14th International Society for Music Information Retrieval Conference (ISMIR 2013), ISMIR, Curitiba, Brasil, 04.-08.11.2013.
    34. Reviewer of the 22nd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2013), IEEE, Gyeongju, Korea, 26.-29.08.2013.
    35. Reviewer 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2013), ACM SIGCHI, Munich, Germany, 27.-30.08.2013.
    36. Reviewer ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), ACM, Paris, France, 27.04.-02.05.2013.
    37. Reviewer 9th International Workshop on Systems, Signal Processing and their Applications (WOSSPA 2013),IEEE/EURASIP, Mazafran, Algeria, 12.-15.05.2013.
    38. Reviewer 4th International Conference on Intelligent Human Computer Interaction (ICHI 2012), IEEE, Kharagpur, India, 27.-29.12.2012.
    39. Reviewer 11th Biannual Conference of the German Cognitive Science Society (KogWis 2012), Bamberg, Germany, 30.09.-03.10.2012.
    40. Reviewer 10th ITG Conference on Speech Communication, ITG, IEEE, Braunschweig, Germany, 26.-28.09.2012.
    41. Reviewer ACM 14th International Conference on Multimodal Interfaces (ICMI 2012), ACM, Santa Monica, CA, 22.-26.10.2012.
    42. Reviewer 20th European Signal Processing Conference 2012 (EUSIPCO 2012), EURASIP, Bucharest, Romania, 27.08.-31.08.2012.
    43. Reviewer IEEE/RSJ International Conference on Intelligent RObots and Systems (IROS 2012), IEEE, Vilamoura, Portugal, 07.-12.10.2012.
    44. Reviewer 11th International Conference on Information Sciences, Signal Processing and their Applications (ISSPA), IEEE, Montral, QC, 03.-05.07.2012.
    45. Reviewer 2012 International Conference on Intelligent Computing (ICIC 2012), IEEE, Springer LNCS, Huangshan, China, 25.-29.07.2012.
    46. Reviewer INTERSPEECH 2012, Portland, OR, USA, 09.-13.09.2012.
    47. Reviewer Conference on Empirical Methods in Natural Language Processing (EMNLP 2012), ACL, Jeju, South Korea, 12.-14.07.2012.
    48. Reviewer 2012 International Conference on Intelligent User Interfaces (IUI 2012), ACM, SIGCHI, Lisbon, Portugal, 14.-17.02.2012.
    49. Reviewer 2012 IEEE International Conference on Robotics and Automation (ICRA 2012), IEEE, RiverCentre, Saint Paul, Minnesota, USA, 14.-18.05.2012.
    50. Reviewer 37th International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE Signal Processing Society, Kyoto, Japan, 25.-30.03.2012.
    51. Reviewer 4th COST 2102 International Training School on Cognitive Behavioural Systems, Jointly organized with EUCogII and SSPNet, Dresden, Germany, 21.-26.02.2011.
    52. Reviewer 2011 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2011), IEEE, Big Island, Hawaii, 11.-15.12.2011.
    53. Reviewer 13th International Conference on Multimodal Interaction (ICMI 2011), ACM, Alicante, Spain, 14.-18.11.2011.
    54. Reviewer 2nd International Conference on Computer & Communication Technology (ICCCT 2011), IEEE, Allahabad, India, 15.-17.09.2011.
    55. Reviewer 14th International Conference on Text, Speech and Dialogue (TSD 2011), ISCA, Plzen, Czech Republic, 01.-05.09.2011.
    56. Reviewer IEEE/RSJ International Conference on Intelligent RObots and Systems (IROS 2011), IEEE, San Francisco, CA, USA, 25.-30.09.2011.
    57. Reviewer IEEE International Conference on Systems, Man, and Cybernetcis (SMC 2011), Special Session "Social Signal Processing", IEEE, Anchorage, Alaska, USA, 09.-12.10.2011.
    58. Reviewer 12th International Society for Music Information Retrieval Conference (ISMIR) 2011, ISMIR, Miami, FL, USA, 24.-28.10.2011.
    59. Reviewer The PINK COST 2102 International Conference on Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issues, Jointly organized with the Social Signal Processing Network (NoE), Budapest, Hungary, 07.-10.09.2010.
    60. Reviewer 17th International Conference on Digital Signal Processing (DSP 2011), IEEE, EURASIP, Corfu, Greece, 06.-08.07.2011.
    61. Reviewer 33rd International Conference on Information Technology Interfaces (ITI 2011), Dubrovnik, Croatia, 27.-30.06.2011.
    62. Reviewer AES 42nd Conference on Semantic Audio, Audio Engineering Society (AES), Ilmenau, Germany, 22.-24.07.2011.
    63. Reviewer 19th European Signal Processing Conference 2011 (EUSIPCO 2011), EURASIP, Barcelona, Spain, 29.08.-02.09.2011.
    64. Reviewer INTERSPEECH 2011, ISCA, Florence, Italy, 28.-31.08.2011.
    65. Reviewer IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP) 2011, IEEE, Prague, Czech Republic, 22.-27.05.2011.
    66. Reviewer 12th International Conference on Multimodal Interfaces and 7th Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010), ACM, Beijing, China, 08.-12.11.2010.
    67. Reviewer 11th International Society for Music Information Retrieval Conference (ISMIR) 2010, ISMIR, Utrecht, The Netherlands, 09.-13.08.2010.
    68. Reviewer INTERSPEECH 2010, ISCA, Makuhari, Japan, 26.-30.09.2010.
    69. Reviewer IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2010), IEEE, Dallas, TX, 14.-19.03.2010.
    70. Reviewer ICMI-MLMI 2009, The 11th International Conference on Multimodal Interfaces and The Sixth Workshop on Machine Learning for Multimodal Interaction, ACM SIGCHI, Cambridge, MA, 02-06.11.2009.
    71. Reviewer INTERSPEECH 2009, ISCA, Brighton, UK, 06.-10.09.2009.
    72. Reviewer ICME 2009, IEEE International Conference on Multimedia and Expo, IEEE, New York, NY, 28.06. - 03.07.2009.
    73. Reviewer IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2009), IEEE, Taipei, Taiwan, 19.-24.04.2009.
    74. Reviewer ICMI 2008, The 10th International Conference on Multimodal Interfaces, Special Session Social Signal Processing, ACM, IEEE, Chania, Greece, 20-22.10.2008.
    75. Reviewer ICMI 2008, The 10th International Conference on Multimodal Interfaces, ACM, IEEE, Chania, Greece, 20-22.10.2008.
    76. Reviewer INTERSPEECH 2008, ISCA, Brisbane, Australia, 22.-26.09.2008.
    77. Reviewer ICMI 2007, The 9th International Conference on Multimodal Interfaces, ACM, SIGCHI, Nagoya, Japan, 12.-15.11.2007.
    78. Reviewer ICPR 2006, The 18th International Conference on Pattern Recognition, IAPR, Hong Kong, China, 20.-24.08.2006.

    Memberships and Listings


    Visitors and Supervised Theses

    If interested, please contact me.

      Visiting Researchers

    1. Prof. Haifeng Li (Visiting Professor at TUM, 01-02/2012, 10-12/2013, Harbin Institute of Technology, Harbin/China)
    2. Ass. Prof. Stefano Squartini (Visiting ERASMUS lecturer at TUM, 09/2012, Università Politecnica delle Marche, Ancona, Italy)
    3. Dr. Jouni Pohjalainen (Visiting Postdoctoral Reseacher at University of Passau, 10/2015-12/2015, Aalto University, Aalto, Finland): robust short-term features and long-term modeling methods
    4. Dr. Hua (Maggie) Zong (Visiting CSC lecturer at TUM, 02/2014-02/2015, Harbin Institute of Technology, Harbin/China): Radar Signal Analysis
    5. Dr. Shaowei Fan (Visiting CSC lecturer at TUM, 02/2014-02/2015, Harbin Institute of Technology, Harbin/China): Hand Control for Robotics
    6. Dr. Anton Batliner (04-09/2012, Visiting Senior Scientist at TUM, Friedrich-Alexander Universität, Erlangen/Germany): Autism Spectrum Condition and Children's Speech
    7. Dr. Silvia Monica Feraru (Visiting Postdoctoral Researcher at TUM, 12/2011-02/2012, Technical University Iasi, Iasi/Romania): Analysis, Identification and Classification of Emotional Expressiveness for the Romanian Language
    8. Mr. Ramon Reyes (Visiting Doctoral Student at TUM, 10-12/2014, Instituto Tecnológico de Orizaba, Mexico): Developping an augmented reality mannequin for simulating an hemorrhage
    9. Mrs. Mª Inmaculada Mohíno Herranz (Visiting Doctoral Student at TUM, 08-10/2014, University of Alcalá, Madrid/Spain): Emotion recognition through analysis of biological signals, including EKG, EEG, thoracic impedance, galvanic skin response, temperature and speech
    10. Mr. Xinzhou Xu (Visiting Doctoral Student at TUM, 10/2014-10/2016, Southeastern University/P.R. China): Speech Emotion Recognition using Nonlinear Dimensionality Reduction Methods
    11. Ms. Paula López Otero (Visiting Doctoral Researcher at TUM, 01-04/2014, Universida de Vigo/Spain): Emotion Recognition in Speech
    12. Mr. Wei Zhang (Visiting Doctoral Researcher at TUM, 10-12/2013, Harbin Institute of Technology, Harbin/China): Audio/visual Violence Detection in Movies
    13. Mr. Rui Xia (Visiting Doctoral Researcher at TUM, 09-10/2013, University of Texas at Dallas/USA): Recent Topics in Speech Emotion Recognition
    14. Mr. Heysem Kaya (Visiting Doctoral Researcher at TUM, 08-10/2013, Bogaziçi University/Turkey): Adaptive Mixture Models for Speech Emotion Recognition
    15. Mr. Antti Hurmalainen (Visiting Doctoral Researcher at TUM, 12/2012, Tampere University of Technology, Tampere/Finland): Audio Source Separation
    16. Mrs. Aldona Rosner (Visiting Doctoral Student at TUM, since 11/2012, Silesian University of Technology, Gliwice/Poland): Advanced Music Genre Recognition
    17. Ms. Wenjing Han (Visting Doctoral Student at TUM, Harbin Institute of Technology, Harbin/China, 08/2011-09/2012): Highly Robust Interest and Emotion Recognition from Speech
    18. Masao Yamagishi, MsE (Visiting Doctoral Researcher at TUM, 09-12/2011, Tokyo Institute of Technology, Tokyo /Japan): Convex Optimization for Speaker Classification

      Supervised (Post-)Doctoral Researchers:

    1. Dr. Fabien Ringeval (Postdoctoral Researcher, TUM, 07/2011 and from 01/2014, University of Passau, from 04/2015): Autism and its Impact on Children's Speech
    2. Dr. Cyril Joder (Postdoctoral Researcher, TUM, 10/2011 - 12/2012): Source Separation for Speech and Music
    3. Dr. Eduardo Coutinho (Postdoctoral Researcher, TUM, from 11/2013, Imperial College London, from 01/2015): Affect-related Audio Analysis
    4. Dr. Hesam Sagha (Postoctoral Researcher, TUM, from 05/2014): In-car music recommendation system based on driver's emotion
    5. Dr. Bin Dong (Postdoctoral Researcher, TUM, from 05/2014): Blind audio source separation
    6. Dr. Amr Ibrahim El-Desoky Mousa (Postdoctoral Researcher, TUM, from 08/2014): Advanced Language Modelling
    7. Dr.-Ing. Zixing Zhang, MSc (Postdoctoral Researcher, University of Passau, from 05/2015): Efficient Deep Learning

      Supervised PhD Theses:

    1. Dr.-Ing. Martin Wöllmer (Doctoral Thesis, TUM, 01/2008 - 08/2012, finished 02/2013 with highest honour): Context-Sensitive Machine Learning for Intelligent Human Behavior Analysis, now with BMW Group
    2. Dr.-Ing. Florian Eyben (Doctoral Thesis, 01/2008 - 02/2015, finished 01/2015 with highest honour): Real-time Speech and Music Classification by Large Audio Feature Space Extraction
    3. Dr. rer. nat. Felix Weninger (Doctoral Thesis, TUM, 01/2010 - 05/2015, finished 05/2015): Intelligent Single-Channel Methods for Multi-Source Audio Analysis
    4. Dr.-Ing. Zixing Zhang, MSc (Doctoral Thesis, TUM, 08/2010 - 04/2015, finished 04/2015): Semi-Autonomous Data Enrichment and Optimisation for Intelligent Speech Analysis
    5. Dipl.-Ing. Raymond Brückner (external Doctoral Thesis with SVOX/Nuance, TUM, since 06/2011): Automatic Speech Recognition with Deep Hierarchical Networks
    6. Mr. Jun Deng, MSc (Doctoral Thesis, TUM, since 08/2011): Semi-Supervised Learning in the Analysis of Continuous Speaker Emotion and Personality
    7. Mr. Erik Marchi, MSc (Doctoral Thesis, TUM, since 12/2011): Speech Analysis and Feedback for Voice Coaching
    8. Mr. Christian Kirst (Doctoral Thesis, TUM, since 01/2013): Advanced Music Transcription
    9. Dipl.-Ing. Florian Pokorny (external Doctoral Thesis with Medical University of Graz, TUM, since 11/2013): The Voice of Genetic Disorders – An Acoustic Analysis of Early Vocalizations in Rett and Fragile X Syndrome
    10. Ms. Yue Zhang, MSc (Doctoral Thesis, TUM, since 01/2014): Novel Machine Learning Approaches for Holistic Computational Paralinguistics
    11. Ms. Simone Hantke, MSc (Doctoral Thesis, TUM, since 03/2014): Perception-motivated Acoustic Models in Computational Paralinguistics
    12. Mr. Shahin Amiriparian, MSc (Doctoral Thesis, TUM, since 03/2014, University of Passau, since 10/2014): Modeling and detection of user corrections in spoken dialogs
    13. Mr. George Trigeorgis (Doctoral Thesis, Imperial College London, since 09/2013): Deep Learning for Audiovisual Analysis
    14. Mr. Kun Qian (Doctoral Thesis, TUM, since 10/2014): Automatic General Audio Signal Classification
    15. Ms. Jing Han (Doctoral Thesis, University of Passau, since 02/2015): Deep Holistic Speech Analysis
    16. Mr. Vedhas Pandit (Doctoral Thesis, University of Passau, since 01/2015): Machine Learning Methods for Classification of Complex Audio Signals
    17. Mr. Maximilian Schmitt (Doctoral Thesis, University of Passau, since 01/2015): Noise-Robustness in Audio Signal Analysis
    18. Ms. Maryna Gavryukova (Doctoral Thesis, University of Passau, since 03/2015): Deep Linguistic Sentiment Analysis

      Supervised Master Theses:

    1. Gunter Spahn (Diplomarbeit, TUM, 12/2000): Natürlichsprachliche Navigation in virtuellen Welten
    2. Stephan Reiter (Diplomarbeit, TUM, 06/2002): Automatische Emotionserkennung aus der sprachlichen und berührsensitiven Interaktion
    3. Ting-Yap Tong (Diplomarbeit, TUM, 02/2003): Music Retrieval by probabilistic contextual integration of hummed, written, and spoken query
    4. Florian Hörger (Diplomarbeit, TUM, 09/2003): Evaluierung von Merkmalen und Klassifikationsansätzen in der akustischen Emotionserkennung
    5. Juan Wang (Diplomarbeit, TUM, 12/2003): Usability based design of a multimodal Music Information Retrieval interface
    6. Ronald Müller (Diplomarbeit, TUM, 12/2003): Einsatz Bayes'scher Netze zur Interpretation von Benutzeraktionen
    7. Martin Hadersdorfer (external Diplomarbeit with BMW AG, TUM, 04/2004): Entwicklung eines Benutzermodells zur adaptiven Parametrisierung von ACC
    8. Yuping Shi (Diplomarbeit, TUM, 09/2004): Automatische Melodieerkennung in polyphonen Audiodateien
    9. Raquel Jiménez Villar (Diplomarbeit, TUM, 09/2004): Speech Emotion Recognition Combining Acoustic Features and Language Information
    10. Thomas Mikschl (Diplomarbeit, TUM, 07/2006): Funktionalbasierte Zeitreihenanalyse in der audiovisuellen Mustererkennung
    11. Ricardo Minguez (Diplomarbeit, TUM, 07/2007): Feature Space Optimization for Paralinguistic Speech Analysis Tasks
    12. Naijiang Lu (Diplomarbeit, TUM, 09/2007): Speaker and Noise Adaptation in Acoustic Emotion Recognition (Sprecher- und Störgeräuschadaption in akustischer Emotionserkennung)
    13. Florian Dibiasi (Diplomarbeit, TUM, 09/2007): Audiothumbnailing unter Verwendung von Harmonie- und Rhythmusinformation (Audiothumbnailing incorporating Harmony- and Rhythmstructure)
    14. Hermann Anton Karl (Diplomarbeit, TUM, 11/2007): Anwendung von Sprachmodellen in der musikalischen Progressionserkennung (Language Modeling in the Recognition of Musical Chord Progressions)
    15. Jin Yao (Master Thesis, TUM, 02/2008): Speech-based Emotion Recognition in Medical Operations (Sprachbasierte Emotionserkennung in Medizinischen Operationen)
    16. Martin Wöllmer (Diplomarbeit, TUM, 02/2008): Speech Enhancement and Switching Models for Noise Robust Speech Recognition (Speech Enhancement und Switching Models zur störrobusten Spracherkennung)
    17. Florian Eyben (Diplomarbeit, TUM, 02/2008): Detection of Non-Verbals and Disfluencies in Conversational Speech (Erkennung von Nonverbalen Ereignissen und Hesitationen in natürlichsprachlichen Dialogen)
    18. Yuan Ma (Diplomarbeit, TUM, 03/2008): Robust Emotion Recognition from Reverberated Speech
    19. Josef Zwack (Master Thesis, TUM, 04/2008): Semantic and Contextual Analysis for the Recognition of Affect in Spontaneous Speech (Semantische und kontextuelle Analyse für die Erkennung von Affekt in Spontansprache)
    20. Sebastian Kopp (Master Thesis, TUM, 04/2008): Ground Truth Modeling in Automatic Interest Recognition from Speech
    21. Xiaodi Wang (Master Thesis, TUM, 04/2008): Boosted Performance in Acoustic Paralinguistics Recognition by Word Models and Locally Optimized Feature Spaces
    22. Cong Hui (Diplomarbeit, TUM, 05/2008): Multi-Instance Learning for Acoustic Frame-Level Modelling of Interest
    23. Peter Grosche (Diplomarbeit, TUM, 05/2008): Polyphonic Automatic Music Transcription based on Real Audio (Polyphone Automatische Transkription Originaler Musikaufnahmen)
    24. Christoph Scheuermann (Diplomarbeit, TUM, 07/2008): Noise-Robust Automatic Speech Recognition in Medical Operating Room Environments (Störrobuste Spracherkennung im Operationssaal)
    25. Tobias Knaup (Diplomarbeit, TUM, 02/2009): Comparing Linguistic Analysis based on Online Knowledge Sources and Bags-of-N-Grams for Movie Review Valence Estimation
    26. Fabian Heinemann (Diplomarbeit, TUM, 04/2009): Automatic Chord Labelling in Original Recordings with Long Short-Term Memory Recurrent Neural Networks
    27. Yang Sun (Diplomarbeit, TUM, 07/2009): A Tandem BLSTM-DBN Architecture for Robust In-Car Spelling Recognition
    28. Haroon Jacob (Diplomarbeit, TUM, 07/2009): Linguistic Sentence Modality Recognition in Conversational Speech
    29. Yunpeng Sun (Diplomarbeit, TUM, 09/2009): Sentence Modality Recognition in Conversational Speech by Combined Acoustic and Linguistic Property Analysis (Erkennung des Satzyps in Gesprächen an Hand akustischer und linguistischer Merkmale)
    30. Felix Weninger (external Diplomarbeit with Informatik 12 TUM 11/2009): Applications of Non-Negative Matrix Factorization in Speech Processing
    31. Benedikt Gollan (Diplomarbeit, TUM, 12/2009): An Audible Demonstrator for Music Information Retrieval Experiencing
    32. Xiaohua Zhang (Diplomarbeit, TUM, 10/2010): Alternative Features for Acoustic Modeling
    33. Christian Landsiedel (external Master Thesis with KTH Stockholm, Sweden 10/2010): Syllabification of Conversational Speech
    34. Erik Marchi (external Master Thesis with Università Politecnica delle Marche, Ancona, Italy, 01/2011): Noise Robust Acoustic Modeling for Conversational Agents
    35. Duc Bui Tran (Diplomarbeit, TUM, 12/2012): Robustness of Interest and Intoxication Recognition in Prototype Systems
    36. Johannes Bergmann (Master Thesis, TUM, 05/2013): Implementation of Recurrent Neural Networks on Multi-Core Architectures
    37. Giacomo Ferroni (Master Thesis with Università Politecnica delle Marche, Ancona, Italy 09/2013): Advanced Music Signal Processing for Onset Detection
    38. Markus Maier (Diplomarbeit with the German Heart Center / Deutsches Herzzentrum, TUM, 08/2013): Kinect integration into a biofeedback system for children under rehabilitation.
    39. Bernd Huber (Master Thesis, TUM): Mobile Audio Sensing
    40. Johanna Böhm (Master Thesis, University of Passau): Automatic Recognition of Perceived Singing Quality
    41. Marius Telespan (Undergraduate Individual Project, Imperial College London, 06/2014): Audio Watermarking based on Empirical Mode Decomposition and Beat Detection
    42. Jonathan Roitgrund (Undergraduate Individual Project, Imperial College London, 06/2014): A combined ASR and VAD approach to long audio alignment in movies
    43. Vincent Thiberville (MSc Individual Project, Imperial College London, 09/2014): Musical Key Detection
    44. Douglas Gray (MSc Individual Project, Imperial College London, 09/2014): Transcription and instrument recognition of multi-instrumental music using NMF
    45. Fabio Versperini(Master Thesis with Università Politecnica delle Marche, Ancona, Italy): In-home Acoustic Event Detection by using LSTM and/or DNN
    46. Florian Groß (Master Thesis, TUM, 07/2014): Driver Intention Prediction from Fleet Data
    47. Ben Thompson (2nd Marker, Undergraduate Individual Project, Imperial College London, 06/2014): Secure Online Coding Platform
    48. Nikhil George Jacob (external Master Thesis with Fraunhofer IIS Erlangen/Germany): Optimization of Speech Coding Algorithms at Low Bit Rates
    49. Vasileios Vryniotis (MSc Individual Project, Imperial College London, 09/2014): Sentiment Analysis and the importance of Neutral Class
    50. Clément Jambou (2nd Marker, MSc Individual Project, Imperial College London, 09/2014): Generating Music with Recurrent Neural Networks and other deep learning techniques
    51. Georgios Papamakarios (2nd Marker, MSc Individual Project, Imperial College London, 09/2014): Robust Low-Rank Modelling on Matrices and Tensors
    52. Senden Wenyang Cai (2nd Marker, MSc Individual Project, Imperial College London, 09/2014): Detect eating and talking from webcam videos
    53. Zhuolin Liu (2nd Marker, MSc Individual Project, Imperial College London, 09/2014): Face Liveness Recognition
    54. Prerna Arora (Master Thesis with University of Paderborn, TUM, 02/2015): Multi-cultural Analysis of the Effect of Autism Spectrum Condition on Emotional Speech
    55. Jiayun Ding (Individual Project MSc, Imperial College London, 02/2015): A mobile app for detecting symptoms of depression from facial expressions and voice
    56. Sixuan Yang (Individual Project MSc, Imperial College London, 02/2015): Convolutional Neural Networks for Audio Analysis
    57. Rob Brekelmans (Individual Project MSc, Imperial College London, 05/2015): Classifying Emotion from Brain Activity using Machine Learning Methods
    58. Kaveh Fouladgar (2nd Marker, Individual Project MSc, Imperial College London, 05/2015): Study of rank minimization techniques in machine learning
    59. Vincent Zhang (2nd Marker, Individual Project MSc, Imperial College London, 05/2015): Deep Learning for Facial Expression Analysis
    60. Lingyu Lu (2nd Marker, Individual Project MSc, Imperial College London, 05/2015): Application on unstructured big data platform
    61. Ian Billett (2nd Marker, Individual Project MSc, Imperial College London, 05/2015): Exploring the Networks of Academic Literature
    62. Andrea Michi (Individual Project MSc, Imperial College London, 11/2015): Deep Learning Accents of L2 English Speakers for Corrective Feedback Presentation
    63. Christian Nkinsi (Individual Project MSc, Imperial College London, 11/2015): Convolutional Neural Networks for Audio Analysis
    64. Max Rasmusen (Individual Project MSc, Imperial College London, 11/2015): Convolutional Neural Networks for Audio Analysis
    65. Sinduran Sivarajan (Individual Project MSc, Imperial College London, 11/2015): Automatic animal sound classification and retrieval

      Supervised Bachelor Theses:

    1. Ronald Müller (Bachelorarbeit, TUM, 10/2002): Erkennung des psychologischen Sprecherzustands aus prosodischen Merkmalen
    2. Martin Wieser (Bachelorarbeit, TUM, 09/2003): Emotionserkennung in der haptischen Interaktion mittels Support Vector Machines
    3. Marc Kirsch (Bachelorarbeit, TUM, 10/2003): Usability-Untersuchungen zur natürlichsprachlichen Bedienung von Infotainmentfunktionen im Fahrzeug
    4. Elmar Sommer (Bachelorarbeit, TUM, 11/2003): Verfahren und Merkmale zur inhaltsbasierten Musiksuche
    5. Moritz Dausinger (Bachelorarbeit, TUM, 11/2006): Automatische Erkennung musikalischer Progressionen in polyphonem Audiomaterial (Automatic Chord Labeling in Original Audio Recordings)
    6. Florian Eyben (Studienarbeit, TUM, 12/2006): High Level Rhythmic Audio Features For Robust Music Information Retrieval
    7. Qianqian Xu (Bachelorarbeit, TUM, 07/2007): Audio-based Progression Recognition Incorporating Rhythm Analysis
    8. Benedikt Gollan (Bachelorarbeit, TUM, 10/2007): Musical Features for Recognition of Key in Real Audio (Musikalische Merkmale zur datengetriebenen Tonarterkennung in Originalaufnahmen)
    9. Xiaohua Zhang (Studienarbeit, TUM, 01/2008): Prosodic and Spectral Features in Segment-based Acoustic Modeling (Prosodische und spektrale Merkmale zur segmentbasierten Akustischen Modellierung)
    10. Ugur Özcan (Studienarbeit, TUM, 01/2008): Stressdetektion im Fahrzeug anhand akustischer Parameter (Detection of Driver's Stress based on Acoustic Parameters)
    11. Kayssar Chaabane (Studienarbeit, TUM, 06/2008): A Comparison of Spectral and Prosodic Features in Segment-based Phoneme Recognition (Vergleich cepstraler und prosodischer Merkmale in der segment-basierten Phonemerkennung)
    12. Chi He (Studienarbeit, TUM, 06/2008): Datenbankübergreifende Erkennung von Emotion aus akustischen Parametern (Cross-Database Acoustic Emotion Recognition)
    13. Haitao Liu (Studienarbeit, TUM, 06/2008): Boosting Frame-Level Accuracy for Phoneme Recognition
    14. Jian Li (Studienarbeit, TUM, 10/2008): Einfluss des Sprechstils auf die Automatische Spracherkennung (On the Impact of Speaking Style on Automatic Speech Recognition )
    15. Clemens Hage (Bachelorarbeit, TUM, 10/2008): Automatic Musical Mood Recognition from Original Recordings by Musical Features (Automatische Erkennung Musikalischer Stimmung in Originalaufnahmen mittels musikalischer Merkmale)
    16. Johannes Dorfner (Bachelorarbeit, TUM, 10/2008): Automatic Music Mood Classification from Lyrics and Musical Features in large Archives (Automatische Klassifikation Musikalischer Stimmung mittels Textanalyse und musikalischer Merkmale in großen Archiven)
    17. Jürgen Glatz (Bachelorarbeit, TUM, 02/2009): Emotional Factors in Speech-based Surgeon-Robot Interaction
    18. Christoph Kozielski (Bachelorarbeit, TUM, 08/2009): Artist Gender Recognition in Popular Music by Non-Negative Matrix Factorization
    19. Judith Köppe (external Bachelorarbeit with Hochschule Lübeck 09/2009): Speech-based Emotion Recognition in Real-Life Conditions
    20. Felix Friedmann (Bachelorarbeit, TUM, 06/2011): Recognition of Physiological Parameters in the Human Voice
    21. Sebastian Stanislaw Wozny (Bachelorarbeit, TUM, 07/2013): Voice separation in Hip-Hop music
    22. Elzbieta Siwy (Individual Project BEng JMC, Imperial College London, 12/2014): Multitask-Learning with Partially Unknown Labels for Rich Speaker Characterisation

      Supervised Group Projects:

    1. Stefan Kugele, Andreas Scholz, Stephan Thoma (Interdisziplinäres Projekt, TUM, 06/2004): Integrative Dialogführung in einer hybriden Systemarchitektur
    2. Damir Ismailovic, Kevin Tunstall, Maximilian Wöhrl (Interdisziplinäres Projekt, TUM, 06/2006): Integration eines multimodalen biometrischen Erekennungssystems in eine bestehende Zugangskontrolle
    3. Christian Kern, Lorenz Mösenlechner (Interdisziplinäres Projekt, TUM, 09/2007): Audiovisuelle Emotionserkennung
    4. Tayfur Coskun (Interdisziplinäres Projekt, TUM, 02/2008): Linguistische Merkmale in der Emotionserkennung
    5. Alexander Lehmann, Felix Weninger (Interdisziplinäres Projekt, TUM, 11/2008): Instrument Separation by NMF and ICAFup
    6. Marcel Knapp (Interdisziplinäres Projekt, TUM): Automatic Chord Labeling in Original Audio Recordings
    7. Irman Abdic (Interdisziplinäres Projekt, TUM): Automatische Erkennung von Vogelgesang - Neue Methoden und akustische Merkmale
    8. Clotilde Guinard (Interdisziplinäres Projekt, TUM): Real-time Speech Analysis and Recognition for Computational Paralinguistics
    9. Lucas Azaiis, Adrien Payan, Tianjiao Sun, Guillaume Vidal, Tina Zhang (MSc Group Project, Imperial College London, 2015): The Speech Assessor
    10. Graham Walker, Braxton Collier, Andrew Machen, Sam Windels and Marco Wisse (MSc Group Project, Imperial College London, 2015): Matrix Factorisation Enhanced Feature Extraction for Real-World Computer Audition
    11. Tom Bartissol, Sacha Cohen-Scali, Hyun Lee, Nathan Patel, Dane Sherburn, Roxana Ursu (MSc Group Project, Imperial College London, 2015): Automatic detection of social anxiety symptoms from speech and facial expressions
    12. Mate Hegedus, Jiaqi Chen, Miklos Kepes, Long Le Bao, Daniel Lucsanszky, Charles Roelli (MSc Group Project, Imperial College London, 2015): CURRENNT: an open-source Machine Learning library for Deep Learning
    13. Samuel Coope, Michael Cypher, Timotej Kapus, Miguel Marques, Cale Tilford, Mark Valdez (MSc Group Project, Imperial College London, 2015): Automatic estimation of heart rate from video and audio signals
    14. Utsav Tiwary, Vishaal Anandaraman, Omotola Babasola, Jiacheng Chen, Ricardo Hamilton-Davis, Aneeque Safdar, Sinduran Sivarajan (MSc Group Project, Imperial College London, 2015): Mobile adaptive estimation of heart rate from audio signals

      Supervised Research Assistants:

    1. Dipl.-Inf. Thomas Hook (Wissenschaftliche Hilfskraft, TUM, 2008): Internet im Fahrzeug per Sprach- und Touchsteuerung
    2. Dipl.-Ing. Claudia Tiddia (Wissenschaftliche Hilfskraft, TUM, 2010): Nicht-negative Matrixfaktorisierung zur störrobusten Spracherkennung
    3. Fabian Bross (Wissenschaftliche Hilfskraft, TUM, 2010): Nicht-negative Matrixfaktorisierung zur störrobusten Spracherkennung
    4. Erik Marchi (Wissenschaftliche Hilfskraft, TUM, 2010): Nicht-negative Matrixfaktorisierung zur störrobusten Spracherkennung
    5. Jordi Feliu (Wissenschaftliche Hilfskraft, TUM, 2011): Nicht-negative Matrixfaktorisierung zur störrobusten Spracherkennung
    6. Dipl.-Ing. Simone Hantke (Wissenschaftliche Hilfskraft, TUM, 2011): Kontextsensitive automatische Erkennung spontaner Sprache mit BLSTM-Netzwerken
    7. Thomas Knauer (Wissenschaftliche Hilfskraft, TUM, 2011): Spracherkennung in Hip Hop Musik mittels NMF-basierter Quellentrennung
    8. Vikram Ravindra (Wissenschaftliche Hilfskraft, TUM, 2011-2013): An Android client for openSMILE
    9. Otto-Thadäus Jandl (Wissenschaftliche Hilfskraft, TUM, 2011-2012): Hörversuche und Experimente zur Spracherkennung
    10. Youssef Adel (Wissenschaftliche Hilfskraft, TUM, 2011-2012): Efficient Literature Search
    11. Ms. Yingsi Tang (Wissenschaftliche Hilfskraft, TUM, 2014): Data Management in Computational Paralinguistics
    12. Mr. Matthias Fuchs (Wissenschaftliche Hilfskraft, University of Passau, 2015): Complex Systems Engineering
    13. Mr. Tobias Leis (Wissenschaftliche Hilfskraft, University of Passau, 2015): Complex Systems Engineering
    14. Mr. Sergey Pugachevskij (Wissenschaftliche Hilfskraft, University of Passau, 2015): Complex Systems Engineering
    15. Ms. Miriam Deml (Wissenschaftliche Hilfskraft, University of Passau, 2015): Crowd-Sourcing
    16. Ms. Mai Lan Dinh Thanh (Wissenschaftliche Hilfskraft, University of Passau, 2015): Data Collection and Engineering
    17. Mr. Christoph Hausner (Wissenschaftliche Hilfskraft, University of Passau, 2015): Data Analysis

      Supervised Student Trainees:

    1. Imen Bouzouita (Wissenschaftliche Hilfskraft, TUM, 2011): Sprachdatenverwaltung
    2. Salma Zouari (Universitäres Fachpraktikum, TUM, 2011): Verfahren zur Audiosignalanalyse
    3. Judith Köppe (Fachpraktikum, TUM, 2009): Digtiale Verarbeitung und Erkennung von Sprachsignalen
    4. Sun Yang (ENB SIM Porject, TUM, 2008): Automatic Speech Recognition and Natural Language Understanding for Internet Control in the Car
    5. Andreas Mavredakis (Werkstudent, TUM): Natürliches Sprachverstehen zur Steuerung von Audio- und Kommunikationseinheiten
    6. Markus Fronius (Programmierpraktikant Informatik Grundstudium LMU): Implementierung diskreter Hidden-Markov-Modell Evaluation
    7. Sebastian Graf (Fachpraktikant, TUM): Integratives Interfacekonzept zur prototypischen Evaluierung
    8. Ting-Yap Tong (Werkstudent, TUM): Emotionserkennung aus Daten eines Fahrtenschreibers
    9. Florian Hörger (Fachpraktikant, TUM): Neuronale Netze zur Emotionserkennung, Music Retrieval
    10. Bernardo José Brüning Schmitt (Praktikant, TUM): Verfahren und Merkmale in der Emotionserkennung

      Supervised Student Tutors:

    1. Artur Spychaj (UTA Tutor, Imperial College London, Spring Term 2014): PMT

      Project Coordination, Participation, and Advisory

        Running Projects:

      1. DE-ENIGMA: Multi-Modal Human-Robot Interaction for Teaching and Expanding Social Imagination in Autistic Children (#688835)
        EU Horizon 2020 Research & Innovation Action (RIA)
        Runtime: 01.02.2016 - 31.07.2019
        Role: Coauthor Proposal, Beneficiary, LEAR
        Partners: University of Twente, Savez udruzenja Srbije za pomoc osobama sa autizmom, Autism-Europe, IDMIND, University College London, University of Passau, Romane Institute of Mathematics Simion Stoilow of the Romanian Academy, Imperial College London
        Autism Spectrum Conditions (ASC, frequently defined as ASD -- Autism Spectrum Disorders) are neurodevelopmental conditions, characterized by social communication difficulties and restricted and repetitive behaviour patterns. There are over 5 million people with autism in Europe – around 1 in every 100 people, affecting lives of over 20 million people each day. Alongside their difficulties, individuals with ASC tend to have intact and sometimes superior abilities to comprehend and manipulate closed, rule-based, predictable systems, such as robotbased technology. Over the last couple of years, this has led to several attempts to teach emotion recognition and expression to individuals with ASC, using humanoid robots. This has been shown to be very effective as an integral part of the psychoeducational therapy for children with ASC. The main reason for this is that humanoid robots are perceived by children with autism as being more predictable, less complicated, less threatening, and more comfortable to communicate with than humans, with all their complex and frightening subtleties and nuances. The proposed project aims to create and evaluate the effectiveness of such a robot-based technology, directed for children with ASC. This technology will enable to realise robust, context-sensitive (such as user- and culture-specific), multimodal (including facial, bodily, vocal and verbal cues) and naturalistic human-robot interaction (HRI) aimed at enhancing the social imagination skills of children with autism. The proposed will include the design of effective and user-adaptable robot behaviours for the target user group, leading to more personalised and effective therapies than previously realised. Carers will be offered their own supportive environment, including professional information, reports of child’s progress and use of the system and forums for parents and therapists.

      2. EmotAsS: Emotionsensitive Assistance System (#16SV7213)

        BMBF IKT2020-Grant (Sozial- und emotionssensitive Systeme für eine optimierte Mensch-Technik-Interaktion)
        Runtime: 01.06.2015 - 31.05.2018
        Role: Coauthor Proposal, Beneficiary
        Partners: University of Bremen, University of Passau, vacances Mobiler Sozial- und Pflegedienst GmbH, Martinshof (Werkstatt Bremen), Meier und Schütte GmbH und Co. KG
        Emotionen und deren Erkennung in der gesprochenen Sprache sind für die erfolgreiche Mensch-Technik- Interaktion wichtig, insbesondere bei Menschen mit Erkrankungen oder Behinderungen. Ziel des Projekts ist es, Emotionserkennung und deren Nutzung für Interaktionsprozesse in Werkstätten für behinderte Menschen zu entwickeln und zu untersuchen. Es soll daher ein System entwickelt werden, das sicher Emotionen bei Menschen mit Behinderungen in der Sprache erkennt und angemessen und unterstützend auf diese reagiert. Die Erkenntnisse sollen auf ein weiteres Anwendungsgebiet übertragen und in der Kommunikation mit Demenzerkrankten erprobt werden.

      3. VocEmoApI: Voice Emotion detection by Appraisal Inference (#230331)

        EU Horizon 2020 ERC Proof of Concept Grant (PoC 2015) - 46% acceptance rate in the call
        Runtime: 01.11.2015 - 30.04.2017
        Role: Coauthor Proposal, Beneficiary, LEAR
        Partners: audEERING UG
        The automated sensing of human emotions has gained a lot of commercial attention lately. For facial and physiological sensing many companies offer first professional products. Recently, voice analytics has become a hot topic, too, with first companies emerging for the telecom, entertainment, and robot markets (e.g. Sympalog, audEERING, Aldebaran, etc.). Current vocal emotion detection approaches rely on machine learning where emotions are identified based on a reference set of expression clips. The drawback of this method is the need to rely on a small set of basic, highly prototypical emotions. Real life emotion detection application fields such as clinical diagnosis, marketing research, media impact analysis, and forensics and security, require subtle differentiations of feeling states. VocEmoApI will develop a proof-of-concept software for vocal emotion detection based on a fundamentally different approach: Focusing on vocal nonverbal behavior and sophisticated acoustic voice analysis, it exploits the building blocks of emotional processes - a person’s appraisal of relevant events and situations which trigger action tendencies and expressions which constitute an emotional episode. Evidence for emotion-antecedent appraisals will be continuously tracked in running speech. The approach can infer not only basic emotion categories but also much finer distinctions such as subcategories of emotion families and subtle emotions. The development of VocEmoApI draws extensively from the results of the applicant’s Advanced Grant, providing a solid theoretical basis. Market analysis through marketing research partners will be conducted and the prototype software will be utilized to promote the technology and estimate a product value based on feedback from industry contacts. A massive impact of VocEmoApI on large markets such as household robotics, public security, clinical diagnosis and therapy, call analytics, and marketing research is to be expected.

      4. Promoting Early Diagnosis of Rett Syndrome through Speech-Language Pathology (Akustische Parameter als diagnostische Marker zur Früherkennung von Rett-Syndrom) (#16430)
        Österreichische Nationalbank (OeNB) Jubiläumsfonds
        Runtime: 01.11.2015 - 31.10.2019
        Role: Main Cooperation Partner
        Partners: Medical University of Graz, Karolinska Institutet, Boston Children’s Hospital and Harvard Medical School, University of Passau, Imperial College London, Victoria University of Wellington

      5. iHEARu: Intelligent systems' Holistic Evolving Analysis of Real-life Universal speaker characteristics (#338164)

        FP7 ERC Starting Grant (StG) - 8.6% acceptance rate in the call (7% in Computer Science)
        Runtime: 01.01.2014 - 31.12.2018
        Role: Principal Investigator and Grant Holder
        Partners: University of Passau, TUM
        Recently, automatic speech and speaker recognition has matured to the degree that it entered the daily lives of thousands of Europe's citizens, e.g., on their smart phones or in call services. During the next years, speech processing technology will move to a new level of social awareness to make interaction more intuitive, speech retrieval more efficient, and lend additional competence to computer-mediated communication and speech-analysis services in the commercial, health, security, and further sectors. To reach this goal, rich speaker traits and states such as age, height, personality and physical and mental state as carried by the tone of the voice and the spoken words must be reliably identified by machines. In the iHEARu project, ground-breaking methodology including novel techniques for multi-task and semi-supervised learning will deliver for the first time intelligent holistic and evolving analysis in real-life condition of universal speaker characteristics which have been considered only in isolation so far. Today's sparseness of annotated realistic speech data will be overcome by large-scale speech and meta-data mining from public sources such as social media, crowd-sourcing for labelling and quality control, and shared semi-automatic annotation. All stages from pre-processing and feature extraction, to the statistical modelling will evolve in "life-long learning" according to new data, by utilising feedback, deep, and evolutionary learning methods. Human-in-the-loop system validation and novel perception studies will analyse the self-organising systems and the relation of automatic signal processing to human interpretation in a previously unseen variety of speaker classification tasks. The project's work plan gives the unique opportunity to transfer current world-leading expertise in this field into a new de-facto standard of speaker characterisation methods and open-source tools ready for tomorrow's challenge of socially aware speech analysis.

      6. SEWA: Automatic Sentiment Estimation in the Wild (#645094)


        EU Horizon 2020 Innovation Action (IA) - 9.3% acceptance rate in the call
        Runtime: 01.02.2015 - 31.07.2018
        Role: Principal Investigator, Coauthor Proposal, Project Steering Board Member, Workpackage Leader
        Partners: Imperial College London, University of Passau, PlayGen Ltd, RealEyes
        The main aim of SEWA is to deploy and capitalise on existing state-of-the-art methodologies, models and algorithms for machine analysis of facial, vocal and verbal behaviour, and then adjust and combine them to realise naturalistic human-centric human-computer interaction (HCI) and computer-mediated face-to-face interaction (FF-HCI). This will involve development of computer vision, speech processing and machine learning tools for automated understanding of human interactive behaviour in naturalistic contexts. The envisioned technology will be based on findings in cognitive sciences and it will represent a set of audio and visual spatiotemporal methods for automatic analysis of human spontaneous (as opposed to posed and exaggerated) patterns of behavioural cues including continuous and discrete analysis of sentiment, liking and empathy.

      7. MixedEmotions: Social Semantic Emotion Analysis for Innovative Multilingual Big Data Analytics Markets (#644632)

        EU Horizon 2020 Innovation Action (IA) - 12.5% acceptance rate in the call
        Runtime: 01.04.2015 - 31.03.2017
        Role: Principal Investigator, Coauthor Proposal, Project Steering Board Member, Workpackage Leader
        Partners: NUI Galway, Univ. Polit. Madrid, University of Passau, Expert Systems, Paradigma Tecnológico, TU Brno, Sindice Ltd., Deutsche Welle, Phonexia SRO, Adoreboard, Millward Brown
        MixedEmotions will develop innovative multilingual multi-modal Big Data analytics applications that will analyze a more complete emotional profile of user behavior using data from mixed input channels: multilingual text data sources, A/V signal input (multilingual speech, audio, video), social media (social network, comments), and structured data. Commercial applications (implemented as pilot projects) will be in Social TV, Brand Reputation Management and Call Centre Operations. Making sense of accumulated user interaction from different data sources, modalities and languages is challenging and has not yet been explored in fullness in an industrial context. Commercial solutions exist but do not address the multilingual aspect in a robust and large-scale setting and do not scale up to huge data volumes that need to be processed, or the integration of emotion analysis observations across data sources and/or modalities on a meaningful level. MixedEmotions will implement an integrated Big Linked Data platform for emotion analysis across heterogeneous data sources, different languages and modalities, building on existing state of the art tools, services and approaches that will enable the tracking of emotional aspects of user interaction and feedback on an entity level. The MixedEmotions platform will provide an integrated solution for: large-scale emotion analysis and fusion on heterogeneous, multilingual, text, speech, video and social media data streams, leveraging open access and proprietary data sources, and exploiting social context by leveraging social network graphs; semantic-level emotion information aggregation and integration through robust extraction of social semantic knowledge graphs for emotion analysis along multidimensional clusters.

      8. ARIA-VALUSPA: Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects (#645378)

        EU Horizon 2020 Research & Innovation Action (RIA) - 9.3% acceptance rate in the call
        Runtime: 01.01.2015 - 31.12.2017
        Role: Principal Investigator, Coauthor Proposal, Project Steering Board Member, Workpackage Leader
        Partners: University of Nottingham, Imperial College London, CNRS, University of Augsburg, University of Twente, Cereproc Ltd, La Cantoche Production
        The ARIA-VALUSPA project will create a ground-breaking new framework that will allow easy creation of Artificial Retrieval of Information Assistants (ARIAs) that are capable of holding multi-modal social interactions in challenging and unexpected situations. The system can generate search queries and return the information requested by interacting with humans through virtual characters. These virtual humans will be able to sustain an interaction with a user for some time, and react appropriately to the user's verbal and non-verbal behaviour when presenting the requested information and refining search results. Using audio and video signals as input, both verbal and non-verbal components of human communication are captured. Together with a rich and realistic emotive personality model, a sophisticated dialogue management system decides how to respond to a user's input, be it a spoken sentence, a head nod, or a smile. The ARIA uses special speech synthesisers to create emotionally coloured speech and a fully expressive 3D face to create the chosen response. Back-channelling, indicating that the ARIA understood what the user meant, or returning a smile are but a few of the many ways in which it can employ emotionally coloured social signals to improve communication. As part of the project, the consortium will develop two specific implementations of ARIAs for two different industrial applications. A ‘speaking book’ application will create an ARIA with a rich personality capturing the essence of a novel, whom users can ask novel-related questions. An ‘artificial travel agent’ web-based ARIA will be developed to help users find their perfect holiday – something that is difficult to do with existing web interfaces such as those created by booking.com or tripadvisor.

      9. Automatic General Audio Signal Classification China Scholarship Council
        Runtime: 01.09.2014 - 31.08.2018
        Role: Supervisor

      10. Speech Emotion Recognition using Nonlinear Dimensionality Reduction Methods
        China Scholarship Council
        Runtime: 01.08.2014 - 31.07.2016
        Role: Supervisor

      11. Semi-Supervised Learning in the Analysis of Continuous Speaker Emotion and Personality
        China Scholarship Council
        Runtime: 01.08.2011 - 31.07.2015
        Role: Supervisor

        Finished Projects:

      12. In-car music recommendation system based on driver's emotion
        TUM University Foundation Fellowship
        Runtime: 01.05.2014 - 30.04.2015
        Role: Supervisor


      13. PROPEREMO: Production and Perception of Emotions: An affective sciences approach (#230331)
        FP7 ERC Advanced Grant
        Runtime: 01.03.2008 - 28.02.2015
        Role: Participant
        Partners: University of Geneva (PI Klaus Scherer), TUM, Free University of Berlin
        Emotion is a prime example of the complexity of human mind and behaviour, a psychobiological mechanism shaped by language and culture, which has puzzled scholars in the humanities and social sciences over the centuries. In an effort to reconcile conflicting theoretical traditions, we advocate a componential approach which treats event appraisal, motivational shifts, physiological responses, motor expression, and subjective feeling as dynamically interrelated and integrated components during emotion episodes. Using a prediction-generating theoretical model, we will address both production (elicitation and reaction patterns) and perception (observer inference of emotion from expressive cues). Key issues are the cognitive architecture and mental chronometry of appraisal, neurophysiological structures of relevance and valence detection, the emergence of conscious feelings due to the synchronization of brain/body systems, the generating mechanism for motor expression, the dimensionality of affective space, and the role of embodiment and empathy in perceiving and interpreting emotional expressions. Using multiple paradigms in laboratory, game, simulation, virtual reality, and field settings, we will critically test theory-driven hypotheses by examining brain structures and circuits (via neuroimagery), behaviour (via monitoring decisions and actions), psychophysiological responses (via electrographic recording), facial, vocal, and bodily expressions (via micro-coding and image processing), and conscious feeling (via advanced self-report procedures). In this endeavour, we benefit from extensive research experience, access to outstanding infrastructure, advanced analysis and synthesis methods, validated experimental paradigms as well as, most importantly, from the joint competence of an interdisciplinary affective science group involving philosophers, linguists, psychologists, neuroscientists, behavioural economists, anthropologists, and computer scientists.

      14. ASC-INCLUSION: Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions (#289021)

        EU FP7 Specific Targeted Research Project (STREP)
        Runtime: 01.11.2011 - 31.12.2014
        Role: Coordinator, Principal Investigator, Coauthor Proposal, Project Steering Board Member, Workpackage Leader
        Partners: University of Cambridge, Bar Ilan University, Compedia, University of Genoa, Karolinska Institutet, Autism Europe, TUM, Koc University, Spectrum ASC-Med
        Autism Spectrum Conditions (ASC, frequently defined as ASD - Autism Spectrum Disorders) are neurodevelopmental conditions, characterized by social communication difficulties and restricted and repetitive behaviour patterns. Current studies suggest 1% of the population might fit an ASC diagnosis. Alongside their difficulties individuals with ASC tend to have intact and sometimes superior abilities to comprehend and manipulate closed, rule-based, predictable systems, such as computerized environment. Their affinity for the computerized environment has led to several attempts to teach emotion recognition and expression, and social problem solving to individuals with ASC, using computer-based training.
        In the last decade, web applications have been increasingly used for social interaction, forming online communities and social networks. Anecdotal reports of the emergence of online autistic communities, and the use of forums and virtual-worlds, show the great promise the internet holds for better inclusion and social skills training for users/people with ASC. Since intervention into ASC has been shown to be more effective when provided early in life, using the internet as a platform for the support of younger individuals with ASC could significantly promote their social inclusion.
        The project aims to create and evaluate the effectiveness of such an internet-based platform, directed for children with ASC (and other groups like ADHD and socially-neglected children) and those interested in their inclusion. This platform will combine several state-of-the art technologies in one comprehensive virtual world, including analysis of users’ gestures, facial and vocal expressions using standard microphone and webcam, training through games, text communication with peers and smart agents, animation, video and audio clips. User’s environment will be personalized, according to individual profile & sensory requirements, as well as motivational. Carers will be offered their own supportive environment, including professional information, reports of child’s progress and use of the system and forums for parents and therapists.

      15. Novel Approaches for Large Vocabulary Continuous Speech Recognition
        China Scholarship Council
        Runtime: 01.08.2010 - 31.07.2014
        Role: Supervisor

      16. U-STAR: Universal Speech Translation Advanced Research
        Academic Cooperation


        Runtime: 01.06.2012 - 31.03.2013
        Role: Consortial Partner
        The Universal Speech Translation Advanced Research Consortium (U-STAR) is an international research collaboration entity formed to develop a network-based speech-to-speech translation (S2ST) with the aim of breaking language barriers around the world and to implement vocal communication between different languages.

      17. GLASS: Generic Live Audio Source Separation
        Industry Cooperation with HUAWEI TECHNOLOGIES within the HUAWEI Innovative Research Program (HIRP)
        Runtime: 01.01.2011 - 31.12.2013
        Role: Principal Investigator, Author Proposal
        GLASS finds new ways of separating audio sources, e.g., for crystal clear speech communication, by machine intelligence and advanced separation algorithms.

      18. Kontextsensitive automatische Erkennung spontaner Sprache mit BLSTM-Netzwerken (#SCHU2508-4/1) ("Context-Sensitive Automatic Recognition of Spontaneous Speech by BLSTM Networks"
        Funded by the DFG (German Research Foundation)
        Runtime: 01.03.2011 - 28.02.2014
        Role: Principal Investigator, Author Proposal
        Trotz zahlreicher Fortschritte im Bereich der automatischen Spracherkennung ist die Erkennungsleistung und Robustheit heutiger Spracherkennungssysteme nicht ausreichend, um als Grundlage für natürliche, spontansprachliche Mensch-Maschine-Interaktion zu dienen. Ziel des Forschungsvorhabens ist es deshalb, die Genauigkeit von Systemen zur Erkennung natürlicher, fließender Sprache mittels neuartiger Mustererkennungsmethoden zu verbessern. Da die Effizienz der menschlichen Spracherkennung vor allem auf der intelligenten Auswertung von Langzeit-Kontextinformation beruht, sollen dabei Ansätze zur Berücksichtigung von Kontext auf Merkmalsebene verfolgt werden. Ausgehend von sogenannten Tandem-Spracherkennern, bei denen neuronale Netze zur Phonemprädiktion in Kombination mit dynamischen Klassifikatoren verwendet werden, sollen hierzu bidirektionale Long Short-Term Memory (BLSTM) Netzwerke eingesetzt werden. Im Gegensatz zu derzeit in Tandem- Systemen verwendeten Phonemschätzern erlaubt es das BLSTM-Prinzip, ein optimales Maß an Kontextinformation bei der Prädiktion miteinzubeziehen. Da jüngste Erfolge im Bereich der kontextsensitiven Phonemerkennung und Schlüsselwortdetektion die Effektivität des BLSTM-Ansatzes unterstreichen, ist eine entsprechende Weiterentwicklung kontinuierlicher Spracherkennungssysteme äußerst vielversprechend.

      19. Nichtnegative Matrix-Faktorisierung zur störrobusten Merkmalsextraktion in der Sprachverarbeitung (#SCHU2508-2/1) (“Non-Negative Matrix Factorization for Robust Feature Extraction in Speech Processing”)
        Funded by the DFG (German Research Foundation)
        Runtime: 01.06.2010 - 31.05.2013
        Role: Principal Investigator, Author Proposal
        Hauptziel des Forschungsvorhabens ist, die Erkennung von Sprach- und Musiksignalen störrobuster zu gestalten. Besonderes Kennzeichen ist die Integration von Merkmalen, die auf Nichtnegativer Matrix-Faktorisierung (NMF) basieren. NMF – ein Verfahren zur Datenreduktion – erfreut sich in der Signalverarbeitung jüngst zunehmender Popularität. Dabei wird meist ein Spektrogramm in zwei Faktoren zerlegt. Der erste enthält eine spektrale ‘Basis’ des Signals, der zweite die Aktivität der Basisvektoren über die Zeit. In diesem Forschungsvorhaben werden aus dem zweiten Faktor Merkmale gewonnen, die bestehende Architekturen zur Sprach- und Musikverarbeitung ergänzen können. Erste durchgeführte Experimente zur NMF-Merkmalsextraktion für die störrobuste Erkennung gesprochener Buchstabensequenzen im Fahrzeug haben sich dabei konventionellen Verfahren als signifikant überlegen und äußerst vielversprechend erwiesen. Das dabei verwendete Verfahren soll im Rahmen des Projekts durch Weiterentwicklung der NMF verbessert werden und insbesondere für den Einsatz in echtzeitfähigen Spracherkennungssystemen, auch für fließende Sprache, vorbereitet werden. Schließlich sollen die beschriebenen NMF-Merkmale in weiteren Anwendungsfeldern wie Emotionserkennung, Erkennung von nichtlinguistischer Vokalisierung wie Lachen oder Husten in Sprache und Akkorderkennung mit dem Ziel der Steigerung aktueller Erkennungsgüte und der Störrobustheit eingesetzt werden.

      20. Highly Robust Interest and Emotion Recognition from Speech
        China Scholarship Council
        Runtime: 01.08.2011 - 30.09.2012
        Role: Supervisor

      21. SEMAINE: Sustained Emotionally coloured Machine-humane Interaction using Nonverbal Expression (#211486)

        EU FP7 STREP
        Runtime: 01.01.2008 - 31.12.2010
        Role: Principal Investigator, Coauthor Proposal (highest ranked in the call), Project Steering Board Member, Workpackage Leader
        Partners: DfKI, Queens University Belfast (QUB), Imperial College of Science, Technology and Medicine London, University Twente, University Paris VIII, CNRS-ENST, TUM
        SEMAINE deals with real-time, robust, non-verbally competent conversations between a conversational agent and a human user.

      22. TCVC: Talking Car and Virtual Companion
        Industry Cooperation with Continental Automotive GmbH
        Runtime: 01.06.2008 - 30.11.2008
        Role: Principal Investigator, Author Proposal
        TCVC provides an expertise on emotion in the car with respect to a requirement analysis, potential and near-future use-cases, technology assessment and a user acceptance study.

      23. ICRI: In-Car Real Internet
        Industry Cooperation with Continental Automotive GmbH
        Runtime: 01.06.2008 - 30.11.2008
        Role: Principal Investigator, Author Proposal
        ICRI aims at benchmarking of internet browsers on embedded platforms as well as at development of an integrated multimodal demonstrator for internet in the car. Investigated modalities contain hand-writing and touch-gestures and natural speech apart from conventional GUI interaction. The focus lies on MMI development with an embedded realisation.

      24. cUSER 2
        Industry cooperation with Toyota
        Runtime: 08.01.2007 - 31.07.2007
        Role: Principal Investigator, Coauthor Proposal
        The aim of the cUSER follow-up project is to establish a system to interpret human interest by combined speech and facial expression analysis basing on multiple input analyses. Besides the aim of improved highest possible accuracy by subject adaptation, class balancing strategies, and fully automatic segmentation by individual audio and video stream analysis, cUSER 2 focuses on real-time application by cost-sensitive feature space optimization, graphics processing power utilization, and high-performance programming methods. Furthermore, feasibility and real recognition scenarios will be evaluated.

      25. cUSER
        Industry cooperation with Toyota
        Runtime: 01.08.2005 - 30.09.2006
        Role: Coauthor Proposal, Project Steering, Senior Researcher
        The aim of this project was an audiovisual approach to the recognition of spontaneous human interest. For a most robust estimate, information from four sources was combined for the first time (as reported in the literature) by a synergistic and individual failure tolerant early feature fusion: Firstly, speech is analyzed with respect to acoustic properties based on a high-dimensional prosodic, articulatory, and voice quality feature space plus the linguistic analysis of spoken content by ASR and bag-of-words vector space modeling. Secondly, visual analysis provides patterns of the facial expression by Active Appearance Models, and of the movement activity by eye tracking. Experiments were carried out on a video database of 10.5h of spontaneous human-to-human conversation collected throughout the project. It contains 20+ subjects in gender and age-class balance. Recordings were fulfilled considering diverse comfort and noise conditions. Multiple levels of interest were annotated within a rich transcription. Experiments aimed at person-independent and robust real-life usage and showed the high potential of such a multimodal approach. Benchmark results could further be provided based on transcription versus full automatic processing.

      26. CEICES: Combining Efforts for Improving automatic Classification of Emotional user States
        Reserach Initiative within the EU FP6 Network of Excellence (NoE) HUMAINE
        Runtime: 2005 - 2008
        Role: Invited Research Expert
        Partners: Friedrich Alexander Universität Erlangen-Nürnberg (FAU), Fondazione Bruno Kessler (FBK, formerly ITC-IRST), Universität Karlsruhe (UKA), Universität Augsburg (UA), LIMSI-CNRS, Tel Aviv University (TAU), Tel Aviv Academic College of Engineering (AFEKA), TUM
        CEICES is a co-operation between several sites dealing with classification of emotional user states conveyed via speech; this initiative was taken within the European Network of Excellence HUMAINE under the name CEICES (Combining Efforts for Improving automatic Classification of Emotional user States). The database used within CEICES is a German corpus with recordings of 51 ten- to thirteen-year old children communicating with Sony's AIBO pet robot. Conceptualization, design and recordings were done at the originator site FAU. The approach to be followed within CEICES looked like this: the originator site provided speech files, phonetic lexicon, manually corrected word segmentation, and manually corrected F0 values, emotional labels, definition of train and test samples, etc. The data was annotated at the word level. All partners committed themselves to share with all the other partners their extracted feature values together with the necessary information (which feature models which acoustic or linguistic phenomenon, format of feature values, classifier used, etc.). Thus each site could assess the features provided by all other sites, together with their own features, aiming at a repertoire of optimal features.

      27. FERMUS: Fehlerrobuste Multimodale Sprachdialoge
        Industry cooperation with BMW, DaimlerChrysler, Siemens, VDO Automotive
        Runtime: 01.03.2000 - 30.06.2003
        Role: Coauthor Proposal, Project Steering, Researcher
        The primary intention of the FERMUS-project was to localize and evaluate various strategies for a dedicated analysis of potential error patterns during human-machine interaction with information and communication systems in upper-class cars. For reaching this goal, we have employed a huge bundle of progressive and mainly recognition-based input modalities, like interfaces for natural speech and dynamic gestural input. Particularly, emotional patterns of the driver have beeen integrated for generating context-adequate dialog structures.

      28. SOMMIA: Speech-oriented Man-Machine-Interface in the Automobile
        Industry Cooperation with SiemensVDO Automotive
        Runtime: 01.06.2000 - 30.09.2001
        Role: Coauthor Proposal, Project Steering, Researcher
        The SOMMIA project focused on the design and evaluation of an ergonomic and generic operation concept for a speech-based MMI integrated in a car MP3-player or in comparable automotive applications. In addition, the system was subject to several economic and geometrical boundary conditions: a two line, 16 characters display with a small set of LEDs and a speaker- independent full word recognizer with 30 to 50 words active vocabulary. Nevertheless, the interface had to meet high technical requirements: its handling should be easy to learn, comfortable and, above all, intuitive and interactively explorable.

      29. ADVIA: Adaptive Dialogverfahren im Automobil
        Industry cooperation with BMW
        Runtime: 01.07.1998 - 31.12.2000
        Role: Coauthor Proposal, Project Steering, Researcher
        In modernen Fahrzeugen der Luxusklasse, aber durch den ständigen Preisverfall bereits in Mittelklassefahrzeugen, koexistieren zahlreiche elektronische Geräte zur Steigerung des Komforts. Einige Beispiele hierfür sind: Klimaanlage, Navigations- und Telematiksysteme, Audiokomponenten wie CD-Wechsler und Radio, Funktelefon, Bordcomputer und vieles mehr. Da die meisten dieser Komponenten in irgendeiner Weise computerbasiert sind, kann man sich viele Funktionen ausdenken und diese implementieren. Spendiert man jeder dieser Funktionen einen eigenen mechanischen Schalter würde die Anzahl dieser Bedienelemente in der Größenordnung von grossen Konzertorgeln oder Studiomischpulten liegen, nur eben auf der kleinen Fläche im Fahrzeugcockpit. Werden nun die Geräte von verschiedenen Herstellern geliefert, sieht jedes anders aus und besitzt eine firmenspezifische Bedienlogik. Fazit: Trotz aller Funktionalität wird die Flut an Technik unbedienbar. Natürlich haben die Fahrzeughersteller schon längst reagiert und multifunktionale Schnittstellen mit Display und wenigen Bedienelementen entwickelt, wobei die eigentlichen Geräte räumlich über das Fahrzeug verteilt sind und über ein Bussystem mit der Bedieneinheit kommunizieren. Allerdings ergibt sich nun das nächste Problem: Wie gestaltet man eine solche Bedieneinheit, wie kann man Sprache, Akustik und Gesten integrieren und wie erleichtert man dem Fahrer den Umgang mit all der Technik. Hier kommen wir ins Spiel. Für unsere Forschungen steht uns ein speziell eingerichter Fahrssimulator zur Verfügung, der uns Usability-Versuche mit Fahrzeugbedienungen gestattet. Hierbei wird ein MMI (Man-Machine-Interface) durch einen Rechner simuliert. Durch Wizard-of-Oz Versuche können wir in einer Art Rapid Prototyping neue Techniken ausprobieren, indem ein "Wizard" die Versuchspersonen beobachtet und im Hintergrund den Versuchsrechner bedient. Die Versuchsperson bekommt dadurch den Eindruck, tatsächlich mit einer Geste oder einem Satz Aktionen zu bewirken. Erweisen sich bestimmte Bedienungsmethoden als vorteilhaft können diese tatsächlich umgesetzt werden und beispielsweise auf dem Lehrstuhlnetzwerk realisiert werden. Diese Vorgehensweise erscheint zunächst seltsam, hat sich aber als absolut effektiv bewährt.

        Project and External Advisory:

      1. Mentor in the TUM Mentoring Programm, since 2015.
      2. Advisory Board Member fluent.ai, since 2015.
      3. Advisory Board Member SensAura Tech, since 2015.
      4. Advisory Board Member EPSRC project Humans and Robots in Public Spaces (HARPS), 2013-2016.
      5. Advisory Board Member EU FP7 STREP TARDIS (Training young Adult's Regulation of emotions and Development of social Interaction Skills), 2011-2014.
      6. Advisory Board Member EU FP7 STREP MASELTOV, 2012-2015.
      7. Coordinator Digital Games for Empowerment and Inclusion (DGEI) Cluster Activities ASC-INCLUSION, MASELTOV, TARDIS, 2011-2015.

      Ready.