CS6998: Topics in Speech Processing: Computational Approaches to Emotional Speech, Fall 2009
Time: Mon 4:10-6:00
Place: TBA
Professor Julia Hirschberg (Office Hours TBA)
julia@cs.columbia.edu, 212-939-7114
Teaching Assistant TBA (Office Hours TBA)
Announcements | Academic Integrity | Description
Readings | Resources | Requirements | Syllabus
Description
Requirements
Students will lead one class discussion, prepare several homework assignments, prepare weekly discussion questions based on assigned readings, and prepare a term project. The Columbia Speech Lab is available for use in homeworks on a signup basis.
All students are required to have a Computer Science Account for this class. To sign up for one, go to the CRF website and then click on "Apply for an Account".
Homework submission procedure.
Academic Integrity
Readings
Required readings will be available on line.
Announcements
Resources
- Praat - Praat resources
- Wavesurfer
- Help using ToBI - ToBI Annotation Environments
- Whissel's Dictionary of Affect
- Feeltrace download
- FACS facial coding system
- Synface demo
Syllabus
Date | Topic | Readings | Reports & HW |
---|---|---|---|
Sep 14 |
Introduction | The Love Detector; Emotional Synthetic Speech |
|
Sep 21 |
Evidence of Emotion: Theory, Experiments and Corpora |
Wiltingetal06; Enos&Hirschberg06; Nisimuraelal06; Cornelius00 |
|
Sep 28 |
Cues to Emotion: Face, Body, Brain |
Johnstoneetal06, Ekman video; Ekman bio; cf FACS |
|
Oct 5 |
Cues to Emotion: Language | Gupta&Rajput07; cf DAL, Praat Yanushevskayaetal05 | HW1 due |
Oct 12 |
Techniques for Emotion Classification |
Kumaretal06; Satohetal07; Cowie00; cf. Feeltrace |
|
Oct 19 |
Cultural Differences |
Braun&Katerbow05; Shahidetal07; Ekman&Friesen03 |
|
Oct 26 |
Producing Emotional Speech |
Cahn90; Eideetal04; Beskow&Nordenberg06 cf Synface demo |
|
Nov 9 |
Emotion in IVR Systems: Anger and Frustration |
Liscombeetal05; Devillers&Vidrascu06 |
|
Nov 16 |
Emotion in Tutoring Systems: Confidence and Confusion |
Aietal06; Liscombeetal05b |
|
Nov 23 |
Emotion in Meetings: Hot Spots and Laughter |
Wrede&Shriberg03; Laskowski&Burger07 |
|
Nov 30 |
Deception Detection |
Hirschbergetal05; Eriksson&Lacerda07 YouDecide |
|
Dec 7 |
Medical Diagnosis |
Luoetal06; Levitetal01; Kalioubyetal06 |
|
Dec 14 |
Modeling Other Speaker State: Sarcasm, Charisma, Urgent/Personal |
Teppermanetal06; Biadsyetal08; Ringel&Hirschberg02 |
|
Dec 23 |
Projects due |