| LEC # | TOPICS | READINGS |
|---|---|---|
| 1 | Course introduction, visitors welcome | |
| 2 | Technologies for recognizing affect-related information |
Optional reading Bechara, A., et al. "Deciding Advantageously Before Knowing the Advantageous Strategy." Science 275, no. 5304 (February 1997): 1293-1295. [doi: 10.1126/science.275.5304.1293] |
| 3 | Empathy and its measurement |
Marci, C. D., J. Ham, E. Moran, and S. P. Orr. "Physiologic Correlates of Perceived Therapist Empathy and Social-emotional Process During Psychotherapy." The Journal of Nervous and Mental Disease 195, no. 2 (2007): 103-111. (PDF)# Marci, C. D., E. K. Moran, and S. P. Orr. "Physiologic Evidence for the Interpersonal Role of Laughter During Psychotherapy." The Journal of Nervous and Mental Disease 192, no. 10 (2004): 689-695. (PDF)# Bargh, J., and T. L. Chartrand. "The Unbearable Automaticity of Being." American Psychologist 54, no. 7 (1999): 462-79. |
| 4 | How do you build empathetic technology? What happens when technology appears to show empathy? Picard leading | Bickmore, T., and D. Schulman. "Practical Approaches to Comforting users with Relational Agents." In CHI '07 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 2007, pp. 2291-2296. ISBN: 9781595936424. [doi: 10.1145/1240866.1240996] Klein, J., Y. Moon, and R. W. Picard. "This Computer Responds to User Frustration." In CHI '99 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 1999, pp. 242-243. ISBN: 9781581131581. [doi: 10.1145/632716.632866] Nass, C., et al. "Improving Automotive Safety by Pairing Driver Emotion and Car Voice Emotion." In CHI '05 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 2005, pp. 1973-1976. ISBN: 9781595930026. [doi: 10.1145/1056808.1057070] Picard, R. W., and K. K. Liu. "Relative Subjective Count and Assessment of Interruptive Technologies Applied to Mobile Monitoring of Stress." Int J Hum-Comput Stud 65, no. 4 (2007): 361-375. [doi: 10.1016/j.ijhcs.2006.11.019] Supplemental readings McQuiggan, S. W., and J. C. Lester. "Modeling and Evaluating Empathy in Embodied Companion Agents." Int J Hum-Comput Stud 65, no. 4 (2007): 348-360. (PDF)# Brave, S., C. Nass, and K. Hutchinson. "Computers that Care: Investigating the Effects of Orientation of Emotion Exhibited by an Embodied Computer Agent." Int J Hum-Comput Stud 62, no. 2 (2005): 161-178. [doi: 10.1016/j.ijhcs.2004.11.002] |
| 5 | Multi-modal affect recognition and recognition from facial expression | el Kaliouby, Rana. "Background." Chapter 2 in Mind-reading Machines: Automated Inference of Complex Mental States. PhD Thesis, University of Cambridge, 2005. (PDF - 23.8 MB)# Baron-Cohen, S., et al. "The 'Reading the Mind in the Eyes' Test Revised Version: A Study with Normal Adults, and Adults with Asperger Syndrome or High-Functioning Autism." J Child Psychol Psychiat 42, no. 2 (2001): 241-251. (PDF)# [And take the associated eyes test.] Wagner, J., et al. "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification." Proceedings of ICME 2005: IEEE International Conference on Multimedia and Expo. Pantic, M., and L. J. M. Rothkrantz. "Toward an Affect-Sensitive Multimodal Human-computer Interaction." Proceedings of the IEEE 91, no. 9 (September 2003): 1370-1390. Supplemental readings Kapoor, Ashish, Winslow Burleson, and Rosalind W Picard. "Automatic Prediction of Frustration." International Journal of Human-Computer Studies 65, no. 8 (August 2007): 724-736. [doi:10.1016/j.ijhcs.2007.02.003] |
| 6 | Reading emotions from facial expressions and emotion as a constructed process | Russell, J. A. "Is There Universal Recognition of Emotion from Facial Expression? A Review of the Cross-Cultural Studies." Psychol Bull 115, no. 1 (1994): 102-41. (PDF - 4.6 MB)# ———. "Core Affect and the Psychological Construction of Emotion." Psychol Rev 110, no. 1 (2003): 145-72. (PDF)#
Carroll, J. M., and J. A. Russell. "Do Facial Expressions Signal Specific Emotions? Judging Emotion from the Face in Context." J Pers Soc Psychol 70, no. 2 (1996): 205-18. (PDF - 1.9 MB)# Carroll, J., and J. Russell. "Facial Expressions in Hollywood's Portrayal of Emotion." Journal of Personality and Social Psychology 72, no. 1 (1997): 164-176. (PDF - 1.3 MB)# |
| 7 | Emotion regulation | Mauss, I. B., C. L. Cook, and J. J. Gross. "Automatic Emotion Regulation During an Anger Provocation." Journal of Experimental Social Psychology 43 (2007): 698-711. (PDF)# Tamir, M., C. Mitchell, and J. J. Gross. "Hedonic and Instrumental Motives in Anger Regulation." Psychological Science. (PDF)# (in press). Butler, E. A., F. H. Wilhelm, and J. J. Gross. "Respiratory Sinus Arrhythmia, Emotion, and Emotion Regulation During Social Interaction." Psychophysiology 3 (2006): 612-622. (PDF)# McRae, K., K. N. Ochnser, I. B. Mauss, J. J. D. Gabrielli, and J. J. Gross. "Gender Differences in Emotion Regulation: An fMRI study of Cognitive Reappraisal." Group Processes and Intergroup Relations. (PDF)# (in press). Allen, J. B., E. Harmon-Jones, and J. H. Cavender. "Manipulation of Frontal EEG Asymmetry Through Biofeedback Alters Self-reported Emotional Responses and Facial EMG." Psychophysiology 38 (2001): 685-693. Supplemental readings Lieberman, M. D., N. I. Eisenberger, M. J. Crockett, S. M. Tom, J. H. Pfeifer, and B. M. Way. "Putting Feelings in Words: Affect Labeling Disrupts Amygdala Activity to Affective Stimuli." Psychological Science 18 (2007): 421-428. Note: Don't stress too much about the fMRI data analysis sections in McRae et al. and Lieberman et al. |
| 8 | Cognitive-affective influences; creativity; detection of subtle affect | Forgas, J. P., and S. Moylan. "After the Movies: Transient Mood and Social Judgements." Personality and Social Psychology Bulletin 13, no. 4 (1987): 467-477. Lerner, J. S., D. A. Small, and G. Loewenstein. "Heart Strings and Purse Strings: Carryover Effects of Emotions on Economic Decisions." (PDF)# Isen, A. M., K. A. Daubman, and G. P. Nowicki. "Positive Affect Facilitates Creative Problem Solving" Journal of Personality and Social Psychology 52 (1987): 1122-1131. Isen, A. M., A. S. Rosenzweig, and M. J. Young. "The Influence of Positive Affect on Clinical Problem Solving." Medical Decision Making 11 (1991): 221-227. Larson, K., and R. W. Picard. "The Aesthetics of Reading." (PDF) (Courtesy of Kevin Larson. Used with permission.) Picard, R. W., and S. B. Daily. "Evaluating Affective Interactions: Alternatives to Asking What Users Feel." Presented at CHI 2005 Workshop on Evaluating Affective Interfaces: Innovative Approaches. (PDF) |
| 9 | Affect in patient-physician interactions | Frankel, R. M. "Emotion and the Physician-Patient Relationship." Motivation and Emotion 19, no. 3 (1995): 163-173. Slack, W. V., and L. J. Van Cura. "Patient Reaction to Computer-based Medical Interviewing." Comput Biomed Res 1, no. 5 (May 1968): 527-31. Robinson R, and R. West. "A Comparison of Computer and Questionnaire Methods of History-taking in a Genito-urinary Clinic." Psychol Health 6 (1992): 77-84. Bickmore, T., A. Gruber, and R. Picard. "Establishing the Computer-Patient Working Alliance in Automated Health Behavior Change Interventions." Patient Educational Counseling 59, no. 1 (2005): 21-30. (PDF)# |
| 10 | Potential concerns of affective computing research | Picard, R. W., and J. Klein. "Computers that Recognise and Respond to user Emotion: Theoretical and Practical Implications." Interacting with Computers 14 (2002): 141-169. a. The "Little Emotional Controller" Story. I and A Research, Inc. February 19, 2001. b. Desktop Computers to Counsel Users to Make Better Decisions. Sandia National Laboratories, January 22, 2004. Tsiamyrtzis, P., J. Dowdall, D. Shastri, I. Pavlidis, M.G. Frank, and P. Eckman. "Lie Detection - Recovery of the Periorbital Signal through Tandem Tracking and Noise Suppression in Thermal Facial Video." Proceedings of SPIE ThermoSense 2005: Sensor Technologies, Orlando, Florida, March 27-30, 2005. Picard, R. W. "Potential Concerns." Chapter 4 in Affective Computing.
Please choose to watch either one of these films a. 2001: A Space Odyssey (148 mins.) b. Artificial Intelligence: AI (145 mins.) |
| 11 | New affective technology research directions | Please read these before the next class meeting. There is no written assignment this week in order to give you more time to focus on your class project. Riskind, J. H. "They Stoop to Conquer: Guiding and Self Regulatory Functions of Physical Posture after Success and Failure." Journal of Personality and Social Psychology 47 (1984): 479-493. Niedenthal, P. M., et al. "Embodying Emotion." Science 316 (2007): 1002-1005. Ahn, H. I., A. Teeters, A. Wang, C. Breazeal, and R. W. Picard. "Stoop to Conquer: Posture and Affect Interact to Influence Computer users' Persistence." In The 2nd International Conference on Affective Computing and Intelligent Interaction. September 12-14, 2007, Lisbon, Portugal. (PDF) |
| 12 | Project presentations |
Table of Contents
Study Materials
Readings
This section contains documents that could not be made accessible to screen reader software. A "#" symbol is used to denote such documents.
 When you click the Amazon logo to the left of any citation and purchase the book (or other media) from Amazon.com, MIT OpenCourseWare will receive up to 10% of this purchase and any other purchases you make during that visit. This will not increase the cost of your purchase. Links provided are to the US Amazon site, but you can also support OCW through Amazon sites in other regions. Learn more. |