people do online catting all the time. We communicate so much with each other through messages everyday, but there’s still so much that has not been communicated. When we talk with each other face to face, we are also giving out our body language, our facial expression and our voice. And those things help us understand each other and make connections. However, we cannot do video chat like FaceTime all the time, especially at work. So when it comes to online chatting, all those things are missing.
Misunderstanding happens all the time, same text can mean different things with different tones.
The lack of connection makes us feel isolated.
Emoji tries to solve this problem. But I believe there is a better, passive way to imbuing our emotions into text messages.
The passive way I am using is Facial Recognition. Because facial expressions are universal and I want this project to stand alone as a web application so that people can use it everywhere, anytime. So I am not using any physical sensors, just the web camera. The camera reads your facial expression, the program analysis your emotion and when you send your message, you will also send the Emotion Data together.
For the design part, I am using weather as a metaphor of emotion.
I have 5 basic emotions for now. Each cloud represents the emotion of that certain message. The background shows your location. And also it is a summary of both participants’ emotion for a longer period of time. For example: if both participants are upset for a while, the background will get darker.
I am using Sinch for instant messages communication : https://www.sinch.com/products/instant-messaging/
And clmtrackr for facial recognition and emotion analysis : https://github.com/auduno/clmtrackr
Please use FIREFOX, and remember to allow it to get access of the camera,The sign up function is not fully functional right now, but you can try login with
Username: ChloeGuo Password: 123456 Receiver: PerryLuo
Username: PerryLuo Password: 123456 Receiver: ChloeGuo