Just as a quick recap of the project, Face Blind is a visualization of prosopagnosia symptom and calls for the awareness of this perception disorder. On Wikipedia’s prosopagnosia page, the brief intro is given as follows,

Prosopagnosia (sometimes known as face blindness) is a disorder of face perception where the ability to recognize faces is impaired, while the ability to recognize other objects may be relatively intact. The term usually refers to a condition following acute brain damage, but recent evidence suggests that a congenital form of the disorder may exist. The specific brain area usually associated with prosopagnosia is the fusiform gyrus.[1]

Few successful therapies have so far been developed for affected people, although individuals often learn to use ‘piecemeal’ or ‘feature by feature’ recognition strategies. This may involve secondary clues such as clothing, hair color, body shape, and voice. Because the face seems to function as an important identifying feature in memory, it can also be difficult for people with this condition to keep track of information about people, and socialize normally with others.

The difficulty of face-blind people could hardly be explained and understood by people around because we are taking face recognition so for granted and seldom think of how faces are specifically optimized in our memory system. The analogy of the stones were used by Cecilia Burman on her website on prosopagnosia and I found it a relatively effective approach of making this explanation short. I decided to create a set of cloud masks for every student in the ITP community to illustrate this idea in a similar yet different way.

The clouds are generated by several different features on peoples faces and are overlaying on their faces to obscure them The optimized mechanism for face-recognition in our brain would not be activated since most of the facial features are turned off by the noises (clouds). However since the clouds are generated from an abstraction of facial features so ideally I could still create a unique cloud mask for each person. In this way, we could probably experience the difficulty of face blindness and, however, could also experience the “piecemeal” or “feature by feature” recognition strategy by observing the shape, texture and other features of the clouds.

Cloud Generation

My first difficulty in the process is creating the cloud texture programmatically. I first thought of using stock photos of clouds textures and trimming them for my use. After some research I decided to create my clouds by Perlin Noise, which seems to be a classic and efficient way of generating the texture. Since I’m not only looking for the randomness of the clouds, I would also like to gain control of the generated result through a set of configuration parameters (which would be the output of my face recognition/analysis tool).

The first iteration and the later revision of the cloud generator looked like this. The clouds used in the final visualization were composition of two layers of cloud highlights and another two layers of shadows, plus a adjusting filter to make sure the generated cloud cover at least 50% of the face area.

Facial Recognition

Since I’m not building a sophisticated robot with computer vision that watch your door or build you an iron armor, my goal for the facial recognition program was to just extract certain features from the face, which in this case includes aspect ratio of the face shape, positions of the eyes, nose and mouth, and whether the person is wearing glasses or not.

In fact it worked pretty well. Click on the thumbnails below to view larger pictures.

• Rectangle on the top left indicates aspect radio of face shape;
• Red stripe – position of eyes, brown of wearing glasses;
• Lower stripes – position of nose/mouth, not really accurate from time to time;

Composition

After the preparation of the previous two steps, I tried to develop a showcase for the visualization. The performance problem emerged as I was putting everything together. The realtime rendering of the cloud for each individual took about 3-4 seconds in average and created an unacceptable latency in the viewing experience. Due to the short of time, I pre-rendered all graphics beforehand. I cannot argue this is the best way to present the final product. It might be better to cache the whole cloud space to optimize calculating time than pre-rendering. Anyway this is what I presented at the final.

See if you could recognize anyone. Click on the thumbnail for higher resolution. All headshot images courtesy of Social Genius. If you’re interested in getting your “cloud” just drop me a message at leejayxia [at] gmail.com.

It’s always been hard to squeeze time out of all other projects in the final times but after all presentations were over it was even more exhausted. My problem now is I cannot get back to normal sleep and would anway stay awake until 4 am.

Okay I still remember the couch since we all got into the central area and saw people taking pictures from above. The best part for me is that while the girl was projected on the screen opposite to the pig and they were like fighting for one apple with no physical contact. I was somehow happy for being underlying in the protected miniature world. For a moment.

Prosopagnosia, also known as P.A. or face-blindness, is a symptom with which people lose the ability of identifying people by their faces. In my understanding the optimization module in the brain taking care of the facial recognition is not functioning, so that people can no longer associate the visually seen faces with the memory of people. Recognizing people in the social life becomes as hard as looking for one specific stone among thousands of them.

My proposed project is to recreate this experience for normal people by obscuring faces on the screen. Meanwhile the faces will be replaced by the texture of cloud. The idea is to create a mapping function between human faces and cloud shapes/patterns. Ideally I would be able to find a consistent conversion so that two similar faces should generate similar clouds.

some early sketches:

special thanks to “social genius”, images courtesy of ITP community

some 3 days ago pictures.

Here is the archive for all posts regarding the class this semester.

coin and collage:
 

poster and proposal (more images):

I’ll keep working on the odor database and try to find out how our sense of smell are manipulated and cheated by the artificial tastes. Ironically it is a reflection on the “mango cavier” effect presented by professor Ken Kirshchenbaum on last week’s class.

images for reference slash inspiration: cartography / mutant food and taste / visual cue of the sensor / representation of the food and taste / visual cue of the sense

So here’s the storyboard. Visit this page for uninterrupted browsing experience.

charactor originally designed by molmol, great work!

Thank Lina, Bryan and Adi!