Facebook Physical AR

For Facebook's 2011 F8 conference we created a physical, social, augmented reality experience dubbed "Connections". Attendees "badge in" to the experience using their RFID enabled event badge. Multiple overhead projectors map visuals to the floor and an array of 3D cameras are used to reliably track any number of people within the space.

Once "logged in" to Connections, a radial visualization, constructed from the participant's social graph data, surrounds the participant creating a unique "fingerprint". Colored lines extend from the circles connecting people who share one or more of the observed metrics (mutual friends, interests, workplaces, schools, locations, birth sign, or non-english languages). When two or more people, who have mutual connections, stand within close proximity a slideshow of mutual friends and interests appears between them.

Positioned behind the Connections space, a large screen shares aggregate data about the collective group - surfacing common interests and profiling the most connected of the group.

Every house party/bar needs one of those floor connection things. That is awesome... #f8

- jesslyn8706 (Twitter)

Concept illustration


Concept illustration


TouchDesigner development


Prototyping


Live at F8


Overhead display showing aggregate metrics