Facebook built a facial recognition app that let employees identify people by pointing a phone at them

Rob Price

Nov 23, 2019, 02:04 IST

Facebook built a facial recognition app that let employees identify people by pointing a phone at them

Facebook once built an internal app that let employees identify people using facial recognition and their phone cameras.
The app, which was developed between 2015 and 2016, utilised Facebook's vast collection of user identities to automatically recognise the person at whom the phone's camera was pointed.
The app was not released publicly, and Facebook tells Business Insider that it only worked on company employees and any of their friends who opted in to the social network's facial recognition system.
"As a way to learn about new technologies, our teams regularly build apps to use internally. The apps described here were only available to Facebook employees, and could only recognize employees and their friends who had face recognition enabled," said a Facebook spokesperson.
The existence of the app illustrates how Facebook has been quick to experiment with technology that could have significant societal implications.
Click here for more BI Prime stories.

Facebook once built an internal facial recognition app that allowed employees to identify people by pointing their phone cameras at them.

The app, which was developed by Facebook employees between 2015 and 2016 and tested internally, relied on information from the social network's vast collection of user-uploaded photos and facial recognition data to identify people in real life within seconds, sources told Business Insider.

Complimentary Tech Event

Transform talent with learning that works

Capability development is critical for businesses who want to push the envelope of innovation.Discover how business leaders are strategizing around building talent capabilities and empowering employee transformation.Know More

It was shown off at an internal all-hands meeting in late 2015, one source said, and was presented as an "example of future innovations" that Facebooks' technology and data could enable.

A second source said that in 2016 a beta version of the app was made available for download to Facebook employees that used a smartphone camera to identify anyone for whom the social network had enough data - regardless of whether or not they were a Facebook employee. It was subsequently restricted to only identify people recognized as Facebook friends of the app user (still regardless of whether or not they were an employee), and they only used the app on their friends after that change was made, they said.

A Facebook spokesperson denied that the app could ever identify strangers who didn't work at Facebook, saying that it was only ever able to recognise the faces of Facebook employees and of Facebook friends of the user who had enabled the social network's facial recognition system on their accounts.

The app was clearly in its early stages, and had a basic camera interface, a source said. When pointed at someone, it would take around three to five seconds to recognize them, and then displayed their Facebook name and profile picture.

For years, Facebook has used facial recognition technology to identify the subjects of photos uploaded to its core social network and recommend "tagging" them - but the version available to consumers has only ever applied to photos, and never for real-time, real-world face recognition. In September 2019, Facebook said it would change to make facial recognition opt-in, rather than assuming by default that users consent to having their faces scanned.

The existence of the experimental app, which has not been previously reported, highlights Facebook's willingness to experiment with technologies with major societal implications. And it raises questions about the $564 billion company's historic approach to privacy and consent, and its handling of users' data.

A Facebook spokesperson said the company routinely builds experimental apps internally, and that the facial recognition app has since been discontinued.

"As a way to learn about new technologies, our teams regularly build apps to use internally. The apps described here were only available to Facebook employees, and could only recognize employees and their friends who had face recognition enabled," said the Facebook spokesperson in a prepared statement.

Facebook has a history of privacy scandals

The experimental app was developed at a time when Facebook was under pressure from then-rapidly growing rival Snapchat and its comparatively advanced face-tracking technology and filters. A former Facebook employee who worked at the company at the time and was not aware of the beta app speculated that it might have been a experiment by Facebook to better understand the area, in a bid to tackle Snapchat's "looming threat."

Facebook has suffered through more than two years of scandals, from the spread of misinformation and propaganda on its platform in the 2016 US election to issues with its handling of user data. Earlier this year, the company was hit with a $5 billion fine from the Federal Trade Commission after political research firm Cambridge Analytica misappropriated more than 80 million users' data as a result of lax controls by Facebook.

Facial recognition has also been a thorny issue for the company. In 2012, Facebook stopped using facial recognition in the European Union over privacy regulatory issues, before bringing in back in 2018 with stricter controls. The company is currently facing a lawsuit over allegations that it didn't acquire consent from users in Illinois before utilising their biometric data, which could cost it up to $35 billion if it loses, Ars Technica reported.

Do you work at Facebook? Contact this reporter via encrypted messaging app Signal at +1 (650) 636-6268 using a non-work phone, email at rprice@businessinsider.com, Telegram or WeChat at robaeprice, or Twitter DM at @robaeprice. (PR pitches by email only, please.)