In Apple’s shadow, Google takes new route to face recognition on Pixel phones

Published October 7, 2022
New Google Pixel 7 Pro smartphones are displayed at a launch event for new Google hardware devices in the Brooklyn borough of New York City, New York. — Reuters
New Google Pixel 7 Pro smartphones are displayed at a launch event for new Google hardware devices in the Brooklyn borough of New York City, New York. — Reuters

Facial recognition returned to the latest Google Pixel phones on Thursday after a short hiatus due to challenges on cost and performance, according to three former employees at the Alphabet Inc unit knowledgeable about the efforts.

The feature on the new Pixel 7 is not as good Apple Inc’s Face ID unlocking mechanism, as it can struggle in low light and is more vulnerable to being spoofed. In addition, Google has said it is not secure enough to enable signing into apps or making payments.

The return comes after Google became stricter about launching products with facial recognition, in part due to questions about its performance on darker skin. The company took time to review its approach to training and testing facial recognition since the previous Pixel with the capability launched in 2019, one of the sources said.

Google declined to comment on several specific questions about its history with face unlock. It said generally, “Thanks to advanced machine learning models for face recognition, Pixel 7 and Pixel 7 Pro feature Face Unlock, but we’re doing it a little differently.”

It added, “We achieve good facial accuracy performance with the front-facing camera.”

Google’s pursuit of face unlock for Android smartphones spans at least a decade, but it came under greater pressure when Apple released Face ID in September 2017, the sources said.

To that point, Google struggled to devise a system that both performed quickly and was impervious to spoofing, or the use of photos or hyper-realistic costumes to fool someone else’s phone into unlocking, one of the sources said.

Engineers toyed with requiring a smile or a blink — proving a person’s “liveness” — to combat spoofing but it was awkward and slow, the source said.

Another source noted that after the arrival of Apple’s Face ID, which uses a depth-sensing and infrared camera called TrueDepth to map a face, Google executives signed off on a comparable technology. Google’s Pixel 4, released in 2019, called its infrared depth-sensing setup uDepth.

It performed well, including in dark conditions, with no more than a 1-in-50,000 chance that it would unlock a phone for an unauthorized face, according to Google.

But the gear was expensive. And while Apple sells 240 million iPhones annually, Google has topped out at a few million, preventing it from buying parts at the volume discounts Apple does.

Google dropped uDepth in the Pixel 5 in 2020 due to costs, the sources said.

Face masking because of the pandemic gave Google reason to exclude the feature from last year’s Pixel 6 and additional research time, two sources said.

Face unlock on the new phones relies on a typical front camera. But unlike the previous system, it cannot securely unlock apps and payments because Google says spoofing chances — such as by holding up a user’s photo — are greater than 20 per cent, above the 7pc threshold it requires to be considered most “secure”.

Low light and sunglasses also can cause trouble, Google says, noting fingerprint unlock remains an alternative.

Follow Dawn Business on Twitter, LinkedIn, Instagram and Facebook for insights on business, finance and tech from Pakistan and across the world.

Opinion

Editorial

Ties with Tehran
Updated 24 Apr, 2024

Ties with Tehran

Tomorrow, if ties between Washington and Beijing nosedive, and the US asks Pakistan to reconsider CPEC, will we comply?
Working together
24 Apr, 2024

Working together

PAKISTAN’S democracy seems adrift, and no one understands this better than our politicians. The system has gone...
Farmers’ anxiety
24 Apr, 2024

Farmers’ anxiety

WHEAT prices in Punjab have plummeted far below the minimum support price owing to a bumper harvest, reckless...
By-election trends
Updated 23 Apr, 2024

By-election trends

Unless the culture of violence and rigging is rooted out, the credibility of the electoral process in Pakistan will continue to remain under a cloud.
Privatising PIA
23 Apr, 2024

Privatising PIA

FINANCE Minister Muhammad Aurangzeb’s reaffirmation that the process of disinvestment of the loss-making national...
Suffering in captivity
23 Apr, 2024

Suffering in captivity

YET another animal — a lioness — is critically ill at the Karachi Zoo. The feline, emaciated and barely able to...