iPhones can now tell blind users where and how far away people are –

  • Technology
  • iPhones can now tell blind users where and how far away people are –

Apple has packed an interesting new accessibility feature into the latest beta of iOS: a system that detects the presence of and distance to people in the view of the iPhone’s camera, so blind users can social distance effectively, among many other things.

The feature emerged from Apple’s ARKit, for which the company developed “people occlusion,” which detects people’s shapes and lets virtual items pass in front of and behind them. The accessibility team realized that this, combined with the accurate distance measurements provided by the lidar units on the iPhone 12 Pro and Pro Max, could be an extremely useful tool for anyone with a visual impairment.

Of course during the pandemic one immediately thinks of the idea of keeping six feet away from other people. But knowing where others are and how far away is a basic visual task that we use all the time to plan where we walk, which line we get in at the store, whether to cross the street and so on.

The new feature, which will be part of the Magnifier app, uses the lidar and wide-angle camera of the Pro and Pro Max, giving feedback to the user in a variety of ways.

The lidar in the iPhone 12 Pro shows up in this infrared video. Each dot reports back the precise distance of what it reflects off of.

First, it tells the user whether there are people in view at all. If someone is there, it will then say how far away the closest person is in feet or meters, updating regularly as they approach or move further away. The sound corresponds in stereo to the direction the person is in the camera’s view.

Second, it allows the user to set tones corresponding to certain distances. For example, if they set the distance at six feet, they’ll hear one tone if a person is more than six feet away, another if they’re inside that range. After all, not everyone wants a constant feed of exact distances if all they care about is staying two paces away.

The third feature, perhaps extra useful for folks who have both visual and hearing impairments, is a haptic pulse that goes faster as a person gets closer.

Last is a visual feature for people who need a little help discerning the world around them, an arrow that points to the detected person on the screen. Blindness is a spectrum, after all, and any number of vision problems could make a person want a bit of help in that regard.

The system requires a decent image on the wide-angle camera, so it won’t work in pitch darkness. And while the restriction of the feature to the high end of the iPhone line reduces the reach somewhat, the constantly increasing utility of such a device as a sort of vision prosthetic likely makes the investment in the hardware more palatable to people who need it.

Here’s how it works so far:

This is far from the first tool like this — many phones and dedicated devices have features for finding objects and people, but it’s not often that it comes baked in as a standard feature.

People detection should be available to iPhone 12 Pro and Pro Max running the iOS 14.2 release candidate that was just made available today. Details will presumably appear soon on Apple’s dedicated iPhone accessibility site.

FRESHEST

Here's the latest news

Earlier this year, Selena opened up about her ex-boyfriends and what it's really like to date celebrities. "If I can be honest, it is so cliché, it's just, everyone dates everyone," the Rare singer told Zane Lowe on Apple Music's Beats 1...

Here's What's Really Going on Between Selena Gomez and Jimmy Butler

December 2, 2020By Jessica JaganathanSINGAPORE (Reuters) – Oil prices extended losses on Wednesday, hit by a surprise build in oil inventories in the United States and as OPEC and its allies left markets in limbo by delaying a formal meeting...

Oil prices drop on U.S. stock build, delay in OPEC+ meeting

Genshin is sure having an impact on MiHoYo’s bottom line. Mobile analytics firm Sensor Tower said today that Genshin Impact has brought in an estimated $393 million in the first two months after its September 28 launch. But the firm...

Sensor Tower: Genshin Impact brings in nearly $400 million in 2 months on mobile

Two of four women charged in a South Florida prostitution sting that also involved New England Patriots owner Robert Kraft have taken plea deals this week, court records show.Lei Wang, 41, and Shen Mingbi, 60, each pleaded guilty in Palm...

Women plead guilty in sex sting involving Patriots owner

I wrote a few months back about how I’m more excited about the RTX 3080 than the Xbox Series X or PlayStation 5. But as we move past the launch of the first RTX 3000 cards, the new consoles, and...

Nvidia RTX 3060 Ti is the best GPU under $500
Load More