A new innovation by Mark Zuckerberg's team will now allow blind Facebook users to 'see' photos and videos on their Newsfeed
Advertisement
A new innovation at Facebook will soon make it super easy for blind people to use the website!
Facebook ’s artificial intelligence can now automatically read out descriptions of photos and videos on their Newsfeed, which means they will be able to visualize what’s in the photo or video on their wall.
This because the social network is now able to "understand" images such as food, people and trees, and will now be able to describe them to visually-impaired smartphone owners using what’s called a screen reader technology. This will tells users what is on the screen with a computer-generated voice.
How is it different from the past? Well previously, Facebook simply described a blind user's News Feed by saying the name of somebody posting the image, and then saying "photo". But from now on it will be able to describe what is in the image by detecting things in it. So it would say "image may contain: two people, smiling, sunglasses, sky, outdoor, water" for a photo of a couple on holiday by the sea beach.
The company expects this technology will do wonders in increasing the user friendliness of the website for blind people because it claims there are 2 billion photos which are shared every day across Facebook,Instagram and WhatsApp, and that it has 39 million blind users and 246 million who are severely visually impaired.
Recent studies have shown that blind people often feel excluded from conversations on social media centered around photos and videos.
While the company, using image recognition technology, was able to make facebook understand the photos (such as when it suggests you what friends should be tagged in photos), it has been ramping up investment in machine learning to solve the difficult task of getting computers to better recognise objects in photos now.
The work on automatic photo-reading for visually impaired people has been on for close to10 months now. But for a technology of this strength, it seems success has come far too quick than was expected. No doubt it is still in its nascent stages, but can recognise around 100 concepts including babies, beards, mountains, smiling and selfies with a precision of at least 80 per cent. There’ll be more as the technology becomes smarter.
Notably, Twitter also recently introduced a new feature to help blind people understand photos on its network - but Facebook's is far more advanced. While Facebook uses AI to automatically detect what's in a photo, Twitter requires users to manually add a description, which it can then narrate.
As of now, the Facebook feature is being introduced only in English oniOS devices in the US, UK, Canada, Australia and New Zealand and the company plans to expand it in the future.
Advertisement
This because the social network is now able to "understand" images such as food, people and trees, and will now be able to describe them to visually-impaired smartphone owners using what’s called a screen reader technology. This will tells users what is on the screen with a computer-generated voice.
How is it different from the past? Well previously, Facebook simply described a blind user's News Feed by saying the name of somebody posting the image, and then saying "photo". But from now on it will be able to describe what is in the image by detecting things in it. So it would say "image may contain: two people, smiling, sunglasses, sky, outdoor, water" for a photo of a couple on holiday by the sea beach.
The company expects this technology will do wonders in increasing the user friendliness of the website for blind people because it claims there are 2 billion photos which are shared every day across Facebook,
Recent studies have shown that blind people often feel excluded from conversations on social media centered around photos and videos.
Advertisement
The work on automatic photo-reading for visually impaired people has been on for close to10 months now. But for a technology of this strength, it seems success has come far too quick than was expected. No doubt it is still in its nascent stages, but can recognise around 100 concepts including babies, beards, mountains, smiling and selfies with a precision of at least 80 per cent. There’ll be more as the technology becomes smarter.
Notably, Twitter also recently introduced a new feature to help blind people understand photos on its network - but Facebook's is far more advanced. While Facebook uses AI to automatically detect what's in a photo, Twitter requires users to manually add a description, which it can then narrate.
As of now, the Facebook feature is being introduced only in English on
Advertisement
- Colon cancer rates are rising in young people. If you have two symptoms you should get a colonoscopy, a GI oncologist says.
- I spent $2,000 for 7 nights in a 179-square-foot room on one of the world's largest cruise ships. Take a look inside my cabin.
- An Ambani disruption in OTT: At just ₹1 per day, you can now enjoy ad-free content on JioCinema
- IMD predicts severe heatwave conditions over East, South Peninsular India for next five days
- COVID lockdown-related school disruptions will continue to worsen students’ exam results into the 2030s: study
- India legend Yuvraj Singh named ICC Men's T20 World Cup 2024 ambassador
- Maruti Suzuki Q4 net profit rises 47.8% to ₹3,877.8 crore
- 10 Incredible destinations for backpackers in India
- JNK India IPO allotment date
- JioCinema New Plans
- Realme Narzo 70 Launched
- Apple Let Loose event
- Elon Musk Apology
- RIL cash flows
- Charlie Munger
- Feedbank IPO allotment
- Tata IPO allotment
- Most generous retirement plans
- Broadcom lays off
- Cibil Score vs Cibil Report
- Birla and Bajaj in top Richest
- Nestle Sept 2023 report
- India Equity Market