Facebook to Use AI to Describe Photos to Blind Users

...

Facebook is making it easier for the blind and visually impaired to see and interact with friends' photos.

Automatic alternative text generates an image description using object recognition technology. Previously, the social network announced only the name of the person who posted the photo on Facebook, followed by the term "photo." Now, anyone operating a screen reader on an iOS device can hear a list of items in each picture: for example, "Image may contain three people, smiling, outdoors."

"Now we can offer a richer description of what's in a photo thanks to automatic alt text," software engineers Shaomei Wu and Hermes Pique and head of accessibility Jeffrey Wieland wrote in a blog post.

Automatic alt text rolls out this week to iOS screen readers set to English, but will be available in other languages and platforms "soon," the social network says.

"While this technology is still nascent, tapping its current capabilities to describe photos is an important step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," the Facebook blog said.

In November, the Facebook AI Research (FAIR) team achieved "new milestones," including a "state-of-the-art system that segments, or distinguishes between, objects in a photo" 30 percent faster and using 10 times less training data than previous industry benchmarks. So when a friend posts an snapshot of their cat sunbathing on the sofa, Facebook's AI (pictured) can describe the image in enough detail for the user to form a mental image.

Twitter, meanwhile, just last week began allowing iOS and Android users to add descriptions, or alternative text (alt text), to images. Enable the feature via the "compose image descriptions" option in the app's accessibility settings. Summaries are limited to 420 characters.

Categories
APPLICATIONS
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    Detachable Tablets Will Lead Market Rebound In 2018

    However, demand for detachable tablets will help this market rebound in 2018.This rebound in growth is likely to be fueled by the detachable tablet segment of the market, which currently accounts for just 16% of the global tablet market.
  • 5300c769af79e

    Google Daydream VR Headset Pre-Order Live on Verizon

    The Daydream View VR headset from Google is now available for pre-order through Verizon, priced at the same $79 as it is on the Google Store.However, if you pre-order through Verizon, it’s always possible you will receive the device before you would from Google.
  • 5300c769af79e

    Huawei: We're Making Another Nexus Device

    Charlene Munilall, Huawei's General Manager of its South African consumer business group, confirmed the news in an interview with Gear Burn, telling the site "we're doing the Nexus again this year, by the way.So far it's not clear [what it will be], but there are a lot of potentials to explore.
  • 5300c769af79e

    Yahoo Jazzes Up iOS, Android Mail Apps

    And when sending images or videos from the iOS Photos app or text from your notes, click the share button and choose the Yahoo Mail app icon to launch a new email message.Jazz up your messages on iOS with Yahoo's expanded Paperless Post integration: Just tap the plus icon, select the stationary option, and choose from dozens of designs, including thank you and happy birthday themes.