Facebook to Use AI to Describe Photos to Blind Users

...

Facebook is making it easier for the blind and visually impaired to see and interact with friends' photos.

Automatic alternative text generates an image description using object recognition technology. Previously, the social network announced only the name of the person who posted the photo on Facebook, followed by the term "photo." Now, anyone operating a screen reader on an iOS device can hear a list of items in each picture: for example, "Image may contain three people, smiling, outdoors."

"Now we can offer a richer description of what's in a photo thanks to automatic alt text," software engineers Shaomei Wu and Hermes Pique and head of accessibility Jeffrey Wieland wrote in a blog post.

Automatic alt text rolls out this week to iOS screen readers set to English, but will be available in other languages and platforms "soon," the social network says.

"While this technology is still nascent, tapping its current capabilities to describe photos is an important step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," the Facebook blog said.

In November, the Facebook AI Research (FAIR) team achieved "new milestones," including a "state-of-the-art system that segments, or distinguishes between, objects in a photo" 30 percent faster and using 10 times less training data than previous industry benchmarks. So when a friend posts an snapshot of their cat sunbathing on the sofa, Facebook's AI (pictured) can describe the image in enough detail for the user to form a mental image.

Twitter, meanwhile, just last week began allowing iOS and Android users to add descriptions, or alternative text (alt text), to images. Enable the feature via the "compose image descriptions" option in the app's accessibility settings. Summaries are limited to 420 characters.

Categories
APPLICATIONS
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    Number of Icon Packs are Free on Google Play Right Now

    Should you consider yourself a fan of custom icon packs, such as the one shown above (Griddy), you’ll find a few developers are taking advantage of Google Play’s new discount feature, offering various packs free of charge.Most of these packs range in the $1 to $2 range, and you’ll never hear me complain about free icon packs.
  • 5300c769af79e

    Google-Owned DeepMind to Set Up Shop in US

    Google-owned artificial intelligence lab DeepMind is setting up shop in the US.The London-based firm last week advertised a new job as an applied research scientist in Mountain View, Calif.
  • 5300c769af79e

    ShowBox APK for Android | Download Apps For Free

    We are talking about an app for android that puts hundreds of TV shows and movies in your pocket.Once you understand the benefits of the Showbox APK file then you will understand why people are wondering.
  • 5300c769af79e

    Symantec Norton Security Premium (2017)

    Symantec Norton Security Premium contains virtually every security component you can imagine, and a number of them are Editors' Choice products in their own right.It lets you install Norton security on up to 10 Windows, Android, macOS, and iOS devices.