Facebook to Use AI to Describe Photos to Blind Users

...

Facebook is making it easier for the blind and visually impaired to see and interact with friends' photos.

Automatic alternative text generates an image description using object recognition technology. Previously, the social network announced only the name of the person who posted the photo on Facebook, followed by the term "photo." Now, anyone operating a screen reader on an iOS device can hear a list of items in each picture: for example, "Image may contain three people, smiling, outdoors."

"Now we can offer a richer description of what's in a photo thanks to automatic alt text," software engineers Shaomei Wu and Hermes Pique and head of accessibility Jeffrey Wieland wrote in a blog post.

Automatic alt text rolls out this week to iOS screen readers set to English, but will be available in other languages and platforms "soon," the social network says.

"While this technology is still nascent, tapping its current capabilities to describe photos is an important step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," the Facebook blog said.

In November, the Facebook AI Research (FAIR) team achieved "new milestones," including a "state-of-the-art system that segments, or distinguishes between, objects in a photo" 30 percent faster and using 10 times less training data than previous industry benchmarks. So when a friend posts an snapshot of their cat sunbathing on the sofa, Facebook's AI (pictured) can describe the image in enough detail for the user to form a mental image.

Twitter, meanwhile, just last week began allowing iOS and Android users to add descriptions, or alternative text (alt text), to images. Enable the feature via the "compose image descriptions" option in the app's accessibility settings. Summaries are limited to 420 characters.

Categories
APPLICATIONS
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    CES: LG Created a Speaker That You Wear Around Your Neck

    Not only will LG show off a levitating Bluetooth speaker at CES, the Korean electronics giant also has new TONE audio products on the way.The two new TONE options are the TONE Studio and TONE Free, both of which offer their own unique take on the collar audio trend that LG seems to be fully invested in.
  • 5300c769af79e

    So, Yeah, T-Mobile is Gifting Customers With Free Pokémon GO Data

    This free data will be good for one year, so whenever you are out and about capturing Pokémon or taking over gyms, you won’t need to worry about your data usage.I have been playing Pokemon GO for about a week now, and from what I can tell, the app does more harm to your smartphone’s battery than it does to your data plan.
  • 5300c769af79e

    HPE Reportedly Considers Going Private

    They are empowered Has HPE put itself or its software business up for sale?Multiple reports note that a group of private equity companies are interested in buying the software business, or taking the entire company private.
  • 5300c769af79e

    Avast Pro Antivirus 2017

    Some products go way beyond the basics; Avast Pro Antivirus 2017 is one such.Compare Similar ProductsCompare Bitdefender Antivirus Plus 2017 %displayPrice% Kaspersky Anti-Virus (2017) %displayPrice% McAfee AntiVirus Plus (2017) %displayPrice% Webroot SecureAnywhere AntiVirus %displayPrice% Emsisoft Anti-Malware 11.