Facebook to Use AI to Describe Photos to Blind Users

...

Facebook is making it easier for the blind and visually impaired to see and interact with friends' photos.

Automatic alternative text generates an image description using object recognition technology. Previously, the social network announced only the name of the person who posted the photo on Facebook, followed by the term "photo." Now, anyone operating a screen reader on an iOS device can hear a list of items in each picture: for example, "Image may contain three people, smiling, outdoors."

"Now we can offer a richer description of what's in a photo thanks to automatic alt text," software engineers Shaomei Wu and Hermes Pique and head of accessibility Jeffrey Wieland wrote in a blog post.

Automatic alt text rolls out this week to iOS screen readers set to English, but will be available in other languages and platforms "soon," the social network says.

"While this technology is still nascent, tapping its current capabilities to describe photos is an important step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," the Facebook blog said.

In November, the Facebook AI Research (FAIR) team achieved "new milestones," including a "state-of-the-art system that segments, or distinguishes between, objects in a photo" 30 percent faster and using 10 times less training data than previous industry benchmarks. So when a friend posts an snapshot of their cat sunbathing on the sofa, Facebook's AI (pictured) can describe the image in enough detail for the user to form a mental image.

Twitter, meanwhile, just last week began allowing iOS and Android users to add descriptions, or alternative text (alt text), to images. Enable the feature via the "compose image descriptions" option in the app's accessibility settings. Summaries are limited to 420 characters.

Categories
APPLICATIONS
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    The Best Unlimited Data Plan: Verizon vs. T-Mobile vs. AT&T vs. Sprint

    announced revamped, tweaked, or entirely new unlimited data plans.But just because all four major carriers now offer “unlimited” data doesn’t mean that the plans are equal.
  • 5300c769af79e

    Is This the Beginning of the End for the Set-Top Box?

    Now it is partnering with MobiTV to offer a new television service for the home.While I hope it is a successful service for C Spire and its customers, it raises several nagging questions.
  • 5300c769af79e

    LG G6: First 10 Things You Should Do

    The LG G6 doesn’t have a firm launch date just yet, but once it does show up at your local carrier store, we want you to know exactly the types of settings to consider as you unbox and then begin setup.As we have done with top-tier phones for some time, we’ve put together a video list of the first 10 things we think you should do to help get you on your way to getting the most out of your new phone.
  • 5300c769af79e

    Link to us

    Draftmobile is a media company obsessed with covering amazing technology and why it matters in our lives.From the most innovative tech and gaming companies — and the incredible people behind them — to the money fueling it all, we’re devoted to exhaustive coverage of the technology revolution.