'Touch' Videos With Interactive MIT Tech

...

Researchers are working on a new type of virtual reality—no headset required.

MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) developed a way to "touch" objects you see in a video, which it calls Interactive Dynamic Video (IDV).

"One of the most important ways that we experience our environment is by manipulating it: we push, pull, poke, and prod to test hypotheses about our surroundings," the IDV site said. "By observing how objects respond to forces that we control, we learn about their dynamics.

"Unfortunately, regular video does not afford this type of manipulation—it limits us to observing what was recorded," the page continued. "The goal of our work is to record objects in a way that captures not only their appearance, but their physical behavior as well."

Led by CSAIL PhD student Abe Davis, the research team examined tiny, almost invisible tremors they created on camera by banging the surface near an object—a small wire statue, for instance.

Each vibration pattern, or mode, represents different ways the object moves—up, down, side to side. By identifying those modes, the team can predict how an object might act in new situations, allowing someone to virtually interact with the on-screen statue, tugging at it with a mouse and watching it bounce back into place.

This and other simulations, Davis admitts, are not perfect. But they are a "very useful starting point," he says.

IDV technology would most likely be used in engineering applications, such as structural health monitoring (SHM)—the process of predicting the safety of an old bridge or building. Aspiring filmmakers should also keep their eyes on the emerging tech, which—as the video above highlights—is ideal for making low-cost special effects for movies.

Categories
GAMES
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    Rounded ZenWatch 3 Strolls Through FCC Ahead of IFA

    The ZenWatch 3, likely to be unveiled at this year’s IFA in early September, has been unintentionally announced via a FCC filing.As you can see from the sketch above that was located in the filing, the ZenWatch 3 might come with a very different design than previous ZenWatch models, featuring a rounded display this year.
  • 5300c769af79e

    Google Home's Conversation Actions are Open for Developers to Make Magic Happen

    During Google’s unveiling of Google Home, the Pixel phones, and Google Assistant a couple of months ago, they showed off a preview of the future of Assistant on both devices.Today, Google has opened up one of those two pieces on Google Home, which could lead to the third party, conversational action magic you’ve been dreaming of.
  • 5300c769af79e

    Microsoft Launches Teams to Foil Office 365 Poachers

    It's trying to take that behemoth that's Microsoft and make it more responsive to the marketplace.The full gamut of Office tools is integrated into Teams, including Word, Excel, PowerPoint, SharePoint, OneNote, Planner, Power BI and Delve.
  • 5300c769af79e

    China Subjects Tech Imports to Heavy Security Scrutiny

    They might be used to block the import of products or to extract trade secrets in exchange for access to China's market.Tech knowledge so obtained might be passed on to Chinese companies competing with foreign ones, or expose vulnerabilities that could be exploited by hackers in China.