'Touch' Videos With Interactive MIT Tech

...

Researchers are working on a new type of virtual reality—no headset required.

MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) developed a way to "touch" objects you see in a video, which it calls Interactive Dynamic Video (IDV).

"One of the most important ways that we experience our environment is by manipulating it: we push, pull, poke, and prod to test hypotheses about our surroundings," the IDV site said. "By observing how objects respond to forces that we control, we learn about their dynamics.

"Unfortunately, regular video does not afford this type of manipulation—it limits us to observing what was recorded," the page continued. "The goal of our work is to record objects in a way that captures not only their appearance, but their physical behavior as well."

Led by CSAIL PhD student Abe Davis, the research team examined tiny, almost invisible tremors they created on camera by banging the surface near an object—a small wire statue, for instance.

Each vibration pattern, or mode, represents different ways the object moves—up, down, side to side. By identifying those modes, the team can predict how an object might act in new situations, allowing someone to virtually interact with the on-screen statue, tugging at it with a mouse and watching it bounce back into place.

This and other simulations, Davis admitts, are not perfect. But they are a "very useful starting point," he says.

IDV technology would most likely be used in engineering applications, such as structural health monitoring (SHM)—the process of predicting the safety of an old bridge or building. Aspiring filmmakers should also keep their eyes on the emerging tech, which—as the video above highlights—is ideal for making low-cost special effects for movies.

Categories
GAMES
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    Aruba ClearPass Policy Management Platform

    Download To protect the enterprise, IT needs an adaptive security approach to make smart decisions about who (and what) can connect to the network.Today's enterprise workforce has virtually erased the notion of a fixed perimeter - it doesn't exist when users can connect from anywhere.
  • 5300c769af79e

    DEAL: Unlocked Moto Z Play at eBay for $369 ($80 Off)

    Outside of the Pixel and Galaxy S7, the Moto Z Play is probably my other favorite Android phone of 2016.If you haven’t already, be sure to checkout our Moto Z Play review for the full details.
  • 5300c769af79e

    Panasonic Invests $60M in Laundry-Folding Robot

    Children and robots are our future—which is probably why Panasonic recently invested $60 million in the world's first laundry-folding bot.From Japan-based Seven Dreamers, Laundroid uses image-recognition algorithms and tech to identify types of clothing (T-shirts, towels, pants, etc.
  • 5300c769af79e

    Facebook now loads images 15% faster on iOS, cuts Android errors by 8%

    Today Facebook engineers are talking about the hard work they’ve done recently to speed up rendering for Facebook’s iOS and Android apps.For the Facebook iOS app, engineers some time ago adopted an image format called Progressive JPEG (PJPEG), Facebook explained today in an engineering blog post.