Scientists Turn Brain’s Visual Memories into a Mind-Blowing Video
[quote]Ever dreamed of recording your dreams and turning them into a video clip? The technology that enables you to do that is near: UC Berkeley scientists figured out a way to turn the way our brains interpret visual stimuli into a video, and the result is amazing.
To be able to do this, the researches used functĂonal Magnetic Resonance Imaging (fMRI) to measure the blood flow through brain’s visual cortex. Then, different parts of the brain were divided into volumetric pixels or voxels (the term might be familiar to those who remember early 3D gámes which were based on voxels instead of polygons which are more commonly used today). Finally, the scientists built a computational model which describes how visual information is mapped into brain actĂvĂty.
In practice, test subjects viewed some video clips, and their brain actĂvĂty was recorded by a computer program, which learned how to associate the visual patterns in the movie with the corresponding brain actĂvĂty.
Then, test subjects viewed a second set of clips. The movie reconstruction algorithm was fed 18 million seconds of random YouTube videos, which were used to teach the program how to predict the brain actĂvĂty evoked by fĂlm clips. Finally, the program chose 100 clips which were most similar to the movie the subject had seen, which were merged to create a reconstruction of the original movie.
The result is a video that shows how our brain sees things, and at moments it’s eerily similar to the original imagery.
“This is a major leap toward reconstructing internal imagery. We are opening a window into the movies in our minds,” said Professor Jack Gallant, a UC Berkeley neuroscientist and coauthor of the study published in the journal Current Biology.
Recording our dreams and “reading” the minds of coma patients requires a lot of work stĂll, as current technology only enables scientists to interpret brain actĂvĂty while the test subject is watching a movie. Ultimately, it could be used to decode how our brain processes visual events in everyday life or, perhaps, our dreams.
Check out another video, which shows the movie reconstruction algorithm at work, below. More details about the study can be found here.
Watch video @ http://mashable.com/2011/09/23/scientis ... -memories/
[quote]Ever dreamed of recording your dreams and turning them into a video clip? The technology that enables you to do that is near: UC Berkeley scientists figured out a way to turn the way our brains interpret visual stimuli into a video, and the result is amazing.
To be able to do this, the researches used functĂonal Magnetic Resonance Imaging (fMRI) to measure the blood flow through brain’s visual cortex. Then, different parts of the brain were divided into volumetric pixels or voxels (the term might be familiar to those who remember early 3D gámes which were based on voxels instead of polygons which are more commonly used today). Finally, the scientists built a computational model which describes how visual information is mapped into brain actĂvĂty.
In practice, test subjects viewed some video clips, and their brain actĂvĂty was recorded by a computer program, which learned how to associate the visual patterns in the movie with the corresponding brain actĂvĂty.
Then, test subjects viewed a second set of clips. The movie reconstruction algorithm was fed 18 million seconds of random YouTube videos, which were used to teach the program how to predict the brain actĂvĂty evoked by fĂlm clips. Finally, the program chose 100 clips which were most similar to the movie the subject had seen, which were merged to create a reconstruction of the original movie.
The result is a video that shows how our brain sees things, and at moments it’s eerily similar to the original imagery.
“This is a major leap toward reconstructing internal imagery. We are opening a window into the movies in our minds,” said Professor Jack Gallant, a UC Berkeley neuroscientist and coauthor of the study published in the journal Current Biology.
Recording our dreams and “reading” the minds of coma patients requires a lot of work stĂll, as current technology only enables scientists to interpret brain actĂvĂty while the test subject is watching a movie. Ultimately, it could be used to decode how our brain processes visual events in everyday life or, perhaps, our dreams.
Check out another video, which shows the movie reconstruction algorithm at work, below. More details about the study can be found here.
Watch video @ http://mashable.com/2011/09/23/scientis ... -memories/
