The currently validated research highlights an original project: reconstructing qualitative videos from brain imaging data based on artificial intelligence. “MinD-Video” allows us to better understand our cognitive process.
You will also be interested
[EN VIDÉO] Artificial intelligence that adjusts the angle at which the photo is taken Interactive point-based manipulation of a generative image collector. © DragAN project
In order to better understand our cognitive mechanisms, researchers are trying to reconstruct human vision from our brain functions. Although recent research has already achieved great success in reconstructing static images from non-invasive brain recordings, there is a lack of recovery of continuous visual experiences as videos.
The “MinD-Video” program enables high-quality video reconstruction from brain recordings. A peer-reviewed study can be found on the pre-publication site Arxiv. Based on AI, the new model gradually learns spatio-temporal information from videos, and it infers information from brain signals (continuous fMRI scanner data modelingmodeling hidden from the brain).
A biologically plausible and interpretable model
The result provides video images that are very close to reality, again showing the impressive capabilities of AI. ” Analysis of attention revealed correspondence with visual cortex and higher cognitive networks. “, the researchers note.
Their analysis is particularly illustrative the lightthe light A key role of the visual cortex in processing spatio-temporal visual information. Also, their EncoderEncoder Works in hierarchical layers: early layers focus on structural information, while deeper layers focus on learning more abstract visual features.
