Convolutional neural network driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode functional magnetic resonance imaging data from humans watching natural movies, despite its lack of any mechanism to account for temporal dynamics or feedback processing. Using separate data, encoding and decoding models were developed and evaluated for describing the bi-directional relationships between the CNN and the brain (Wen et al., 2017). Here, we provided the main source codes (Matlab or Python) that are related to this study. 

Reference:  Wen, H., Shi, J., Zhang, Y., Lu, KH., Cao JY. & Liu, Z. (2017). Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision. Cerebral cortex. In press. 

Researchers should cite this work as follows:

• Wen, H.; Shi, J.; Zhang, Y.; Lu, K.; Cao, J.; Liu, Z. (2017). Source code for Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision. Purdue University Research Repository. doi:10.4231/R7V98675

  BibTex | EndNote

1. Biomedical Engineering
2. Biomedical Engineering (Dept)
3. deep learning
4. FMR1
5. LIBI
6. Matlab
7. natural vision
8. neural decoding
9. Neural encoding
10. Neuroscience
11. Python Code
12. Source Code