Search Results for author: Shinji Nishimoto

Found 8 papers, 1 papers with code

Applicability of scaling laws to vision encoding models

no code implementations1 Aug 2023 Takuya Matsuyama, Kota S Sasaki, Shinji Nishimoto

(2) How does the prediction accuracy across the visual cortex vary with the parameter size of the vision models?

Brain2Music: Reconstructing Music from Human Brain Activity

no code implementations20 Jul 2023 Timo I. Denk, Yu Takagi, Takuya Matsuyama, Andrea Agostinelli, Tomoya Nakai, Christian Frank, Shinji Nishimoto

The process of reconstructing experiences from human brain activity offers a unique lens into how the brain interprets and represents the world.

Music Generation Retrieval

Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs

1 code implementation20 Jun 2023 Yu Takagi, Shinji Nishimoto

The reconstruction of visual experience from human brain activity is an area that has particularly benefited: the use of deep learning models trained on large amounts of natural images has greatly improved its quality, and approaches that combine the diverse information contained in visual experiences have proliferated rapidly in recent years.

Image Reconstruction

High-Resolution Image Reconstruction With Latent Diffusion Models From Human Brain Activity

no code implementations CVPR 2023 Yu Takagi, Shinji Nishimoto

Here, we propose a new method based on a diffusion model (DM) to reconstruct images from human brain activity obtained via functional magnetic resonance imaging (fMRI).

Denoising Image Reconstruction

Voluntary control of semantic neural representations by imagery with conflicting visual stimulation

no code implementations7 Nov 2021 Ryohei Fukuma, Takufumi Yanagisawa, Shinji Nishimoto, Hidenori Sugano, Kentaro Tamura, Shota Yamamoto, Yasushi Iimura, Yuya Fujita, Satoru Oshino, Naoki Tani, Naoko Koide-Majima, Yukiyasu Kamitani, Haruhiko Kishima

The successful control of the feedback images demonstrated that the semantic vector inferred from electrocorticograms became closer to the vector of the imagined category, even while watching images from different categories.

Brain-mediated Transfer Learning of Convolutional Neural Networks

no code implementations24 May 2019 Satoshi Nishida, Yusuke Nakano, Antoine Blanc, Naoya Maeda, Masataka Kado, Shinji Nishimoto

Thus, our BTL provides a framework to improve the generalization ability of machine-learning feature representations and enable machine learning to estimate human-like cognition and behavior, including individual variability.

BIG-bench Machine Learning Transfer Learning

Describing Semantic Representations of Brain Activity Evoked by Visual Stimuli

no code implementations19 Jan 2018 Eri Matsuo, Ichiro Kobayashi, Shinji Nishimoto, Satoshi Nishida, Hideki Asoh

The results demonstrate that the proposed model can decode brain activity and generate descriptions using natural language sentences.

Image Captioning Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.