Search Results for author: Zijin Gu

Found 7 papers, 5 papers with code

dMel: Speech Tokenization made Simple

1 code implementation22 Jul 2024 He Bai, Tatiana Likhomanenko, Ruixiang Zhang, Zijin Gu, Zakaria Aldeneh, Navdeep Jaitly

Large language models have revolutionized natural language processing by leveraging self-supervised pretraining on vast textual data.

Decoder Language Modelling +4

Denoising LM: Pushing the Limits of Error Correction Models for Speech Recognition

no code implementations24 May 2024 Zijin Gu, Tatiana Likhomanenko, He Bai, Erik McDermott, Ronan Collobert, Navdeep Jaitly

Language models (LMs) have long been used to improve results of automatic speech recognition (ASR) systems, but they are unaware of the errors that ASR systems make.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Modulating human brain responses via optimal natural image selection and synthetic image generation

no code implementations18 Apr 2023 Zijin Gu, Keith Jamison, Mert R. Sabuncu, Amy Kuceyeski

Furthermore, aTLfaces and FBA1 had higher activation in response to maximal synthetic images compared to maximal natural images.

Image Generation

Decoding natural image stimuli from fMRI data with a surface-based convolutional network

1 code implementation5 Dec 2022 Zijin Gu, Keith Jamison, Amy Kuceyeski, Mert Sabuncu

In this work, we propose a novel approach for this task, which we call Cortex2Image, to decode visual stimuli with high semantic fidelity and rich fine-grained detail.

Personalized visual encoding model construction with small data

1 code implementation4 Feb 2022 Zijin Gu, Keith Jamison, Mert Sabuncu, Amy Kuceyeski

Our approach shows the potential to use previously collected, deeply sampled data to efficiently create accurate, personalized encoding models and, subsequently, personalized optimal synthetic images for new individuals scanned under different experimental conditions.

NeuroGen: activation optimized image synthesis for discovery neuroscience

2 code implementations15 May 2021 Zijin Gu, Keith W. Jamison, Meenakshi Khosla, Emily J. Allen, Yihan Wu, Thomas Naselaris, Kendrick Kay, Mert R. Sabuncu, Amy Kuceyeski

NeuroGen combines an fMRI-trained neural encoding model of human vision with a deep generative network to synthesize images predicted to achieve a target pattern of macro-scale brain activation.

Image Generation

Cannot find the paper you are looking for? You can Submit a new open access paper.