Search Results for author: Sen Song

Found 21 papers, 7 papers with code

Contrastive Learning of Shared Spatiotemporal EEG Representations Across Individuals for Naturalistic Neuroscience

no code implementations22 Feb 2024 Xinke Shen, Lingyi Tao, Xuyang Chen, Sen Song, Quanying Liu, Dan Zhang

Targeting the Electroencephalogram (EEG) technique, known for its rich spatial and temporal information, this study presents a framework for Contrastive Learning of Shared SpatioTemporal EEG Representations across individuals (CL-SSTER).

Brain Decoding Contrastive Learning +1

UniMem: Towards a Unified View of Long-Context Large Language Models

1 code implementation5 Feb 2024 Junjie Fang, Likai Tang, Hongzhe Bi, Yujia Qin, Si Sun, Zhenyu Li, Haolun Li, Yongjian Li, Xin Cong, Yankai Lin, Yukun Yan, Xiaodong Shi, Sen Song, Zhiyuan Liu, Maosong Sun

Distinguished by its four core dimensions-Memory Management, Memory Writing, Memory Reading, and Memory Injection, UniMem empowers researchers to conduct systematic exploration of long-context methods.

Management

OpenChat: Advancing Open-source Language Models with Mixed-Quality Data

1 code implementation20 Sep 2023 Guan Wang, Sijie Cheng, Xianyuan Zhan, Xiangang Li, Sen Song, Yang Liu

Specifically, we consider the general SFT training data, consisting of a small amount of expert data mixed with a large proportion of sub-optimal data, without any preference labels.

Arithmetic Reasoning Code Generation +1

AI of Brain and Cognitive Sciences: From the Perspective of First Principles

no code implementations20 Jan 2023 Luyao Chen, Zhiqiang Chen, Longsheng Jiang, Xiang Liu, Linlu Xu, Bo Zhang, Xiaolong Zou, Jinying Gao, Yu Zhu, Xizi Gong, Shan Yu, Sen Song, Liangyi Chen, Fang Fang, Si Wu, Jia Liu

Nowadays, we have witnessed the great success of AI in various applications, including image classification, game playing, protein structure analysis, language translation, and content generation.

Few-Shot Learning Image Classification

Simulated annealing for optimization of graphs and sequences

no code implementations1 Oct 2021 Xianggen Liu, Pengyong Li, Fandong Meng, Hao Zhou, Huasong Zhong, Jie zhou, Lili Mou, Sen Song

The key idea is to integrate powerful neural networks into metaheuristics (e. g., simulated annealing, SA) to restrict the search space in discrete optimization.

Paraphrase Generation

Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition

no code implementations20 Sep 2021 Xinke Shen, Xianggen Liu, Xin Hu, Dan Zhang, Sen Song

Contrastive learning was employed to minimize the inter-subject differences by maximizing the similarity in EEG signal representations across subjects when they received the same emotional stimuli in contrast to different ones.

Contrastive Learning EEG +4

An effective self-supervised framework for learning expressive molecular global representations to drug discovery

1 code implementation Briefings in Bioinformatics 2021 Pengyong Li, Jun Wang, Yixuan Qiao, Hao Chen, Yihuan Yu, Xiaojun Yao, Peng Gao, Guotong Xie, Sen Song

In MPG, we proposed a powerful GNN for modelling molecular graph named MolGNet, and designed an effective self-supervised strategy for pre-training the model at both the node and graph-level.

Drug Discovery Graph Neural Network

Learn molecular representations from large-scale unlabeled molecules for drug discovery

no code implementations21 Dec 2020 Pengyong Li, Jun Wang, Yixuan Qiao, Hao Chen, Yihuan Yu, Xiaojun Yao, Peng Gao, Guotong Xie, Sen Song

Here, we proposed a novel Molecular Pre-training Graph-based deep learning framework, named MPG, that leans molecular representations from large-scale unlabeled molecules.

Drug Discovery Graph Neural Network

TrimNet: learning molecular representation from triplet messages for biomedicine

1 code implementation4 Nov 2020 Pengyong Li, Yuquan Li, Chang-Yu Hsieh, Shengyu Zhang, Xianggen Liu, Huanxiang Liu, Sen Song, Xiaojun Yao

These advantages have established TrimNet as a powerful and useful computational tool in solving the challenging problem of molecular representation learning.

Drug Discovery Molecular Property Prediction +5

Brain-inspired global-local learning incorporated with neuromorphic computing

no code implementations5 Jun 2020 Yujie Wu, Rong Zhao, Jun Zhu, Feng Chen, Mingkun Xu, Guoqi Li, Sen Song, Lei Deng, Guanrui Wang, Hao Zheng, Jing Pei, Youhui Zhang, Mingguo Zhao, Luping Shi

We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors.

Continual Learning Few-Shot Learning

Unsupervised Paraphrasing by Simulated Annealing

no code implementations ACL 2020 Xianggen Liu, Lili Mou, Fandong Meng, Hao Zhou, Jie zhou, Sen Song

Unsupervised paraphrase generation is a promising and important research topic in natural language processing.

Diversity Paraphrase Generation +3

JUMPER: Learning When to Make Classification Decisions in Reading

no code implementations6 Jul 2018 Xianggen Liu, Lili Mou, Haotian Cui, Zhengdong Lu, Sen Song

Both the classification result and when to make the classification are part of the decision process, which is controlled by a policy network and trained with reinforcement learning.

General Classification Reinforcement Learning +2

Estimation of the volume of the left ventricle from MRI images using deep neural networks

1 code implementation13 Feb 2017 Fangzhou Liao, Xi Chen, Xiaolin Hu, Sen Song

In 2016, Kaggle organized a competition to estimate the volume of LV from MRI images.

CaMKII activation supports reward-based neural network optimization through Hamiltonian sampling

no code implementations1 Jun 2016 Zhaofei Yu, David Kappel, Robert Legenstein, Sen Song, Feng Chen, Wolfgang Maass

Our theoretical analysis shows that stochastic search could in principle even attain optimal network configurations by emulating one of the most well-known nonlinear optimization methods, simulated annealing.

Attentional Neural Network: Feature Selection Using Cognitive Feedback

1 code implementation NeurIPS 2014 Qian Wang, Jiaxing Zhang, Sen Song, Zheng Zhang

Attentional Neural Network is a new framework that integrates top-down cognitive bias and bottom-up feature extraction in one coherent architecture.

feature selection General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.