Search Results for author: Xinyu Chen

Found 24 papers, 11 papers with code

Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment

no code implementations21 Feb 2024 Yunxin Li, Xinyu Chen, Baotian Hu, Haoyuan Shi, Min Zhang

Evaluating and Rethinking the current landscape of Large Multimodal Models (LMMs), we observe that widely-used visual-language projection approaches (e. g., Q-former or MLP) focus on the alignment of image-text descriptions yet ignore the visual knowledge-dimension alignment, i. e., connecting visuals to their relevant knowledge.

Language Modelling Question Answering +1

LLMs Meet Long Video: Advancing Long Video Comprehension with An Interactive Visual Adapter in LLMs

no code implementations21 Feb 2024 Yunxin Li, Xinyu Chen, Baotain Hu, Min Zhang

Long video understanding is a significant and ongoing challenge in the intersection of multimedia and artificial intelligence.

Video Understanding

A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question Answering

no code implementations13 Nov 2023 Yunxin Li, Longyue Wang, Baotian Hu, Xinyu Chen, Wanqi Zhong, Chenyang Lyu, Wei Wang, Min Zhang

The emergence of multimodal large models (MLMs) has significantly advanced the field of visual understanding, offering remarkable capabilities in the realm of visual question answering (VQA).

Decision Making General Knowledge +3

Understanding Deep Neural Networks via Linear Separability of Hidden Layers

no code implementations26 Jul 2023 Chao Zhang, Xinyu Chen, Wensheng Li, Lixue Liu, Wei Wu, DaCheng Tao

In this paper, we measure the linear separability of hidden layer outputs to study the characteristics of deep neural networks.

Optimal Weighted Random Forests

no code implementations17 May 2023 Xinyu Chen, Dalei Yu, Xinyu Zhang

The random forest (RF) algorithm has become a very popular prediction method for its great flexibility and promising accuracy.

feature selection

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

1 code implementation8 May 2023 Yunxin Li, Baotian Hu, Xinyu Chen, Yuxin Ding, Lin Ma, Min Zhang

This makes the language model well-suitable for such multi-modal reasoning scenario on joint textual and visual clues.

Language Modelling

LMEye: An Interactive Perception Network for Large Language Models

1 code implementation5 May 2023 Yunxin Li, Baotian Hu, Xinyu Chen, Lin Ma, Yong Xu, Min Zhang

LMEye addresses this issue by allowing the LLM to request the desired visual information aligned with various human instructions, which we term as the dynamic visual information interaction.

Language Modelling Large Language Model +1

Laplacian Convolutional Representation for Traffic Time Series Imputation

1 code implementation3 Dec 2022 Xinyu Chen, Zhanhong Cheng, Nicolas Saunier, Lijun Sun

In this study, we first introduce a Laplacian kernel to temporal regularization for characterizing local trends in traffic time series, which can be formulated in the form of circular convolution.

Decision Making Image Inpainting +4

Discovering Dynamic Patterns from Spatiotemporal Data with Time-Varying Low-Rank Autoregression

1 code implementation28 Nov 2022 Xinyu Chen, ChengYuan Zhang, Xiaoxu Chen, Nicolas Saunier, Lijun Sun

In the temporal context, the complex time-varying system behaviors can be revealed by the temporal modes in the proposed model.

Model Compression

TCBERT: A Technical Report for Chinese Topic Classification BERT

no code implementations21 Nov 2022 Ting Han, Kunhao Pan, Xinyu Chen, Dingjie Song, Yuchen Fan, Xinyu Gao, Ruyi Gan, Jiaxing Zhang

Bidirectional Encoder Representations from Transformers or BERT~\cite{devlin-etal-2019-bert} has been one of the base models for various NLP tasks due to its remarkable performance.

Classification Contrastive Learning +1

POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices

no code implementations17 May 2022 Xinyu Chen, Renjie Li, Yueyao Yu, Yuanwen Shen, Wenye Li, Zhaoyu Zhang, Yin Zhang

In this work, we propose the first-ever Transformer model (POViT) to efficiently design and simulate semiconductor photonic devices with multiple objectives.

NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results

2 code implementations11 May 2022 Yawei Li, Kai Zhang, Radu Timofte, Luc van Gool, Fangyuan Kong, Mingxi Li, Songwei Liu, Zongcai Du, Ding Liu, Chenhui Zhou, Jingyi Chen, Qingrui Han, Zheyuan Li, Yingqi Liu, Xiangyu Chen, Haoming Cai, Yu Qiao, Chao Dong, Long Sun, Jinshan Pan, Yi Zhu, Zhikai Zong, Xiaoxiao Liu, Zheng Hui, Tao Yang, Peiran Ren, Xuansong Xie, Xian-Sheng Hua, Yanbo Wang, Xiaozhong Ji, Chuming Lin, Donghao Luo, Ying Tai, Chengjie Wang, Zhizhong Zhang, Yuan Xie, Shen Cheng, Ziwei Luo, Lei Yu, Zhihong Wen, Qi Wu1, Youwei Li, Haoqiang Fan, Jian Sun, Shuaicheng Liu, Yuanfei Huang, Meiguang Jin, Hua Huang, Jing Liu, Xinjian Zhang, Yan Wang, Lingshun Long, Gen Li, Yuanfan Zhang, Zuowei Cao, Lei Sun, Panaetov Alexander, Yucong Wang, Minjie Cai, Li Wang, Lu Tian, Zheyuan Wang, Hongbing Ma, Jie Liu, Chao Chen, Yidong Cai, Jie Tang, Gangshan Wu, Weiran Wang, Shirui Huang, Honglei Lu, Huan Liu, Keyan Wang, Jun Chen, Shi Chen, Yuchun Miao, Zimo Huang, Lefei Zhang, Mustafa Ayazoğlu, Wei Xiong, Chengyi Xiong, Fei Wang, Hao Li, Ruimian Wen, Zhijing Yang, Wenbin Zou, Weixin Zheng, Tian Ye, Yuncheng Zhang, Xiangzhen Kong, Aditya Arora, Syed Waqas Zamir, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Dandan Gaoand Dengwen Zhouand Qian Ning, Jingzhu Tang, Han Huang, YuFei Wang, Zhangheng Peng, Haobo Li, Wenxue Guan, Shenghua Gong, Xin Li, Jun Liu, Wanjun Wang, Dengwen Zhou, Kun Zeng, Hanjiang Lin, Xinyu Chen, Jinsheng Fang

The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29. 00dB on DIV2K validation set.

Image Super-Resolution

An Adaptive Deep Clustering Pipeline to Inform Text Labeling at Scale

no code implementations1 Feb 2022 Xinyu Chen, Ian Beaver

Mining the latent intentions from large volumes of natural language inputs is a key step to help data analysts design and refine Intelligent Virtual Assistants (IVAs) for customer service and sales support.

Clustering Community Detection +1

A Semi-Supervised Deep Clustering Pipeline for Mining Intentions From Texts

no code implementations1 Feb 2022 Xinyu Chen, Ian Beaver

The clustering quality exceeds the state-of-the-art results when BERT is fine-tuned with labeled subsets of only 2. 5% of the task data.

Clustering Community Detection +1

Ultralow complexity long short-term memory network for fiber nonlinearity mitigation in coherent optical communication systems

no code implementations12 Aug 2021 Hao Ming, Xinyu Chen, Xiansong Fang, Lei Zhang, Chenjia Li, Fan Zhang

In this paper, we propose a center-oriented long short-term memory network (Co-LSTM) incorporating a simplified mode with a recycling mechanism in the equalization operation, which can mitigate fiber nonlinearity in coherent optical communication systems with ultralow complexity.

Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputation

1 code implementation30 Apr 2021 Xinyu Chen, MengYing Lei, Nicolas Saunier, Lijun Sun

In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework by introducing \textit{temporal variation} as a new regularization term into the completion of a third-order (sensor $\times$ time of day $\times$ day) tensor.

Imputation Time Series +2

Scalable Low-Rank Tensor Learning for Spatiotemporal Traffic Data Imputation

2 code implementations7 Aug 2020 Xinyu Chen, Yixian Chen, Nicolas Saunier, Lijun Sun

Recent studies based on tensor nuclear norm have demonstrated the superiority of tensor learning in imputation tasks by effectively characterizing the complex correlations/dependencies in spatiotemporal data.

Imputation Traffic Data Imputation

Incremental Bayesian tensor learning for structural monitoring data imputation and response forecasting

no code implementations1 Jul 2020 Pu Ren, Xinyu Chen, Lijun Sun, Hao Sun

To address this fundamental issue, this paper presents an incremental Bayesian tensor learning method for reconstruction of spatiotemporal missing data in SHM and forecasting of structural response.

Imputation Incremental Learning +1

Low-Rank Autoregressive Tensor Completion for Multivariate Time Series Forecasting

1 code implementation18 Jun 2020 Xinyu Chen, Lijun Sun

In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework to model multivariate time series data.

Imputation Multivariate Time Series Forecasting +2

A Nonconvex Low-Rank Tensor Completion Model for Spatiotemporal Traffic Data Imputation

1 code implementation23 Mar 2020 Xinyu Chen, Jinming Yang, Lijun Sun

Sparsity and missing data problems are very common in spatiotemporal traffic data collected from various sensing systems.

Imputation Traffic Data Imputation

Bayesian Temporal Factorization for Multidimensional Time Series Prediction

3 code implementations14 Oct 2019 Xinyu Chen, Lijun Sun

In this paper, we propose a Bayesian temporal factorization (BTF) framework for modeling multidimensional time series -- in particular spatiotemporal data -- in the presence of missing values.

Imputation Test +2

A Survey on Graph Processing Accelerators: Challenges and Opportunities

no code implementations26 Feb 2019 Chuangyi Gui, Long Zheng, Bingsheng He, Cheng Liu, Xinyu Chen, Xiaofei Liao, Hai Jin

Graph is a well known data structure to represent the associated relationships in a variety of applications, e. g., data science and machine learning.

Distributed, Parallel, and Cluster Computing

In situ TensorView: In situ Visualization of Convolutional Neural Networks

no code implementations16 Jun 2018 Xinyu Chen, Qiang Guan, Li-Ta Lo, Simon Su, James Ahrens, Trilce Estrada

We present in situ TensorView to visualize the training and functioning of CNNs as if they are systems of scientific simulations.

Cannot find the paper you are looking for? You can Submit a new open access paper.