1 code implementation • 25 Jun 2024 • Songming Zhang, Xue Zhang, Zengkui Sun, Yufeng Chen, Jinan Xu
Furthermore, this discrepancy also hinders the KD process between models with different vocabularies, which is common for current LLMs.
1 code implementation • 24 Jun 2024 • Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Yufeng Chen, Jinan Xu, Jie zhou
To address this issue, we first investigate how LLMs process multilingual factual knowledge and discover that the same factual knowledge in different languages generally activates a shared set of neurons, which we call language-agnostic factual neurons (LAFNs).
1 code implementation • 25 May 2024 • Xue Zhang, Si-Yuan Cao, Fang Wang, Runmin Zhang, Zhe Wu, Xiaohan Zhang, Xiaokai Bai, Hui-Liang Shen
In this paper, we address this issue by improving the performance of efficient single-branch structures.
no code implementations • 19 May 2024 • Xin Li, Jingdong Zhang, Qunxi Zhu, Chengli Zhao, Xue Zhang, Xiaojun Duan, Wei Lin
We then incorporate the estimated spatial gradients as additional inputs to a neural network.
2 code implementations • 25 Mar 2024 • Zicong Fan, Takehiko Ohkawa, Linlin Yang, Nie Lin, Zhishan Zhou, Shihao Zhou, Jiajun Liang, Zhong Gao, Xuanyang Zhang, Xue Zhang, Fei Li, Zheng Liu, Feng Lu, Karim Abou Zeid, Bastian Leibe, Jeongwan On, Seungryul Baek, Aditya Prakash, Saurabh Gupta, Kun He, Yoichi Sato, Otmar Hilliges, Hyung Jin Chang, Angela Yao
A holistic 3Dunderstanding of such interactions from egocentric views is important for tasks in robotics, AR/VR, action recognition and motion generation.
no code implementations • 9 Jan 2024 • Xue Zhang, Xiangyu Shi, Xinyue Lou, Rui Qi, Yufeng Chen, Jinan Xu, Wenjuan Han
Large language models (LLMs) and multimodal large language models (MLLMs) have shown excellent general capabilities, even exhibiting adaptability in many professional domains such as law, economics, transportation, and medicine.
1 code implementation • 20 Oct 2023 • Xue Zhang, Songming Zhang, Yunlong Liang, Yufeng Chen, Jian Liu, Wenjuan Han, Jinan Xu
Furthermore, for situations requiring multiple paraphrases for each source sentence, we design a Diverse Templates Search (DTS) algorithm, which can enhance the diversity between paraphrases without sacrificing quality.
1 code implementation • 26 May 2023 • Xue Zhang, Xiaohan Zhang, Jiangtao Wang, Jiacheng Ying, Zehua Sheng, Heng Yu, Chunguang Li, Hui-Liang Shen
Different from them, we comprehensively analyze the impacts of false positives on the detection performance and find that enhancing feature contrast can significantly reduce these false positives.
no code implementations • 9 Jun 2022 • Fei Chen, Gene Cheung, Xue Zhang
In this paper, focusing on manifold graphs -- collections of uniform discrete samples on low-dimensional continuous manifolds -- we generalize GLR to gradient graph Laplacian regularizer (GGLR) that promotes planar / piecewise planar (PWP) signal reconstruction.
1 code implementation • NAACL 2022 • Siyu Lai, Zhen Yang, Fandong Meng, Xue Zhang, Yufeng Chen, Jinan Xu, Jie zhou
Generating adversarial examples for Neural Machine Translation (NMT) with single Round-Trip Translation (RTT) has achieved promising results by releasing the meaning-preserving restriction.
no code implementations • 15 Dec 2021 • Fei Chen, Gene Cheung, Xue Zhang
Experiments show that our embedding is among the fastest in the literature, while producing the best clustering performance for manifold graphs.
no code implementations • 9 Nov 2021 • Xue Zhang, Gene Cheung, Jiahao Pang, Yash Sanghvi, Abhiram Gnanasambandam, Stanley H. Chan
Specifically, we model depth formation as a combined process of signal-dependent noise addition and non-uniform log-based quantization.
2 code implementations • 14 Oct 2021 • Xue Zhang, Zehua Sheng, Hui-Liang Shen
We also introduce a novel focus-picking loss function to improve classification accuracy by encouraging FocusNet to focus on the most confusing classes.
no code implementations • 22 Feb 2021 • Xue Zhang, Georgios Chatzidrosos, Yinan Hu, Huijie Zheng, Arne Wickenbrock, Alexej Jerschow, Dmitry Budker
Sensitive and accurate diagnostic technologies with magnetic sensors are of great importance for identifying and localizing defects of rechargeable solid batteries in a noninvasive detection.
Applied Physics
no code implementations • 25 Jan 2021 • Fei Chen, Gene Cheung, Xue Zhang
In the graph signal processing (GSP) literature, it has been shown that signal-dependent graph Laplacian regularizer (GLR) can efficiently promote piecewise constant (PWC) signal reconstruction for various image restoration tasks.
no code implementations • 15 Feb 2020 • Xue Zhang, Wangxin Xiao, Weijia Xiao
Results: We proposed a deep learning based method, DeepHE, to predict human essential genes by integrating features derived from sequence data and protein-protein interaction (PPI) network.
no code implementations • 9 Sep 2017 • Chong Wang, Xue Zhang, Xipeng Lan
However, as the number of identities becomes extremely large, the training will suffer from bad local minima because effective hard triplets are difficult to be found.