1 code implementation • 28 Apr 2025 • Jiageng Wu, Bowen Gu, Ren Zhou, Kevin Xie, Doug Snyder, Yixing Jiang, Valentina Carducci, Richard Wyss, Rishi J Desai, Emily Alsentzer, Leo Anthony Celi, Adam Rodman, Sebastian Schneeweiss, Jonathan H. Chen, Santiago Romero-Brufau, Kueiyu Joshua Lin, Jie Yang
Large language models (LLMs) hold great promise for medical applications and are evolving rapidly, with new models being released at an accelerated pace.
no code implementations • 24 Apr 2025 • Kaidong Feng, Zhu Sun, Jie Yang, Hui Fang, Xinghua Qu, Wenyuan Liu
We explore three critical research questions: (1) how does the format of KD impact bundle generation performance?
no code implementations • 12 Apr 2025 • Jie Yang, Wanchen Hu, Yi Jiang, Shuangyang Li, Xin Wang, Derrick Wing Kwan Ng, Giuseppe Caire
The proposed scheme leverages the channel bidiagonalization decomposition (CBD), based on which an optimization framework for the precoder and post-processor is developed for maximizing the mutual information (MI) with finite-alphabet inputs.
no code implementations • 9 Apr 2025 • Shihang Lu, Fan Liu, Yifeng Xiong, Zhen Du, Yuanhao Cui, Shuangyang Li, Weijie Yuan, Jie Yang, Shi Jin
To address this issue, we elaborate on random ISAC signal processing methods in this article, aiming at improving the sensing performance without unduly deteriorating the communication functionality.
1 code implementation • 9 Apr 2025 • Yuxin Wang, Yiran Guo, Yining Zheng, Zhangyue Yin, Shuo Chen, Jie Yang, Jiajun Chen, Xuanjing Huang, Xipeng Qiu
To bridge this gap, we introduce FamilyTool, a novel benchmark grounded in a family-based knowledge graph (KG) that simulates personalized, multi-hop tool use scenarios.
no code implementations • 8 Apr 2025 • Jie Yang, Chang Su, Yuhan Zhang, Jianjun Zhu, Jianli Wang
The advancement of sensing technology has driven the widespread application of high-dimensional data.
no code implementations • 5 Apr 2025 • Jie Yang, Yiqiu Tang, YongJie Li, Lihua Zhang, Haoran Zhang
Large language models (LLMs) have emerged as powerful tools in the field of finance, particularly for risk management across different asset classes.
no code implementations • 5 Apr 2025 • Jie Yang, Yiqiu Tang, YongJie Li, Lihua Zhang, Haoran Zhang
Dynamic hedging strategies are essential for effective risk management in derivatives markets, where volatility and market sentiment can greatly impact performance.
no code implementations • 2 Apr 2025 • Philip Lippmann, Jie Yang
Specialized reasoning language models (RLMs) have demonstrated that scaling test-time computation through detailed reasoning traces significantly enhances performance.
no code implementations • 18 Mar 2025 • Mingming Peng, Zhendong Chen, Jie Yang, Jin Huang, Zhengqi Shi, Qihao Liu, Xinyu Li, Liang Gao
Additionally, enterprises have high privacy requirements for production scheduling data, which prevents the use of cloud-based large language models (LLMs) for solution development.
no code implementations • 13 Mar 2025 • Chaoqun Wang, Jie Yang, Xiaobin Hong, Ruimao Zhang
Specifically, we first introduce a series of template-based prompts to extract scene information, generating questions that create pseudo-answers for the unlabeled data based on a model trained with limited labeled data.
no code implementations • 23 Feb 2025 • Zhenhuan Liu, Shuai Liu, Yidong Lu, Yirui Chen, Jie Yang, Wei Liu
Recent methods have made significant progress in synthesizing novel views with long video sequences.
no code implementations • 20 Feb 2025 • Zhong-Liang Zhang, Jie Yang, Jian-Ming Ru, Xiao-Xi Zhao, Xing-Gang Luo
To find the optimal model effectively and learn the support vectors for each class simultaneously, an improved differential evolution (DE) algorithm is applied to solve this large optimization problem.
no code implementations • 17 Feb 2025 • Tianhao Mao, Jie Yang, Le Liang, Shi Jin
Integrated sensing and communication (ISAC) in millimeter wave is a key enabler for next-generation networks, which leverages large bandwidth and extensive antenna arrays, benefiting both communication and sensing functionalities.
1 code implementation • 17 Feb 2025 • Ailin Huang, Boyong Wu, Bruce Wang, Chao Yan, Chen Hu, Chengli Feng, Fei Tian, Feiyu Shen, Jingbei Li, Mingrui Chen, Peng Liu, Ruihang Miao, Wang You, Xi Chen, Xuerui Yang, Yechang Huang, Yuxiang Zhang, Zheng Gong, Zixin Zhang, HongYu Zhou, Jianjian Sun, Brian Li, Chengting Feng, Changyi Wan, Hanpeng Hu, Jianchang Wu, Jiangjie Zhen, Ranchen Ming, Song Yuan, Xuelin Zhang, Yu Zhou, Bingxin Li, Buyun Ma, Hongyuan Wang, Kang An, Wei Ji, Wen Li, Xuan Wen, Xiangwen Kong, Yuankai Ma, Yuanwei Liang, Yun Mou, Bahtiyar Ahmidi, Bin Wang, Bo Li, Changxin Miao, Chen Xu, Chenrun Wang, Dapeng Shi, Deshan Sun, Dingyuan Hu, Dula Sai, Enle Liu, Guanzhe Huang, Gulin Yan, Heng Wang, Haonan Jia, Haoyang Zhang, Jiahao Gong, Junjing Guo, Jiashuai Liu, Jiahong Liu, Jie Feng, Jie Wu, Jiaoren Wu, Jie Yang, Jinguo Wang, Jingyang Zhang, Junzhe Lin, Kaixiang Li, Lei Xia, Li Zhou, Liang Zhao, Longlong Gu, Mei Chen, Menglin Wu, Ming Li, Mingxiao Li, Mingliang Li, Mingyao Liang, Na Wang, Nie Hao, Qiling Wu, Qinyuan Tan, Ran Sun, Shuai Shuai, Shaoliang Pang, Shiliang Yang, Shuli Gao, Shanshan Yuan, SiQi Liu, Shihong Deng, Shilei Jiang, Sitong Liu, Tiancheng Cao, Tianyu Wang, Wenjin Deng, Wuxun Xie, Weipeng Ming, Wenqing He, Wen Sun, Xin Han, Xin Huang, Xiaomin Deng, Xiaojia Liu, Xin Wu, Xu Zhao, Yanan Wei, Yanbo Yu, Yang Cao, Yangguang Li, Yangzhen Ma, Yanming Xu, Yaoyu Wang, Yaqiang Shi, Yilei Wang, Yizhuang Zhou, Yinmin Zhong, Yang Zhang, Yaoben Wei, Yu Luo, Yuanwei Lu, Yuhe Yin, Yuchu Luo, Yuanhao Ding, Yuting Yan, Yaqi Dai, Yuxiang Yang, Zhe Xie, Zheng Ge, Zheng Sun, Zhewei Huang, Zhichao Chang, Zhisheng Guan, Zidong Yang, Zili Zhang, Binxing Jiao, Daxin Jiang, Heung-Yeung Shum, Jiansheng Chen, Jing Li, Shuchang Zhou, Xiangyu Zhang, Xinhao Zhang, Yibo Zhu
Based on our new StepEval-Audio-360 evaluation benchmark, Step-Audio achieves state-of-the-art performance in human evaluations, especially in terms of instruction following.
3 code implementations • 14 Feb 2025 • Guoqing Ma, Haoyang Huang, Kun Yan, Liangyu Chen, Nan Duan, Shengming Yin, Changyi Wan, Ranchen Ming, Xiaoniu Song, Xing Chen, Yu Zhou, Deshan Sun, Deyu Zhou, Jian Zhou, Kaijun Tan, Kang An, Mei Chen, Wei Ji, Qiling Wu, Wen Sun, Xin Han, Yanan Wei, Zheng Ge, Aojie Li, Bin Wang, Bizhu Huang, Bo wang, Brian Li, Changxing Miao, Chen Xu, Chenfei Wu, Chenguang Yu, Dapeng Shi, Dingyuan Hu, Enle Liu, Gang Yu, Ge Yang, Guanzhe Huang, Gulin Yan, Haiyang Feng, Hao Nie, Haonan Jia, Hanpeng Hu, Hanqi Chen, Haolong Yan, Heng Wang, Hongcheng Guo, Huilin Xiong, Huixin Xiong, Jiahao Gong, Jianchang Wu, Jiaoren Wu, Jie Wu, Jie Yang, Jiashuai Liu, Jiashuo Li, Jingyang Zhang, Junjing Guo, Junzhe Lin, Kaixiang Li, Lei Liu, Lei Xia, Liang Zhao, Liguo Tan, Liwen Huang, Liying Shi, Ming Li, Mingliang Li, Muhua Cheng, Na Wang, Qiaohui Chen, Qinglin He, Qiuyan Liang, Quan Sun, Ran Sun, Rui Wang, Shaoliang Pang, Shiliang Yang, Sitong Liu, SiQi Liu, Shuli Gao, Tiancheng Cao, Tianyu Wang, Weipeng Ming, Wenqing He, Xu Zhao, Xuelin Zhang, Xianfang Zeng, Xiaojia Liu, Xuan Yang, Yaqi Dai, Yanbo Yu, Yang Li, Yineng Deng, Yingming Wang, Yilei Wang, Yuanwei Lu, Yu Chen, Yu Luo, Yuchu Luo, Yuhe Yin, Yuheng Feng, Yuxiang Yang, Zecheng Tang, Zekai Zhang, Zidong Yang, Binxing Jiao, Jiansheng Chen, Jing Li, Shuchang Zhou, Xiangyu Zhang, Xinhao Zhang, Yibo Zhu, Heung-Yeung Shum, Daxin Jiang
We present Step-Video-T2V, a state-of-the-art text-to-video pre-trained model with 30B parameters and the ability to generate videos up to 204 frames in length.
no code implementations • 5 Feb 2025 • Ran Xin, Chenguang Xi, Jie Yang, Feng Chen, Hang Wu, Xia Xiao, Yifan Sun, Shen Zheng, Kai Shen
In this paper, we investigate whether BFS can achieve competitive performance in large-scale theorem proving tasks.
no code implementations • 12 Jan 2025 • Jie Yang, Ehsan Latif, Yuze He, Xiaoming Zhai
These findings demonstrate the effectiveness of LLMs in automatic scoring within a Chinese context and emphasize the importance of linguistic features and reasoning complexity in fine-tuning scoring models for educational assessments.
1 code implementation • 6 Jan 2025 • Ji Cao, Tongya Zheng, Qinghong Guo, Yu Wang, Junshu Dai, Shunyu Liu, Jie Yang, Jie Song, Mingli Song
Trajectory generation has garnered significant attention from researchers in the field of spatio-temporal analysis, as it can generate substantial synthesized human mobility trajectories that enhance user privacy and alleviate data scarcity.
no code implementations • 4 Jan 2025 • Yan Li, Jie Yang, Yixuan Huang, Tao Yang, Chao-Kai Wen, Shi Jin
This study presents the first channel state information (CSI)-based measurement and analysis of rainfall attenuation at 2. 8 GHz.
no code implementations • 27 Dec 2024 • Siyu Wang, Cailian Chen, Xinyi Le, Qimin Xu, Lei Xu, Yanzhou Zhang, Jie Yang
Computer-aided design (CAD) significantly enhances the efficiency, accuracy, and innovation of design processes by enabling precise 2D and 3D modeling, extensive analysis, and optimization.
no code implementations • 15 Dec 2024 • Minghui Zhang, Chenyu Li, Fangfang Xie, Yaoyu Liu, Hanxiao Zhang, Junyang Wu, Chunxi Zhang, Jie Yang, Jiayuan Sun, Guang-Zhong Yang, Yun Gu
Accurate anatomical labeling and analysis of the pulmonary structure and its surrounding anatomy from thoracic CT is getting increasingly important for understanding the etilogy of abnormalities or supporting targetted therapy and early interventions.
no code implementations • 10 Dec 2024 • Wangli Yang, Jie Yang, Yi Guo, Johan Barthelemy
The field of textual adversarial defenses has gained considerable attention in recent years due to the increasing vulnerability of natural language processing (NLP) models to adversarial attacks, which exploit subtle perturbations in input text to deceive models.
no code implementations • 4 Nov 2024 • Philip Lippmann, Matthijs T. J. Spaan, Jie Yang
Intelligent agents designed for interactive environments face significant challenges in text-based games, a domain that demands complex reasoning and adaptability.
no code implementations • 4 Nov 2024 • Jie Yang, Wang Zeng, Sheng Jin, Lumin Xu, Wentao Liu, Chen Qian, Ruimao Zhang
To bridge this gap, we introduce the novel challenge of Semantic Keypoint Comprehension, which aims to comprehend keypoints across different task scenarios, including keypoint semantic understanding, visual prompt-based keypoint detection, and textual prompt-based keypoint detection.
1 code implementation • 4 Nov 2024 • Philip Lippmann, Konrad Skublicki, Joshua Tanner, Shonosuke Ishiwatari, Jie Yang
Due to the significant time and effort required for handcrafting translations, most manga never leave the domestic Japanese market.
no code implementations • 13 Oct 2024 • Di wu, Siyuan Li, Chen Feng, Lu Cao, Yue Zhang, Jie Yang, Mohamad Sawan
To address these limitations, we introduce Homogeneity-Heterogeneity Disentangled Learning for neural Representations (H2DiLR), a novel framework that disentangles and learns both the homogeneity and heterogeneity from intracranial recordings across multiple subjects.
no code implementations • 12 Oct 2024 • Rui Liu, Zhenqi Jia, Jie Yang, Yifan Hu, Haizhou Li
In this paper, we propose a novel Emphasis Rendering scheme for the CTTS model, termed ER-CTTS, that includes two main components: 1) we simultaneously take into account textual and acoustic contexts, with both global and local semantic modeling to understand the conversation context comprehensively; 2) we deeply integrate multi-modal and multi-scale context to learn the influence of context on the emphasis expression of the current utterance.
no code implementations • 10 Oct 2024 • Zeqiang Wang, Jiageng Wu, Yuqi Wang, Wei Wang, Jie Yang, Jon Johnson, Nishanth Sastry, Suparna De
Social media is recognized as an important source for deriving insights into public opinion dynamics and social impacts due to the vast textual data generated daily and the 'unconstrained' behavior of people interacting on these platforms.
no code implementations • 16 Sep 2024 • Kun Fang, Qinghua Tao, Zuopeng Yang, Xiaolin Huang, Jie Yang
Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i. e., In-Distribution (InD), or from OoD.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
1 code implementation • 14 Sep 2024 • Jiabao Wang, Zhaojiang Liu, Qiang Meng, Liujiang Yan, Ke Wang, Jie Yang, Wei Liu, Qibin Hou, Ming-Ming Cheng
Mainstream occupancy prediction works first discretize the 3D environment into voxels, then perform classification on such dense grids.
no code implementations • 13 Sep 2024 • Jie Yang, Padunna Valappil Krishnaraj Sekhar, Sho Sekine, Yilin Li
We introduce a Dynamic Sequential Coupon Allocation Framework (DSCAF) to optimize item coupon allocation strategies across a series of promotions.
no code implementations • 8 Sep 2024 • Zhenhuan Liu, Shuai Liu, Zhiwei Ning, Jie Yang, Yifan Zuo, Yuming Fang, Wei Liu
The experimental results on our long video sequences dataset show the superior scalability and reconstruction quality compared to existing state-of-the-art approaches.
1 code implementation • 28 Aug 2024 • Yuncheng Yang, Yulei Qin, Tong Wu, Zihan Xu, Gang Li, Pengcheng Guo, Hang Shao, Yuchen Shi, Ke Li, Xing Sun, Jie Yang, Yun Gu
For the latter, we highlight the diversity of constituting experts and that of the fine-tuning instructions throughout the model and data selection process.
no code implementations • 21 Aug 2024 • Bowen Gu, Rishi J. Desai, Kueiyu Joshua Lin, Jie Yang
Large Language Models (LLMs) have shown promise in clinical applications through prompt engineering, allowing flexible clinical predictions.
2 code implementations • 15 Aug 2024 • Fenghe Tang, Bingkun Nian, Yingtai Li, Zihang Jiang, Jie Yang, Wei Liu, S. Kevin Zhou
We pre-train MambaMIM on a large-scale dataset of 6. 8K CT scans and evaluate its performance across eight public medical segmentation benchmarks.
no code implementations • 20 Jul 2024 • Koya Ohashi, Sho Sekine, Deddy Jobson, Jie Yang, Naoki Nishimura, Noriyoshi Sukegawa, Yuichi Takano
Then, we propose a personalized promotion to increase the number of successful providers with sales experiences on the platform.
no code implementations • 17 Jul 2024 • Jie Yang, Xuesong Niu, Nan Jiang, Ruimao Zhang, Siyuan Huang
Existing 3D human object interaction (HOI) datasets and models simply align global descriptions with the long HOI sequence, while lacking a detailed understanding of intermediate states and the transitions between states.
1 code implementation • 11 Jul 2024 • Xin You, Yixin Lou, Minghui Zhang, Jie Yang, Nassir Navab, Yun Gu
Specifically, a contour generation network is proposed based on Structural Low-Rank Descriptors for shape consistency, termed SLoRD.
1 code implementation • 27 Jun 2024 • Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang
Based on the tree, our ToL agent not only comprehends the content of the indicated area but also articulates the layout and spatial relationships between elements.
1 code implementation • 24 Jun 2024 • Yirui Chen, Xudong Huang, Quan Zhang, Wei Li, Mingjian Zhu, Qiangyu Yan, Simiao Li, Hanting Chen, Hailin Hu, Jie Yang, Wei Liu, Jie Hu
The extraordinary ability of generative models emerges as a new trend in image editing and generating realistic images, posing a serious threat to the trustworthiness of multimedia data and driving the research of image manipulation detection and location (IMDL).
1 code implementation • 24 Jun 2024 • Yirui Chen, Pengjin Wei, Zhenhuan Liu, Bingchao Wang, Jie Yang, Wei Liu
Producing traversability maps and understanding the surroundings are crucial prerequisites for autonomous navigation.
1 code implementation • 17 Jun 2024 • Ziyue Xu, Peilin Zhou, Xinyu Shi, Jiageng Wu, Yikang Jiang, Dading Chong, Bin Ke, Jie Yang
This paper builds a benchmark FinTruthQA, that can evaluate advanced natural language processing (NLP) techniques for the automatic quality assessment of information disclosure in financial Q&A data.
no code implementations • 11 Jun 2024 • Yuki Uehara, Shunnosuke Ikeda, Naoki Nishimura, Koya Ohashi, Yilin Li, Jie Yang, Deddy Jobson, Xingxia Zha, Takeshi Matsumoto, Noriyoshi Sukegawa, Yuichi Takano
In two-sided marketplaces such as online flea markets, recommender systems for providing consumers with personalized item rankings play a key role in promoting transactions between providers and consumers.
no code implementations • CVPR 2024 • Jie Yang, Bingliang Li, Ailing Zeng, Lei Zhang, Ruimao Zhang
In this paper, we develop \textbf{MP-HOI}, a powerful Multi-modal Prompt-based HOI detector designed to leverage both textual descriptions for open-set generalization and visual exemplars for handling high ambiguity in descriptions, realizing HOI detection in the open world.
no code implementations • 30 May 2024 • Jie Yang, Jiankun Wang, Max Q. -H. Meng
The inadequate feature extraction and the noise in X-ray images are the main difficulties of automated Cobb angle estimation, and it is challenging to ensure that the calculated Cobb angle meets clinical requirements.
no code implementations • 29 May 2024 • Zhenbei Wu, Qiang Wang, Jie Yang
There continues to be a lack of large-scale paired datasets for scene sketches.
no code implementations • 21 May 2024 • Yuki Uehara, Naoki Nishimura, Yilin Li, Jie Yang, Deddy Jobson, Koya Ohashi, Takeshi Matsumoto, Noriyoshi Sukegawa, Yuichi Takano
We apply a robust portfolio optimization model based on customer segmentation to the coupon allocation problem.
no code implementations • 15 May 2024 • Diji Yang, Jinmeng Rao, Kezhen Chen, Xiaoyuan Guo, Yawen Zhang, Jie Yang, Yi Zhang
Although the Retrieval-Augmented Generation (RAG) paradigms can use external knowledge to enhance and ground the outputs of Large Language Models (LLMs) to mitigate generative hallucinations and static knowledge base problems, they still suffer from limited flexibility in adopting Information Retrieval (IR) systems with varying capabilities, constrained interpretability during the multi-round retrieval process, and a lack of end-to-end optimization.
1 code implementation • 13 May 2024 • Ruikai Yang, Fan He, Mingzhen He, Jie Yang, Xiaolin Huang
Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR).
1 code implementation • techrxiv 2024 • Jie Yang, Chin-Teng Lin, University of Technology Sydney
Clustering is a fundamental tool of scientific analysis, ubiquitous in disciplines from biology and chemistry to astronomy and pattern recognition.
no code implementations • 9 May 2024 • Chen Chen, Kai Qiao, Jie Yang, Jian Chen, Bin Yan
In this model, the teacher-guided MIM pretraining model is introduced into PCB CT image element segmentation for the first time, and a multi-scale local visual field extraction (MVE) module is proposed to reduce redundancy by focusing on local visual fields.
no code implementations • 26 Mar 2024 • Philip Lippmann, Matthijs T. J. Spaan, Jie Yang
Language models (LMs) have achieved impressive accuracy across a variety of tasks but remain vulnerable to high-confidence misclassifications, also referred to as unknown unknowns (UUs).
no code implementations • 17 Mar 2024 • Tong Wu, Yu-Jie Yuan, Ling-Xiao Zhang, Jie Yang, Yan-Pei Cao, Ling-Qi Yan, Lin Gao
The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis.
no code implementations • 15 Mar 2024 • Rui Zhang, Dawei Cheng, Xin Liu, Jie Yang, Yi Ouyang, Xian Wu, Yefeng Zheng
We find that in graph anomaly detection, the homophily distribution differences between different classes are significantly greater than those in homophilic and heterophilic graphs.
no code implementations • 14 Mar 2024 • Qian Ding, Jie Yang, Yang Luo, Chunbo Luo
This letter aims to provide a fundamental analytical comparison for the two major types of relaying methods: intelligent reflecting surfaces and full-duplex relays, particularly focusing on unmanned aerial vehicle communication scenarios.
no code implementations • 13 Mar 2024 • Qian Ding, Jie Yang, Yang Luo, Chunbo Luo
This commentary dedicates to envision what role THz is going to play in the coming human-centric 6G era.
no code implementations • 11 Mar 2024 • Jiageng Wu, Xian Wu, Jie Yang
Clinical reasoning refers to the cognitive process that physicians employ in evaluating and managing patients.
no code implementations • 11 Mar 2024 • Jiageng Wu, Xian Wu, Yefeng Zheng, Jie Yang
With appropriate data selection and training techniques, Large Language Models (LLMs) have demonstrated exceptional success in various medical examinations and multiple-choice questions.
1 code implementation • 10 Mar 2024 • Yuncheng Yang, Chuyan Zhang, Zuopeng Yang, Yuting Gao, Yulei Qin, Ke Li, Xing Sun, Jie Yang, Yun Gu
Prompt learning is effective for fine-tuning foundation models to improve their generalization across a variety of downstream tasks.
no code implementations • 26 Feb 2024 • Yu Ming, Zihao Wu, Jie Yang, Danyi Li, Yuan Gao, Changxin Gao, Gui-Song Xia, Yuanqing Li, Li Liang, Jin-Gang Yu
In this paper, we propose to formulate annotation-efficient nucleus instance segmentation from the perspective of few-shot learning (FSL).
1 code implementation • 13 Feb 2024 • Chongyang Gao, Kezhen Chen, Jinmeng Rao, Baochen Sun, Ruibo Liu, Daiyi Peng, Yawen Zhang, Xiaoyuan Guo, Jie Yang, VS Subrahmanian
In this paper, we introduce a novel parameter-efficient MoE method, \textit{\textbf{M}oE-L\textbf{o}RA with \textbf{L}ayer-wise Expert \textbf{A}llocation (MoLA)} for Transformer-based models, where each model layer has the flexibility to employ a varying number of LoRA experts.
no code implementations • 7 Feb 2024 • Lin Gao, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai
Based on this representation, we further introduce a large-scale Gaussian deformation technique to enable deformable GS, which alters the parameters of 3D Gaussians according to the manipulation of the associated mesh.
1 code implementation • 5 Feb 2024 • Kun Fang, Qinghua Tao, Kexin Lv, Mingzhen He, Xiaolin Huang, Jie Yang
Out-of-Distribution (OoD) detection is vital for the reliability of Deep Neural Networks (DNNs).
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
no code implementations • 30 Jan 2024 • Chen Bai, Zeman Shao, Guoxiang Zhang, Di Liang, Jie Yang, Zhuorui Zhang, Yujian Guo, Chengzhang Zhong, Yiqiao Qiu, Zhendong Wang, Yichen Guan, Xiaoyin Zheng, Tao Wang, Cheng Lu
Our proposed general framework encompasses three key processes: 1) integrating a realistic object into a given scene video with proper placement to ensure geometric realism; 2) estimating the sky and environmental lighting distribution and simulating realistic shadows to enhance the light realism; 3) employing a style transfer network that refines the final video output to maximize photorealism.
4 code implementations • 25 Jan 2024 • Tianhe Ren, Shilong Liu, Ailing Zeng, Jing Lin, Kunchang Li, He Cao, Jiayu Chen, Xinyu Huang, Yukang Chen, Feng Yan, Zhaoyang Zeng, Hao Zhang, Feng Li, Jie Yang, Hongyang Li, Qing Jiang, Lei Zhang
We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM).
1 code implementation • 16 Jan 2024 • Kexin Lv, Rui Ye, Xiaolin Huang, Jie Yang, Siheng Chen
Personalized federated learning aims to address data heterogeneity across local clients in federated learning.
2 code implementations • ACM Transactions on Multimedia Computing, Communications, and Applications 2024 • Mingyu Li, Tao Zhou, Zhuo Huang, Jian Yang, Jie Yang, Chen Gong
Nowadays, class-mismatch problem has drawn intensive attention in Semi-Supervised Learning (SSL), where the classes of labeled data are assumed to be only a subset of the classes of unlabeled data.
1 code implementation • 30 Dec 2023 • Aleksander Buszydlik, Karol Dobiczek, Michał Teodor Okoń, Konrad Skublicki, Philip Lippmann, Jie Yang
We consider the problem of red teaming LLMs on elementary calculations and algebraic tasks to evaluate how various prompting techniques affect the quality of outputs.
no code implementations • 30 Dec 2023 • Wenhao Ma, Yu-Cheng Chang, Jie Yang, Yu-Kai Wang, Chin-Teng Lin
However, existing agent modeling approaches typically assume the availability of local observations from other agents (modeled agents) during training or a long observation trajectory for policy adaption.
no code implementations • 26 Dec 2023 • Zhu Sun, Kaidong Feng, Jie Yang, Xinghua Qu, Hui Fang, Yew-Soon Ong, Wenyuan Liu
To enhance reliability and mitigate the hallucination issue, we develop (1) a self-correction strategy to foster mutual improvement in both tasks without supervision signals; and (2) an auto-feedback mechanism to recurrently offer dynamic supervision based on the distinct mistakes made by ChatGPT on various neighbor sessions.
no code implementations • 18 Dec 2023 • Zhenhuan Liu, Shuai Liu, Jie Yang, Wei Liu
Novel view synthesis for dynamic scenes is one of the spotlights in computer vision.
1 code implementation • 13 Dec 2023 • Xin You, Ming Ding, Minghui Zhang, Hanxiao Zhang, Yi Yu, Jie Yang, Yun Gu
Precise boundary segmentation of volumetric images is a critical task for image-guided diagnosis and computer-assisted intervention, especially for boundary confusion in clinical practice.
1 code implementation • 4 Dec 2023 • Fenghe Tang, Bingkun Nian, Jianrui Ding, Quan Quan, Jie Yang, Wei Liu, S. Kevin Zhou
This work revisits the relationship between CNNs and Transformers in lightweight universal networks for medical image segmentation, aiming to integrate the advantages of both worlds at the infrastructure design level.
1 code implementation • 4 Dec 2023 • Bingkun Nian, Fenghe Tang, Jianrui Ding, Pingping Zhang, Jie Yang, S. Kevin Zhou, Wei Liu
In this paper, we present a high-performance deep neural network for weak target image segmentation, including medical image segmentation and infrared image segmentation.
1 code implementation • 30 Nov 2023 • Weikai Li, Hongfeng Wei, Yanlai Wu, Jie Yang, Yudi Ruan, Yuan Li, Ying Tang
Few-shot object detection (FSOD) aims to extract semantic knowledge from limited object instances of novel categories within a target domain.
2 code implementations • 24 Nov 2023 • Yankun Xu, Junzhe Wang, Yun-Hsuan Chen, Jie Yang, Wenjie Ming, Shuang Wang, Mohamad Sawan
An accurate and efficient epileptic seizure onset detection can significantly benefit patients.
no code implementations • 26 Oct 2023 • Yingwen Wu, Tao Li, Xinwen Cheng, Jie Yang, Xiaolin Huang
To bridge this gap, in this paper, we conduct a comprehensive investigation into leveraging the entirety of gradient information for OOD detection.
1 code implementation • 22 Oct 2023 • Kun Fang, Qinghua Tao, Xiaolin Huang, Jie Yang
Motivated by such diversities on OoD loss landscape across modes, we revisit the deep ensemble method for OoD detection through mode ensemble, leading to improved performance and benefiting the OoD detector with reduced variances.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
2 code implementations • 12 Oct 2023 • Jie Yang, Ailing Zeng, Ruimao Zhang, Lei Zhang
This work aims to address an advanced keypoint detection problem: how to accurately detect any keypoints in complex real-world scenarios, which involves massive, messy, and open-ended objects as well as their associated keypoints definitions.
Ranked #1 on
2D Human Pose Estimation
on Human-Art
(using extra training data)
no code implementations • 6 Oct 2023 • Yifan Xu, Pourya Shamsolmoali, Jie Yang
VPR is particularly difficult due to the presence of duplicate regions and the lack of attention to small objects in complex scenes, resulting in recognition deviations.
1 code implementation • MICCAI 2023 • Xin You, Ming Ding, Minghui Zhang, Yangqian Wu, Yi Yu, Yun Gu, Jie Yang
In this paper, we have modeled relative relations between the LA and LAA via deep segmentation networks for the first time, and introduce a new LA & LAA CT dataset.
no code implementations • 25 Sep 2023 • Zhengxuan Qiu, Jie Yang, Jiankun Wang
In the MMA-Net, we first feed spine X-ray images into the segmentation network to produce multiple morphological information (spine region, centerline, and boundary) and then concatenate the original X-ray image with the resulting segmentation maps as input for the regression module to perform precise Cobb angle measurement.
1 code implementation • 11 Sep 2023 • Jinfeng Liu, Lingtong Kong, Jie Yang, Wei Liu
Additionally, we introduce the detail-enhanced DepthNet with an extra full-scale branch in the encoder and a grid decoder to enhance the restoration of fine details in depth maps.
1 code implementation • 7 Sep 2023 • Lingtong Kong, Boyuan Jiang, Donghao Luo, Wenqing Chu, Ying Tai, Chengjie Wang, Jie Yang
Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience.
no code implementations • 7 Sep 2023 • Jiaying Lu, Jinmeng Rao, Kezhen Chen, Xiaoyuan Guo, Yawen Zhang, Baochen Sun, Carl Yang, Jie Yang
Large Vision-Language Models (LVLMs) offer remarkable benefits for a variety of vision-language tasks.
no code implementations • 28 Aug 2023 • Yemin li, Zhongcheng Liu, Xiaoying Lou, Mirigual Kurban, Miao Li, Jie Yang, Kaiwei Che, Jiankun Wang, Max Q. -H Meng, Yan Huang, Qin Guo, Pinjin Hu
A total of 5105 images of 154 intestinal segments from 87 patients undergoing EC treatment at a center in China between March 2022 and March 2023 are scored according to the Geboes score.
1 code implementation • 25 Aug 2023 • Lorenzo Corti, Jie Yang
Complex text is a major barrier for many citizens when accessing public information and knowledge.
1 code implementation • ICCV 2023 • Jie Yang, Ailing Zeng, Feng Li, Shilong Liu, Ruimao Zhang, Lei Zhang
Click-Pose explores how user feedback can cooperate with a neural keypoint detector to correct the predicted keypoints in an interactive way for a faster and more effective annotation process.
no code implementations • 19 Aug 2023 • Diji Yang, Kezhen Chen, Jinmeng Rao, Xiaoyuan Guo, Yawen Zhang, Jie Yang, Yi Zhang
Visual language tasks require AI models to comprehend and reason with both visual and textual content.
1 code implementation • 12 Aug 2023 • Jie Yang, Soyeon Caren Han, Siqu Long, Josiah Poon, Goran Nenadic
Extracting meaningful drug-related information chunks, such as adverse drug events (ADE), is crucial for preventing morbidity and saving many lives.
1 code implementation • 22 Jul 2023 • Yuncheng Yang, Meng Wei, Junjun He, Jie Yang, Jin Ye, Yun Gu
To make up for its deficiency when applying transfer learning to medical image segmentation, in this paper, we therefore propose a new Transferability Estimation (TE) method.
no code implementations • 12 Jul 2023 • Xiaomeng Wang, Fengshi Tian, Xizi Chen, Jiakun Zheng, Xuejiao Liu, Fengbin Tu, Jie Yang, Mohamad Sawan, Kwang-Ting Cheng, Chi-Ying Tsui
In this paper, we propose a high-precision SRAM-based CIM macro that can perform 4x4-bit MAC operations and yield 9-bit signed output.
no code implementations • 5 Jul 2023 • Shuhao Shi, Kai Qiao, Zhengyan Wang, Jie Yang, Baojie Song, Jian Chen, Bin Yan
Recently, more and more GNN-based methods have been proposed for bot detection.
2 code implementations • 28 Jun 2023 • Yining Hua, Jiageng Wu, Shixu Lin, Minghui Li, Yujie Zhang, Dinah Foer, Siwen Wang, Peilin Zhou, Jie Yang, Li Zhou
Conclusions: This study advances public health research by implementing a novel, systematic pipeline for curating symptom lexicons from social media data.
no code implementations • 25 Jun 2023 • Xiaoyan Guo, Jie Yang, Xinyu Jia, Chuanyan Zang, Yan Xu, Zhaoyang Chen
Therefore, this paper proposes a novel dual-pooling attention (DpA) module, which achieves the extraction and enhancement of locally important information about vehicles from both channel and spatial dimensions by constructing two branches of channel-pooling attention (CpA) and spatial-pooling attention (SpA), and employing multiple pooling operations to enhance the attention to fine-grained information of vehicles.
1 code implementation • 12 Jun 2023 • Tianhe Ren, Shilong Liu, Feng Li, Hao Zhang, Ailing Zeng, Jie Yang, Xingyu Liao, Ding Jia, Hongyang Li, He Cao, Jianan Wang, Zhaoyang Zeng, Xianbiao Qi, Yuhui Yuan, Jianwei Yang, Lei Zhang
To address this issue, we develop a unified, highly modular, and lightweight codebase called detrex, which supports a majority of the mainstream DETR-based instance recognition algorithms, covering various fundamental tasks, including object detection, segmentation, and pose estimation.
no code implementations • 31 May 2023 • Xiaoyuan Guo, Kezhen Chen, Jinmeng Rao, Yawen Zhang, Baochen Sun, Jie Yang
To train LOWA, we propose a hybrid vision-language training strategy to learn object detection and recognition with class names as well as attribute information.
1 code implementation • 20 May 2023 • Jie Yang, Bingliang Li, Fengyu Yang, Ailing Zeng, Lei Zhang, Ruimao Zhang
Extensive experiments demonstrate that DiffHOI significantly outperforms the state-of-the-art in regular detection (i. e., 41. 50 mAP) and zero-shot detection.
Ranked #2 on
Zero-Shot Human-Object Interaction Detection
on HICO-DET
(using extra training data)
no code implementations • 17 May 2023 • Jiageng Wu, Xian Wu, Zhaopeng Qiu, Minghui Li, Yingying Zhang, Yefeng Zheng, Changzheng Yuan, Jie Yang
We systematically evaluate LLMs in the Chinese medical context and develop a novel in-context learning framework to enhance their performance.
no code implementations • CVPR 2023 • Yu-Tao Liu, Li Wang, Jie Yang, Weikai Chen, Xiaoxu Meng, Bo Yang, Lin Gao
Multi-view shape reconstruction has achieved impressive progresses thanks to the latest advances in neural implicit surface rendering.
no code implementations • 18 Apr 2023 • Jiasheng Xu, Tianyi Zhang, Yangqian Wu, Jie Yang, Guang-Zhong Yang, Yun Gu
Endobronchial intervention is increasingly used as a minimally invasive means for the treatment of pulmonary diseases.
1 code implementation • 14 Apr 2023 • Shuhao Shi, Kai Qiao, Jie Yang, Baojie Song, Jian Chen, Bin Yan
This paper proposes a Random Forest boosted Graph Neural Network for social bot detection, called RF-GNN, which employs graph neural networks (GNNs) as the base classifiers to construct a random forest, effectively combining the advantages of ensemble learning and GNNs to improve the accuracy and robustness of the model.
no code implementations • CVPR 2023 • Jie Yang, Chaoqun Wang, Zhen Li, Junle Wang, Ruimao Zhang
This paper presents Scalable Semantic Transfer (SST), a novel training paradigm, to explore how to leverage the mutual benefits of the data from different label domains (i. e. various levels of label granularity) to train a powerful human parsing network.
1 code implementation • 31 Mar 2023 • Xin You, Junjun He, Jie Yang, Yun Gu
Hence, in our work, we proposed a novel shape prior module (SPM), which can explicitly introduce shape priors to promote the segmentation performance of UNet-based models.
no code implementations • 30 Mar 2023 • Yuting Gao, Jinfeng Liu, Zihan Xu, Tong Wu Enwei Zhang, Wei Liu, Jie Yang, Ke Li, Xing Sun
During the preceding biennium, vision-language pre-training has achieved noteworthy success on several downstream tasks.
2 code implementations • 24 Mar 2023 • Ye Zhu, Jie Yang, Si-Qi Liu, Ruimao Zhang
Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations.
10 code implementations • 9 Mar 2023 • Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang
To effectively fuse language and vision modalities, we conceptually divide a closed-set detector into three phases and propose a tight fusion solution, which includes a feature enhancer, a language-guided query selection, and a cross-modality decoder for cross-modality fusion.
Ranked #2 on
Zero Shot Segmentation
on Segmentation in the Wild
1 code implementation • 23 Feb 2023 • Jiageng Wu, Xian Wu, Yining Hua, Shixu Lin, Yefeng Zheng, Jie Yang
Secondly, We conducted an extensive analysis of this dataset to investigate the characteristic of COVID-19 patients with a higher risk of depression.
no code implementations • 16 Feb 2023 • Lin Gao, Jia-Mu Sun, Kaichun Mo, Yu-Kun Lai, Leonidas J. Guibas, Jie Yang
We propose SCENEHGN, a hierarchical graph network for 3D indoor scenes that takes into account the full hierarchy from the room level to the object level, then finally to the object part level.
1 code implementation • 14 Feb 2023 • Shuhao Shi, Kai Qiao, Jie Yang, Baojie Song, Jian Chen, Bin Yan
The proposed framework is evaluated using three real-world bot detection benchmark datasets, and it consistently exhibits superiority over the baselines.
no code implementations • 10 Feb 2023 • Zhen Wang, Peide Zhu, Jie Yang
Controversy is widespread online.
1 code implementation • 5 Feb 2023 • Zuopeng Yang, Tianshu Chu, Xin Lin, Erdun Gao, Daqing Liu, Jie Yang, Chaoyue Wang
The proposed model incorporates a Bias Elimination Cycle that consists of both a forward path and an inverted path, each featuring a Structural Consistency Cycle to ensure the preservation of image content during the editing process.
3 code implementations • 3 Feb 2023 • Jie Yang, Ailing Zeng, Shilong Liu, Feng Li, Ruimao Zhang, Lei Zhang
This paper presents a novel end-to-end framework with Explicit box Detection for multi-person Pose estimation, called ED-Pose, where it unifies the contextual learning between human-level (global) and keypoint-level (local) information.
Ranked #2 on
2D Human Pose Estimation
on Human-Art
no code implementations • 4 Jan 2023 • Yankun Xu, Jie Yang, Wenjie Ming, Shuang Wang, Mohamad Sawan
And, a novel multiscale STFT-based feature extraction method combined with 3D-CNN architecture is proposed to accurately capture predictive probabilities of samples.
1 code implementation • 3 Jan 2023 • Shuhao Shi, Kai Qiao, Jian Chen, Shuai Yang, Jie Yang, Baojie Song, Linyuan Wang, Bin Yan
However, in addition to low annotation quality, existing benchmarks generally have incomplete user relationships, suppressing graph-based account detection research.
Ranked #1 on
Stance Detection
on MGTAB
1 code implementation • 1 Dec 2022 • Yulei Qin, Xingyu Chen, Chao Chen, Yunhang Shen, Bo Ren, Yun Gu, Jie Yang, Chunhua Shen
Most existing methods focus on learning noise-robust models from web images while neglecting the performance drop caused by the differences between web domain and real-world domain.
no code implementations • 28 Nov 2022 • Jinbo Chen, Hui Wu, Jie Yang, Mohamad Sawan
A bio-inspired Neuron-ADC with reconfigurable sampling and static power reduction for biomedical applications is proposed in this work.
no code implementations • 27 Nov 2022 • Jie Yang, Baibhab Chatterjee, Mohammad Abu Khater, Mattias Thorsell, Sten E. Gunnarsson, Tero Kiuru, Shreyas Sen
The system permits an LNA power consumption to tune from 500 mW to 2 W (4X increase) in order to adjust the linearity from P\textsubscript{1dB, IN}=-10. 5 dBm to 0. 5 dBm (>10X increase).
1 code implementation • 20 Nov 2022 • Kun Fang, Qinghua Tao, Yingwen Wu, Tao Li, Xiaolin Huang, Jie Yang
Randomized Smoothing (RS) is a promising technique for certified robustness, and recently in RS the ensemble of multiple deep neural networks (DNNs) has shown state-of-the-art performances.
1 code implementation • 13 Nov 2022 • Qingcheng Zeng, Lucas Garay, Peilin Zhou, Dading Chong, Yining Hua, Jiageng Wu, Yikang Pan, Han Zhou, Rob Voigt, Jie Yang
Large pre-trained models have revolutionized natural language processing (NLP) research and applications, but high training costs and limited data resources have prevented their benefits from being shared equally amongst speakers of all the world's languages.
no code implementations • 11 Nov 2022 • Lingtong Kong, Jinfeng Liu, Jie Yang
Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation.
1 code implementation • 11 Nov 2022 • Lingtong Kong, Jie Yang
To break the dilemma, we propose a novel mutual distillation framework to transfer reliable knowledge back and forth between the teacher and student networks for alternate improvement.
Ranked #1 on
Optical Flow Estimation
on KITTI 2015 unsupervised
(Fl-all metric)
no code implementations • 2 Nov 2022 • Da Chen, Nima Emami, Shahed Rezaei, Philipp L. Rosendahl, Bai-Xiang Xu, Jens Schneider, Kang Gao, Jie Yang
The error range of CNN models leads to an uncertain mechanical performance, which is further evaluated in a structural uncertainty analysis on the FG porous three-layer beam consisting of two thin high-density layers and a thick low-density one, where the imprecise CNN predicted moduli are represented as triangular fuzzy numbers in double parametric form.
no code implementations • 20 Oct 2022 • Yichao Wang, Jie Yang
In this paper, we present, Wi-Mesh, a WiFi vision-based 3D human mesh construction system.
1 code implementation • 19 Oct 2022 • Pengjin Wei, Guohang Yan, Yikang Li, Kun Fang, Jie Yang, Wei Liu
This calibration task is multi-modal, where the rich color and texture information captured by the camera and the accurate three-dimensional spatial information from the LiDAR is incredibly significant for downstream tasks.
1 code implementation • 17 Oct 2022 • Andrea Tocchetti, Lorenzo Corti, Agathe Balayn, Mireia Yurrita, Philip Lippmann, Marco Brambilla, Jie Yang
Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption.
no code implementations • 16 Oct 2022 • Yuanyuan Qiao, Jiaxin Yin, Wei Wang, Fábio Duarte, Jie Yang, Carlo Ratti
Within the next several years, there will be a high level of autonomous technology that will be available for widespread use, which will reduce labor costs, increase safety, save energy, enable difficult unmanned tasks in harsh environments, and eliminate human error.
no code implementations • 3 Oct 2022 • Di wu, Jie Yang, Mohamad Sawan
In this survey, we assess the eligibility of more than fifty published peer-reviewed representative transfer learning approaches for EMG applications.
no code implementations • 30 Sep 2022 • Burcu Sayin, Fabio Casati, Andrea Passerini, Jie Yang, Xinyue Chen
In this paper, we argue that the way we have been training and evaluating ML models has largely forgotten the fact that they are applied in an organization or societal context as they provide value to people.
no code implementations • 30 Sep 2022 • Yili Ren, Jie Yang
In particular, we leverage multiple antennas on next-generation WiFi devices and 2D AoA estimation of the signal reflections to enable WiFi to visualize a person in the physical environment.
1 code implementation • 28 Sep 2022 • Peilin Zhou, Zeqiang Wang, Dading Chong, Zhijiang Guo, Yining Hua, Zichang Su, Zhiyang Teng, Jiageng Wu, Jie Yang
To further investigate tweet users' attitudes toward specific entities, 4 types of entities (Person, Organization, Drug, and Vaccine) are selected and annotated with user sentiments, resulting in a targeted sentiment dataset with 9, 101 entities (in 5, 278 tweets).
1 code implementation • 28 Sep 2022 • Zeqiang Wang, Yile Wang, Jiageng Wu, Zhiyang Teng, Jie Yang
Designed in a hierarchical structure, YATO supports free combinations of three types of widely used features including 1) traditional neural networks (CNN, RNN, etc.
no code implementations • 26 Sep 2022 • Chaoming Fang, Ziyang Shen, Fengshi Tian, Jie Yang, Mohamad Sawan
In this design, a compact online learning neuromorphic hardware architecture with ultra-low power consumption designed explicitly for biosignal processing is proposed.
no code implementations • 16 Sep 2022 • Chuanqing Wang, Chaoming Fang, Yong Zou, Jie Yang, Mohamad Sawan
In this paper, we propose an energy-efficient dynamic scenes processing framework (SpikeSEE) that combines a spike representation encoding technique and a bio-inspired spiking recurrent neural network (SRNN) model to achieve intelligent processing and extreme low-power computation for retinal prostheses.
no code implementations • 15 Sep 2022 • Guang Liu, Jie Yang, Ledell Wu
The learning of an effective contextual representation requires meaningful features and a large amount of data.
no code implementations • 2 Aug 2022 • Feilong Chen, Di wu, Jie Yang, Yi He
In many real applications such as intelligent healthcare platform, streaming feature always has some missing data, which raises a crucial challenge in conducting OSFS, i. e., how to establish the uncertain relationship between sparse streaming features and labels.
no code implementations • 1 Aug 2022 • Jinfeng Liu, Lingtong Kong, Jie Yang
Video frame interpolation is a classic and challenging low-level computer vision task.
no code implementations • 23 Jul 2022 • Jie Yang, Yilin Li, Deddy Jobson
To achieve a better lift return on investment (lift ROI) on the enduring effect of the promotion and improve customer retention and loyalty, we propose a framework of multiple treatment promotion decision making by modeling each customer's direct and enduring response.
1 code implementation • 29 Jun 2022 • Yining Hua, Hang Jiang, Shixu Lin, Jie Yang, Joseph M. Plasek, David W. Bates, Li Zhou
Time-trend analysis indicated that Hydroxychloroquine and Ivermectin were discussed more than Molnupiravir and Remdesivir, particularly during COVID-19 surges.
1 code implementation • Pattetn Recognition 2022 • Jie Yang
We develop our DFC in an asymmetric dual network framework that consists of a generic feature extraction network and an elaborated feature estimation network, and detect the possible anomalies within images by modeling and evaluating the associated deep feature correspondence between the two dual network branches.
Ranked #1 on
Anomaly Detection
on BottleCap
(using extra training data)
no code implementations • 26 Jun 2022 • Qingcheng Zeng, Dading Chong, Peilin Zhou, Jie Yang
Accented speech recognition and accent classification are relatively under-explored research areas in speech technology.
1 code implementation • 23 Jun 2022 • Weijie Ma, Ye Zhu, Ruimao Zhang, Jie Yang, Yiwen Hu, Zhen Li, Li Xiang
By aligning the class tokens and spatial attention maps of paired NBI and WL images at different levels, the Transformer achieves the ability to keep both global and local representation consistency for the above two modalities.
2 code implementations • 22 Jun 2022 • Zhu Sun, Hui Fang, Jie Yang, Xinghua Qu, Hongyang Liu, Di Yu, Yew-Soon Ong, Jie Zhang
Recently, one critical issue looms large in the field of recommender systems -- there are no effective benchmarks for rigorous evaluation -- which consequently leads to unreproducible evaluation and unfair comparison.
no code implementations • 21 Jun 2022 • Jie Yang, Ye Zhu, Chaoqun Wang, Zhen Li, Ruimao Zhang
Integrating multi-modal data to promote medical image analysis has recently gained great attention.
4 code implementations • 16 Jun 2022 • Yuanfeng Ji, Haotian Bai, Jie Yang, Chongjian Ge, Ye Zhu, Ruimao Zhang, Zhen Li, Lingyan Zhang, Wanling Ma, Xiang Wan, Ping Luo
Constraint by the high cost of collecting and labeling 3D medical data, most of the deep learning models to date are driven by datasets with a limited number of organs of interest or samples, which still limits the power of modern deep models and makes it difficult to provide a fully comprehensive and fair estimate of various methods.
no code implementations • 8 Jun 2022 • Shiqi Zhao, Jie Yang, Yankun Xu, Mohamad Sawan
Nowadays, several deep learning methods are proposed to tackle the challenge of epileptic seizure prediction.
1 code implementation • CVPR 2022 • Zuopeng Yang, Daqing Liu, Chaoyue Wang, Jie Yang, DaCheng Tao
Compared to existing CNN-based and Transformer-based generation models that entangled modeling on pixel-level&patch-level and object-level&patch-level respectively, the proposed focal attention predicts the current patch token by only focusing on its highly-related tokens that specified by the spatial layout, thereby achieving disambiguation during training.
2 code implementations • CVPR 2022 • Lingtong Kong, Boyuan Jiang, Donghao Luo, Wenqing Chu, Xiaoming Huang, Ying Tai, Chengjie Wang, Jie Yang
Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time applications.
Ranked #1 on
Video Frame Interpolation
on Middlebury
no code implementations • 27 May 2022 • Jinbo Chen, Mahdi Tarkhan, Hui Wu, Fereidoon Hashemi Noshahr, Jie Yang, Mohamad Sawan
Recent years have seen fast advances in neural recording circuits and systems as they offer a promising way to investigate real-time brain monitoring and the closed-loop modulation of psychological disorders and neurodegenerative diseases.
no code implementations • 26 May 2022 • Jinbo Chen, Fengshi Tian, Jie Yang, Mohamad Sawan
Wearable electrocardiograph (ECG) recording and processing systems have been developed to detect cardiac arrhythmia to help prevent heart attacks.
no code implementations • 12 May 2022 • Pourya Shamsolmoali, Masoumeh Zareapoor, Eric Granger, Jocelyn Chanussot, Jie Yang
In IPSSD, single-shot detector is adopted combined with an image pyramid network to extract semantically strong features for generating candidate regions.
no code implementations • 29 Apr 2022 • Yankun Xu, Jie Yang, Mohamad Sawan
To identify the preictal region that precedes the onset of seizure, a large number of annotated EEG signals are required to train DL algorithms.
1 code implementation • 20 Apr 2022 • Di wu, Siyuan Li, Jie Yang, Mohamad Sawan
To address the appetite for data in deep learning, we present Neuro-BERT, a self-supervised pre-training framework of neurological signals based on masked autoencoding in the Fourier domain.
no code implementations • 16 Apr 2022 • Yili Ren, Jie Yang
This paper presents GoPose, a 3D skeleton-based human pose estimation system that uses WiFi devices at home.
1 code implementation • 15 Apr 2022 • Linyi Yang, Zhen Wang, Yuxiang Wu, Jie Yang, Yue Zhang
Understanding causality is key to the success of NLP applications, especially in high-stakes domains.
1 code implementation • 7 Mar 2022 • Pengjin Wei, Guohang Yan, Yikang Li, Kun Fang, Xinyu Cai, Jie Yang, Wei Liu
Sensor-based environmental perception is a crucial part of the autonomous driving system.
no code implementations • 25 Feb 2022 • Di wu, Jie Yang, Mohamad Sawan
The proposed training scheme significantly improves the performance of patient-specific seizure predictors and bridges the gap between patient-specific and patient-independent predictors.
no code implementations • 22 Feb 2022 • Jie Yang, Qinghe Du, Yi Jiang
As an interesting by-product, we propose an enhancement to the BLE standard by introducing a bit interleaver to its physical layer; the resultant improvement of the receiver sensitivity can make it a better fit for some Internet of Things (IoT) communications.
no code implementations • 18 Feb 2022 • Huihui Fang, Fei Li, Junde Wu, Huazhu Fu, Xu sun, Jaemin Son, Shuang Yu, Menglu Zhang, Chenglang Yuan, Cheng Bian, Baiying Lei, Benjian Zhao, Xinxing Xu, Shaohua Li, Francisco Fumero, José Sigut, Haidar Almubarak, Yakoub Bazi, Yuanhao Guo, Yating Zhou, Ujjwal Baid, Shubham Innani, Tianjiao Guo, Jie Yang, José Ignacio Orlando, Hrvoje Bogunović, Xiulan Zhang, Yanwu Xu
Here we release a multi-annotation, multi-quality, and multi-device color fundus image dataset for glaucoma analysis on an original challenge -- Retinal Fundus Glaucoma Challenge 2nd Edition (REFUGE2).
no code implementations • 9 Feb 2022 • Lu Wang, Jie Yang, Masoumeh Zareapoor, ZhongLong Zheng
Cross-modal hashing still has some challenges needed to address: (1) most existing CMH methods take graphs as input to model data distribution.
no code implementations • 29 Jan 2022 • Weihao Yu, Hao Zheng, Minghui Zhang, Hanxiao Zhang, Jiayuan Sun, Jie Yang
Since the volume of the peripheral bronchi may be much smaller than the large branches in an input patch, the common segmentation loss is not sensitive to the breakages among the distal branches.
no code implementations • 13 Dec 2021 • Fabio Casati, Pierre-André Noël, Jie Yang
We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics that better capture the value delivered by their model in practical applications.
no code implementations • 30 Nov 2021 • Garrett Allen, Jie Yang, Maria Soledad Pera, Ujwal Gadiraju
Further, we discuss preliminary ideas on strategies for evaluation.
no code implementations • 11 Nov 2021 • Burcu Sayin, Jie Yang, Andrea Passerini, Fabio Casati
We motivate why the science of learning to reject model predictions is central to ML, and why human computation has a lead role in this effort.
no code implementations • NeurIPS 2021 • Jia-Heng Tang, Weikai Chen, Jie Yang, Bo wang, Songrun Liu, Bo Yang, Lin Gao
We achieve this goal by introducing a hierarchical octree structure to adaptively subdivide the 3D space according to the surface occupancy and the richness of part geometry.
no code implementations • 26 Oct 2021 • Di wu, Yi Shi, Ziyu Wang, Jie Yang, Mohamad Sawan
Although compressive sensing (CS) can be adopted to compress the signals to reduce communication bandwidth requirement, it needs a complex reconstruction procedure before the signal can be used for seizure prediction.
no code implementations • 19 Oct 2021 • Zhenyuan Zhong, Jie Yang, Yacong Ma, Shoubin Dong, Jinlong Hu
The challenge of solving data mining problems in e-commerce applications such as recommendation system (RS) and click-through rate (CTR) prediction is how to make inferences by constructing combinatorial features from a large number of categorical features while preserving the interpretability of the method.
no code implementations • 19 Oct 2021 • Heng Fan, Jiaxiang Ren, Jie Yang, Yi-Xian Qin, Haibin Ling
The aim of this study was to investigate whether a deep convolutional neural network (CNN) with an attention module can detect osteoporosis on panoramic radiographs.
no code implementations • 18 Oct 2021 • Hossein A. Rahmani, Jie Yang
Key Opinion Leaders (KOLs) are people that have a strong influence and their opinions are listened to by people when making important decisions.
no code implementations • 15 Oct 2021 • Yili Ren, Jie Yang
Our system tracks free-form activity by estimating a 3D skeleton pose that consists of a set of joints of the human body.
no code implementations • 27 Sep 2021 • Jie Yang, Ruijie Xu, Zhiquan Qi, Yong Shi
Visual anomaly detection is an important and challenging problem in the field of machine learning and computer vision.
no code implementations • 27 Sep 2021 • Xun Yao, Junlong Ma, Xinrong Hu, Junping Liu, Jie Yang, Wanqing Li
The task of multiple choice question answering (MCQA) refers to identifying a suitable answer from multiple candidates, by estimating the matching score among the triple of the passage, question and answer.
2 code implementations • 13 Sep 2021 • Kai Li, Jie Yang, Siwei Ma, Bo wang, Shanshe Wang, Yingjie Tian, Zhiquan Qi
For the second issue, we reconsider how to improve detection efficiency with excellent performance, and then propose our lightweight encoder-decoder architecture termed CarNet.
1 code implementation • LREC 2022 • Zhen Wang, Xu Shan, Xiangxie Zhang, Jie Yang
Current news datasets merely focus on text features on the news and rarely leverage the feature of images, excluding numerous essential features for news classification.
Ranked #1 on
News Classification
on N15News
no code implementations • 18 Aug 2021 • Pourya Shamsolmoali, Jocelyn Chanussot, Masoumeh Zareapoor, Huiyu Zhou, Jie Yang
Second, most of the standard methods used hand-crafted features, and do not work well on the detection of objects parts of which are missing.
no code implementations • 17 Aug 2021 • Yankun Xu, Jie Yang, Shiqi Zhao, Hemmings Wu, Mohamad Sawan
Conventional seizure prediction works usually rely on features extracted from Electroencephalography (EEG) recordings and classification algorithms such as regression or support vector machine (SVM) to locate the short time before seizure onset.
1 code implementation • 15 Jul 2021 • Wei Liu, Pingping Zhang, Yinjie Lei, Xiaolin Huang, Jie Yang, Michael Ng
The effectiveness and superior performance of our approach are validated through comprehensive experiments in a range of applications.
1 code implementation • 5 Jul 2021 • Ziyi Liu, Jie Yang, Svetlana Yanushkevich, Orly Yadid-Pecht
Embedded systems have a huge market, and utilizing DCNNs' powerful functionality into them will further reduce human intervention.
no code implementations • 24 Jun 2021 • Yulei Qin, Yun Gu, Hanxiao Zhang, Jie Yang, Lihui Wang, Zhexin Wang, Feng Yao, Yue-Min Zhu
The correlation between nodules and the counting number of airways and vessels that contact or project towards nodules are respectively (OR=22. 96, \chi^2=105. 04) and (OR=7. 06, \chi^2=290. 11).
no code implementations • 18 Jun 2021 • Yili Ren, Jie Yang
Among those services, sensing the liquid level in a container is critical to building many smart home and mobile healthcare applications that improve the quality of life.
no code implementations • 7 Jun 2021 • Kuikun Liu, Jie Yang, Cai Sun, Haoyuan Chi
Currently, instance segmentation is attracting more and more attention in machine learning region.
no code implementations • 2 Jun 2021 • Pourya Shamsolmoali, Masoumeh Zareapoor, Jocelyn Chanussot, Huiyu Zhou, Jie Yang
The proposed model adopts single-shot detector in parallel with a lightweight image pyramid module to extract representative features and generate regions of interest in an optimization approach.
no code implementations • IEEE International Conference on Acoustics, Speech and Signal Processing 2021 • Ning Lv, Xuezhi Xiang, Xinyao Wang, Jie Yang, Rokia Abdeen, Abdulmotaleb El Saddik
In order to process divergence between detection and re-identification, we introduce switchable normalization and gradient centralization to improve the stability of the model.
no code implementations • 5 May 2021 • Ziyu Wang, Jie Yang, Mohamad Sawan
Accurate prediction of epileptic seizures allows patients to take preventive measures in advance to avoid possible injuries.
1 code implementation • 3 May 2021 • Jing Huang, Jie Yang
In this paper, we propose UniGNN, a unified framework for interpreting the message passing process in graph and hypergraph neural networks, which can generalize general GNN models into hypergraphs.
1 code implementation • 2 May 2021 • Jing Huang, Xiaolin Huang, Jie Yang
Hypergraphs are a generalized data structure of graphs to model higher-order correlations among entities, which have been successfully adopted into various research domains.
1 code implementation • 13 Apr 2021 • Qin Luo, Kun Fang, Jie Yang, Xiaolin Huang
Random Fourier Features (RFF) demonstrate wellappreciated performance in kernel approximation for largescale situations but restrict kernels to be stationary and positive definite.
2 code implementations • 8 Mar 2021 • Lingtong Kong, Chunhua Shen, Jie Yang
Experiments on both synthetic Sintel data and real-world KITTI datasets demonstrate the effectiveness of the proposed approach, which needs only 1/10 computation of comparable networks to achieve on par accuracy.
Ranked #12 on
Optical Flow Estimation
on KITTI 2012
no code implementations • 5 Mar 2021 • Xiaohang Yang, Lingtong Kong, Jie Yang
Learning reliable motion representation between consecutive frames, such as optical flow, has proven to have great promotion to video understanding.
no code implementations • 25 Feb 2021 • Fengshi Tian, Jie Yang, Shiqi Zhao, Mohamad Sawan
Motivated by the energy-efficient spiking neural networks (SNNs), a neuromorphic computing approach for seizure prediction is proposed in this work.
no code implementations • 23 Feb 2021 • Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai
Moreover, as such methods only add details, they require coarse meshes to be close to fine meshes, which can be either impossible, or require unrealistic constraints when generating fine meshes.
no code implementations • 2 Feb 2021 • Jie Yang, Mengchen Lin, Ziyi Liu, Ulian Shahnovich, Orly Yadid-Pecht
It is especially crucial for mobile devices because most of the images taken today are from mobile phones, hence such technology is highly demanded in the consumer market of mobile devices and is essential for a good customer experience.
no code implementations • 31 Jan 2021 • Lingtong Kong, Xiaohang Yang, Jie Yang
Optical flow estimation is an essential step for many real-world computer vision tasks.
1 code implementation • 31 Jan 2021 • Jie Yang, Ziyi Liu, Ulian Shahnovich, Orly Yadid-Pecht
HVS perceives luminance differently when under different adaptation levels, and therefore our algorithm uses functions built upon different scales to tone map pixels to different values.
1 code implementation • 31 Jan 2021 • Jie Yang, Ziyi Liu, Mengchen Lin, Svetlana Yanushkevich, Orly Yadid-Pecht
The reformulated Laplacian pyramid always decompose a WDR image into two frequency bands where the low-frequency band is global feature-oriented, and the high-frequency band is local feature-oriented.
no code implementations • 16 Jan 2021 • Jie Yang, Soyeon Caren Han, Josiah Poon
Existing causality extraction techniques include knowledge-based, statistical machine learning(ML)-based, and deep learning-based approaches.
no code implementations • 11 Jan 2021 • Ziyi Liu, Jie Yang, Mengchen Lin, Kenneth Kam Fai Lai, Svetlana Yanushkevich, Orly Yadid-Pecht
Furthermore, we show the effect of different face detection procedures on the WDRIs in our database.
1 code implementation • ICCV 2021 • Ming-Xian Lin, Jie Yang, He Wang, Yu-Kun Lai, Rongfei Jia, Binqiang Zhao, Lin Gao
Inspired by the great success in recent contrastive learning works on self-supervised representation learning, we propose a novel IBSR pipeline leveraging contrastive learning.