Search Results for author: Tianyu Zhao

Found 44 papers, 8 papers with code

An Evolved Universal Transformer Memory

1 code implementation17 Oct 2024 Edoardo Cetin, Qi Sun, Tianyu Zhao, Yujin Tang

Prior methods propose to offset the escalating costs of modern foundation models by dropping specific parts of their contexts with hand-designed rules, while attempting to preserve their original performance.

IntrinsicVoice: Empowering LLMs with Intrinsic Real-time Voice Interaction Abilities

no code implementations9 Oct 2024 Xin Zhang, Xiang Lyu, Zhihao Du, Qian Chen, Dong Zhang, Hangrui Hu, Chaohong Tan, Tianyu Zhao, Yuxuan Wang, Bin Zhang, Heng Lu, Yaqian Zhou, Xipeng Qiu

Current methods of building LLMs with voice interaction capabilities rely heavily on explicit text autoregressive generation before or during speech response generation to maintain content quality, which unfortunately brings computational overhead and increases latency in multi-turn interactions.

Response Generation

Rapid Parameter Estimation for Extreme Mass Ratio Inspirals Using Machine Learning

no code implementations12 Sep 2024 Bo Liang, Hong Guo, Tianyu Zhao, He Wang, Herik Evangelinelis, Yuxiang Xu, Chang Liu, Manjia Liang, Xiaotong Wei, Yong Yuan, Peng Xu, Minghui Du, Wei-Liang Qian, Ziren Luo

Extreme-mass-ratio inspiral (EMRI) signals pose significant challenges in gravitational wave (GW) astronomy owing to their low-frequency nature and highly complex waveforms, which occupy a high-dimensional parameter space with numerous variables.

Astronomy Computational Efficiency

Enhancing Travel Choice Modeling with Large Language Models: A Prompt-Learning Approach

no code implementations19 Jun 2024 Xuehao Zhai, Hanlin Tian, Lintong Li, Tianyu Zhao

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS).

Discrete Choice Models Language Modelling +2

Release of Pre-Trained Models for the Japanese Language

no code implementations2 Apr 2024 Kei Sawada, Tianyu Zhao, Makoto Shing, Kentaro Mitsui, Akio Kaga, Yukiya Hono, Toshiaki Wakatsuki, Koh Mitsuda

AI democratization aims to create a world in which the average person can utilize AI techniques.

VmambaIR: Visual State Space Model for Image Restoration

1 code implementation18 Mar 2024 Yuan Shi, Bin Xia, Xiaoyu Jin, Xing Wang, Tianyu Zhao, Xin Xia, Xuefeng Xiao, Wenming Yang

To address these challenges, we propose VmambaIR, which introduces State Space Models (SSMs) with linear complexity into comprehensive image restoration tasks.

Denoising Image Restoration +3

Highly Accurate Disease Diagnosis and Highly Reproducible Biomarker Identification with PathFormer

no code implementations11 Feb 2024 Zehao Dong, Qihang Zhao, Philip R. O. Payne, Michael A Province, Carlos Cruchaga, Muhan Zhang, Tianyu Zhao, Yixin Chen, Fuhai Li

However, we found two major limitations of existing GNNs in omics data analysis, i. e., limited-prediction (diagnosis) accuracy and limited-reproducible biomarker identification capacity across multiple datasets.

DoseGNN: Improving the Performance of Deep Learning Models in Adaptive Dose-Volume Histogram Prediction through Graph Neural Networks

no code implementations2 Feb 2024 Zehao Dong, Yixin Chen, Tianyu Zhao

Dose-Volume Histogram (DVH) prediction is fundamental in radiation therapy that facilitate treatment planning, dose evaluation, plan comparison and etc.

Deep Learning

Enhancing Personality Recognition in Dialogue by Data Augmentation and Heterogeneous Conversational Graph Networks

1 code implementation11 Jan 2024 Yahui Fu, Haiyue Song, Tianyu Zhao, Tatsuya Kawahara

Personality recognition is useful for enhancing robots' ability to tailor user-adaptive responses, thus fostering rich human-robot interactions.

Data Augmentation

Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognition

no code implementations6 Dec 2023 Yukiya Hono, Koh Mitsuda, Tianyu Zhao, Kentaro Mitsui, Toshiaki Wakatsuki, Kei Sawada

Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +5

SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System

1 code implementation CVPR 2024 Yunfei Fan, Tianyu Zhao, Guidong Wang

To this end, we propose a novel filter-based VINS framework named SchurVINS, which could guarantee both high accuracy by building a complete residual model and low computational complexity with Schur complement.

Computational Efficiency

Which Matters Most in Making Fund Investment Decisions? A Multi-granularity Graph Disentangled Learning Framework

no code implementations23 Nov 2023 Chunjing Gan, Binbin Hu, Bo Huang, Tianyu Zhao, Yingru Lin, Wenliang Zhong, Zhiqiang Zhang, Jun Zhou, Chuan Shi

In this paper, we highlight that both conformity and risk preference matter in making fund investment decisions beyond personal interest and seek to jointly characterize these aspects in a disentangled manner.

FinA: Fairness of Adverse Effects in Decision-Making of Human-Cyber-Physical-System

no code implementations6 Nov 2023 Tianyu Zhao, Salma Elmalaki

Ensuring fairness in decision-making systems within Human-Cyber-Physical-Systems (HCPS) is a pressing concern, particularly when diverse individuals, each with varying behaviors and expectations, coexist within the same application space, influenced by a shared set of control actions in the system.

Decision Making Fairness

Compact Binary Systems Waveform Generation with Generative Pre-trained Transformer

no code implementations31 Oct 2023 Ruijun Shi, Yue Zhou, Tianyu Zhao, Zhoujian Cao, Zhixiang Ren

Space-based gravitational wave (GW) detection is one of the most anticipated GW detection projects in the next decade, which promises to detect abundant compact binary systems.

Gravitational Wave Detection

Dilated convolutional neural network for detecting extreme-mass-ratio inspirals

no code implementations31 Aug 2023 Tianyu Zhao, Yue Zhou, Ruijun Shi, Zhoujian Cao, Zhixiang Ren

The detection of Extreme Mass Ratio Inspirals (EMRIs) is intricate due to their complex waveforms, extended duration, and low signal-to-noise ratio (SNR), making them more challenging to be identified compared to compact binary coalescences.

Reinforcement Federated Learning Method Based on Adaptive OPTICS Clustering

no code implementations22 Jun 2023 Tianyu Zhao, Junping Du, Yingxia Shao, Zeli Guan

The algorithm combines OPTICS clustering and adaptive learning technology, and can effective-ly deal with the problem of non-independent and identically distributed data across different user terminals.

Clustering Federated Learning

Focused Prefix Tuning for Controllable Text Generation

no code implementations1 Jun 2023 Congda Ma, Tianyu Zhao, Makoto Shing, Kei Sawada, Manabu Okumura

In a controllable text generation dataset, there exist unannotated attributes that could provide irrelevant learning signals to models that use it for training and thus degrade their performance.

Attribute Text Generation

Space-based gravitational wave signal detection and extraction with deep neural network

1 code implementation15 Jul 2022 Tianyu Zhao, Ruoxi Lyu, He Wang, Zhoujian Cao, Zhixiang Ren

Space-based gravitational wave (GW) detectors will be able to observe signals from sources that are otherwise nearly impossible from current ground-based detection.

Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa

no code implementations6 Jul 2022 Tianyu Zhao, Junping Du, Zhe Xue, Ang Li, Zeli Guan

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in the field of sentiment analysis, which aims to predict the polarity of aspects.

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA) +4

Space4HGNN: A Novel, Modularized and Reproducible Platform to Evaluate Heterogeneous Graph Neural Network

1 code implementation18 Feb 2022 Tianyu Zhao, Cheng Yang, Yibo Li, Quan Gan, Zhenyi Wang, Fengqi Liang, Huan Zhao, Yingxia Shao, Xiao Wang, Chuan Shi

Heterogeneous Graph Neural Network (HGNN) has been successfully employed in various tasks, but we cannot accurately know the importance of different design dimensions of HGNNs due to diverse architectures and applied scenarios.

Graph Neural Network

Ensuring DNN Solution Feasibility for Optimization Problems with Convex Constraints and Its Application to DC Optimal Power Flow Problems

no code implementations15 Dec 2021 Tianyu Zhao, Xiang Pan, Minghua Chen, Steven H. Low

We systematically calibrate inequality constraints used in DNN training, thereby anticipating prediction errors and ensuring the resulting solutions remain feasible.

CORSAIR: Convolutional Object Retrieval and Symmetry-AIded Registration

no code implementations11 Mar 2021 Tianyu Zhao, Qiaojun Feng, Sai Jadhav, Nikolay Atanasov

This paper considers online object-level mapping using partial point-cloud observations obtained online in an unknown environment.

Object Retrieval

Topic-relevant Response Generation using Optimal Transport for an Open-domain Dialog System

no code implementations COLING 2020 Shuying Zhang, Tianyu Zhao, Tatsuya Kawahara

The semantic constraint, which encourages a response to be semantically related to its context by regularizing the decoding objective function with semantic distance, is proposed.

Open-Domain Dialog Response Generation

Multi-Referenced Training for Dialogue Response Generation

1 code implementation SIGDIAL (ACL) 2021 Tianyu Zhao, Tatsuya Kawahara

In this work, we first analyze the training objective of dialogue models from the view of Kullback-Leibler divergence (KLD) and show that the gap between the real world probability distribution and the single-referenced data's probability distribution prevents the model from learning the one-to-many relations efficiently.

Response Generation

DeepOPF: A Feasibility-Optimized Deep Neural Network Approach for AC Optimal Power Flow Problems

no code implementations2 Jul 2020 Xiang Pan, Minghua Chen, Tianyu Zhao, Steven H. Low

High percentage penetrations of renewable energy generations introduce significant uncertainty into power systems.

End-to-end speech-to-dialog-act recognition

no code implementations23 Apr 2020 Viet-Trung Dang, Tianyu Zhao, Sei Ueno, Hirofumi Inaguma, Tatsuya Kawahara

In the proposed model, the dialog act recognition network is conjunct with an acoustic-to-word ASR model at its latent layer before the softmax layer, which provides a distributed representation of word-level ASR decoding information.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

An adaptive neuro-fuzzy model for attitude estimation and 2 control a 3 DOF system

no code implementations21 Apr 2020 Xin Wang, SeyedMehdi Abtahi, Mahmood Chahari, Tianyu Zhao

To evaluate the performance of the AN-FIS controller in closed-loop simulation, an ANFIS observer is used to estimate the attitude and angular velocities of the satellite using magnetometer, sun sensor and data gyro data.

Designing Precise and Robust Dialogue Response Evaluators

1 code implementation ACL 2020 Tianyu Zhao, Divesh Lala, Tatsuya Kawahara

Automatic dialogue response evaluator has been proposed as an alternative to automated metrics and human evaluation.

DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flow

no code implementations30 Oct 2019 Xiang Pan, Tianyu Zhao, Minghua Chen, Shengyu Zhang

We then directly reconstruct the phase angles from the generations and loads by using the power flow equations.

Efficient and Robust Equilibrium Strategies of Utilities in Day-ahead Market with Load Uncertainty

no code implementations12 Sep 2019 Tianyu Zhao, Hanling Yi, Minghua Chen, Chenye Wu, Yunjian Xu

We consider the scenario where $N$ utilities strategically bid for electricity in the day-ahead market and balance the mismatch between the committed supply and actual demand in the real-time market, with uncertainty in demand and local renewable generation in consideration.

Effective Incorporation of Speaker Information in Utterance Encoding in Dialog

no code implementations12 Jul 2019 Tianyu Zhao, Tatsuya Kawahara

In dialog studies, we often encode a dialog using a hierarchical encoder where each utterance is converted into an utterance vector, and then a sequence of utterance vectors is converted into a dialog vector.

Response Generation

Content Word-based Sentence Decoding and Evaluating for Open-domain Neural Response Generation

no code implementations31 May 2019 Tianyu Zhao, Shinsuke Mori, Tatsuya Kawahara

Various encoder-decoder models have been applied to response generation in open-domain dialogs, but a majority of conventional models directly learn a mapping from lexical input to lexical output without explicitly modeling intermediate representations.

Decoder Response Generation +1

DeepOPF: Deep Neural Network for DC Optimal Power Flow

no code implementations11 May 2019 Xiang Pan, Tianyu Zhao, Minghua Chen

DeepOPF is inspired by the observation that solving DC-OPF for a given power network is equivalent to characterizing a high-dimensional mapping between the load inputs and the dispatch and transmission decisions.

Systems and Control

Unsupervised Degradation Learning for Single Image Super-Resolution

no code implementations11 Dec 2018 Tianyu Zhao, Wenqi Ren, Changqing Zhang, Dongwei Ren, QinGhua Hu

Specifically, we propose a degradation network to model the real-world degradation process from HR to LR via generative adversarial networks, and these generated realistic LR images paired with real-world HR images are exploited for training the SR reconstruction network, forming the first cycle.

Image Super-Resolution

Cannot find the paper you are looking for? You can Submit a new open access paper.