1 code implementation • COLING 2022 • Pengshan Cai, Fei Liu, Adarsha Bajracharya, Joe Sills, Alok Kapoor, Weisong Liu, Dan Berlowitz, David Levy, Richeek Pradhan, Hong Yu
Crucially, we introduce a feedback mechanism that alerts physicians when an automatic summary fails to capture the important details of the clinical notes or when it contains hallucinated facts that are potentially detrimental to the summary quality.
no code implementations • 22 Dec 2022 • Zhichao Yang, Weisong Liu, Dan Berlowitz, Hong Yu
Question: Can an encoder-decoder architecture pretrained on a large dataset of longitudinal electronic health records improves patient outcome predictions?
1 code implementation • 11 Dec 2022 • Avijit Mitra, Richeek Pradhan, Rachel D Melamed, Kun Chen, David C Hoaglin, Katherine L Tucker, Joel I Reisman, Zhichao Yang, Weisong Liu, Jack Tsai, Hong Yu
All SDOH, measured by structured data and NLP, were significantly associated with increased risk of suicide.
no code implementations • 6 Dec 2022 • Zonghai Yao, Jack Tsai, Weisong Liu, David A. Levy, Emily Druhl, Joel I Reisman, Hong Yu
Materials and Methods: We annotated eviction status in 5000 EHR notes from the Veterans Health Administration.
no code implementations • 26 Nov 2022 • Sunjae Kwon, Zhichao Yang, Hong Yu
The transfer learning framework helps SOAP classification model's inter-hospital migration with a minimal size of the manually annotated dataset.
1 code implementation • 24 Nov 2022 • Zhichao Yang, Sunjae Kwon, Zonghai Yao, Hong Yu
This task is challenging due to the high-dimensional space of multi-label assignment (155, 000+ ICD code candidates) and the long-tail challenge - Many ICD codes are infrequently assigned yet infrequent ICD codes are important clinically.
no code implementations • 18 Nov 2022 • Zonghai Yao, Yi Cao, Zhichao Yang, Hong Yu
Different from the previous known-unknown evaluation criteria, we propose the concept of "Misunderstand" in LAMA for the first time.
no code implementations • 12 Oct 2022 • Sunjae Kwon, Zonghai Yao, Harmon S. Jordan, David A. Levy, Brian Corner, Hong Yu
We first present a novel and publicly available dataset with expert-annotated medical jargon terms from 18K+ EHR note sentences ($MedJ$).
1 code implementation • 7 Oct 2022 • Zhichao Yang, Shufan Wang, Bhanu Pratap Singh Rawat, Avijit Mitra, Hong Yu
Automatic International Classification of Diseases (ICD) coding aims to assign multiple ICD codes to a medical note with average length of 3, 000+ tokens.
Ranked #1 on
Medical Code Prediction
on MIMIC-III
no code implementations • 26 Aug 2022 • Zonghai Yao, Yi Cao, Zhichao Yang, Vijeta Deshpande, Hong Yu
In order to make LMs as KBs more in line with the actual application scenarios of the biomedical domain, we specifically add EHR notes as context to the prompt to improve the low bound in the biomedical domain.
no code implementations • 26 Jul 2022 • Ye Wang, Jingbo Liao, Hong Yu, Guoyin Wang, Xiaoxia Zhang, Li Liu
Particularly, the model integrates the macro-level guided-category knowledge and micro-level open-domain dialogue data for the training, leveraging the priori knowledge into the latent space, which enables the model to disentangle the latent variables within the mesoscopic scale.
no code implementations • 28 Jun 2022 • Ziyan Chen, Zhentao Liu, Chenyu Hu, Heng Wu, Jianrong Wu, Jinda Lin, Zhishen Tong, Hong Yu, Shensheng Han
When applying deep learning into GISC spectral camera, there are several challenges need to be solved: 1) how to deal with the large amount of 3D hyperspectral data, 2) how to reduce the influence caused by the uncertainty of the random reference measurements, 3) how to improve the reconstructed image quality as far as possible.
no code implementations • 14 Jun 2022 • Han Liu, Feng Zhang, Xiaotong Zhang, Siyang Zhao, Junjie Sun, Hong Yu, Xianchao Zhang
Multi-label aspect category detection allows a given review sentence to contain multiple aspect categories, which is shown to be more practical in sentiment analysis and attracting increasing attention.
no code implementations • 5 Jun 2022 • Han Liu, Siyang Zhao, Xiaotong Zhang, Feng Zhang, Junjie Sun, Hong Yu, Xianchao Zhang
Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data.
1 code implementation • NAACL 2022 • Pengshan Cai, Hui Wan, Fei Liu, Mo Yu, Hong Yu, Sachindra Joshi
We propose novel AI-empowered chat bots for learning as conversation where a user does not read a passage but gains information and knowledge through conversation with a teacher bot.
1 code implementation • NAACL 2022 • Bhanu Pratap Singh Rawat, Samuel Kovaly, Wilfred R. Pigeon, Hong Yu
In this study, we first built Suicide Attempt and Ideation Events (ScAN) dataset, a subset of the publicly available MIMIC III dataset spanning over 12k+ EHR notes with 19k+ annotated SA and SI events information.
1 code implementation • 18 Apr 2022 • Yiming Zhang, Hong Yu, Ruoyi Du, Zhanyu Ma, Yuan Dong
To eliminate this negative effect, in this paper, we propose a two-stage framework for audio captioning: (i) in the first stage, via the contrastive learning, we construct a proxy feature space to reduce the distances between captions correlated to the same audio, and (ii) in the second stage, the proxy feature space is utilized as additional supervision to encourage the model to be optimized in the direction that benefits all the correlated captions.
1 code implementation • 9 Apr 2022 • Jiangyun Li, Sen Zha, Chen Chen, Meng Ding, Tianxiang Zhang, Hong Yu
First, commonly used upsampling methods in the decoder such as interpolation and deconvolution suffer from a local receptive field, unable to encode global contexts.
1 code implementation • 29 Mar 2022 • Jiangyun Li, Hong Yu, Chen Chen, Meng Ding, Sen Zha
In this model, we design a Supervised Attention Module (SAM) based on the attention mechanism, which can capture more accurate and stable long-range dependency in feature maps without introducing much computational cost.
1 code implementation • 30 Jan 2022 • Jiangyun Li, Wenxuan Wang, Chen Chen, Tianxiang Zhang, Sen Zha, Jing Wang, Hong Yu
Different from TransBTS, the proposed TransBTSV2 is not limited to brain tumor segmentation (BTS) but focuses on general medical image segmentation, providing a stronger and more efficient 3D baseline for volumetric segmentation of medical images.
no code implementations • ACL 2021 • Zonghai Yao, Hong Yu
Models pre-trained on large-scale regular text corpora often do not work well for user-generated data where the language styles differ significantly from the mainstream text.
1 code implementation • NAACL 2021 • Bo-Hsiang Tseng, Shruti Bhargava, Jiarui Lu, Joel Ruben Antony Moniz, Dhivya Piraviperumal, Lin Li, Hong Yu
In this work, we propose a novel joint learning framework of modeling coreference resolution and query rewriting for complex, multi-turn dialogue understanding.
no code implementations • 16 Apr 2021 • Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu
We show that membership inference attacks on CLMs lead to non-trivial privacy leakages of up to 7%.
1 code implementation • 15 Apr 2021 • Qixuan Sun, Yaqi Yin, Hong Yu
Existing work follows a two-stage pipeline which identifies emotions and causes at the first step and pairs them at the second step.
1 code implementation • 7 Mar 2021 • Wenxuan Wang, Chen Chen, Meng Ding, Jiangyun Li, Hong Yu, Sen Zha
To capture the local 3D context information, the encoder first utilizes 3D CNN to extract the volumetric spatial feature maps.
no code implementations • 14 Dec 2020 • Yuxuan Zhang, Chen Gong, Dawei Li, Zhi-Wei Wang, Shengda D Pu, Alex W Robertson, Hong Yu, John Parrington
A reasonable prediction of infectious diseases transmission process under different disease control strategies is an important reference point for policy makers.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Zhichao Yang, Hong Yu
One of the fundamental goals of artificial intelligence is to build computer-based expert systems.
no code implementations • Findings of the Association for Computational Linguistics 2020 • John P. Lalor, Hong Yu
Curriculum learning methods typically rely on heuristics to estimate the difficulty of training examples or the ability of the model.
1 code implementation • EMNLP 2020 • Jianpeng Cheng, Devang Agrawal, Hector Martinez Alonso, Shruti Bhargava, Joris Driesen, Federico Flego, Shaona Ghosh, Dain Kaplan, Dimitri Kartsaklis, Lin Li, Dhivya Piraviperumal, Jason D Williams, Hong Yu, Diarmuid O Seaghdha, Anders Johannsen
We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog.
no code implementations • 5 Aug 2020 • Yang Wang, Fengwei Zhang, Hong Yu, Xianwei Ye, Yongqun He
The commonly occurring 17 phenotypes were classified into different groups based on the Human Phenotype Ontology (HPO).
no code implementations • ACL 2020 • Yonghao Jin, Fei Li, Hong Yu
In addition, the GUI interface enables researchers with limited computer background to compose tools into NLP pipelines and then apply the pipelines on their own datasets in a {``}what you see is what you get{''} (WYSIWYG) way.
no code implementations • COLING 2020 • Somil Gupta, Bhanu Pratap Singh Rawat, Hong Yu
Conversational Machine Comprehension (CMC), a research track in conversational AI, expects the machine to understand an open-domain natural language text and thereafter engage in a multi-turn conversation to answer questions related to the text.
Machine Reading Comprehension
Natural Language Understanding
+1
1 code implementation • 31 May 2020 • Hong Yu, Li Li, Hsin-hui Huang, Yang Wang, Yingtong Liu, Edison Ong, Anthony Huffman, Tao Zeng, Jingsong Zhang, Pengpai Li, Zhiping Liu, Xiangyan Zhang, Xianwei Ye, Samuel K. Handelman, Gerry Higgins, Gilbert S. Omenn, Brian Athey, Junguk Hur, Luonan Chen, Yongqun He
We hypothesized that ontology can be used as an integrative platform to classify and analyze HCI and disease outcomes.
Other Quantitative Biology
no code implementations • 16 Apr 2020 • Kai Chen, Fayuan Li, Baotian Hu, Weihua Peng, Qingcai Chen, Hong Yu
We further design a reconstruction mechanism with a novel objective function that can reconstruct the whole entry of the used data sequentially from the hidden states of the decoder, which aids the accuracy of the generated text.
no code implementations • ACL 2020 • Abhyuday Jagannatha, Hong Yu
Additionally, we show that our calibration method can also be used as an uncertainty-aware, entity-specific decoding step to improve the performance of the underlying model at no additional training cost or data requirements.
no code implementations • 5 Apr 2020 • Subendhu Rongali, Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu
Pre-trained language models (LM) such as BERT, DistilBERT, and RoBERTa can be tuned for different domains (domain-tuning) by continuing the pre-training phase on a new target domain corpus.
no code implementations • 11 Dec 2019 • Rumeng Li, Xun Wang, Hong Yu
Manipulating training data leads to robust neural models for MT.
1 code implementation • 25 Nov 2019 • Fei Li, Hong Yu
The innovations of our model are two-folds: it utilizes a multi-filter convolutional layer to capture various text patterns with different lengths and a residual convolutional layer to enlarge the receptive field.
Ranked #9 on
Medical Code Prediction
on MIMIC-III
no code implementations • WS 2019 • Wuti Xiong, Fei Li, Ming Cheng, Hong Yu, Donghong Ji
abstract In this article, we describe our approach for the Bacteria Biotopes relation extraction (BB-rel) subtask in the BioNLP Shared Task 2019.
no code implementations • 9 Oct 2019 • Hong Yu, Xiaofan Zhang, Lingjun Song, Liren Jiang, Xiaodi Huang, Wen Chen, Chenbin Zhang, Jiahui Li, Jiji Yang, Zhiqiang Hu, Qi Duan, Wanyuan Chen, Xianglei He, Jinshuang Fan, Weihai Jiang, Li Zhang, Chengmin Qiu, Minmin Gu, Weiwei Sun, Yangqiong Zhang, Guangyin Peng, Weiwei Shen, Guohui Fu
Gastric cancer is one of the most common cancers, which ranks third among the leading causes of cancer death.
1 code implementation • IJCNLP 2019 • Zhichao Yang, Pengshan Cai, Yansong Feng, Fei Li, Weijiang Feng, Elena Suet-Ying Chiu, Hong Yu
According to experiments, our approach significantly improve the perplexity and BLEU compared with typical UMT models.
1 code implementation • IJCNLP 2019 • John P. Lalor, Hao Wu, Hong Yu
We demonstrate a use-case for latent difficulty item parameters, namely training set filtering, and show that using difficulty to sample training data outperforms baseline methods.
no code implementations • 29 Nov 2018 • Yonghao Jin, Fei Li, Hong Yu
We used this annotated dataset to train and evaluate HYPE, supervised NLP systems for hypoglycemia detection.
no code implementations • 18 Sep 2018 • Zhanyu Ma, Hong Yu
In order to improve the SLD accuracy of short utterances a phase vocoder based time-scale modification(TSM) method is used to reduce and increase speech rated of the test utterance.
no code implementations • 2 Aug 2018 • Zhanyu Ma, Hong Yu
A novel text-independent speaker identification (SI) method is proposed.
no code implementations • 2 Aug 2018 • Hong Yu, Zhanyu Ma
Many researches demonstrated that the DNA methylation, which occurs in the context of a CpG, has strong correlation with diseases, including cancer.
no code implementations • NAACL 2018 • Tu Vu, Baotian Hu, Tsendsuren Munkhdalai, Hong Yu
Sentence simplification aims to simplify the content and structure of complex sentences, and thus make them easier to interpret for human readers, and easier to process for downstream NLP applications.
Ranked #1 on
Text Simplification
on PWKP / WikiSmall
1 code implementation • ICML 2017 • Tsendsuren Munkhdalai, Hong Yu
Neural networks have been successfully applied in applications with a large amount of labeled data.
no code implementations • 1 Mar 2017 • Jinying Chen, Hong Yu
Objective: The aim of this work was to develop FIT (Finding Important Terms for patients), an unsupervised natural language processing (NLP) system that ranks medical terms in EHR notes based on their importance to patients.
no code implementations • 27 Feb 2017 • John P. Lalor, Hao Wu, Hong Yu
Often when multiple labels are obtained for a training example it is assumed that there is an element of noise that must be accounted for.
no code implementations • EMNLP 2018 • John P. Lalor, Hao Wu, Tsendsuren Munkhdalai, Hong Yu
We examine the impact of a test set question's difficulty to determine if there is a relationship between difficulty and performance.
no code implementations • 13 Feb 2017 • Hong Yu, Zheng-Hua Tan, Zhanyu Ma, Jun Guo
In order to improve the reliability of speaker verification systems, we develop a new filter bank based cepstral feature, deep neural network filter bank cepstral coefficients (DNN-FBCC), to distinguish between natural and spoofed speech.
no code implementations • 14 Nov 2016 • Jinying Chen, Abhyuday N. Jagannatha, Samah J. Jarad, Hong Yu
Methods: We developed an innovative adapted distant supervision (ADS) model based on support vector machines to rank medical jargon from EHRs.
no code implementations • 4 Nov 2016 • Jesse M Lingeman, Hong Yu
Finding related published articles is an important task in any science, but with the explosion of new work in the biomedical domain it has become especially challenging.
no code implementations • 20 Oct 2016 • Tsendsuren Munkhdalai, Hong Yu
Hypothesis testing is an important cognitive process that supports human reasoning.
1 code implementation • EMNLP 2016 • Abhyuday Jagannatha, Hong Yu
In this work we experimented with various CRF based structured learning models with Recurrent Neural Networks.
1 code implementation • EACL 2017 • Tsendsuren Munkhdalai, Hong Yu
NTI constructs a full n-ary tree by processing the input text with its node function in a bottom-up fashion.
Ranked #46 on
Natural Language Inference
on SNLI
3 code implementations • EACL 2017 • Tsendsuren Munkhdalai, Hong Yu
We present a memory augmented neural network for natural language understanding: Neural Semantic Encoders.
Ranked #16 on
Question Answering
on WikiQA
no code implementations • 26 Jun 2016 • Feifan Liu, Jinying Chen, Abhyuday Jagannatha, Hong Yu
Biomedical information extraction (BioIE) is important to many applications, including clinical decision support, integrative biology, and pharmacovigilance, and therefore it has been an active research.
1 code implementation • 25 Jun 2016 • Abhyuday Jagannatha, Hong Yu
Sequence labeling for extraction of medical events and their attributes from unstructured text in Electronic Health Record (EHR) notes is a key step towards semantic understanding of EHRs.
no code implementations • EMNLP 2016 • John P. Lalor, Hao Wu, Hong Yu
Evaluation of NLP methods requires testing against a previously vetted gold-standard test set and reporting standard metrics (accuracy/precision/recall/F1).
no code implementations • 22 Dec 2015 • Xi'ao Ma, Guoyin Wang, Hong Yu
This is partly due to the fact that there are no monotonic fitness functions that are used to design heuristic attribute reduction algorithms in probabilistic rough set model.