Search Results for author:
Found 71 papers, 30 papers with code
Conversational Bots for Psychotherapy: A Study of Generative Transformer Models Using Domain-specific Dialogues
Through quantitative evaluation of the linguistic quality, we observe that the dialog generation model - DialoGPT (345M) with transfer learning on video data attains scores similar to a human response baseline.
Map2Text: New Content Generation from Low-Dimensional Visualizations
Low-dimensional visualizations, or "projection maps" of datasets, are widely used across scientific research and creative industries as effective tools for interpreting large-scale and complex information.
Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback
In this work, we make the first attempt to fine-tune all-modality models (i. e. input and output with any modality, also named any-to-any models) using human preference data across all modalities (including text, image, audio, and video), ensuring its behavior aligns with human intentions.
CDEMapper: Enhancing NIH Common Data Element Normalization using Large Language Models
We propose CDEMapper, a large language model (LLM) powered mapping tool designed to assist in mapping local data elements to NIH CDEs.
Bridging AI and Science: Implications from a Large-Scale Literature Analysis of AI4Science
Artificial Intelligence has proven to be a transformative tool for advancing scientific research across a wide range of disciplines.
Information Extraction from Clinical Notes: Are We Ready to Switch to Large Language Models?
On unseen i2b2 data, LLaMA-3-70B outperformed BERT by 7% (F1) on NER and 4% on RE.
A Comparative Study of Recent Large Language Models on Generating Hospital Discharge Summaries for Lung Cancer Patients
Evaluation metrics included token-level analysis (BLEU, ROUGE-1, ROUGE-2, ROUGE-L) and semantic similarity scores between model-generated summaries and physician-written gold standards.
Generative AI in Health Economics and Outcomes Research: A Taxonomy of Key Definitions and Emerging Applications, an ISPOR Working Group Report
The article discusses strategies to improve the accuracy of these AI tools.
GPTON: Generative Pre-trained Transformers enhanced with Ontology Narration for accurate annotation of biological data
By leveraging GPT-4 for ontology narration, we developed GPTON to infuse structured knowledge into LLMs through verbalized ontology terms, achieving accurate text and ontology annotations for over 68% of gene sets in the top five predictions.
A practical applicable quantum-classical hybrid ant colony algorithm for the NISQ era
Quantum ant colony optimization (QACO) has drew much attention since it combines the advantages of quantum computing and ant colony optimization (ACO) algorithm overcoming some limitations of the traditional ACO algorithm.
Language Enhanced Model for Eye (LEME): An Open-Source Ophthalmology-Specific Large Language Model
In external validations, LEME excelled in long-form QA with a Rouge-L of 0. 19 (all p<0. 0001), ranked second in MCQ accuracy (0. 68; all p<0. 0001), and scored highest in EHR summarization and clinical QA (ranging from 4. 24 to 4. 83 out of 5 for correctness, completeness, and readability).
Environment Scan of Generative AI Infrastructure for Clinical and Translational Science
This study reports a comprehensive environmental scan of the generative AI (GenAI) infrastructure in the national network for clinical and translational science across 36 institutions supported by the Clinical and Translational Science Award (CTSA) Program led by the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) at the United States.
NeuralQP: A General Hypergraph-based Optimization Framework for Large-scale QCQPs
Machine Learning (ML) optimization frameworks have gained attention for their ability to accelerate the optimization of large-scale Quadratically Constrained Quadratic Programs (QCQPs) by learning shared problem structures.
Suicide Phenotyping from Clinical Notes in Safety-Net Psychiatric Hospital Using Multi-Label Classification with Pre-Trained Language Models
We evaluated the performance of four BERT-based models using two fine-tuning strategies (multiple single-label and single multi-label) for detecting coexisting suicidal events from 500 annotated psychiatric evaluation notes.
Enhancing Large Language Models with Domain-specific Retrieval Augment Generation: A Case Study on Long-form Consumer Health Question Answering in Ophthalmology
The evaluation focuses on factuality of evidence, selection and ranking of evidence, attribution of evidence, and answer accuracy and completeness.
Quantum Long Short-Term Memory for Drug Discovery
Quantum computing combined with machine learning (ML) is an extremely promising research area, with numerous studies demonstrating that quantum machine learning (QML) is expected to solve scientific problems more effectively than classical ML.
Generative AI for Health Technology Assessment: Opportunities, Challenges, and Policy Considerations
This review introduces the transformative potential of generative Artificial Intelligence (AI) and foundation models, including large language models (LLMs), for health technology assessment (HTA).
Improving Entity Recognition Using Ensembles of Deep Learning and Fine-tuned Large Language Models: A Case Study on Adverse Event Extraction from Multiple Sources
This study aims to evaluate the effectiveness of LLMs and traditional deep learning models in AE extraction, and to assess the impact of ensembling these models on performance.
Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research
The applications of large language models (LLMs) are promising for biomedical and healthcare research.
CancerLLM: A Large Language Model in Cancer Domain
Medical Large Language Models (LLMs) such as ClinicalCamel 70B, Llama3-OpenBioLLM 70B have demonstrated impressive performance on a wide variety of medical NLP task. However, there still lacks a large language model (LLM) specifically designed for cancer domain.
Augmenting Biomedical Named Entity Recognition with General-domain Resources
Specifically, our models consistently outperformed the baseline models in six out of eight entity types, achieving an average improvement of 0. 9% over the best baseline performance across eight entities.
XL3M: A Training-free Framework for LLM Length Extension Based on Segment-wise Inference
Under the XL3M framework, the input context will be firstly decomposed into multiple short sub-contexts, where each sub-context contains an independent segment and a common ``question'' which is a few tokens from the end of the original context.
Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances
UMC shows remarkable improvements of 2-6\% scores in clustering metrics over state-of-the-art methods, marking the first successful endeavor in this domain.
BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine
Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.
Relation Extraction Using Large Language Models: A Case Study on Acupuncture Point Locations
This study underscores the effectiveness of LLMs like GPT in extracting relations related to acupoint locations, with implications for accurately modeling acupuncture knowledge and promoting standard implementation in acupuncture training and practice.
MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations
We believe that MIntRec2. 0 will serve as a valuable resource, providing a pioneering foundation for research in human-machine conversational interactions, and significantly facilitating related applications.
Me LLaMA: Foundation Large Language Models for Medical Applications
This work underscores the importance of domain-specific data in developing medical LLMs and addresses the high computational costs involved in training, highlighting a balance between pre-training and fine-tuning strategies.
A Span-based Model for Extracting Overlapping PICO Entities from RCT Publications
On the PICO-Corpus, PICOX obtained higher recall and F1 scores than the baseline and improved the micro recall score from 56. 66 to 67. 33.
Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition
To establish an optimal multimodal semantic environment for text modality, we develop a modality-aware prompting module (MAP), which effectively aligns and fuses features from text, video and audio modalities with similarity-based modality alignment and cross-modality attention mechanism.
Ranked #2 on
Multimodal Intent Recognition
on MIntRec
Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation
This study introduces Ascle, a pioneering natural language processing (NLP) toolkit designed for medical text generation.
AI Alignment: A Comprehensive Survey
The former aims to make AI systems aligned via alignment training, while the latter aims to gain evidence about the systems' alignment and govern them appropriately to avoid exacerbating misalignment risks.
Identifying and Extracting Rare Disease Phenotypes with Large Language Models
Despite this, ChatGPT achieved similar or higher accuracy for certain entities (i. e., rare diseases and signs) in the one-shot setting (F1 of 0. 776 and 0. 725).
Complementary and Integrative Health Lexicon (CIHLex) and Entity Recognition in the Literature
Results: From the 198 unique concepts in CIHLex, 62. 1% could be matched to at least one term in the UMLS.
A systematic evaluation of large language models for biomedical natural language processing: benchmarks, baselines, and recommendations
The biomedical literature is rapidly expanding, posing a significant challenge for manual curation and knowledge discovery.
A Clustering Framework for Unsupervised and Semi-supervised New Intent Discovery
New intent discovery is of great value to natural language processing, allowing for a better understanding of user needs and providing friendly services.
Improving Large Language Models for Clinical Named Entity Recognition via Prompt Engineering
Results: Using baseline prompts, GPT-3. 5 and GPT-4 achieved relaxed F1 scores of 0. 634, 0. 804 for MTSamples, and 0. 301, 0. 593 for VAERS.
Adaptive Constraint Partition based Optimization Framework for Large-scale Integer Linear Programming(Student Abstract)
Integer programming problems (IPs) are challenging to be solved efficiently due to the NP-hardness, especially for large-scale IPs.
A Self-Adjusting Fusion Representation Learning Model for Unaligned Text-Audio Sequences
In this paper, a Self-Adjusting Fusion Representation Learning Model (SA-FRLM) is proposed to learn robust crossmodal fusion representations directly from the unaligned text and audio sequences.
MIntRec: A New Dataset for Multimodal Intent Recognition
This paper introduces a novel dataset for multimodal intent recognition (MIntRec) to address this issue.
Ranked #1 on
Multimodal Intent Recognition
on MIntRec
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module
The designed modality mixup module can be regarded as an augmentation, which mixes the acoustic and visual modalities from different videos.
Continual Machine Reading Comprehension via Uncertainty-aware Fixed Memory and Adversarial Domain Adaptation
However, it is a great challenge to learn a new domain incrementally without catastrophically forgetting previous knowledge.
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis
The platform features a fully modular video sentiment analysis framework consisting of data management, feature extraction, model training, and result analysis modules.
Learning Discriminative Representations and Decision Boundaries for Open Intent Detection
To address these issues, this paper presents an original framework called DA-ADB, which successively learns distance-aware intent representations and adaptive decision boundaries for open intent detection.
Consistent Representation Learning for Continual Relation Extraction
Specifically, supervised contrastive learning based on a memory bank is first used to train each new task so that the model can effectively learn the relation representation.
An Open Natural Language Processing Development Framework for EHR-based Clinical Research: A case demonstration using the National COVID Cohort Collaborative (N3C)
Although we use COVID-19 as a use case in this effort, our framework is general enough to be applied to other domains of interest in clinical NLP.
Simple Recurrent Neural Networks is all we need for clinical events predictions using EHR data
As a result, deep learning models developed for sequence modeling, like recurrent neural networks (RNNs) are common architecture for EHR-based clinical events predictive models.
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition
It is composed of two main modules: open intent detection and open intent discovery.
An Empirical Study of UMLS Concept Extraction from Clinical Notes using Boolean Combination Ensembles
Our objective in this study is to investigate the behavior of Boolean operators on combining annotation output from multiple Natural Language Processing (NLP) systems across multiple corpora and to assess how filtering by aggregation of Unified Medical Language System (UMLS) Metathesaurus concepts affects system performance for Named Entity Recognition (NER) of UMLS concepts.
RGB Image Classification with Quantum Convolutional Ansaetze
With the rapid growth of qubit numbers and coherence times in quantum hardware technology, implementing shallow neural networks on the so-called Noisy Intermediate-Scale Quantum (NISQ) devices has attracted a lot of interest.
Discovering novel drug-supplement interactions using a dietary supplements knowledge graph generated from the biomedical literature
MATERIALS AND METHODS: We created SemRepDS (an extension of SemRep), capable of extracting semantic relations from abstracts by leveraging a DS-specific terminology (iDISK) containing 28, 884 DS terms not found in the UMLS.
Representation Iterative Fusion based on Heterogeneous Graph Neural Network for Joint Entity and Relation Extraction
Joint entity and relation extraction is an essential task in information extraction, which aims to extract all relational triples from unstructured text.
Ranked #2 on
Relation Extraction
on SemEval-2010 Task-8
Graph Neural Network
Joint Entity and Relation Extraction
+3
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis
On MOSI and MOSEI datasets, our method surpasses the current state-of-the-art methods.
Deep Open Intent Classification with Adaptive Decision Boundary
In this paper, we propose a post-processing method to learn the adaptive decision boundary (ADB) for open intent classification.
Ranked #1 on
Open Intent Detection
on StackOverFlow(75%known)
Discovering New Intents with Deep Aligned Clustering
In this work, we propose an effective method, Deep Aligned Clustering, to discover new intents with the aid of the limited known intent data.
Ranked #2 on
Open Intent Discovery
on CLINC150
Cross-Modal BERT for Text-Audio Sentiment Analysis
In this paper, we propose the Cross-Modal BERT (CM-BERT), which relies on the interaction of text and audio modality to fine-tune the pre-trained BERT model.
Ranked #4 on
Multimodal Sentiment Analysis
on MOSI
COVID-19 SignSym: a fast adaptation of a general clinical NLP tool to identify and normalize COVID-19 signs and symptoms to OMOP common data model
To this end, this study aims at adapting the existing CLAMP natural language processing tool to quickly build COVID-19 SignSym, which can extract COVID-19 signs/symptoms and their 8 attributes (body location, severity, temporal expression, subject, condition, uncertainty, negation, and course) from clinical text.
CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality
Previous studies in multimodal sentiment analysis have used limited datasets, which only contain unified multimodal annotations.
Finding structural hole spanners based on community forest model and diminishing marginal utility in large scale social networks
In this paper, we try to give a more visual and detailed definition of structural hole spanner based on the existing work, and propose a novel algorithm to identify structural hole spanner based on community forest model and diminishing marginal utility.
Robustly Pre-trained Neural Model for Direct Temporal Relation Extraction
Background: Identifying relationships between clinical events and temporal expressions is a key challenge in meaningfully analyzing clinical text for use in advanced AI applications.
A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifier
In this paper, we propose SofterMax and deep novelty detection (SMDN), a simple yet effective post-processing method for detecting unknown intent in dialogue systems based on pre-trained deep neural network classifiers.
Discovering New Intents via Constrained Deep Adaptive Clustering with Cluster Refinement
Identifying new user intents is an essential task in the dialogue system.
Ranked #1 on
Open Intent Discovery
on ATIS
BERT-based Ranking for Biomedical Entity Normalization
Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community.
Deep Unknown Intent Detection with Margin Loss
With margin loss, we can learn discriminative deep features by forcing the network to maximize inter-class variance and to minimize intra-class variance.
Ranked #1 on
Open Intent Detection
on SNIPS (25% known)
The Strength of the Weakest Supervision: Topic Classification Using Class Labels
When developing topic classifiers for real-world applications, we begin by defining a set of meaningful topic labels.
Enhancing Clinical Concept Extraction with Contextual Embeddings
We explore a battery of embedding methods consisting of traditional word embeddings and contextual embeddings, and compare these on four concept extraction corpora: i2b2 2010, i2b2 2012, SemEval 2014, and SemEval 2015.
Ranked #1 on
Clinical Concept Extraction
on 2010 i2b2/VA
Finding overlapping community from social networks based on community forest model
Overlapping community detection is the key research work to discover and explore the social networks.
