Search Results for author:
Found 59 papers, 26 papers with code
Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Dataset
However, their ability to comprehend and analyze hybrid text, containing textual and tabular data, remains unexplored.
Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning
In this work, we propose Table-LLM-Specialist, or Table-Specialist for short, as a new self-trained fine-tuning paradigm specifically designed for table tasks.
SpreadsheetLLM: Encoding Spreadsheets for Large Language Models
Finally, we propose Chain of Spreadsheet for downstream tasks of spreadsheet understanding and validate in a new and demanding spreadsheet QA task.
PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning
Recent advances in fine-tuning large language models (LLMs) have greatly enhanced their usage in domain-specific tasks.
Scalable Differentiable Causal Discovery in the Presence of Latent Confounders with Skeleton Posterior (Extended Version)
Differentiable causal discovery has made significant advancements in the learning of directed acyclic graphs.
Vision Language Models for Spreadsheet Understanding: Challenges and Opportunities
Notably, to leverage the strengths of VLMs in understanding text rather than two-dimensional positioning, we propose to decode cell values on the four boundaries of the table in spreadsheet boundary detection.
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering
In this paper, we propose to use a knowledge base (KB) as the external knowledge source for TableQA and construct a dataset KET-QA with fine-grained gold evidence annotation.
CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testing
Large Language Models have revolutionized code generation ability by converting natural language descriptions into executable code.
TAROT: A Hierarchical Framework with Multitask Co-Pretraining on Semi-Structured Data towards Effective Person-Job Fit
Person-job fit is an essential part of online recruitment platforms in serving various downstream applications like Job Search and Candidate Recommendation.
Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queries
We evaluate five state-of-the-art models using three different metrics and the results show that our benchmark presents introduces considerable challenge in the field of tabular data analysis, paving the way for more advanced research opportunities.
Professional Network Matters: Connections Empower Person-Job Fit
Online recruitment platforms typically employ Person-Job Fit models in the core service that automatically match suitable job seekers with appropriate job positions.
TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning
Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions.
Text-to-Image Generation for Abstract Concepts
Recent years have witnessed the substantial progress of large-scale models across various domains, such as natural language processing and computer vision, facilitating the expression of concrete concepts.
SoTaNa: The Open-Source Software Development Assistant
To meet the demands of this dynamic field, there is a growing need for an effective software development assistant.
On Manipulating Signals of User-Item Graph: A Jacobi Polynomial-based Graph Collaborative Filtering
Graph CF has attracted more and more attention in recent years due to its effectiveness in leveraging high-order information in the user-item bipartite graph for better recommendations.
Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs
We propose an Automated Financial Information Extraction (AFIE) framework that enhances LLMs' ability to comprehend and extract information from financial reports.
GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarking
In this study, we conduct an extensive investigation to assess the proficiency of LLMs in comprehending graph data, employing a diverse range of structural and semantic-related tasks.
Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Study
Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks.
Causal-Based Supervision of Attention in Graph Neural Network: A Better and Simpler Choice towards Powerful Attention
Recent years have witnessed the great potential of attention mechanism in graph representation learning.
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond
Our experimental study shows that (1) lexical, syntactic and structural properties of source code are encoded in the lower, intermediate, and higher layers, respectively, while the semantic property spans across the entire model.
Demonstration of InsightPilot: An LLM-Empowered Automated Data Exploration System
In brief, an IQuery is an abstraction and automation of data analysis operations, which mimics the approach of data analysts and simplifies the exploration process for users.
Robust Mid-Pass Filtering Graph Convolutional Networks
Theoretical analyses guarantee the robustness of signals through the mid-pass filter, and we also shed light on the properties of different frequency signals under adversarial attacks.
Homophily-oriented Heterogeneous Graph Rewiring
To this end, we propose HDHGR, a homophily-oriented deep heterogeneous graph rewiring approach that modifies the HG structure to increase the performance of HGNN.
Out-of-Distribution Detection based on In-Distribution Data Patterns Memorization with Modern Hopfield Energy
In more detail, penultimate layer outputs on the training set are considered as the representations of in-distribution (ID) data.
Ranked #11 on
Out-of-Distribution Detection
on ImageNet-1k vs Places
LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training
But current approaches to rich-number tasks with transformer-based language models abandon or lose some of the numeracy information - e. g., breaking numbers into sub-word tokens - which leads to many number-related errors.
Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems
Numerical Question Answering is the task of answering questions that require numerical capabilities.
FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information
To assist form designers, in this work we present FormLM to model online forms (by enhancing pre-trained language model with form structural information) and recommend form creation ideas (including question / options recommendations and block type suggestion).
DIGMN: Dynamic Intent Guided Meta Network for Differentiated User Engagement Forecasting in Online Professional Social Platforms
Furthermore, based on the dynamic user intent representations, we propose a meta predictor to perform differentiated user engagement forecasting.
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems
Numerical reasoning over natural language has been a long-standing goal for the research community.
Unveiling the Black Box of PLMs with Semantic Anchors: Towards Interpretable Neural Semantic Parsing
The recent prevalence of pretrained language models (PLMs) has dramatically shifted the paradigm of semantic parsing, where the mapping from natural language utterances to structured logical forms is now formulated as a Seq2Seq task.
Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approach
Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data.
Ranked #7 on
Node Classification
on Squirrel
AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks
Tabular data analysis is performed every day across various domains.
Learning Rate Perturbation: A Generic Plugin of Learning Rate Schedule towards Flatter Local Minima
Learning rate is one of the most important hyper-parameters that has a significant influence on neural network training.
MM-GNN: Mix-Moment Graph Neural Network towards Modeling Neighborhood Feature Distribution
Graph Neural Networks (GNNs) have shown expressive performance on graph representation learning by aggregating information from neighbors.
ASTA: Learning Analytical Semantics over Tables for Intelligent Data Analysis and Visualization
ASTA framework extracts data features by designing signatures based on expert knowledge, and enables data referencing at field- (chart) or cell-level (conditional formatting) with pre-trained models.
XInsight: eXplainable Data Analysis Through The Lens of Causality
XInsight is a three-module, end-to-end pipeline designed to extract causal graphs, translate causal primitives into XDA semantics, and quantify the quantitative contribution of each explanation to a data fact.
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data
Existing auto-regressive pre-trained language models (PLMs) like T5 and BART, have been well applied to table question answering by UNIFIEDSKG and TAPEX, respectively, and demonstrated state-of-the-art results on multiple benchmarks.
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation
However, directly learning the logical inference knowledge from table-text pairs is very difficult for neural models because of the ambiguity of natural language and the scarcity of parallel data.
CoCoSoDa: Effective Contrastive Learning for Code Search
However, there is still a lot of room for improvement in using contrastive learning for code search.
Accelerating Code Search with Deep Hashing and Code Classification
Code search is to search reusable code snippets from source code corpus based on natural languages queries.
RACE: Retrieval-Augmented Commit Message Generation
Furthermore, RACE can boost the performance of existing Seq2Seq models in commit message generation.
Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks
Since a vast number of tables can be easily collected from web pages, spreadsheets, PDFs, and various other document types, a flurry of table pre-training frameworks have been proposed following the success of text and images, and they have achieved new state-of-the-arts on various tasks such as table question answering, table type recognition, column relation classification, table search, formula prediction, etc.
Source Free Unsupervised Graph Domain Adaptation
To address the non-trivial adaptation challenges in this practical scenario, we propose a model-agnostic algorithm called SOGA for domain adaptation to fully exploit the discriminative ability of the source model while preserving the consistency of structural proximity on the target graph.
Neuron with Steady Response Leads to Better Generalization
Based on the analysis results, we articulate the Neuron Steadiness Hypothesis: the neuron with similar responses to instances of the same class leads to better generalization.
A Unified and Fast Interpretable Model for Predictive Analytics
Predictive analytics is human involved, thus the machine learning model is preferred to be interpretable.
GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily
For node-level tasks, GNNs have strong power to model the homophily property of graphs (i. e., connected nodes are more similar) while their ability to capture the heterophily property is often doubtful.
ML4C: Seeing Causality Through Latent Vicinity
Starting from seeing that SCL is not better than random guessing if the learning target is non-identifiable a priori, we propose a two-phase paradigm for SCL by explicitly considering structure identifiability.
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining
In this paper, we find that the spreadsheet formula, which performs calculations on numerical values in tables, is naturally a strong supervision of numerical reasoning.
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation
HiTab provides 10, 686 QA pairs and descriptive sentences with well-annotated quantity and entity alignment on 3, 597 tables with broad coverage of table hierarchies and numerical reasoning types.
Neuron Campaign for Initialization Guided by Information Bottleneck Theory
Initialization plays a critical role in the training of deep neural networks (DNN).
On the Evaluation of Neural Code Summarization
To achieve a profound understanding of how far we are from solving this problem and provide suggestions to future research, in this paper, we conduct a systematic and in-depth analysis of 5 state-of-the-art neural code summarization models on 6 widely used BLEU variants, 4 pre-processing operations and their combinations, and 3 widely used datasets.
On the Evaluation of Commit Message Generation Models: An Experimental Study
We find that: (1) Different variants of the BLEU metric are used in previous works, which affects the evaluation and understanding of existing methods.
Is a Single Model Enough? MuCoS: A Multi-Model Ensemble Learning for Semantic Code Search
On the other hand, as a specific query may focus on one or several perspectives, it is difficult for a single query representation module to represent different user intents.
TableSense: Spreadsheet Table Detection with Convolutional Neural Networks
Spreadsheet table detection is the task of detecting all tables on a given sheet and locating their respective ranges.
TabularNet: A Neural Network Architecture for Understanding Semantic Structures of Tabular Data
To simultaneously extract spatial and relational information from tables, we propose a novel neural network architecture, TabularNet.
Understanding and Improvement of Adversarial Training for Network Embedding from an Optimization Perspective
Network Embedding aims to learn a function mapping the nodes to Euclidean space contribute to multiple learning analysis tasks on networks.
TUTA: Tree-based Transformers for Generally Structured Table Pre-training
First, we devise a unified tree-based structure, called a bi-dimensional coordinate tree, to describe both the spatial and hierarchical information of generally structured tables.
Table2Charts: Recommending Charts by Learning Shared Table Representations
It is common for people to create different types of charts to explore a multi-dimensional dataset (table).
Semantic Structure Extraction for Spreadsheet Tables with a Multi-task Learning Architecture
To learn spatial correlations and capture semantics on spreadsheets, we have developed a novel learning-based framework for spreadsheet semantic structure extraction.
