Search Results for author:
Found 28 papers, 15 papers with code
XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
On the other hand, we implement the ICL approach with an example selection method based on named entity recognition to prevent overemphasis on entities.
Ranked #1 on
Text-To-SQL
on spider
What is Wrong with Perplexity for Long-context Language Modeling?
To address this, we propose \textbf{LongPPL}, a novel metric that focuses on key tokens by employing a long-short context contrastive method to identify them.
MoMQ: Mixture-of-Experts Enhances Multi-Dialect Query Generation across Relational and Non-Relational Databases
Additionally, a shared expert group is introduced to address data imbalance, facilitating the transfer of common knowledge from high-resource dialects to low-resource ones.
$α$-DPO: Adaptive Reward Margin is What Direct Preference Optimization Needs
Aligning large language models (LLMs) with human values and intentions is crucial for their utility, honesty, and safety.
Semantic Alignment for Multimodal Large Language Models
By involving the bidirectional semantic guidance between different images in the visual-token extraction process, SAM aims to enhance the preservation of linking information for coherent analysis and align the semantics of different images before feeding them into LLM.
$β$-DPO: Direct Preference Optimization with Dynamic $β$
Direct Preference Optimization (DPO) has emerged as a compelling approach for training Large Language Models (LLMs) to adhere to human preferences.
Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
We categorize noise into pointwise noise, which includes low-quality data points, and pairwise noise, which encompasses erroneous data pair associations that affect preference rankings.
When to Trust LLMs: Aligning Confidence with Response Quality
Specifically, the order-preserving reward incentivizes the model to verbalize greater confidence for responses of higher quality to align the order of confidence and quality.
Double-I Watermark: Protecting Model Copyright for LLM Fine-tuning
To support various applications, a prevalent and efficient approach for business owners is leveraging their valuable datasets to fine-tune a pre-trained LLM through the API provided by LLM owners or cloud servers.
DiffsFormer: A Diffusion Transformer on Stock Factor Augmentation
Our research demonstrates the efficacy of leveraging AIGS and the DiffsFormer architecture to mitigate data scarcity in stock forecasting tasks.
Data-Juicer: A One-Stop Data Processing System for Large Language Models
A data recipe is a mixture of data from different sources for training LLMs, which plays a vital role in LLMs' performance.
CARD: Channel Aligned Robust Blend Transformer for Time Series Forecasting
In this work, we design a special Transformer, i. e., Channel Aligned Robust Blend Transformer (CARD for short), that addresses key shortcomings of CI type Transformer in time series forecasting.
Studying the Impact of Data Disclosure Mechanism in Recommender Systems via Simulation
Then we study users' privacy decision making under different data disclosure mechanisms and recommendation models, and how their data disclosure decisions affect the recommender system's performance.
OpenBox: A Generalized Black-box Optimization Service
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design.
CausCF: Causal Collaborative Filtering for RecommendationEffect Estimation
It is based on the idea that similar users not only have a similar taste on items, but also have similar treatment effect under recommendations.
Explore User Neighborhood for Real-time E-commerce Recommendation
On the one hand, it utilizes UI relations and user neighborhood to capture both global and local information.
PURE: An Uncertainty-aware Recommendation Framework for Maximizing Expected Posterior Utility of Platform
In this paper, we propose a novel recommendation framework which effectively utilizes the information of user uncertainty over different item dimensions and explicitly takes into consideration the impact of display policy on user in order to achieve maximal expected posterior utility for the platform.
Efficient Automatic CASH via Rising Bandits
In this framework, the BO methods are used to solve the HPO problem for each ML algorithm separately, incorporating a much smaller hyperparameter space for BO methods.
MFES-HB: Efficient Hyperband with Multi-Fidelity Quality Measurements
Instead of sampling configurations randomly in HB, BOHB samples configurations based on a BO surrogate model, which is constructed with the high-fidelity measurements only.
Contrastive Learning for Sequential Recommendation
Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions.
Modeling Personalized Item Frequency Information for Next-basket Recommendation
NBR is in general more complex than the widely studied sequential (session-based) recommendation which recommends the next item based on a sequence of items.
Ranked #1 on
Next-basket recommendation
on TaFeng
Privileged Features Distillation at Taobao Recommendations
To guarantee the consistency of off-line training and on-line serving, we usually utilize the same features that are both available.
Model Slicing for Supporting Complex Analytics with Elastic Inference Cost and Resource Constraints
Model slicing could be viewed as an elastic computation solution without requiring more computational resources.
Medical Concept Embedding with Time-Aware Attention
Embeddings of medical concepts such as medication, procedure and diagnosis codes in Electronic Medical Records (EMRs) are central to healthcare analytics.
PANDA: Facilitating Usable AI Development
In many complex applications such as healthcare, subject matter experts (e. g. Clinicians) are the ones who appreciate the importance of features that affect health, and their knowledge together with existing knowledge bases are critical to the end results.
Rafiki: Machine Learning as an Analytics Service System
Second, expertise knowledge is required to optimize the training and inference procedures in terms of efficiency and effectiveness, which imposes heavy burden on the system users.
Deep Learning At Scale and At Ease
The other is scalability, that is the deep learning system must be able to provision for a huge demand of computing resources for training large models with massive datasets.
Active Sampler: Light-weight Accelerator for Complex Data Analytics at Scale
Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data".
