Search Results for author: JiaQi Zhang

Found 32 papers, 14 papers with code

QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishou

no code implementations18 Nov 2024 Xinchen Luo, Jiangxia Cao, Tianyu Sun, Jinkai Yu, Rui Huang, Wei Yuan, Hezheng Lin, Yichen Zheng, Shiyao Wang, Qigen Hu, Changqing Qiu, JiaQi Zhang, Xu Zhang, Zhiheng Yan, Jingming Zhang, Simin Zhang, Mingxing Wen, Zhaojie Liu, Kun Gai, Guorui Zhou

In recent years, with the significant evolution of multi-modal large models, many recommender researchers realized the potential of multi-modal information for user interest modeling.

TODO: Enhancing LLM Alignment with Ternary Preferences

1 code implementation2 Nov 2024 Yuxiang Guo, Lu Yin, Bo Jiang, JiaQi Zhang

Standard alignment techniques, such as Direct Preference Optimization (DPO), often rely on the binary Bradley-Terry (BT) model, which can struggle to capture the complexities of human preferences -- particularly in the presence of noisy or inconsistent labels and frequent ties.

ARC MMLU

Identifiability Guarantees for Causal Disentanglement from Purely Observational Data

1 code implementation31 Oct 2024 Ryan Welch, JiaQi Zhang, Caroline Uhler

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation.

Disentanglement

A Robust Anchor-based Method for Multi-Camera Pedestrian Localization

1 code implementation25 Oct 2024 Wanyu Zhang, JiaQi Zhang, Dongdong Ge, Yu Lin, Huiwen Yang, Huikang Liu, Yinyu Ye

This paper addresses the problem of vision-based pedestrian localization, which estimates a pedestrian's location using images and camera parameters.

Position

Causal Discovery with Fewer Conditional Independence Tests

1 code implementation3 Jun 2024 Kirankumar Shiragur, JiaQi Zhang, Caroline Uhler

We show that it is possible to a learn a coarser representation of the hidden causal graph with a polynomial number of tests.

Causal Discovery

Multi-Modality Spatio-Temporal Forecasting via Self-Supervised Learning

1 code implementation6 May 2024 Jiewen Deng, Renhe Jiang, JiaQi Zhang, Xuan Song

Multi-modality spatio-temporal (MoST) data extends spatio-temporal (ST) data by incorporating multiple modalities, which is prevalent in monitoring systems, encompassing diverse traffic demands and air quality assessments.

Self-Supervised Learning Spatio-Temporal Forecasting

Membership Testing in Markov Equivalence Classes via Independence Query Oracles

no code implementations9 Mar 2024 JiaQi Zhang, Kirankumar Shiragur, Caroline Uhler

While learning involves the task of recovering the Markov equivalence class (MEC) of the underlying causal graph from observational data, the testing counterpart addresses the following critical question: Given a specific MEC and observational data from some causal graph, can we determine if the data-generating causal graph belongs to the given MEC?

SecFormer: Towards Fast and Accurate Privacy-Preserving Inference for Large Language Models

1 code implementation1 Jan 2024 Jinglong Luo, Yehong Zhang, Zhuo Zhang, JiaQi Zhang, Xin Mu, Hui Wang, Yue Yu, Zenglin Xu

However, the application of SMPC in Privacy-Preserving Inference (PPI) for large language models, particularly those based on the Transformer architecture, often leads to considerable slowdowns or declines in performance.

Knowledge Distillation Privacy Preserving

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

1 code implementation1 Oct 2023 JiaQi Zhang, Joel Jennings, Agrin Hilmkil, Nick Pawlowski, Cheng Zhang, Chao Ma

These results provide compelling evidence that our method has the potential to serve as a stepping stone for the development of causal foundation models.

Causal Inference

NineRec: A Benchmark Dataset Suite for Evaluating Transferable Recommendation

2 code implementations14 Sep 2023 JiaQi Zhang, Yu Cheng, Yongxin Ni, Yunzhu Pan, Zheng Yuan, Junchen Fu, Youhua Li, Jie Wang, Fajie Yuan

The development of TransRec has encountered multiple challenges, among which the lack of large-scale, high-quality transfer learning recommendation dataset and benchmark suites is one of the biggest obstacles.

Descriptive Recommendation Systems +1

An Image Dataset for Benchmarking Recommender Systems with Raw Pixels

1 code implementation13 Sep 2023 Yu Cheng, Yunzhu Pan, JiaQi Zhang, Yongxin Ni, Aixin Sun, Fajie Yuan

Then, to show the effectiveness of the dataset's image features, we substitute the itemID embeddings (from IDNet) with a powerful vision encoder that represents items using their raw image pixels.

Benchmarking Recommendation Systems

Model Provenance via Model DNA

no code implementations4 Aug 2023 Xin Mu, Yu Wang, Yehong Zhang, JiaQi Zhang, Hui Wang, Yang Xiang, Yue Yu

Understanding the life cycle of the machine learning (ML) model is an intriguing area of research (e. g., understanding where the model comes from, how it is trained, and how it is used).

Representation Learning

Digital twin brain: a bridge between biological intelligence and artificial intelligence

no code implementations3 Aug 2023 Hui Xiong, Congying Chu, Lingzhong Fan, Ming Song, JiaQi Zhang, Yawei Ma, Ruonan Zheng, Junyang Zhang, Zhengyi Yang, Tianzi Jiang

In recent years, advances in neuroscience and artificial intelligence have paved the way for unprecedented opportunities for understanding the complexity of the brain and its emulation by computational systems.

Practical Privacy-Preserving Gaussian Process Regression via Secret Sharing

no code implementations26 Jun 2023 Jinglong Luo, Yehong Zhang, JiaQi Zhang, Shuang Qin, Hui Wang, Yue Yu, Zenglin Xu

In contrast to existing studies that protect the data privacy of GPR via homomorphic encryption, differential privacy, or federated learning, our proposed method is more practical and can be used to preserve the data privacy of both the model inputs and outputs for various data-sharing scenarios (e. g., horizontally/vertically-partitioned data).

Federated Learning GPR +2

Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights

no code implementations19 May 2023 Ruyu Li, Wenhao Deng, Yu Cheng, Zheng Yuan, JiaQi Zhang, Fajie Yuan

Furthermore, we compare the performance of the TCF paradigm utilizing the most powerful LMs to the currently dominant ID embedding-based paradigm and investigate the transferability of this TCF paradigm.

Collaborative Filtering News Recommendation +1

Active Learning for Optimal Intervention Design in Causal Models

1 code implementation10 Sep 2022 JiaQi Zhang, Louis Cammarata, Chandler Squires, Themistoklis P. Sapsis, Caroline Uhler

Here, we develop a causal active learning strategy to identify interventions that are optimal, as measured by the discrepancy between the post-interventional mean of the distribution and a desired target mean.

Active Learning Experimental Design

Polarized deep diffractive neural network for classification, generation, multiplexing and de-multiplexing of orbital angular momentum modes

no code implementations30 Mar 2022 JiaQi Zhang, Zhiyuan Ye, Jianhua Yin, Liying Lang, Shuming Jiao

6 polarized OAM beams with identical total intensity and 8 cylinder vector beams with different topology charges also have been classified effectively.

Simple Contrastive Representation Adversarial Learning for NLP Tasks

no code implementations26 Nov 2021 Deshui Miao, JiaQi Zhang, WenBo Xie, Jian Song, Xin Li, Lijuan Jia, Ning Guo

In this paper, adversarial training is performed to generate challenging and harder learning adversarial examples over the embedding space of NLP as learning pairs.

Contrastive Learning Natural Language Understanding +4

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

no code implementations9 Nov 2021 Ziyi Liu, JiaQi Zhang, Yongshuai Hou, Xinran Zhang, Ge Li, Yang Xiang

Background: Electronic Health Records (EHRs) contain rich information of patients' health history, which usually include both structured and unstructured data.

BIG-bench Machine Learning

Subjective evaluation of traditional and learning-based image coding methods

no code implementations28 Jul 2021 Zhigao Fang, JiaQi Zhang, Lu Yu, Yin Zhao

Additionally, we utilize some typical and frequently used objective quality metrics to evaluate the coding methods in the experiment as comparison.

Matching a Desired Causal State via Shift Interventions

1 code implementation NeurIPS 2021 JiaQi Zhang, Chandler Squires, Caroline Uhler

In particular, we show that our strategies may require exponentially fewer interventions than the previously considered approaches, which optimize for structure learning in the underlying causal graph.

Active Learning

Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergence

no code implementations14 May 2021 JiaQi Zhang, Keyou You, Lihua Xie

Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks.

Distributed Optimization

Optimizing the Whole-life Cost in End-to-end CNN Acceleration

no code implementations12 Apr 2021 JiaQi Zhang, Xiangru Chen, Sandip Ray

With the heterogeneous functional layers that cannot be pro-cessed by the accelerators proposed for convolution layers only, modern end-to-end CNN acceleration so-lutions either transform the diverse computation into matrix/vector arithmetic, which loses data reuse op-portunities in convolution, or introduce dedicated functional unit to each kind of layer, which results in underutilization and high update expense.

Fast and Scalable Estimator for Sparse and Unit-Rank Higher-Order Regression Models

no code implementations29 Nov 2019 Jiaqi Zhang, Beilun Wang

Because tensor data appear more and more frequently in various scientific researches and real-world applications, analyzing the relationship between tensor features and the univariate outcome becomes an elementary task in many fields.

regression

Sparse and Low-Rank High-Order Tensor Regression via Parallel Proximal Method

no code implementations29 Nov 2019 Jiaqi Zhang, Yinghao Cai, Zhaoyang Wang, Beilun Wang

Recently, tensor data (or multidimensional array) have been generated in many modern applications, such as functional magnetic resonance imaging (fMRI) in neuroscience and videos in video analysis.

Action Recognition regression +1

Distributed Dual Gradient Tracking for Resource Allocation in Unbalanced Networks

no code implementations22 Sep 2019 JiaQi Zhang, Keyou You, Kai Cai

Our key idea is the novel use of the distributed push-pull gradient algorithm (PPG) to solve the dual problem of the resource allocation problem.

Decentralized Stochastic Gradient Tracking for Non-convex Empirical Risk Minimization

no code implementations6 Sep 2019 Jiaqi Zhang, Keyou You

We explicitly evaluate the convergence rate of DSGT with respect to the number of iterations in terms of algebraic connectivity of the network, mini-batch size, gradient variance, etc.

Efficient Private ERM for Smooth Objectives

no code implementations29 Mar 2017 Jiaqi Zhang, Kai Zheng, Wenlong Mou, Li-Wei Wang

For strongly convex and smooth objectives, we prove that gradient descent with output perturbation not only achieves nearly optimal utility, but also significantly improves the running time of previous state-of-the-art private optimization algorithms, for both $\epsilon$-DP and $(\epsilon, \delta)$-DP.

Cannot find the paper you are looking for? You can Submit a new open access paper.