Search Results for author: Ziniu Hu

Found 30 papers, 15 papers with code

Thought Graph: Generating Thought Process for Biological Reasoning

no code implementations11 Mar 2024 Chi-Yang Hsu, Kyle Cox, Jiawei Xu, Zhen Tan, Tianhua Zhai, Mengzhou Hu, Dexter Pratt, Tianlong Chen, Ziniu Hu, Ying Ding

We present the Thought Graph as a novel framework to support complex reasoning and use gene set analysis as an example to uncover semantic relationships between biological processes.

Symbolic Music Generation with Non-Differentiable Rule Guided Diffusion

1 code implementation22 Feb 2024 Yujia Huang, Adishree Ghatare, Yuanzhe Liu, Ziniu Hu, Qinsheng Zhang, Chandramouli S Sastry, Siddharth Gururani, Sageev Oore, Yisong Yue

We propose Stochastic Control Guidance (SCG), a novel guidance method that only requires forward evaluation of rule functions that can work with pre-trained diffusion models in a plug-and-play way, thus achieving training-free guidance for non-differentiable rules for the first time.

Music Generation

SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning

1 code implementation15 Jan 2024 Dan Zhang, Ziniu Hu, Sining Zhoubian, Zhengxiao Du, Kaiyu Yang, Zihan Wang, Yisong Yue, Yuxiao Dong, Jie Tang

To bridge these gaps, we introduce SciGLM, a suite of scientific language models able to conduct college-level scientific reasoning.

Math Mathematical Reasoning

TANGO: Time-Reversal Latent GraphODE for Multi-Agent Dynamical Systems

no code implementations10 Oct 2023 Zijie Huang, Wanjia Zhao, Jingdong Gao, Ziniu Hu, Xiao Luo, Yadi Cao, Yuanzhou Chen, Yizhou Sun, Wei Wang

Learning complex multi-agent system dynamics from data is crucial across many domains, such as in physical simulations and material modeling.

Inductive Bias Physical Simulations

AvalonBench: Evaluating LLMs Playing the Game of Avalon

1 code implementation8 Oct 2023 Jonathan Light, Min Cai, Sheng Shen, Ziniu Hu

In this paper, we explore the potential of Large Language Models (LLMs) Agents in playing the strategic social deduction game, Resistance Avalon.

Decision Making

SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models

1 code implementation20 Jul 2023 Xiaoxuan Wang, Ziniu Hu, Pan Lu, Yanqiao Zhu, Jieyu Zhang, Satyen Subramaniam, Arjun R. Loomba, Shichang Zhang, Yizhou Sun, Wei Wang

Most of the existing Large Language Model (LLM) benchmarks on scientific problem reasoning focus on problems grounded in high-school subjects and are confined to elementary algebraic operations.

Benchmarking Language Modelling +2

Professional Basketball Player Behavior Synthesis via Planning with Diffusion

no code implementations7 Jun 2023 Xiusi Chen, Wei-Yao Wang, Ziniu Hu, Curtis Chou, Lam Hoang, Kun Jin, Mingyan Liu, P. Jeffrey Brantingham, Wei Wang

To accomplish reward-guided trajectory generation, conditional sampling is introduced to condition the diffusion model on the value function and conduct classifier-guided sampling.

Decision Making

ProgSG: Cross-Modality Representation Learning for Programs in Electronic Design Automation

no code implementations18 May 2023 Yunsheng Bai, Atefeh Sohrabizadeh, Zongyue Qin, Ziniu Hu, Yizhou Sun, Jason Cong

In addition, these programs can be compiled and converted into a control data flow graph (CDFG), and the compiler also provides fine-grained alignment between the code tokens and the CDFG nodes.

Autonomous Driving Representation Learning

Improving Multi-Task Generalization via Regularizing Spurious Correlation

no code implementations19 May 2022 Ziniu Hu, Zhe Zhao, Xinyang Yi, Tiansheng Yao, Lichan Hong, Yizhou Sun, Ed H. Chi

First, the risk of having non-causal knowledge is higher, as the shared MTL model needs to encode all knowledge from different tasks, and causal knowledge for one task could be potentially spurious to the other.

Multi-Task Learning Representation Learning

Zero-shot Transfer Learning within a Heterogeneous Graph via Knowledge Transfer Networks

1 code implementation3 Mar 2022 Minji Yoon, John Palowitch, Dustin Zelle, Ziniu Hu, Ruslan Salakhutdinov, Bryan Perozzi

We propose a zero-shot transfer learning module for HGNNs called a Knowledge Transfer Network (KTN) that transfers knowledge from label-abundant node types to zero-labeled node types through rich relational information given in the HG.

Domain Adaptation Graph Learning +2

Fuzzy Logic Based Logical Query Answering on Knowledge Graphs

no code implementations5 Aug 2021 Xuelu Chen, Ziniu Hu, Yizhou Sun

Answering complex First-Order Logical (FOL) queries on large-scale incomplete knowledge graphs (KGs) is an important yet challenging task.

Knowledge Graphs Link Prediction

Motif-Driven Contrastive Learning of Graph Representations

no code implementations23 Dec 2020 Shichang Zhang, Ziniu Hu, Arjun Subramonian, Yizhou Sun

Our framework MotIf-driven Contrastive leaRning Of Graph representations (MICRO-Graph) can: 1) use GNNs to extract motifs from large graph datasets; 2) leverage learned motifs to sample informative subgraphs for contrastive learning of GNN.

Clustering Contrastive Learning +1

GPT-GNN: Generative Pre-Training of Graph Neural Networks

2 code implementations27 Jun 2020 Ziniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang, Yizhou Sun

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data.

Attribute Graph Generation

Improving Neural Language Generation with Spectrum Control

no code implementations ICLR 2020 Lingxiao Wang, Jing Huang, Kevin Huang, Ziniu Hu, Guangtao Wang, Quanquan Gu

Recent Transformer-based models such as Transformer-XL and BERT have achieved huge success on various natural language processing tasks.

Language Modelling Machine Translation +2

Heterogeneous Graph Transformer

4 code implementations3 Mar 2020 Ziniu Hu, Yuxiao Dong, Kuansan Wang, Yizhou Sun

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data.

Graph Sampling Node Property Prediction

Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks

1 code implementation NeurIPS 2019 Difan Zou, Ziniu Hu, Yewen Wang, Song Jiang, Yizhou Sun, Quanquan Gu

Original full-batch GCN training requires calculating the representation of all the nodes in the graph per GCN layer, which brings in high computation and memory costs.

Node Classification

Demystifying Graph Neural Network Via Graph Filter Assessment

no code implementations25 Sep 2019 Yewen Wang, Ziniu Hu, Yusong Ye, Yizhou Sun

However, there still lacks in-depth analysis on (1) Whether there exists a best filter that can perform best on all graph data; (2) Which graph properties will influence the optimal choice of graph filter; (3) How to design appropriate filter adaptive to the graph data.

Learning to Transfer via Modelling Multi-level Task Dependency

no code implementations25 Sep 2019 Haonan Wang, Zhenbang Wu, Ziniu Hu, Yizhou Sun

Besides, the understanding of relationships among tasks has been ignored by most of the current methods.

Multi-Task Learning

Few-Shot Representation Learning for Out-Of-Vocabulary Words

1 code implementation ACL 2019 Ziniu Hu, Ting Chen, Kai-Wei Chang, Yizhou Sun

Existing approaches for learning word embeddings often assume there are sufficient occurrences for each word in the corpus, such that the representation of words can be accurately estimated from their contexts.

Learning Word Embeddings Meta-Learning +1

Pre-Training Graph Neural Networks for Generic Structural Feature Extraction

no code implementations31 May 2019 Ziniu Hu, Changjun Fan, Ting Chen, Kai-Wei Chang, Yizhou Sun

With the proposed pre-training procedure, the generic structural information is learned and preserved, thus the pre-trained GNN requires less amount of labeled data and fewer domain-specific features to achieve high performance on different downstream tasks.

Denoising

Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm

1 code implementation16 Sep 2018 Ziniu Hu, Yang Wang, Qu Peng, Hang Li

Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i. e., learning-to-rank.

Learning-To-Rank Position

Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification

1 code implementation7 Jun 2018 Zhenpeng Chen, Sheng Shen, Ziniu Hu, Xuan Lu, Qiaozhu Mei, Xuanzhe Liu

To tackle this problem, cross-lingual sentiment classification approaches aim to transfer knowledge learned from one language that has abundant labeled examples (i. e., the source language, usually English) to another language with fewer labels (i. e., the target language).

Classification Cross-Lingual Sentiment Classification +5

Cannot find the paper you are looking for? You can Submit a new open access paper.