Search Results for author: Zheng Zhao

Found 35 papers, 21 papers with code

Are Large Language Models Temporally Grounded?

1 code implementation14 Nov 2023 Yifu Qiu, Zheng Zhao, Yftah Ziser, Anna Korhonen, Edoardo M. Ponti, Shay B. Cohen

Instead, we provide LLMs with textual narratives and probe them with respect to their common-sense knowledge of the structure and duration of events, their ability to order events along a timeline, and self-consistency within their temporal model (e. g., temporal relations such as after and before are mutually exclusive for any pair of events).

Common Sense Reasoning In-Context Learning +2

On Feynman--Kac training of partial Bayesian neural networks

1 code implementation30 Oct 2023 Zheng Zhao, Sebastian Mair, Thomas B. Schön, Jens Sjölund

Recently, partial Bayesian neural networks (pBNNs), which only consider a subset of the parameters to be stochastic, were shown to perform competitively with full Bayesian neural networks.

A Joint Matrix Factorization Analysis of Multilingual Representations

1 code implementation24 Oct 2023 Zheng Zhao, Yftah Ziser, Bonnie Webber, Shay B. Cohen

Using this tool, we study to what extent and how morphosyntactic features are reflected in the representations learned by multilingual pre-trained models.

Controlling Vision-Language Models for Multi-Task Image Restoration

1 code implementation2 Oct 2023 Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön

In this paper, we present a degradation-aware vision-language model (DA-CLIP) to better transfer pretrained vision-language models to low-level vision tasks as a multi-task framework for image restoration.

Image Dehazing Image Denoising +8

Understanding Domain Learning in Language Models Through Subpopulation Analysis

1 code implementation22 Oct 2022 Zheng Zhao, Yftah Ziser, Shay B. Cohen

We investigate how different domains are encoded in modern neural network architectures.

Language Modelling

To Adapt or to Fine-tune: A Case Study on Abstractive Summarization

1 code implementation CCL 2022 Zheng Zhao, Pinzhen Chen

Recent advances in the field of abstractive summarization leverage pre-trained language models rather than train a model from scratch.

Abstractive Text Summarization Language Modelling +1

Probabilistic Estimation of Instantaneous Frequencies of Chirp Signals

1 code implementation12 May 2022 Zheng Zhao, Simo Särkkä, Jens Sjölund, Thomas B. Schön

We present a continuous-time probabilistic approach for estimating the chirp signal and its instantaneous frequency function when the true forms of these functions are not accessible.

Gaussian Processes

A Unified Model for Reverse Dictionary and Definition Modelling

1 code implementation9 May 2022 Pinzhen Chen, Zheng Zhao

We build a dual-way neural dictionary to retrieve words given definitions, and produce definitions for queried words.

Definition Modelling Reverse Dictionary

Revisiting Shallow Discourse Parsing in the PDTB-3: Handling Intra-sentential Implicits

no code implementations CODI 2021 Zheng Zhao, Bonnie Webber

In the PDTB-3, several thousand implicit discourse relations were newly annotated \textit{within} individual sentences, adding to the over 15, 000 implicit relations annotated \textit{across} adjacent sentences in the PDTB-2.

Discourse Parsing Implicit Relations +1

State-space deep Gaussian processes with applications

1 code implementation24 Nov 2021 Zheng Zhao

Lastly, this thesis features a number of applications of state-space (deep) GPs.

Gaussian Processes regression

A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learning

1 code implementation11 Nov 2021 Chenghao Feng, Jiaqi Gu, Hanqing Zhu, Zhoufeng Ying, Zheng Zhao, David Z. Pan, Ray T. Chen

The optical neural network (ONN) is a promising hardware platform for next-generation neurocomputing due to its high parallelism, low latency, and low energy consumption.

Advance in Reversible Covalent Kinase Inhibitors

no code implementations22 Jun 2021 Zheng Zhao, Philip E. Bourne

Finally, we provide a brief perspective on future design strategies for RCKIs, including those that target proteins other than kinases.

Hierarchical Non-Stationary Temporal Gaussian Processes With $L^1$-Regularization

no code implementations20 May 2021 Zheng Zhao, Rui Gao, Simo Särkkä

This paper is concerned with regularized extensions of hierarchical non-stationary temporal Gaussian processes (NSGPs) in which the parameters (e. g., length-scale) are modeled as GPs.

Gaussian Processes regression

Using the structural kinome to systematize kinase drug discovery

no code implementations27 Apr 2021 Zheng Zhao, Philip E. Bourne

Thus, obtaining the desired selectivity, given the whole human kinome, is a fundamental task during early-stage drug discovery.

Drug Discovery

Temporal Gaussian Process Regression in Logarithmic Time

1 code implementation19 Feb 2021 Adrien Corenflos, Zheng Zhao, Simo Särkkä

The aim of this article is to present a novel parallelization method for temporal Gaussian process (GP) regression problems.

regression

SqueezeLight: Towards Scalable Optical Neural Networks with Multi-Operand Ring Resonators

1 code implementation IEEE Design, Automation & Test in Europe Conference & Exhibition (DATE) 2021 Jiaqi Gu, Chenghao Feng, Zheng Zhao, Zhoufeng Ying, Mingjie Liu, Ray T. Chen, David Z. Pan

Optical neural networks (ONNs) have demonstrated promising potentials for next-generation artificial intelligence acceleration with ultra-low latency, high bandwidth, and low energy consumption.

Study of charmonium-like and fully-charm tetraquark spectroscopy

no code implementations31 Dec 2020 Zheng Zhao, Kai Xu, Attaphon Kaewsnod, Xuyang Liu, Ayut Limphirat, Yupeng Yan

The masses of tetraquark states of all $qc\bar q \bar c$ and $cc\bar c \bar c$ quark configurations are evaluated in a constituent quark model, where the Cornell-like potential and one-gluon exchange spin-spin coupling are employed.

High Energy Physics - Phenomenology

Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization

1 code implementation21 Dec 2020 Jiaqi Gu, Chenghao Feng, Zheng Zhao, Zhoufeng Ying, Ray T. Chen, David Z. Pan

Optical neural networks (ONNs) have demonstrated record-breaking potential in high-performance neuromorphic computing due to their ultra-high execution speed and low energy consumption.

Review of Machine-Learning Methods for RNA Secondary Structure Prediction

no code implementations1 Sep 2020 Qi Zhao, Zheng Zhao, Xiaoya Fan, Zhengwei Yuan, Qian Mao, YuDong Yao

Recently, with the increasing availability of RNA structure data, new methods based on machine-learning technologies, especially deep learning, have alleviated the issue.

BIG-bench Machine Learning

Deep State-Space Gaussian Processes

1 code implementation11 Aug 2020 Zheng Zhao, Muhammad Emzir, Simo Särkkä

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression.

Gaussian Processes regression

Taylor Moment Expansion for Continuous-Discrete Gaussian Filtering and Smoothing

2 code implementations8 Jan 2020 Zheng Zhao, Toni Karvonen, Roland Hostettler, Simo Särkkä

The paper is concerned with non-linear Gaussian filtering and smoothing in continuous-discrete state-space models, where the dynamic model is formulated as an It\^{o} stochastic differential equation (SDE), and the measurements are obtained at discrete time instants.

Kalman-based Spectro-Temporal ECG Analysis using Deep Convolutional Networks for Atrial Fibrillation Detection

no code implementations12 Dec 2018 Zheng Zhao, Simo Särkkä, Ali Bahrami Rad

In this article, we propose a novel ECG classification framework for atrial fibrillation (AF) detection using spectro-temporal representation (i. e., time varying spectrum) and deep convolutional networks.

Atrial Fibrillation Detection ECG Classification

Successive Ray Refinement and Its Application to Coordinate Descent for LASSO

no code implementations17 Dec 2015 Jun Liu, Zheng Zhao, Ruiwen Zhang

Coordinate descent is one of the most popular approaches for solving Lasso and its extensions due to its simplicity and efficiency.

Computational Efficiency

Safe and Efficient Screening For Sparse Support Vector Machine

no code implementations30 Oct 2013 Zheng Zhao, Jun Liu

Screening is an effective technique for speeding up the training process of a sparse learning model by removing the features that are guaranteed to be inactive the process.

Sparse Learning

Safe Screening With Variational Inequalities and Its Application to LASSO

no code implementations29 Jul 2013 Jun Liu, Zheng Zhao, Jie Wang, Jieping Ye

Safe screening is gaining increasing attention since 1) solving sparse learning formulations usually has a high computational cost especially when the number of features is large and 2) one needs to try several regularization parameters to select a suitable model.

Computational Efficiency feature selection +1

Discriminative K-means for Clustering

no code implementations NeurIPS 2007 Jieping Ye, Zheng Zhao, Mingrui Wu

The connection between DisKmeans and several other clustering algorithms is also analyzed.

Clustering

Cannot find the paper you are looking for? You can Submit a new open access paper.