Search Results for author: Yu Feng

Found 32 papers, 11 papers with code

BLINK: Multimodal Large Language Models Can See but Not Perceive

no code implementations18 Apr 2024 Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Ma, Ranjay Krishna

We introduce Blink, a new benchmark for multimodal language models (LLMs) that focuses on core visual perception abilities not found in other evaluations.

Depth Estimation Multiple-choice +1

DiffPoint: Single and Multi-view Point Cloud Reconstruction with ViT Based Diffusion Model

no code implementations17 Feb 2024 Yu Feng, Xing Shi, Mengli Cheng, Yun Xiong

As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds.

Point cloud reconstruction

Integrating 3D City Data through Knowledge Graphs

no code implementations17 Oct 2023 Linfang Ding, Guohui Xiao, Albulen Pano, Mattia Fumagalli, Dongsheng Chen, Yu Feng, Diego Calvanese, Hongchao Fan, Liqiu Meng

Moreover, embracing KGs makes it easier to integrate with other spatial data sources, e. g., OpenStreetMap and existing (Geo)KGs (e. g., Wikidata, DBPedia, and GeoNames), and to perform queries combining information from multiple data sources.

Knowledge Graphs

Generic Temporal Reasoning with Differential Analysis and Explanation

no code implementations20 Dec 2022 Yu Feng, Ben Zhou, Haoyu Wang, Helen Jin, Dan Roth

Temporal reasoning is the task of predicting temporal relations of event pairs.

Hybrid Multimodal Fusion for Humor Detection

no code implementations24 Sep 2022 Haojie Xu, Weifeng Liu, Jingwei Liu, Mingzheng Li, Yu Feng, Yasi Peng, Yunwei Shi, Xiao Sun, Meng Wang

Our experiments demonstrate the effectiveness of our proposed model and hybrid fusion strategy on multimodal fusion, and the AUC of our proposed model on the test set is 0. 8972.

Humor Detection

The activity-weight duality in feed forward neural networks: The geometric determinants of generalization

1 code implementation21 Mar 2022 Yu Feng, Yuhai Tu

The contribution from a given eigen-direction is the product of two geometric factors (determinants): the sharpness of the loss landscape and the standard deviation of the dual weights, which is found to scale with the weight norm of the solution.

Determination of building flood risk maps from LiDAR mobile mapping data

no code implementations14 Jan 2022 Yu Feng, Qing Xiao, Claus Brenner, Aaron Peche, Juntao Yang, Udo Feuerhake, Monika Sester

By comparing the detected facade openings' heights with the predicted water levels from a flood simulation model, a map can be produced which assigns per-building flood risk levels.

object-detection Object Detection

Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models

1 code implementation12 Dec 2021 Yu Feng, Jing Zhang, Xiaokang Zhang, Lemao Liu, Cuiping Li, Hong Chen

Embedding-based methods are popular for Knowledge Base Question Answering (KBQA), but few current models have numerical reasoning skills and thus struggle to answer ordinal constrained questions.

Data Augmentation Knowledge Base Question Answering

Loss Landscape Dependent Self-Adjusting Learning Rates in Decentralized Stochastic Gradient Descent

no code implementations2 Dec 2021 Wei zhang, Mingrui Liu, Yu Feng, Xiaodong Cui, Brian Kingsbury, Yuhai Tu

We conduct extensive studies over 18 state-of-the-art DL models/tasks and demonstrate that DPSGD often converges in cases where SSGD diverges for large learning rates in the large batch setting.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

FIBA: Frequency-Injection based Backdoor Attack in Medical Image Analysis

3 code implementations CVPR 2022 Yu Feng, Benteng Ma, Jing Zhang, Shanshan Zhao, Yong Xia, DaCheng Tao

However, designing a unified BA method that can be applied to various MIA systems is challenging due to the diversity of imaging modalities (e. g., X-Ray, CT, and MRI) and analysis tasks (e. g., classification, detection, and segmentation).

Artifact Detection Backdoor Attack +6

AI-assisted super-resolution cosmological simulations II: Halo substructures, velocities and higher order statistics

no code implementations3 May 2021 Yueying Ni, Yin Li, Patrick Lachance, Rupert A. C. Croft, Tiziana Di Matteo, Simeon Bird, Yu Feng

In this work, we expand and test the capabilities of our recently developed super-resolution (SR) model to generate high-resolution (HR) realizations of the full phase-space matter distribution, including both displacement and velocity, from computationally cheap low-resolution (LR) cosmological N-body simulations.

Super-Resolution

Fast and Accurate: Video Enhancement using Sparse Depth

no code implementations15 Mar 2021 Yu Feng, Patrick Hansen, Paul N. Whatmough, Guoyu Lu, Yuhao Zhu

This paper presents a general framework to build fast and accurate algorithms for video enhancement tasks such as super-resolution, deblurring, and denoising.

Deblurring Denoising +4

Falx: Synthesis-Powered Visualization Authoring

no code implementations1 Feb 2021 Chenglong Wang, Yu Feng, Rastislav Bodik, Isil Dillig, Alvin Cheung, Amy J. Ko

Modern visualization tools aim to allow data analysts to easily create exploratory visualizations.

Human-Computer Interaction Programming Languages

Phases of learning dynamics in artificial neural networks: with or without mislabeled data

no code implementations16 Jan 2021 Yu Feng, Yuhai Tu

Without mislabeled data, we find that the SGD learning dynamics transitions from a fast learning phase to a slow exploration phase, which is associated with large changes in order parameters that characterize the alignment of SGD gradients and their mean amplitude.

Why Does Decentralized Training Outperform Synchronous Training In The Large Batch Setting?

no code implementations1 Jan 2021 Wei zhang, Mingrui Liu, Yu Feng, Brian Kingsbury, Yuhai Tu

We conduct extensive studies over 12 state-of-the-art DL models/tasks and demonstrate that DPSGD consistently outperforms SSGD in the large batch setting; and DPSGD converges in cases where SSGD diverges for large learning rates.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Field-Tuned Quantum Effects in a Triangular-Lattice Ising Magnet

no code implementations18 Nov 2020 Yayuan Qin, Yao Shen, ChangLe Liu, Hongliang Wo, Yonghao Gao, Yu Feng, Xiaowen Zhang, Gaofeng Ding, Yiqing Gu, Qisi Wang, Shoudong Shen, Helen C. Walker, Robert Bewley, Jianhui Xu, Martin Boehm, Paul Steffens, Seiko Ohira-Kawamura, Naoki Murai, Astrid Schneidewind, Xin Tong, Gang Chen, Jun Zhao

We report thermodynamic and neutron scattering measurements of the triangular-lattice quantum Ising magnet TmMgGaO 4 in longitudinal magnetic fields.

Strongly Correlated Electrons Materials Science

AI-assisted super-resolution cosmological simulations

no code implementations13 Oct 2020 Yin Li, Yueying Ni, Rupert A. C. Croft, Tiziana Di Matteo, Simeon Bird, Yu Feng

Cosmological simulations of galaxy formation are limited by finite computational resources.

Super-Resolution

Mesorasi: Architecture Support for Point Cloud Analytics via Delayed-Aggregation

1 code implementation16 Aug 2020 Yu Feng, Boyuan Tian, Tiancheng Xu, Paul Whatmough, Yuhao Zhu

Point cloud analytics is poised to become a key workload on battery-powered embedded and mobile platforms in a wide range of emerging application domains, such as autonomous driving, robotics, and augmented reality, where efficiency is paramount.

Autonomous Driving

Flood severity mapping from Volunteered Geographic Information by interpreting water level from images containing people: a case study of Hurricane Harvey

no code implementations21 Jun 2020 Yu Feng, Claus Brenner, Monika Sester

Since more images are shared on social media than ever before, recent research focused on the extraction of flood-related posts by analyzing images in addition to texts.

How neural networks find generalizable solutions: Self-tuned annealing in deep learning

no code implementations6 Jan 2020 Yu Feng, Yuhai Tu

Despite the tremendous success of Stochastic Gradient Descent (SGD) algorithm in deep learning, little is known about how SGD finds generalizable solutions in the high-dimensional weight space.

Relation

ASV: Accelerated Stereo Vision System

2 code implementations15 Nov 2019 Yu Feng, Paul Whatmough, Yuhao Zhu

The key to ASV is to exploit unique characteristics inherent to stereo vision, and apply stereo-specific optimizations, both algorithmically and computationally.

Stereo Matching

The Quijote simulations

3 code implementations11 Sep 2019 Francisco Villaescusa-Navarro, ChangHoon Hahn, Elena Massara, Arka Banerjee, Ana Maria Delgado, Doogesh Kodi Ramanah, Tom Charnock, Elena Giusarma, Yin Li, Erwan Allys, Antoine Brochard, Chi-Ting Chiang, Siyu He, Alice Pisani, Andrej Obuljen, Yu Feng, Emanuele Castorina, Gabriella Contardo, Christina D. Kreisch, Andrina Nicola, Roman Scoccimarro, Licia Verde, Matteo Viel, Shirley Ho, Stephane Mallat, Benjamin Wandelt, David N. Spergel

The Quijote simulations are a set of 44, 100 full N-body simulations spanning more than 7, 000 cosmological models in the $\{\Omega_{\rm m}, \Omega_{\rm b}, h, n_s, \sigma_8, M_\nu, w \}$ hyperplane.

Cosmology and Nongalactic Astrophysics Instrumentation and Methods for Astrophysics

Intensity mapping with neutral hydrogen and the Hidden Valley simulations

2 code implementations26 Apr 2019 Chirag Modi, Emanuele Castorina, Yu Feng, Martin White

This paper introduces the Hidden Valley simulations, a set of trillion-particle N-body simulations in gigaparsec volumes aimed at intensity mapping science.

Cosmology and Nongalactic Astrophysics

Learning to Predict the Cosmological Structure Formation

1 code implementation15 Nov 2018 Siyu He, Yin Li, Yu Feng, Shirley Ho, Siamak Ravanbakhsh, Wei Chen, Barnabás Póczos

We build a deep neural network, the Deep Density Displacement Model (hereafter D$^3$M), to predict the non-linear structure formation of the Universe from simple linear perturbation theory.

Disconnected Covariance of 2-point Functions in Large-Scale Structure

1 code implementation14 Nov 2018 Yin Li, Sukhdeep Singh, Byeonghee Yu, Yu Feng, Uros Seljak

We verify the analytic covariance against the sample covariance from the galaxy mock simulations in two test cases: (1) the power spectrum multipole covariance, and (2) the joint covariance of the projected correlation function and the correlation function multipoles.

Cosmology and Nongalactic Astrophysics

Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection

no code implementations6 May 2018 Chirag Modi, Yu Feng, Uros Seljak

Our method relies on following the gradients of forward model and since the standard way to identify halos is non-differentiable and results in a discrete sample of objects, we propose a framework to model the halo position and mass field starting from the non-linear matter field using Neural Networks.

Cosmology and Nongalactic Astrophysics

nbodykit: an open-source, massively parallel toolkit for large-scale structure

2 code implementations15 Dec 2017 Nick Hand, Yu Feng, Florian Beutler, Yin Li, Chirag Modi, Uros Seljak, Zachary Slepian

The package is extensively documented at http://nbodykit. readthedocs. io, which also includes an interactive set of example recipes for new users to explore.

Instrumentation and Methods for Astrophysics Cosmology and Nongalactic Astrophysics

Mining Significant Microblogs for Misinformation Identification: An Attention-based Approach

no code implementations20 Jun 2017 Liu Qiang, Yu Feng, Wu Shu, Wang Liang

Based on the attention mechanism, AIM can select microblogs with largest attention values for misinformation identification.

Misinformation

Perturbation theory, effective field theory, and oscillations in the power spectrum

1 code implementation7 Sep 2015 Zvonimir Vlah, Uroš Seljak, Man Yat Chu, Yu Feng

Shell crossings lead to non-perturbative effects, and the PT ignorance can be quantified in terms of their ratio, which is also the transfer function squared in the absence of stochasticity.

Cosmology and Nongalactic Astrophysics

Cannot find the paper you are looking for? You can Submit a new open access paper.