Search Results for author: Yibo Zhang

Found 30 papers, 3 papers with code

DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction

no code implementations7 Mar 2025 Miaowei Wang, Yibo Zhang, Rui Ma, Weiwei Xu, Changqing Zou, Daniel Morris

We present DecoupledGaussian, a novel system that decouples static objects from their contacted surfaces captured in-the-wild videos, a key prerequisite for realistic Newtonian-based physical simulations.

Autonomous Driving Object +1

PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness

no code implementations9 Oct 2024 Zekun Wang, Feiyu Duan, Yibo Zhang, Wangchunshu Zhou, Ke Xu, Wenhao Huang, Jie Fu

Large Language Models (LLMs) demonstrate impressive capabilities across various domains, including role-playing, creative writing, mathematical reasoning, and coding.

Mathematical Reasoning

MIO: A Foundation Model on Multimodal Tokens

1 code implementation26 Sep 2024 Zekun Wang, King Zhu, Chunpu Xu, Wangchunshu Zhou, Jiaheng Liu, Yibo Zhang, Jiashuo Wang, Ning Shi, Siyu Li, Yizhi Li, Haoran Que, Zhaoxiang Zhang, Yuanxing Zhang, Ge Zhang, Ke Xu, Jie Fu, Wenhao Huang

In this paper, we introduce MIO, a novel foundation model built on multimodal tokens, capable of understanding and generating speech, text, images, and videos in an end-to-end, autoregressive manner.

model Text Generation

Northeast Materials Database (NEMAD): Enabling Discovery of High Transition Temperature Magnetic Compounds

no code implementations24 Sep 2024 Suman Itani, Yibo Zhang, Jiadong Zang

This work shows the feasibility of combining LLMs for automated data extraction and machine learning models in accelerating the discovery of magnetic materials.

RAG-Optimized Tibetan Tourism LLMs: Enhancing Accuracy and Personalization

no code implementations21 Aug 2024 Jinhu Qi, Shuai Yan, Yibo Zhang, Wentao Zhang, Rong Jin, Yuwei Hu, Ke Wang

With the development of the modern social economy, tourism has become an important way to meet people's spiritual needs, bringing development opportunities to the tourism industry.

Hallucination RAG +1

SARA: Singular-Value Based Adaptive Low-Rank Adaption

no code implementations6 Aug 2024 Jihao Gu, Shuai Chen, Zelin Wang, Yibo Zhang, Ping Gong

However, the rank values need to be manually verified to match different downstream tasks, and they cannot accommodate the varying importance of different layers in the model.

parameter-efficient fine-tuning

Research on Tibetan Tourism Viewpoints information generation system based on LLM

no code implementations18 Jul 2024 Jinhu Qi, Shuai Yan, Wentao Zhang, Yibo Zhang, Zirui Liu, Ke Wang

Tibet, ensconced within China's territorial expanse, is distinguished by its labyrinthine and heterogeneous topography, a testament to its profound historical heritage, and the cradle of a unique religious ethos.

Language Modeling Language Modelling +1

A Label-Free and Non-Monotonic Metric for Evaluating Denoising in Event Cameras

no code implementations13 Jun 2024 Chenyang Shi, Shasha Guo, Boyi Wei, Hanxiao Liu, Yibo Zhang, Ningfang Song, Jing Jin

To overcome these limitations, we propose the first label-free and non-monotonic evaluation metric, the area of the continuous contrast curve (AOCC), which utilizes the area enclosed by event frame contrast curves across different time intervals.

Denoising valid

Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Rendering

no code implementations24 May 2024 Yibo Zhang, Lihong Wang, Changqing Zou, Tieru Wu, Rui Ma

Specifically, we perform perspective projection to render the 3D rational B\'ezier curves into 2D curves, which are subsequently converted to a 2D raster image via our customized differentiable rasterizer.

Image to 3D

IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events

1 code implementation17 May 2023 Chenyang Shi, Hanxiao Liu, Jing Jin, Wenzhuo Li, Yuzhen Li, Boyi Wei, Yibo Zhang

The proposed method first estimates the optical flow based on frames and events, and then decides whether to further calculate the residual optical flow in those sub-regions via a Gumbel gating module according to the optical flow amplitude.

Event-based Optical Flow Optical Flow Estimation +1

Rapid Assessments of Light-Duty Gasoline Vehicle Emissions Using On-Road Remote Sensing and Machine Learning

no code implementations1 Oct 2021 Yan Xia, Linhui Jiang, Lu Wang, Xue Chen, Jianjie Ye, Tangyan Hou, Liqiang Wang, Yibo Zhang, Mengying Li, Zhen Li, Zhe Song, Yaping Jiang, Weiping Liu, Pengfei Li, Daniel Rosenfeld, John H. Seinfeld, Shaocai Yu

Our results show that the ORRS measurements, assisted by the machine-learning-based ensemble model developed here, can realize day-to-day supervision of on-road vehicle-specific emissions.

Robusta: Robust AutoML for Feature Selection via Reinforcement Learning

no code implementations15 Jan 2021 Xiaoyang Wang, Bo Li, Yibo Zhang, Bhavya Kailkhura, Klara Nahrstedt

However, these AutoML pipelines only focus on improving the learning accuracy of benign samples while ignoring the ML model robustness under adversarial attacks.

AutoML Feature Importance +4

Deep learning-based holographic polarization microscopy

no code implementations1 Jul 2020 Tairan Liu, Kevin de Haan, Bijie Bai, Yair Rivenson, Yi Luo, Hongda Wang, David Karalli, Hongxiang Fu, Yibo Zhang, John FitzGerald, Aydogan Ozcan

Our analysis shows that a trained deep neural network can extract the birefringence information using both the sample specific morphological features as well as the holographic amplitude and phase distribution.

Deep Learning Diagnostic +1

Early-detection and classification of live bacteria using time-lapse coherent imaging and deep learning

no code implementations29 Jan 2020 Hongda Wang, Hatice Ceylan Koydemir, Yunzhe Qiu, Bijie Bai, Yibo Zhang, Yiyin Jin, Sabiha Tok, Enis Cagatay Yilmaz, Esin Gumustekin, Yair Rivenson, Aydogan Ozcan

Our experiments further confirmed that this method successfully detects 90% of bacterial colonies within 7-10 h (and >95% within 12 h) with a precision of 99. 2-100%, and correctly identifies their species in 7. 6-12 h with 80% accuracy.

Cultural Vocal Bursts Intensity Prediction General Classification

Zero-Shot Paraphrase Generation with Multilingual Language Models

no code implementations9 Nov 2019 Yinpeng Guo, Yi Liao, Xin Jiang, Qing Zhang, Yibo Zhang, Qun Liu

Leveraging multilingual parallel texts to automatically generate paraphrases has drawn much attention as size of high-quality paraphrase corpus is limited.

Denoising Diversity +4

Deep learning-based color holographic microscopy

no code implementations15 Jul 2019 Tairan Liu, Zhensong Wei, Yair Rivenson, Kevin De Haan, Yibo Zhang, Yichen Wu, Aydogan Ozcan

We report a framework based on a generative adversarial network (GAN) that performs high-fidelity color image reconstruction using a single hologram of a sample that is illuminated simultaneously by light at three different wavelengths.

Deep Learning Generative Adversarial Network +1

Maximizing Monotone DR-submodular Continuous Functions by Derivative-free Optimization

no code implementations16 Oct 2018 Yibo Zhang, Chao Qian, Ke Tang

Under a convex polytope constraint, we prove that LDGM can achieve a $(1-e^{-\beta}-\epsilon)$-approximation guarantee after $O(1/\epsilon)$ iterations, which is the same as the best previous gradient-based algorithm.

Deep learning-based super-resolution in coherent imaging systems

no code implementations15 Oct 2018 Tairan Liu, Kevin De Haan, Yair Rivenson, Zhensong Wei, Xin Zeng, Yibo Zhang, Aydogan Ozcan

We present a deep learning framework based on a generative adversarial network (GAN) to perform super-resolution in coherent imaging systems.

Deep Learning Generative Adversarial Network +2

PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning

no code implementations20 Jul 2018 Yair Rivenson, Tairan Liu, Zhensong Wei, Yibo Zhang, Aydogan Ozcan

Using a deep neural network, we demonstrate a digital staining technique, which we term PhaseStain, to transform quantitative phase images (QPI) of labelfree tissue sections into images that are equivalent to brightfield microscopy images of the same samples that are histochemically stained.

Generative Adversarial Network Virtual Staining

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

no code implementations30 Mar 2018 Yair Rivenson, Hongda Wang, Zhensong Wei, Yibo Zhang, Harun Gunaydin, Aydogan Ozcan

Here, we demonstrate a label-free approach to create a virtually-stained microscopic image using a single wide-field auto-fluorescence image of an unlabeled tissue sample, bypassing the standard histochemical staining process, saving time and cost.

Generative Adversarial Network Virtual Staining

Deep learning enhanced mobile-phone microscopy

no code implementations12 Dec 2017 Yair Rivenson, Hatice Ceylan Koydemir, Hongda Wang, Zhensong Wei, Zhengshuang Ren, Harun Gunaydin, Yibo Zhang, Zoltan Gorocs, Kyle Liang, Derek Tseng, Aydogan Ozcan

Mobile-phones have facilitated the creation of field-portable, cost-effective imaging and sensing technologies that approach laboratory-grade instrument performance.

Deep Learning

Deep Learning Microscopy

no code implementations12 May 2017 Yair Rivenson, Zoltan Gorocs, Harun Gunaydin, Yibo Zhang, Hongda Wang, Aydogan Ozcan

We demonstrate that a deep neural network can significantly improve optical microscopy, enhancing its spatial resolution over a large field-of-view and depth-of-field.

Deep Learning

Phase recovery and holographic image reconstruction using deep learning in neural networks

no code implementations10 May 2017 Yair Rivenson, Yibo Zhang, Harun Gunaydin, Da Teng, Aydogan Ozcan

Phase recovery from intensity-only measurements forms the heart of coherent imaging techniques and holography.

Image Reconstruction

Cannot find the paper you are looking for? You can Submit a new open access paper.