Search Results for author:
Found 57 papers, 21 papers with code
High-Efficiency Neural Video Compression via Hierarchical Predictive Learning
This feature-space processing operates from the lowest to the highest scale of each frame, completely eliminating the need for the complexity-intensive motion estimation and compensation techniques that have been standard in video codecs for decades.
All-in-One Image Coding for Joint Human-Machine Vision with Multi-Path Aggregation
Experimental results show that MPA achieves performance comparable to state-of-the-art methods in both task-specific and multi-objective optimization across human viewing and machine analysis tasks.
Accelerating block-level rate control for learned image compression
Despite the unprecedented compression efficiency achieved by deep learned image compression (LIC), existing methods usually approximate the desired bitrate by adjusting a single quality factor for a given input image, which may compromise the rate control results.
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head
We present a novel approach for synthesizing 3D talking heads with controllable emotion, featuring enhanced lip synchronization and rendering quality.
HINER: Neural Representation for Hyperspectral Image
For downstream classification on compressed HSI, we theoretically demonstrate the task accuracy is not only related to the classification loss but also to the reconstruction fidelity through a first-order expansion of the accuracy degradation, and accordingly adapt the reconstruction by introducing Adaptive Spectral Weighting.
FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representation
By initializing the bias of the neural network with different ranges, sub-functions with various frequencies in the variable-periodic function are selected for activation.
Neural Poisson Solver: A Universal and Continuous Framework for Natural Signal Blending
To tackle this issue, we introduce the Neural Poisson Solver, a plug-and-play and universally applicable framework across different signal dimensions for blending visual signals represented by INRs.
PNeRV: Enhancing Spatial Consistency via Pyramidal Neural Representation for Videos
To address this issue, we introduce the Pyramidal Neural Representation for Videos (PNeRV), which is built on a multi-scale information connection and comprises a lightweight rescaling operator, Kronecker Fully-connected layer (KFc), and a Benign Selective Memory (BSM) mechanism.
Efficient and Generic Point Model for Lossless Point Cloud Attribute Compression
In this paper, we propose PoLoPCAC, an efficient and generic lossless PCAC method that achieves high compression efficiency and strong generalizability simultaneously.
Towards Backward-Compatible Continual Learning of Image Compression
This paper explores the possibility of extending the capability of pre-trained neural image compressors (e. g., adapting to new data or target bitrates) without breaking backward compatibility, the ability to decode bitstreams encoded by the original model.
Another Way to the Top: Exploit Contextual Clustering in Learned Image Coding
While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering operations and local attention for correlation characterization and compact representation of an image.
Deep Hierarchical Video Compression
Recently, probabilistic predictive coding that directly models the conditional distribution of latent features across successive frames for temporal redundancy removal has yielded promising results.
FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functions
Implicit Neural Representation (INR), which utilizes a neural network to map coordinate inputs to corresponding attributes, is causing a revolution in the field of signal processing.
Continuous 3D Myocardial Motion Tracking via Echocardiography
Myocardial motion tracking stands as an essential clinical tool in the prevention and detection of cardiovascular diseases (CVDs), the foremost cause of death globally.
RHINO: Regularizing the Hash-based Implicit Neural Representation
This connection ensures a seamless backpropagation of gradients from the network's output back to the input coordinates, thereby enhancing regularization.
Karma: Adaptive Video Streaming via Causal Sequence Modeling
Unlike direct observation-to-action mapping, Karma recurrently maintains a multi-dimensional time series of observations, returns, and actions as input and employs causal sequence modeling via a decision transformer to determine the next action.
DNeRV: Modeling Inherent Dynamics via Difference Neural Representation for Videos
DNeRV achieves competitive results against the state-of-the-art neural compression approaches and outperforms existing implicit methods on downstream inpainting and interpolation for $960 \times 1920$ videos.
Disorder-invariant Implicit Neural Representation
However, the expressive power of INR is limited by the spectral bias in the network training.
Lossless Point Cloud Attribute Compression Using Cross-scale, Cross-group, and Cross-color Prediction
With this aim, we extensively exploit cross-scale, cross-group, and cross-color correlations of point cloud attribute to ensure accurate probability estimation and thus high coding efficiency.
QARV: Quantization-Aware ResNet VAE for Lossy Image Compression
This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications.
Dynamic Point Cloud Geometry Compression Using Multiscale Inter Conditional Coding
This work extends the Multiscale Sparse Representation (MSR) framework developed for static Point Cloud Geometry Compression (PCGC) to support the dynamic PCGC through the use of multiscale inter conditional coding.
Efficient Visual Computing with Camera RAW Snapshots
Conventional cameras capture image irradiance on a sensor and convert it to RGB images using an image signal processor (ISP).
DINER: Disorder-Invariant Implicit Neural Representation
Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems.
Rate-Distortion Optimized Post-Training Quantization for Learned Image Compression
Quantizing a floating-point neural network to its fixed-point representation is crucial for Learned Image Compression (LIC) because it improves decoding consistency for interoperability and reduces space-time complexity for implementation.
CARNet:Compression Artifact Reduction for Point Cloud Attribute
A learning-based adaptive loop filter is developed for the Geometry-based Point Cloud Compression (G-PCC) standard to reduce attribute compression artifacts.
Lossy Image Compression with Quantized Hierarchical VAEs
Recent research has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate-distortion theory.
Efficient LiDAR Point Cloud Geometry Compression Through Neighborhood Point Attention
Although convolutional representation of multiscale sparse tensor demonstrated its superior efficiency to accurately model the occupancy probability for the compression of geometry component of dense object point clouds, its capacity for representing sparse LiDAR point cloud geometry (PCG) was largely limited.
H2-Stereo: High-Speed, High-Resolution Stereoscopic Video System
We utilize a disparity network to transfer spatiotemporal information across views even in large disparity scenes, based on which, we propose disparity-guided flow-based warping for LSR-HFR view and complementary warping for HSR-LFR view.
Fast Simulation of Particulate Suspensions Enabled by Graph Neural Network
Predicting the dynamic behaviors of particles in suspension subject to hydrodynamic interaction (HI) and external drive can be critical for many applications.
High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregation
To this end, Integrated Convolution and Self-Attention (ICSA) unit is first proposed to form a content-adaptive transform to characterize and embed neighborhood information dynamically of any input.
Rendering Nighttime Image Via Cascaded Color and Brightness Compensation
Image signal processing (ISP) is crucial for camera imaging, and neural networks (NN) solutions are extensively deployed for daytime scenes.
Event Transformer
The event camera's low power consumption and ability to capture microsecond brightness changes make it attractive for various computer vision tasks.
Sparse Tensor-based Point Cloud Attribute Compression
Recently, numerous learning-based compression methods have been developed with outstanding performance for the coding of the geometry information of point clouds.
Opening the Black Box of Learned Image Coders
End-to-end learned lossy image coders (LICs), as opposed to hand-crafted image codecs, have shown increasing superiority in terms of the rate-distortion performance.
Towards Robust Neural Image Compression: Adversarial Attack and Model Finetuning
Deep neural network-based image compression has been extensively studied.
Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compression
We call this compression method SparsePCGC.
Transformer-based Image Compression
A Transformer-based Image Compression (TIC) approach is developed which reuses the canonical variational autoencoder (VAE) architecture with paired main and hyper encoder-decoders.
Which One is Better: Assessing Objective Metrics for Point Cloud Compression
Point cloud compression (PCC) has made remarkable achievement in recent years.
End-to-end Neural Video Coding Using a Compound Spatiotemporal Representation
We further design a one-to-many decoder pipeline to generate multiple predictions from the CSTR, including vector-based resampling, adaptive kernel-based resampling, compensation mode selection maps and texture enhancements, and combines them adaptively to achieve more accurate inter prediction.
ANT: Learning Accurate Network Throughput for Better Adaptive Video Streaming
Adaptive Bit Rate (ABR) decision plays a crucial role for ensuring satisfactory Quality of Experience (QoE) in video streaming applications, in which past network statistics are mainly leveraged for future network bandwidth prediction.
NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Results
This paper reviews the first NTIRE challenge on quality enhancement of compressed video, with a focus on the proposed methods and results.
MPED: Quantifying Point Cloud Distortion based on Multiscale Potential Energy Discrepancy
In this paper, we propose a new distortion quantification method for point clouds, the multiscale potential energy discrepancy (MPED).
Decomposition, Compression, and Synthesis (DCS)-based Video Coding: A Neural Exploration via Resolution-Adaptive Learning
Inspired by the facts that retinal cells actually segregate the visual scene into different attributes (e. g., spatial details, temporal motion) for respective neuronal processing, we propose to first decompose the input video into respective spatial texture frames (STF) at its native spatial resolution that preserve the rich spatial details, and the other temporal motion frames (TMF) at a lower spatial resolution that retain the motion smoothness; then compress them together using any popular video coder; and finally synthesize decoded STFs and TMFs for high-fidelity video reconstruction at the same resolution as its native input.
Multiscale Point Cloud Geometry Compression
Recent years have witnessed the growth of point cloud based applications because of its realistic and fine-grained representation of 3D objects and scenes.
Neural Video Coding using Multiscale Motion Compensation and Spatiotemporal Context Model
Over the past two decades, traditional block-based video coding has made remarkable progress and spawned a series of well-known standards such as MPEG-4, H. 264/AVC and H. 265/HEVC.
Inferring Point Cloud Quality via Graph Similarity
We propose the GraphSIM -- an objective metric to accurately predict the subjective quality of point cloud with superimposed geometry and color impairments.
Object-Based Image Coding: A Learning-Driven Revisit
The Object-Based Image Coding (OBIC) that was extensively studied about two decades ago, promised a vast application perspective for both ultra-low bitrate communication and high-level semantical content understanding, but it had rarely been used due to the inefficient compact representation of object with arbitrary shape.
Learning End-to-End Lossy Image Compression: A Benchmark
In this paper, we first conduct a comprehensive literature survey of learned image compression methods.
Learned Video Compression via Joint Spatial-Temporal Correlation Exploration
Traditional video compression technologies have been developed over decades in pursuit of higher coding efficiency.
Neural Image Compression via Non-Local Attention Optimization and Improved Context Modeling
This paper proposes a novel Non-Local Attention optmization and Improved Context modeling-based image compression (NLAIC) algorithm, which is built on top of the deep nerual network (DNN)-based variational auto-encoder (VAE) structure.
A Dual Camera System for High Spatiotemporal Resolution Video Acquisition
This paper presents a dual camera system for high spatiotemporal resolution (HSTR) video acquisition, where one camera shoots a video with high spatial resolution and low frame rate (HSR-LFR) and another one captures a low spatial resolution and high frame rate (LSR-HFR) video.
Learned Point Cloud Geometry Compression
This paper presents a novel end-to-end Learned Point Cloud Geometry Compression (a. k. a., Learned-PCGC) framework, to efficiently compress the point cloud geometry (PCG) using deep neural networks (DNN) based variational autoencoders (VAE).
Learned Quality Enhancement via Multi-Frame Priors for HEVC Compliant Low-Delay Applications
Networked video applications, e. g., video conferencing, often suffer from poor visual quality due to unexpected network fluctuation and limited bandwidth.
Non-local Attention Optimized Deep Image Compression
This paper proposes a novel Non-Local Attention Optimized Deep Image Compression (NLAIC) framework, which is built on top of the popular variational auto-encoder (VAE) structure.
Extreme Image Coding via Multiscale Autoencoders With Generative Adversarial Optimization
We propose a MultiScale AutoEncoder(MSAE) based extreme image compression framework to offer visually pleasing reconstruction at a very low bitrate.
Gated Context Model with Embedded Priors for Deep Image Compression
Besides, a field study on perceptual quality is also given via a dedicated subjective assessment, to compare the efficiency of our proposed methods and other conventional image compression methods.
Deep Image Compression via End-to-End Learning
We present a lossy image compression method based on deep convolutional neural networks (CNNs), which outperforms the existing BPG, WebP, JPEG2000 and JPEG as measured via multi-scale structural similarity (MS-SSIM), at the same bit rate.
