Search Results for author:
Found 76 papers, 22 papers with code
Distribution Guidance Network for Weakly Supervised Point Cloud Semantic Segmentation
Despite alleviating the dependence on dense annotations inherent to fully supervised methods, weakly supervised point cloud semantic segmentation suffers from inadequate supervision signals.
BVI-UGC: A Video Quality Database for User-Generated Content Transcoding
Based on this collected subjective data, we benchmarked the performance of 10 full-reference and 11 no-reference quality metrics.
Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy
To bridge the gap, in this paper, we propose a perception-guided hybrid metric (PHM) that adaptively leverages two visual strategies with respect to distortion degree to predict point cloud quality: to measure visible difference in high-quality samples, PHM takes into account the masking effect and employs texture complexity as an effective compensatory factor for absolute difference; on the other hand, PHM leverages spectral graph theory to evaluate appearance degradation in low-quality samples.
Video Coding with Cross-Component Sample Offset
The input to the mapping is a group of reconstructed luma samples, and the output is an offset value applied on the center luma or co-located chroma sample.
Joint Reference Frame Synthesis and Post Filter Enhancement for Versatile Video Coding
During RFS, two reconstructed frames are sent into STENet's synthesis pipeline to synthesize a virtual reference frame, similar to the current to-be-coded frame.
AIS 2024 Challenge on Video Quality Assessment of User-Generated Content: Methods and Results
The performance of the top-5 submissions is reviewed and provided here as a survey of diverse deep models for efficient video quality assessment of user-generated content.
NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results
This paper reviews the NTIRE 2024 Challenge on Shortform UGC Video Quality Assessment (S-UGC VQA), where various excellent solutions are submitted and evaluated on the collected dataset KVQ from popular short-form video platform, i. e., Kuaishou/Kwai Platform.
PAME: Self-Supervised Masked Autoencoder for No-Reference Point Cloud Quality Assessment
Furthermore, in the model fine-tuning stage, the learned content-aware features serve as a guide to fuse the point cloud quality features extracted from different perspectives.
Contrastive Pre-Training with Multi-View Fusion for No-Reference Point Cloud Quality Assessment
Furthermore, in the model fine-tuning stage, we propose a semantic-guided multi-view fusion module to effectively integrate the features of projected images from multiple perspectives.
Graph Construction with Flexible Nodes for Traffic Demand Prediction
To tackle these challenges, this paper introduces a novel graph construction method tailored to free-floating traffic mode.
Adaptive Online Learning of Separable Path Graph Transforms for Intra-prediction
Current video coding standards, including H. 264/AVC, HEVC, and VVC, employ discrete cosine transform (DCT), discrete sine transform (DST), and secondary to Karhunen-Loeve transforms (KLTs) decorrelate the intra-prediction residuals.
Transferable Learned Image Compression-Resistant Adversarial Perturbations
Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks.
Learned Lossless Image Compression based on Bit Plane Slicing
To tackle these issues we introduce Bit Plane Slicing (BPS) splitting images in the bit plane dimension with the considerations on different importance for latent variables.
Full-reference Video Quality Assessment for User Generated Content Transcoding
In this work, we observe that existing full-/no-reference quality metrics fail to accurately predict the perceptual quality difference between transcoded UGC content and the corresponding unpristine references.
Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations
Utilizing uniformly distributed sparse annotations, weakly supervised learning alleviates the heavy reliance on fine-grained annotations in point cloud semantic segmentation tasks.
Corner-to-Center Long-range Context Model for Efficient Learned Image Compression
To tackle this issue, we conduct an in-depth analysis of the performance degradation observed in existing parallel context models, focusing on two aspects: the Quantity and Quality of information utilized for context prediction and decoding.
SJTU-TMQA: A quality assessment database for static mesh with texture map
However, little research has been done on the quality assessment of textured meshes, which hinders the development of quality-oriented applications, such as mesh compression and enhancement.
Dynamic Kernel-Based Adaptive Spatial Aggregation for Learned Image Compression
In this paper, we focus on extending spatial aggregation capability and propose a dynamic kernel-based transform coding.
GeodesicPSIM: Predicting the Quality of Static Mesh with Texture Map via Geodesic Patch Similarity
A two-step patch cropping algorithm and a patch texture mapping module refine the size of 1-hop geodesic patches and build the relationship between the mesh geometry and color information, resulting in the generation of 1-hop textured geodesic patches.
TDMD: A Database for Dynamic Color Mesh Subjective and Objective Quality Explorations
Dynamic colored meshes (DCM) are widely used in various applications; however, these meshes may undergo different processes, such as compression or transmission, which can distort them and degrade their quality.
TSMD: A Database for Static Color Mesh Quality Assessment Study
Static meshes with texture map are widely used in modern industrial and manufacturing sectors, attracting considerable attention in the mesh compression community due to its huge amount of data.
Layer-wise Representation Fusion for Compositional Generalization
Inspired by this, we propose LRF, a novel \textbf{L}ayer-wise \textbf{R}epresentation \textbf{F}usion framework for CG, which learns to fuse previous layers' information back into the encoding and decoding process effectively through introducing a \emph{fuse-attention module} at each encoder and decoder layer.
Once-Training-All-Fine: No-Reference Point Cloud Quality Assessment via Domain-relevance Degradation Description
Second, to reduce the significant domain discrepancy, we establish an intermediate domain, the description domain, based on insights from subjective experiments, by considering the domain relevance among samples located in the perception domain and learning a structured latent space.
Reconstruction Distortion of Learned Image Compression with Imperceptible Perturbations
Learned Image Compression (LIC) has recently become the trending technique for image transmission due to its notable performance.
Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization
There is mounting evidence that one of the reasons hindering CG is the representation of the encoder uppermost layer is entangled, i. e., the syntactic and semantic representations of sequences are entangled.
PanelNet: Understanding 360 Indoor Environment via Panel Representation
To reduce the negative impact of panoramic distortion, we incorporate a panel geometry embedding network that encodes both the local and global geometric features of a panel.
A Tiny Machine Learning Model for Point Cloud Object Classification
On the other hand, the model size and inference complexity of DGCNN are 42X and 1203X of those of Green-PointHop, respectively.
PointFlowHop: Green and Interpretable Scene Flow Estimation from Consecutive Point Clouds
An efficient 3D scene flow estimation method called PointFlowHop is proposed in this work.
S3I-PointHop: SO(3)-Invariant PointHop for 3D Point Cloud Classification
Many point cloud classification methods are developed under the assumption that all point clouds in the dataset are well aligned with the canonical axes so that the 3D Cartesian point coordinates can be employed to learn features.
gpcgc: a green point cloud geometry coding method
A low-complexity point cloud compression method called the Green Point Cloud Geometry Codec (GPCGC), is proposed to encode the 3D spatial coordinates of static point clouds efficiently.
Efficient Hierarchical Entropy Model for Learned Point Cloud Compression
Learning an accurate entropy model is a fundamental way to remove the redundancy in point cloud compression.
Changes from Classical Statistics to Modern Statistics and Data Science
We urgently need to shift the paradigm for data analysis from the classical Euclidean data analysis to both Euclidean and non Euclidean data analysis and develop more and more innovative methods for describing, estimating and inferring non Euclidean geometries of modern real datasets.
GPA-Net:No-Reference Point Cloud Quality Assessment with Multi-task Graph Convolutional Network
To extract effective features for PCQA, we propose a new graph convolution kernel, i. e., GPAConv, which attentively captures the perturbation of structure and texture.
Robust Human Matting via Semantic Guidance
Unlike previous works, our framework is data efficient, which requires a small amount of matting ground-truth to learn to estimate high quality object mattes.
Point Cloud Quality Assessment using 3D Saliency Maps
Considering the importance of saliency detection in quality assessment, we propose an effective full-reference PCQA metric which makes the first attempt to utilize the saliency information to facilitate quality prediction, called point cloud quality assessment using 3D saliency maps (PQSM).
Enhancing HDR Video Compression through CNN-based Effective Bit Depth Adaptation
In this work, we modify the MFRNet network architecture to enable multiple frame processing, and the new network, multi-frame MFRNet, has been integrated into the EBDA framework using two Versatile Video Coding (VVC) host codecs: VTM 16. 2 and the Fraunhofer Versatile Video Encoder (VVenC 1. 4. 0).
Learning Knowledge Representation with Meta Knowledge Distillation for Single Image Super-Resolution
In addition, the KRNets are optimized in a meta-learning manner to ensure the knowledge transferring and the student learning are beneficial to improving the reconstructed quality of the student.
FAIVConf: Face enhancement for AI-based Video Conference with Low Bit-rate
Recently, high-quality video conferencing with fewer transmission bits has become a very hot and challenging problem.
Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Prediction
The previous deep video compression approaches only use the single scale motion compensation strategy and rarely adopt the mode prediction technique from the traditional standards like H. 264/H. 265 for both motion and residual compression.
Neural Texture Extraction and Distribution for Controllable Person Image Synthesis
Our model is trained to predict human images in arbitrary poses, which encourages it to extract disentangled and expressive neural textures representing the appearance of different semantic entities.
PCRP: Unsupervised Point Cloud Object Retrieval and Pose Estimation
An unsupervised point cloud object retrieval and pose estimation method, called PCRP, is proposed in this work.
OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud Compression
In point cloud compression, sufficient contexts are significant for modeling the point cloud distribution.
LSVC: A Learning-Based Stereo Video Compression Framework
In this work, we propose the first end-to-end optimized framework for compressing automotive stereo videos (i. e., stereo videos from autonomous driving applications) from both left and right views.
GreenPCO: An Unsupervised Lightweight Point Cloud Odometry Method
GreenPCO is an unsupervised learning method that predicts object motion by matching features of consecutive point cloud scans.
Online Meta Adaptation for Variable-Rate Learned Image Compression
This work addresses two major issues of end-to-end learned image compression (LIC) based on deep neural networks: variable-rate learning where separate networks are required to generate compressed images with varying qualities, and the train-test mismatch between differentiable approximate quantization and true hard quantization.
GSIP: Green Semantic Segmentation of Large-Scale Indoor Point Clouds
It is named GSIP (Green Segmentation of Indoor Point clouds) and its performance is evaluated on a representative large-scale benchmark -- the Stanford 3D Indoor Segmentation (S3DIS) dataset.
PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering
The proposed model can generate photo-realistic portrait images with accurate movements according to intuitive modifications.
Combining Attention with Flow for Person Image Synthesis
Pose-guided person image synthesis aims to synthesize person images by transforming reference images into target poses.
Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression
Compressing Deep Neural Network (DNN) models to alleviate the storage and computation requirements is essential for practical applications, especially for resource limited devices.
Recent Standard Development Activities on Video Coding for Machines
Specifically, we will first provide an overview of the MPEG VCM group including use cases, requirements, processing pipelines, plan for potential VCM standards, followed by the evaluation framework including machine-vision tasks, dataset, evaluation metrics, and anchor generation.
Substitutional Neural Image Compression
The key idea is to replace the image to be compressed with a substitutional one that outperforms the original one in a desired way.
Tencent Video Dataset (TVD): A Video Dataset for Learning-based Visual Data Compression and Analysis
Learning-based visual data compression and analysis have attracted great interest from both academia and industry recently.
R-PointHop: A Green, Accurate, and Unsupervised Point Cloud Registration Method
Inspired by the recent PointHop classification method, an unsupervised 3D point cloud registration method, called R-PointHop, is proposed in this work.
An Optimized H.266/VVC Software Decoder On Mobile Platform
As the successor of H. 265/HEVC, the new versatile video coding standard (H. 266/VVC) can provide up to 50% bitrate saving with the same subjective quality, at the cost of increased decoding complexity.
High Quality Disparity Remapping With Two-Stage Warping
In the second stage, we derive another warping model to refine warping results in less important regions by eliminating serious distortions in shape, disparity and 3D structure.
Vocal Bursts Intensity Prediction
Vocal Bursts Valence Prediction
Structure-Transformed Texture-Enhanced Network for Person Image Synthesis
Pose-guided virtual try-on task aims to modify the fashion item based on pose transfer task.
SSD-GAN: Measuring the Realness in the Spatial and Spectral Domains
This issue makes the generator lack the incentive from the discriminator to learn high-frequency content of data, resulting in a significant spectrum discrepancy between generated images and real images.
TFGAN: Time and Frequency Domain Based Generative Adversarial Network for High-fidelity Speech Synthesis
On one hand, we propose to discriminate ground-truth waveform from synthetic one in frequency domain for offering more consistency guarantees instead of only in time domain.
Unsupervised Point Cloud Registration via Salient Points Analysis (SPA)
An unsupervised point cloud registration method, called salient points analysis (SPA), is proposed in this work.
Unsupervised Feedforward Feature (UFF) Learning for Point Cloud Classification and Segmentation
The UFF method exploits statistical correlations of points in a point cloud set to learn shape and point features in a one-pass feedforward manner through a cascaded encoder-decoder architecture.
Deep Spatial Transformation for Pose-Guided Person Image Generation and Animation
We show that our framework can spatially transform the inputs in an efficient manner.
Toward Zero-Shot Unsupervised Image-to-Image Translation
Recent studies have shown remarkable success in unsupervised image-to-image translation.
AdaDurIAN: Few-shot Adaptation for Neural Text-to-Speech with DurIAN
This paper investigates how to leverage a DurIAN-based average model to enable a new speaker to have both accurate pronunciation and fluent cross-lingual speaking with very limited monolingual data.
PointHop++: A Lightweight Learning Model on Point Sets for 3D Classification
The PointHop method was recently proposed by Zhang et al. for 3D point cloud classification with unsupervised feature extraction.
RoIMix: Proposal-Fusion among Multiple Images for Underwater Object Detection
Generic object detection algorithms have proven their excellent performance in recent years.
C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network
However, video quality exhibits different characteristics from static image quality due to the existence of temporal masking effects.
Multi-mapping Image-to-Image Translation via Learning Disentanglement
Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation.
StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Image inpainting techniques have shown significant improvements by using deep neural networks recently.
PointHop: An Explainable Machine Learning Method for Point Cloud Classification
In the attribute building stage, we address the problem of unordered point cloud data using a space partitioning procedure and developing a robust descriptor that characterizes the relationship between a point and its one-hop neighbor in a PointHop unit.
Residual-Guided In-Loop Filter Using Convolution Neural Network
The block-based coding structure in the hybrid video coding framework inevitably introduces compression artifacts such as blocking, ringing, etc.
Deep AutoEncoder-based Lossy Geometry Compression for Point Clouds
Point cloud is a fundamental 3D representation which is widely used in real world applications such as autonomous driving.
Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection
Remarkably, we obtain the frame-level AUC score of 82. 12% on UCF-Crime.
Anomaly Detection In Surveillance Videos
Multiple Instance Learning
+3
Generative Adversarial Network based Speaker Adaptation for High Fidelity WaveNet Vocoder
Firstly, due to the noisy input signal of the model, there is still a gap between the quality of generated and natural waveforms.
BLP -- Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization
Despite tremendous progress achieved in temporal action detection, state-of-the-art methods still suffer from the sharp performance deterioration when localizing the starting and ending temporal action boundaries.
Multi-Mapping Image-to-Image Translation with Central Biasing Normalization
Recent advances in image-to-image translation have seen a rise in approaches generating diverse images through a single network.
