Search Results for author: André Kaup

Found 164 papers, 13 papers with code

High-Resolution Hyperspectral Video Imaging Using A Hexagonal Camera Array

no code implementations12 Jul 2024 Frank Sippel, Jürgen Seiler, André Kaup

For this task, a high-resolution snapshot hyperspectral camera array using a hexagonal shape is introduced. The hexagonal array for hyperspectral imaging uses off-the-shelf hardware, which enables high flexibility regarding employed cameras, lenses and filters.

SVT-AV1 Encoding Bitrate Estimation Using Motion Search Information

no code implementations8 Jul 2024 Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, Christian Herglotz, André Kaup

Enabling high compression efficiency while keeping encoding energy consumption at a low level, requires prioritization of which videos need more sophisticated encoding techniques.

Multispectral Snapshot Image Registration Using Learned Cross Spectral Disparity Estimation and a Deep Guided Occlusion Reconstruction Network

1 code implementation17 Jun 2024 Frank Sippel, Jürgen Seiler, André Kaup

One approach for snapshot multispectral imaging, which is capable of recording multispectral videos, is by using camera arrays, where each camera records a different spectral band.

Data Augmentation Disparity Estimation +1

On Annotation-free Optimization of Video Coding for Machines

no code implementations12 Jun 2024 Marc Windsheimer, Fabian Brand, André Kaup

But ground truth data is difficult to obtain and thus an optimization without ground truth is preferred.

Towards Video Codec Performance Evaluation: A Rate-Energy-Distortion Perspective

no code implementations28 May 2024 Geetha Ramasubbu, André Kaup, Christian Herglotz

The Bj{\o}ntegaard Delta rate (BD-rate) objectively assesses the coding efficiency of video codecs using the rate-distortion (R-D) performance but overlooks encoding energy, which is crucial in practical applications, especially for those on handheld devices.

Efficient Learned Wavelet Image and Video Coding

no code implementations21 May 2024 Anna Meyer, Srivatsa Prativadibhayankaram, André Kaup

Learned wavelet image and video coding approaches provide an explainable framework with a latent space corresponding to a wavelet decomposition.

Data Compression Video Compression

Analysis of Neural Video Compression Networks for 360-Degree Video Coding

no code implementations15 Feb 2024 Andy Regensky, Fabian Brand, André Kaup

As such, the state-of-the-art H. 266/VVC video coding standard integrates dedicated tools for 360-degree video, and considerable efforts have been put into designing 360-degree projection formats with improved compression efficiency.

ERP Video Compression

Predicting the Energy Demand of a Hardware Video Decoder with Unknown Design Using Software Profiling

no code implementations15 Feb 2024 Matthias Kränzler, Christian Herglotz, André Kaup

By using multiple video coding standards for model training, we can predict the complexity of an unknown hardware decoder with a minimum error of 4. 54% without using the corresponding hardware decoder for training.

Decoder

A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders

no code implementations14 Feb 2024 Matthias Kränzler, Christian Herglotz, André Kaup

We find that AV1 is a sweet spot for optimized software decoder implementations with an additional energy demand of 16. 55% and bitrate savings of -43. 95% compared to VP9.

Decoder

SLIC: A Learned Image Codec Using Structure and Color

1 code implementation30 Jan 2024 Srivatsa Prativadibhayankaram, Mahadev Prasad Panda, Thomas Richter, Heiko Sparenberg, Siegfried Fößel, André Kaup

We propose the structure and color based learned image codec (SLIC) in which the task of compression is split into that of luminance and chrominance.

MS-SSIM SSIM

Encoding Time and Energy Model for SVT-AV1 based on Video Complexity

no code implementations29 Jan 2024 Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, Christian Herglotz, André Kaup

We propose an encoding time and energy model for SVT-AV1 based on empirical relations between the encoding time and video parameters as well as encoder configurations.

Enhanced Color Palette Modeling for Lossless Screen Content Compression

no code implementations22 Dec 2023 Hannah Och, Shabhrish Reddy Uddehal, Tilo Strutz, André Kaup

Compared to VVC and HEVC, the proposed method needs roughly 0. 44 and 0. 17 bits per pixel less on average for 24-bit screen content images, respectively.

Quantized Decoder in Learned Image Compression for Deterministic Reconstruction

no code implementations18 Dec 2023 Esin Koyuncu, Timofey Solovyev, Johannes Sauer, Elena Alshina, André Kaup

Learned image compression has a problem of non-bit-exact reconstruction due to different calculations of floating point arithmetic on different devices.

Decoder Image Compression +1

Color Agnostic Cross-Spectral Disparity Estimation

no code implementations14 Dec 2023 Frank Sippel, Nils Genser, Hannah Och, Jürgen Seiler, André Kaup

The theoretical examination of the novel color agnostic method is completed by an extensive evaluation compared to state of the art including self-recorded multispectral data and a reference implementation.

Disparity Estimation Image Generation +1

A Guided Upsampling Network for Short Wave Infrared Images Using Graph Regularization

no code implementations14 Dec 2023 Frank Sippel, Jürgen Seiler, André Kaup

Thus, in this paper an upsampling method for SWIR images guided by a visible image is presented.

Geometry-Corrected Geodesic Motion Modeling with Per-Frame Camera Motion for 360-Degree Video Compression

1 code implementation14 Dec 2023 Andy Regensky, André Kaup

The large amounts of data associated with 360-degree video require highly effective compression techniques for efficient storage and distribution.

Motion Compensation Video Compression

Extended Signaling Methods for Reduced Video Decoder Power Consumption Using Green Metadata

no code implementations26 Oct 2023 Christian Herglotz, Matthias Kränzler, Xixue Chu, Edouard Francois, Yong He, André Kaup

In this paper, we discuss one aspect of the latest MPEG standard edition on energy-efficient media consumption, also known as Green Metadata (ISO/IEC 232001-11), which is the interactive signaling for remote decoder-power reduction for peer-to-peer video conferencing.

Decoder

Improving HEVC Encoding of Rendered Video Data Using True Motion Information

no code implementations13 Sep 2023 Christian Herglotz, David Müller, Andreas Weinlich, Frank Bauer, Michael Ortner, Marc Stamminger, André Kaup

This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences.

Motion Estimation

On Versatile Video Coding at UHD with Machine-Learning-Based Super-Resolution

no code implementations12 Aug 2023 Kristian Fischer, Christian Herglotz, André Kaup

Coding 4K data has become of vital interest in recent years, since the amount of 4K data is significantly increasing.

4k Image Super-Resolution

Video Decoding Energy Estimation Using Processor Events

no code implementations26 Jul 2023 Christian Herglotz, André Kaup

In this paper, we show that processor events like instruction counts or cache misses can be used to accurately estimate the processing energy of software video decoders.

Decoder

Component-wise Power Estimation of Electrical Devices Using Thermal Imaging

no code implementations17 Jul 2023 Christian Herglotz, Simon Grosche, Akarsh Bharadwaj, André Kaup

This paper presents a novel method to estimate the power consumption of distinct active components on an electronic carrier board by using thermal imaging.

object-detection Object Detection

Power Modeling for Virtual Reality Video Playback Applications

no code implementations17 Jul 2023 Christian Herglotz, Stéphane Coulombe, Ahmad Vakili, André Kaup

This paper proposes a method to evaluate and model the power consumption of modern virtual reality playback and streaming applications on smartphones.

Power-Efficient Video Streaming on Mobile Devices Using Optimal Spatial Scaling

no code implementations17 Jul 2023 Christian Herglotz, André Kaup, Stéphane Coulombe, Ahmad Vakili

This paper derives optimal spatial scaling and rate control parameters for power-efficient wireless video streaming on portable devices.

Spatially-Adaptive Learning-Based Image Compression with Hierarchical Multi-Scale Latent Spaces

no code implementations12 Jul 2023 Fabian Brand, Alexander Kopte, Kristian Fischer, André Kaup

Current state-of-the-art neural-network-based image compression systems however use only one scale to transmit the latent space.

Image Compression Video Compression

Encoder Complexity Control in SVT-AV1 by Speed-Adaptive Preset Switching

1 code implementation11 Jul 2023 Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, André Kaup, Christian Herglotz

Current developments in video encoding technology lead to continuously improving compression performance but at the expense of increasingly higher computational demands.

Processing Energy Modeling for Neural Network Based Image Compression

no code implementations29 Jun 2023 Christian Herglotz, Fabian Brand, Andy Regensky, Felix Rievel, André Kaup

Nowadays, the compression performance of neural-networkbased image compression algorithms outperforms state-of-the-art compression approaches such as JPEG or HEIC-based image compression.

Image Compression

Cross Spectral Image Reconstruction Using a Deep Guided Neural Network

1 code implementation27 Jun 2023 Frank Sippel, Jürgen Seiler, André Kaup

Since only little cross spectral data is available for training, this neural network is highly regularized.

Data Augmentation Image Reconstruction +1

Improving Spherical Image Resampling through Viewport-Adaptivity

1 code implementation23 Jun 2023 Andy Regensky, Viktoria Heimann, Ruoyu Zhang, André Kaup

The conversion between different spherical image and video projection formats requires highly accurate resampling techniques in order to minimize the inevitable loss of information.

SSIM

Motion Plane Adaptive Motion Modeling for Spherical Video Coding in H.266/VVC

no code implementations23 Jun 2023 Andy Regensky, Christian Herglotz, André Kaup

Motion compensation is one of the key technologies enabling the high compression efficiency of modern video coding standards.

Motion Compensation

Video Decoding Energy Reduction Using Temporal-Domain Filtering

no code implementations12 Jun 2023 Christian Herglotz, Matthias Kränzler, Robert Ludwig, André Kaup

In this paper, we study decoding energy reduction opportunities using temporal-domain filtering and subsampling methods.

Learned Wavelet Video Coding using Motion Compensated Temporal Filtering

no code implementations25 May 2023 Anna Meyer, Fabian Brand, André Kaup

In our experiments, we compare our MCTF-based approach to learning-based conditional coders and traditional hybrid video coding.

Video Compression

Power Reduction Opportunities on End-User Devices in Quality-Steady Video Streaming

no code implementations24 May 2023 Christian Herglotz, Werner Robitza, Alexander Raake, Tobias Hossfeld, André Kaup

We find that based on the power consumption of the streaming sessions from the crowdsourcing dataset, devices could save more than 55% of power if all participants adhere to low-power settings.

Image Segmentation For Improved Lossless Screen Content Compression

no code implementations10 May 2023 Shabhrish Reddy Uddehal, Tilo Strutz, Hannah Och, André Kaup

For SCIs with natural regions, the proposed method achieves a bit-rate reduction of up to 11. 6% and 1. 52% with respect to HEVC and the previous version of the SCF.

Image Segmentation Semantic Segmentation

Improved Screen Content Coding in VVC Using Soft Context Formation

no code implementations9 May 2023 Hannah Och, Shabhrish Reddy Uddehal, Tilo Strutz, André Kaup

Screen content images typically contain a mix of natural and synthetic image parts.

Multiscale Augmented Normalizing Flows for Image Compression

no code implementations9 May 2023 Marc Windsheimer, Fabian Brand, André Kaup

Most learning-based image compression methods lack efficiency for high image quality due to their non-invertible design.

Image Compression Quantization

The Bjøntegaard Bible -- Why your Way of Comparing Video Codecs May Be Wrong

1 code implementation25 Apr 2023 Christian Herglotz, Hannah Och, Anna Meyer, Geetha Ramasubbu, Lena Eichermüller, Matthias Kränzler, Fabian Brand, Kristian Fischer, Dat Thanh Nguyen, Andy Regensky, André Kaup

Using additional supporting points inbetween standard points defined by parameters such as the quantization parameter, we assess the interpolation error of the Bj{\o}ntegaard-Delta (BD) calculus and its impact on the final BD value.

Quantization SSIM +1

End-to-End Lidar-Camera Self-Calibration for Autonomous Vehicles

no code implementations24 Apr 2023 Arya Rachman, Jürgen Seiler, André Kaup

The network is arranged in a Siamese-twin structure to constrain the network features learning to a mutually shared feature in both point cloud and camera (Lidar-camera constraint).

Autonomous Vehicles Feature Correlation

A novel Cross-Component Context Model for End-to-End Wavelet Image Coding

no code implementations9 Mar 2023 Anna Meyer, André Kaup

In this paper, we explore a promising alternative approach for neural compression, with an autoencoder whose latent space represents a nonlinear wavelet decomposition.

Multispectral Image Compression Based on HEVC Using Pel-Recursive Inter-Band Prediction

no code implementations9 Mar 2023 Anna Meyer, Nils Genser, André Kaup

In this paper, we propose a cross-spectral compression scheme for efficiently coding multispectral data based on HEVC.

Image Compression

Temporal Scalability of Dynamic Volume Data Using Mesh Compensated Wavelet Lifting

no code implementations1 Mar 2023 Wolfgang Schnurrer, Niklas Pallast, Thomas Richter, André Kaup

We propose an approach based on compensated wavelet lifting for obtaining a scalable representation of dynamic CT and MR volumes with very high quality.

Computed Tomography (CT) Motion Compensation

Motion Estimation for Fisheye Video With an Application to Temporal Resolution Enhancement

no code implementations1 Mar 2023 Andrea Eichenseer, Michel Bätz, André Kaup

Simulations and experiments are conducted on synthetic as well as real-world fisheye video sequences that are part of a data set created in the context of this paper.

Motion Estimation

Saliency-Driven Hierarchical Learned Image Coding for Machines

no code implementations27 Feb 2023 Kristian Fischer, Fabian Brand, Christian Blum, André Kaup

Areas without saliency are transmitted in latent spaces of lower spatial resolution in order to reduce the bitrate.

Decoder Image Compression +2

Scalable Lossless Coding of Dynamic Medical CT Data Using Motion Compensated Wavelet Lifting with Denoised Prediction and Update

no code implementations3 Feb 2023 Daniela Lanz, Franz Schilling, André Kaup

To improve the visual quality of the lowpass subband, motion compensation can be incorporated into the lifting structure, but leads to inferior compression results at the same time.

Denoising Motion Compensation

Graph-Based Compensated Wavelet Lifting for Scalable Lossless Coding of Dynamic Medical Data

no code implementations3 Feb 2023 Daniela Lanz, André Kaup

This work focuses on coding these adjacency matrices to make the graph-based motion compensation feasible for data compression.

Data Compression Motion Compensation

Analysis of mesh-based motion compensation in wavelet lifting of dynamical 3-D+t CT data

no code implementations3 Feb 2023 Wolfgang Schnurrer, Thomas Richter, Jürgen Seiler, André Kaup

Factorized in the lifting structure, the wavelet transform can easily be extended by arbitrary compensation methods.

Motion Compensation

Compression of Dynamic Medical CT Data Using Motion Compensated Wavelet Lifting with Denoised Update

no code implementations2 Feb 2023 Daniela Lanz, Jürgen Seiler, Karina Jaskolka, André Kaup

For the lossless compression of dynamic 3-D+t volumes as produced by medical devices like Computed Tomography, various coding schemes can be applied.

Denoising Motion Compensation

Content Adaptive Wavelet Lifting for Scalable Lossless Video Coding

no code implementations2 Feb 2023 Daniela Lanz, Christian Herbert, André Kaup

Wavelet-based video coding decomposes an input sequence into a lowpass and a highpass subband by filtering along the temporal axis.

Optimizing Rate-Distortion Performance of Motion Compensated Wavelet Lifting with Denoised Prediction and Update

no code implementations2 Feb 2023 Daniela Lanz, André Kaup

Additionally, the similarity of the temporal base layer to the input sequence is preserved by the use of motion compensated temporal filtering.

Denoising

Learning Frequency-Specific Quantization Scaling in VVC for Standard-Compliant Task-driven Image Coding

1 code implementation20 Jan 2023 Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup

This is a well-known method for the human visual system, where scaling lists are derived from psycho-visual models.

Quantization

Synthetic Hyperspectral Array Video Database with Applications to Cross-Spectral Reconstruction and Hyperspectral Video Coding

1 code implementation18 Jan 2023 Frank Sippel, Jürgen Seiler, André Kaup

Two novel algorithms for two different applications are proposed to prove the diversity of applications that can be addressed by this novel database.

Diversity Image Reconstruction +1

Graph-based compensated wavelet lifting for 3-D+t medical CT data

no code implementations12 Jan 2023 Daniela Lanz, André Kaup

An efficient scalable data representation is an important task especially in the medical area, e. g. for volumes from Computed Tomography (CT) or Magnetic Resonance Tomography (MRT), when a downscaled version of the original signal is needed.

Computed Tomography (CT) Data Compression +2

Improving mesh-based motion compensation by using edge adaptive graph-based compensated wavelet lifting for medical data sets

no code implementations12 Jan 2023 Daniela Lanz, André Kaup

Medical applications like Computed Tomography (CT) or Magnetic Resonance Tomography (MRT) often require an efficient scalable representation of their huge output volumes in the further processing chain of medical routine.

Computed Tomography (CT) Motion Compensation

On the influence of clipping in lossless predictive and wavelet coding of noisy images

no code implementations11 Jan 2023 Wolfgang Schnurrer, Jürgen Seiler, Michael Schöberl, André Kaup

Especially in lossless image coding the obtainable compression ratio strongly depends on the amount of noise included in the data as all noise has to be coded, too.

Efficient lossless coding of highpass bands from block-based motion compensated wavelet lifting using JPEG 2000

no code implementations11 Jan 2023 Wolfgang Schnurrer, Tobias Tröger, Thomas Richter, Jürgen Seiler, André Kaup

Lossless image coding is a crucial task especially in the medical area, e. g., for volumes from Computed Tomography or Magnetic Resonance Tomography.

A Bit Stream Feature-Based Energy Estimator for HEVC Software Encoding

no code implementations11 Dec 2022 Geetha Ramasubbu, André Kaup, Christian Herglotz

To this end, this paper presents an energy estimator that uses a subset of bit stream features to accurately estimate the energy consumption of the HEVC software encoding process.

Improving block-based compensated wavelet lifting by reconstructing unconnected pixels

no code implementations8 Dec 2022 Wolfgang Schnurrer, Jürgen Seiler, André Kaup

This paper presents a new approach for improving the visual quality of the lowpass band of a compensated wavelet transform.

Motion Compensation

3-D mesh compensated wavelet lifting for 3-D+t medical CT data

no code implementations8 Dec 2022 Wolfgang Schnurrer, Thomas Richter, Jürgen Seiler, Christian Herglotz, André Kaup

We show that a 3-D mesh can obtain a higher quality of the lowpass band by 0. 28 dB with less than 40% of the model parameters of a comparable 2-D mesh.

Motion estimation for fisheye video sequences combining perspective projection with camera calibration information

no code implementations2 Dec 2022 Andrea Eichenseer, Michel Bätz, André Kaup

Fisheye cameras prove a convenient means in surveillance and automotive applications as they provide a very wide field of view for capturing their surroundings.

Camera Calibration Motion Compensation +1

Optimization of Probability Distributions for Residual Coding of Screen Content

no code implementations2 Dec 2022 Hannah Och, Tilo Strutz, André Kaup

For each pixel to be encoded, a probability distribution is estimated based on the neighboring pattern and the occurrence of that pattern in the already encoded image.

Disparity estimation for fisheye images with an application to intermediate view synthesis

no code implementations2 Dec 2022 Andrea Eichenseer, Michel Bätz, André Kaup

A straightforward approach to disparity estimation is block matching, which performs well with perspective data.

Disparity Estimation

Device Interoperability for Learned Image Compression with Weights and Activations Quantization

no code implementations2 Dec 2022 Esin Koyuncu, Timofey Solovyev, Elena Alshina, André Kaup

Learning-based image compression has improved to a level where it can outperform traditional image codecs such as HEVC and VVC in terms of coding performance.

Image Compression Quantization

A hybrid motion estimation technique for fisheye video sequences based on equisolid re-projection

no code implementations30 Nov 2022 Andrea Eichenseer, Michel Bätz, Jürgen Seiler, André Kaup

Capturing large fields of view with only one camera is an important aspect in surveillance and automotive applications, but the wide-angle fisheye imagery thus obtained exhibits very special characteristics that may not be very well suited for typical image and video processing methods such as motion estimation.

Motion Estimation

A data set providing synthetic and real-world fisheye video sequences

no code implementations30 Nov 2022 Andrea Eichenseer, André Kaup

In video surveillance as well as automotive applications, so-called fisheye cameras are often employed to capture a very wide angle of view.

Motion Estimation

Coding of distortion-corrected fisheye video sequences using H.265/HEVC

no code implementations30 Nov 2022 Andrea Eichenseer, André Kaup

Both methods make use of the latest video coding standard H. 265/HEVC and are compared with regard to objective as well as subjective video quality.

Temporal error concealment for fisheye video sequences based on equisolid re-projection

no code implementations21 Nov 2022 Andrea Eichenseer, Jürgen Seiler, Michel Bätz, André Kaup

Wide-angle video sequences obtained by fisheye cameras exhibit characteristics that may not very well comply with standard image and video processing techniques such as error concealment.

Decoder

Modeling of Energy Consumption and Streaming Video QoE using a Crowdsourcing Dataset

no code implementations11 Oct 2022 Christian Herglotz, Werner Robitza, Matthias Kränzler, André Kaup, Alexander Raake

In this paper, we perform a first analysis of both end-user power efficiency and Quality of Experience of a video streaming service.

Domain Adaptation for Unknown Image Distortions in Instance Segmentation

no code implementations5 Oct 2022 Maximiliane Gruber, Fabian Brand, Alina Mosebach, Jürgen Seiler, André Kaup

However, in practice unknown distortion can lead to a domain gap between training and test data, impeding the performance of a machine vision system.

Autonomous Driving Domain Adaptation +2

Sweet Streams are Made of This: The System Engineer's View on Energy Efficiency in Video Communications

no code implementations30 Sep 2022 Christian Herglotz, Matthias Kränzler, Robert Schober, André Kaup

We discuss all relevant energy sinks, highlight dependencies with quality-of-service variables as well as video properties, review energy consumption models for different devices from the literature, and aggregate these existing models into a global model for the overall energy consumption of a generic online video service.

Synthesizing Annotated Image and Video Data Using a Rendering-Based Pipeline for Improved License Plate Recognition

no code implementations28 Sep 2022 Andreas Spruck, Maximilane Gruber, Anatol Maier, Denise Moussa, Jürgen Seiler, Christian Riess, André Kaup

The benefits of the proposed data generation pipeline, especially for machine learning scenarios with limited available training data, are demonstrated by an extensive experimental validation in the context of automatic license plate recognition.

Data Augmentation License Plate Recognition +1

Increasing the Accuracy of a Neural Network Using Frequency Selective Mesh-to-Grid Resampling

no code implementations28 Sep 2022 Andreas Spruck, Viktoria Heimann, André Kaup

Using an extensive experimental evaluation we show that depending on the network architecture and classification task the application of FSMR during training aids the learning process.

3D Rendering Framework for Data Augmentation in Optical Character Recognition

no code implementations27 Sep 2022 Andreas Spruck, Maximiliane Hawesch, Anatol Maier, Christian Riess, Jürgen Seiler, André Kaup

Applying the proposed method, improvements of up to 2. 79 percentage points in terms of Character Error Rate (CER), and up to 7. 88 percentage points in terms of Word Error Rate (WER) are achieved on the subset.

Data Augmentation Optical Character Recognition +1

Quality Assurance of Weld Seams Using Laser Triangulation Imaging and Deep Neural Networks

no code implementations27 Sep 2022 Andreas Spruck, Jürgen Seiler, Michael Roll, Thomas Dudziak, Jürgen Eckstein, André Kaup

Due to their special characteristics, the images must be pre-processed to enable the use of a deep neural network.

Matched Quality Evaluation of Temporally Downsampled Videos with Non-Integer Factors

no code implementations21 Sep 2022 Christian Herglotz, Geetha Ramasubbu, André Kaup

Recent research has shown that temporal downsampling of high-frame-rate sequences can be exploited to improve the rate-distortion performance in video coding.

Advanced Design Space Exploration for Joint Energy and Quality Optimization for VVC

no code implementations21 Sep 2022 Matthias Kränzler, Christian Herglotz, André Kaup

In recent studies, it could be shown that the energy demand of Versatile Video Coding (VVC) decoders can be twice as high as comparable High Efficiency Video Coding (HEVC) decoders.

Decoding Energy Modeling For Versatile Video Coding

no code implementations21 Sep 2022 Matthias Kränzler, Christian Herglotz, André Kaup

In previous research, it was shown that the software decoding energy demand of High Efficiency Video Coding (HEVC) can be reduced by 15$\%$ by using a decoding-energy-rate-distortion optimization algorithm.

Decoder

Extending Video Decoding Energy Models for 360° and HDR Video Formats in HEVC

no code implementations21 Sep 2022 Matthias Kränzler, Christian Herglotz, André Kaup

We show that bit streams of the 360{\deg}, HDR, and fisheye video format can be estimated with a mean estimation error lower than 3. 88% if the setups have the same coding bit depth.

Decoder

A Comparative Analysis of the Time and Energy Demand of Versatile Video Coding and High Efficiency Video Coding Reference Decoders

no code implementations21 Sep 2022 Matthias Kränzler, Christian Herglotz, André Kaup

The evaluation shows that the energy demand of the VTM decoder is increased significantly compared to HM and that the increase depends on the coding configuration.

Decoder

Structure-Preserving Spectral Reflectance Estimation using Guided Filtering

no code implementations16 Sep 2022 Frank Sippel, Jürgen Seiler, Nils Genser, André Kaup

This novel estimation method is based on the guided filtering technique which preserves basic structures, while using spatial information to reduce the influence of noise.

Spatio-spectral Image Reconstruction Using Non-local Filtering

no code implementations16 Sep 2022 Frank Sippel, Jürgen Seiler, André Kaup

In many image processing tasks it occurs that pixels or blocks of pixels are missing or lost in only some channels.

Image Reconstruction Spectral Reconstruction

Hyperspectral Image Reconstruction from Multispectral Images Using Non-Local Filtering

no code implementations16 Sep 2022 Frank Sippel, Jürgen Seiler, André Kaup

Therefore, multispectral cameras with wide-band filters are used, which are much cheaper and are often able to capture videos.

Image Reconstruction Material Classification +1

Optimal Filter Selection for Multispectral Object Classification Using Fast Binary Search

no code implementations16 Sep 2022 Frank Sippel, Jürgen Seiler, André Kaup

In this paper we introduce a novel fast binary search for optimal filter selection that guarantees a minimum distance metric between the different spectra to classify.

Motion-Adapted Three-Dimensional Frequency Selective Extrapolation

no code implementations15 Sep 2022 Andreas Spruck, Markus Jonscher, Jürgen Seiler, André Kaup

This proposed extension solves the problem of changing content within the area considered by the 3D-FSE, which is caused by motion within the sequence.

Orthogonality Deficiency Compensation for Improved Frequency Selective Image Extrapolation

no code implementations20 Jul 2022 Jürgen Seiler, Katrin Meisinger, André Kaup

Therefore the signal from the known samples is iteratively projected onto different basis functions in order to generate a model of the signal.

Optimized processing order for 3D hole filling in video sequences using frequency selective extrapolation

no code implementations20 Jul 2022 Jürgen Seiler, Susanne Schöll, Wolfgang Schnurrer, André Kaup

A problem often arising in video communication is the reconstruction of missing or distorted areas in a video sequence.

Spatio-temporal prediction in video coding by best approximation

no code implementations20 Jul 2022 Jürgen Seiler, Haricharan Lakshman, André Kaup

Within the scope of this contribution we propose a novel efficient spatio-temporal prediction algorithm for video coding.

Motion Compensation

Adaptive frequency prior for frequency selective reconstruction of images from non-regular subsampling

no code implementations14 Jul 2022 Jürgen Seiler, André Kaup

The proposed adaptive prior allows for a very high reconstruction quality, yielding gains of up to 0. 6 dB PSNR over the fixed prior, independently of the density of the available samples.

Adaptive joint spatio-temporal error concealment for video communication

no code implementations14 Jul 2022 Jürgen Seiler, André Kaup

In the past years, video communication has found its application in an increasing number of environments.

Multiple Selection Extrapolation for Improved Spatial Error Concealment

no code implementations14 Jul 2022 Jürgen Seiler, André Kaup

This contribution introduces a novel signal extrapolation algorithm and its application to image error concealment.

Spatio-temporal error concealment in video by denoised temporal extrapolation refinement

no code implementations8 Jul 2022 Jürgen Seiler, Michael Schöberl, André Kaup

For this, Non-Local Means denoising is used which is extended by a spiral scan processing order and is improved by an adaptation step for taking the preliminary temporal extrapolation into account.

Denoising

Spatio-temporal prediction in video coding by spatially refined motion compensation

no code implementations8 Jul 2022 Jürgen Seiler, André Kaup

The purpose of this contribution is to introduce a new method of signal prediction in video coding.

Decoder Motion Compensation

Modeling the HEVC Encoding Energy Using the Encoder Processing Time

no code implementations6 Jul 2022 Geetha Ramasubbu, André Kaup, Christian Herglotz

The global significance of energy consumption of video communication renders research on the energy need of video coding an important task.

Video Compression

Fast orthogonality deficiency compensation for improved frequency selective image extrapolation

no code implementations4 Jul 2022 Jürgen Seiler, André Kaup

Since the basis functions are not orthogonal regarding the area of the known samples, the projection does not lead to the real portion a basis function has of the signal.

Multiple Selection Approximation for Improved Spatio-Temporal Prediction in Video Coding

no code implementations4 Jul 2022 Jürgen Seiler, André Kaup

In this contribution, a novel spatio-temporal prediction algorithm for video coding is introduced.

Reusing the H.264/AVC deblocking filter for efficient spatio-temporal prediction in video coding

no code implementations4 Jul 2022 Jürgen Seiler, André Kaup

The prediction step is a very important part of hybrid video codecs for effectively compressing video sequences.

Motion Compensated Frequency Selective Extrapolation for Error Concealment in Video Coding

no code implementations1 Jul 2022 Jürgen Seiler, André Kaup

Although wireless and IP-based access to video content gives a new degree of freedom to the viewers, the risk of severe block losses caused by transmission errors is always present.

Distributed Parallel Image Signal Extrapolation Framework using Message Passing Interface

no code implementations1 Jul 2022 Jürgen Seiler, André Kaup

The proposed framework allows for the application of existing image signal extrapolation algorithms without the need to modify them for a parallel processing.

Optimized and Parallelized Processing Order for Improved Frequency Selective Signal Extrapolation

no code implementations1 Jul 2022 Jürgen Seiler, André Kaup

In this contribution an optimized processing order is proposed for Frequency Selective Extrapolation, a powerful signal extrapolation algorithm.

Optimized Decoding-Energy-Aware Encoding in Practical VVC Implementations

no code implementations27 Jun 2022 Matthias Kränzler, Adam Wieckowski, Geetha Ramasubbu, Benjamin Bross, André Kaup, Detlev Marpe, Christian Herglotz

We show that encoding using our proposed coding tool profiles, the decoding energy efficiency is improved by over 25% with a bit rate increase of less than 5% with respect to standard encoding.

Denoising-based image reconstruction from pixels located at non-integer positions

no code implementations23 May 2022 Ján Koloda, Jürgen Seiler, André Kaup

Digital images are commonly represented as regular 2D arrays, so pixels are organized in form of a matrix addressed by integers.

Denoising Image Reconstruction +1

Scalable Kernel-Based Minimum Mean Square Error Estimator for Accelerated Image Error Concealment

no code implementations23 May 2022 Ján Koloda, Jürgen Seiler, Antonio M. Peinado, André Kaup

In this paper, we propose a novel scalable spatial error concealment algorithm that aims at obtaining high quality reconstructions with reduced computational burden.

Management

Reliability-based Mesh-to-Grid Image Reconstruction

no code implementations20 May 2022 Ján Koloda, Jürgen Seiler, André Kaup

This paper presents a novel method for the reconstruction of images from samples located at non-integer positions, called mesh.

Denoising Image Reconstruction +1

Evaluation of Video Coding for Machines without Ground Truth

no code implementations13 May 2022 Kristian Fischer, Markus Hofbauer, Christopher Kuhn, Eckehard Steinbach, André Kaup

To mitigate this problem, we propose an evaluation method based on pseudo ground-truth data from the field of semantic segmentation to the evaluation of video coding for machines.

Instance Segmentation object-detection +3

Analysis of Neural Image Compression Networks for Machine-to-Machine Communication

no code implementations13 May 2022 Kristian Fischer, Christian Forsch, Christian Herglotz, André Kaup

Video and image coding for machines (VCM) is an emerging field that aims to develop compression methods resulting in optimal bitstreams when the decoded frames are analyzed by a neural network.

Decoder Image Compression +1

Fast Reconstruction of Three-Quarter Sampling Measurements Using Recurrent Local Joint Sparse Deconvolution and Extrapolation

1 code implementation5 May 2022 Simon Grosche, Andy Regensky, Alexander Sinn, Jürgen Seiler, André Kaup

Recently, non-regular three-quarter sampling has shown to deliver an increased image quality of image sensors by using differently oriented L-shaped pixels compared to the same number of square pixels.

Frequency-Selective Geometry Upsampling of Point Clouds

no code implementations3 May 2022 Viktoria Heimann, Andreas Spruck, André Kaup

The demand for high-resolution point clouds has increased throughout the last years.

Resampling Images to a Regular Grid from a Non-Regular Subset of Pixel Positions Using Frequency Selective Reconstruction

no code implementations27 Apr 2022 Jürgen Seiler, Markus Jonscher, Michael Schöberl, André Kaup

Even though image signals are typically defined on a regular two-dimensional grid, there also exist many scenarios where this is not the case and the amplitude of the image signal only is available for a non-regular subset of pixel positions.

SSIM

Increasing Imaging Resolution by Non-Regular Sampling and Joint Sparse Deconvolution and Extrapolation

no code implementations27 Apr 2022 Jürgen Seiler, Markus Jonscher, Thomas Ussmueller, André Kaup

In this paper, we propose a novel image sensor layout which allows for the acquisition of images at a higher resolution and improved quality.

Motion Compensated Three-Dimensional Frequency Selective Extrapolation for Improved Error Concealment in Video Communication

no code implementations27 Apr 2022 Jürgen Seiler, André Kaup

The model generation is conducted by an enhanced version of Three-Dimensional Frequency Selective Extrapolation, an existing error concealment algorithm.

Decoder Motion Compensation +1

A Fast Algorithm for Selective Signal Extrapolation with Arbitrary Basis Functions

no code implementations27 Apr 2022 Jürgen Seiler, André Kaup

Within the scope of this contribution, a novel efficient solution for Selective Extrapolation is presented for utilization with arbitrary basis functions.

Complex-Valued Frequency Selective Extrapolation for Fast Image and Video Signal Extrapolation

no code implementations27 Apr 2022 Jürgen Seiler, André Kaup

Within the scope of this contribution, we introduce the complex-valued Frequency Selective Extrapolation for fast image and video signal extrapolation.

Miscellaneous

A Bitstream Feature Based Model for Video Decoding Energy Estimation

no code implementations21 Apr 2022 Christian Herglotz, Yongjun Wen, Bowen Dai, Matthias Kränzler, André Kaup

In this paper we show that a small amount of bit stream features can be used to accurately estimate the energy consumption of state-of-the-art software and hardware accelerated decoder implementations for four different video codecs.

Decoder

Recursive Frequency Selective Reconstruction of Non-Regularly Sampled Video Data

no code implementations7 Apr 2022 Markus Jonscher, Karina Jaskolka, Jürgen Seiler, André Kaup

In this paper, a new recursive multi-frame reconstruction approach is proposed in order to further increase the reconstruction quality.

Motion Estimation SSIM

Texture-Dependent Frequency Selective Reconstruction of Non-Regularly Sampled Images

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, André Kaup

Hence, a new texture-dependent approach for frequency selective reconstruction is introduced that distributes the number of iterations depending on the texture of the regions to be reconstructed.

Dynamic Non-Regular Sampling Sensor Using Frequency Selective Reconstruction

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, Daniela Lanz, Michael Schöberl, Michel Bätz, André Kaup

The main benefit of the proposed dynamic readout is that for each frame, different sampling points are available which is advantageous since this information can significantly enhance the reconstruction quality of the proposed reconstruction algorithm.

Super-Resolution

Reconstruction of images taken by a pair of non-regular sampling sensors using correlation based matching

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, Thomas Richter, Michel Bätz, André Kaup

Recently, it has been shown that by covering a low resolution sensor with a non-regular sampling mask and by using an efficient algorithm for image reconstruction, a high resolution image can be obtained.

Image Reconstruction

Reconstruction of Videos Taken by a Non-Regular Sampling Sensor

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, Michel Bätz, Thomas Richter, Wolfgang Schnurrer, André Kaup

Recently, it has been shown that a high resolution image can be obtained without the usage of a high resolution sensor.

Reducing Randomness of Non-Regular Sampling Masks for Image Reconstruction

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, Thomas Richter, André Kaup

Recently, it has been shown that it is possible to obtain a high resolution image by covering a low resolution sensor with a non-regular sampling mask.

Image Reconstruction

Declipping of Speech Signals Using Frequency Selective Extrapolation

no code implementations7 Apr 2022 Markus Jonscher, Jürgen Seiler, André Kaup

The reconstruction of clipped speech signals is an important task in audio signal processing to achieve an enhanced audio quality for further processing.

Audio Signal Processing

RFVTM: A Recovery and Filtering Vertex Trichotomy Matching for Remote Sensing Image Registration

no code implementations2 Apr 2022 Ming Zhao, Bowen An, Yongpeng Wu, Huynh Van Luong, André Kaup

In this paper, a robust feature point matching algorithm called Recovery and Filtering Vertex Trichotomy Matching (RFVTM) is proposed to remove outliers and retain sufficient inliers for remote sensing images.

Image Registration

Automatic Registration of Images with Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal

no code implementations2 Apr 2022 Ming Zhao, Yongpeng Wu, Shengda Pan, Fan Zhou, Bowen An, André Kaup

This new approach is designed to address the problems associated with the registration of images with affine deformations and inconsistent content, such as remote sensing images with different spectral content or noise interference, or map images with inconsistent annotations.

Image Registration

A Novel End-To-End Network for Reconstruction of Non-Regularly Sampled Image Data Using Locally Fully Connected Layers

1 code implementation17 Mar 2022 Simon Grosche, Fabian Brand, André Kaup

Altogether, using a three-quarter sampling sensor with our novel neural network layout, the image quality in terms of PSNR for the Urban100 dataset can be increased by 2. 96 dB compared to the state-of-the-art approach.

Super-Resolution

Novel Consistency Check For Fast Recursive Reconstruction Of Non-Regularly Sampled Video Data

no code implementations17 Mar 2022 Simon Grosche, Jürgen Seiler, André Kaup

Altogether, we are able to significantly increase the reconstruction quality by + 1. 01 dB compared to the state-of-the-art recursive reconstruction method using a fixed mask.

Template Matching

Frequency-Selective Mesh-to-Mesh Resampling for Color Upsampling of Point Clouds

no code implementations17 Mar 2022 Viktoria Heimann, Andreas Spruck, André Kaup

Secondly, we propose to apply a novel Frequency-Selective Mesh-to-Mesh Resampling (FSMMR) technique for the interpolation of the points in 2D.

Point Cloud Super Resolution point cloud upsampling +1

Key Point Agnostic Frequency-Selective Mesh-to-Grid Image Resampling using Spectral Weighting

no code implementations15 Mar 2022 Viktoria Heimann, Nils Genser, André Kaup

A state-of-the-art high quality model-based resampling technique is frequency-selective mesh-to-grid resampling which requires pre-estimation of key points.

Super-Resolution

On Intra Video Coding and In-loop Filtering for Neural Object Detection Networks

no code implementations11 Mar 2022 Kristian Fischer, Christian Herglotz, André Kaup

Classical video coding for satisfying humans as the final user is a widely investigated field of studies for visual content, and common video codecs are all optimized for the human visual system (HVS).

Autonomous Driving object-detection +2

Video Coding for Machines with Feature-Based Rate-Distortion Optimization

no code implementations11 Mar 2022 Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup

In this paper, we propose a standard-compliant feature-based RDO (FRDO) that is designed to increase the coding performance, when the decoded frame is analyzed by a neural network in a video coding for machine scenario.

Quantization

Multi-Objective Design Space Exploration for the Optimization of the HEVC Mode Decision Process

no code implementations3 Mar 2022 Christian Herglotz, Rafael Rosales, Michael Glass, Jürgen Teich, André Kaup

Finding the best possible encoding decisions for compressing a video sequence is a highly complex problem.

Modeling the Energy Consumption of HEVC Intra Decoding

no code implementations3 Mar 2022 Christian Herglotz, Dominic Springer, Andrea Eichenseer, André Kaup

Battery life is one of the major limitations to mobile device use, which makes research on energy efficient soft- and hardware an important task.

Decoder

Joint Optimization of Rate, Distortion, and Decoding Energy for HEVC Intraframe Coding

no code implementations3 Mar 2022 Christian Herglotz, André Kaup

This paper presents a novel algorithm that aims at minimizing the required decoding energy by exploiting a general energy model for HEVC-decoder solutions.

Decoder Quantization

Estimating the HEVC Decoding Energy Using the Decoder Processing Time

no code implementations3 Mar 2022 Christian Herglotz, Elisabeth Walencik, André Kaup

This paper presents a method to accurately estimate the required decoding energy for a given HEVC software decoding solution.

Decoder valid +1

Estimation of Non-Functional Properties for Embedded Hardware with Application to Image Processing

no code implementations3 Mar 2022 Christian Herglotz, Jürgen Seiler, André Kaup, Arne Hendricks, Marc Reichenbach, Dietmar Fey

In recent years, due to a higher demand for portable devices, which provide restricted amounts of processing capacity and battery power, the need for energy and time efficient hard- and software solutions has increased.

Decoding-Energy-Rate-Distortion Optimization for Video Coding

no code implementations2 Mar 2022 Christian Herglotz, Andreas Heindel, André Kaup

Finally, measurements of the software decoding process for HEVC-coded bit streams are performed.

Modeling the Energy Consumption of the HEVC Decoding Process

no code implementations1 Mar 2022 Christian Herglotz, Dominic Springer, Marc Reichenbach, Benno Stabernack, André Kaup

To show the modeling capabilities in general, we test the estimation performance for different decoding software and hardware solutions, where we find that the proposed model outperforms the models from literature by reaching frame-wise mean estimation errors of less than 7% for software and less than 15% for hardware based systems.

Design Techniques for Incremental Non-Regular Image Sampling Patterns

no code implementations1 Mar 2022 Simon Grosche, Jürgen Seiler, André Kaup

Even though image signals are typically acquired on a regular two dimensional grid, there exist many scenarios where non-regular sampling is possible.

Position

A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video

no code implementations28 Feb 2022 Andy Regensky, Christian Herglotz, André Kaup

However, the approach does not consider the large field of view of fisheye lenses that requires the consideration of different motion planes in 3D space.

Motion Compensation

Real-Time Frequency Selective Reconstruction through Register-Based Argmax Calculation

1 code implementation28 Feb 2022 Andy Regensky, Simon Grosche, Jürgen Seiler, André Kaup

Frequency Selective Reconstruction (FSR) is a state-of-the-art algorithm for solving diverse image reconstruction tasks, where a subset of pixel values in the image is missing.

Image Reconstruction

Beyond Bjøntegaard: Limits of Video Compression Performance Comparisons

no code implementations25 Feb 2022 Christian Herglotz, Matthias Kränzler, Ruben Mons, André Kaup

For 20 years, the gold standard to evaluate the performance of video codecs is to calculate average differences between ratedistortion curves, also called the "Bj{\o}ntegaard Delta".

valid Video Compression

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

no code implementations7 Feb 2022 Andy Regensky, Christian Herglotz, André Kaup

Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the - in theory arbitrarily mapped - 2D image representation directly.

Learning True Rate-Distortion-Optimization for End-To-End Image Compression

no code implementations5 Jan 2022 Fabian Brand, Kristian Fischer, Alexander Kopte, André Kaup

Even though rate-distortion optimization is a crucial part of traditional image and video compression, not many approaches exist which transfer this concept to end-to-end-trained image compression.

Image Compression MS-SSIM +2

Boosting Neural Image Compression for Machines Using Latent Space Masking

1 code implementation15 Dec 2021 Kristian Fischer, Fabian Brand, André Kaup

Compared to the standard VVC, 41. 4% of bitrate are saved by this method for Mask R-CNN as analysis network on the uncompressed Cityscapes dataset.

Benchmarking Image Compression

Energy Efficient Video Decoding for VVC Using a Greedy Strategy Based Design Space Exploration

no code implementations23 Nov 2021 Matthias Kränzler, Christian Herglotz, André Kaup

IP traffic has increased significantly in recent years, and it is expected that this progress will continue.

4k Decoder

Image Super-Resolution Using T-Tetromino Pixels

no code implementations CVPR 2023 Simon Grosche, Andy Regensky, Jürgen Seiler, André Kaup

Next, we investigate the reconstruction quality using tetromino pixels for the first time in literature.

Image Super-Resolution SSIM

Online Decomposition of Compressive Streaming Data Using $n$-$\ell_1$ Cluster-Weighted Minimization

no code implementations8 Feb 2018 Huynh Van Luong, Nikos Deligiannis, Søren Forchhammer, André Kaup

The proposed decomposition solves an $n$-$\ell_1$ cluster-weighted minimization to decompose a sequence of frames (or vectors), into sparse and low-rank components, from compressive measurements.

Clustering

Benchmarking Super-Resolution Algorithms on Real Data

no code implementations8 Sep 2017 Thomas Köhler, Michel Bätz, Farzad Naderi, André Kaup, Andreas K. Maier, Christian Riess

Therefore, current studies are either evaluated 1) on simulated data or 2) on real data without a pixel-wise ground truth.

Benchmarking Super-Resolution

Distributed Coding of Multiview Sparse Sources with Joint Recovery

no code implementations18 Jul 2016 Huynh Van Luong, Nikos Deligiannis, Søren Forchhammer, André Kaup

In support of applications involving multiview sources in distributed object recognition using lightweight cameras, we propose a new method for the distributed coding of sparse sources as visual descriptor histograms extracted from multiview images.

Object Recognition

Sparse Signal Reconstruction with Multiple Side Information using Adaptive Weights for Multiview Sources

no code implementations22 May 2016 Huynh Van Luong, Jürgen Seiler, André Kaup, Søren Forchhammer

This two-level optimization leads the proposed reconstruction algorithm with multiple SI using adaptive weights (RAMSIA) to robustly exploit the multiple SIs with different qualities.

Compressive Sensing

Cannot find the paper you are looking for? You can Submit a new open access paper.