Search Results for author: Yuning Jiang

Found 65 papers, 24 papers with code

Multi-Agent Bayesian Optimization with Coupled Black-Box and Affine Constraints

no code implementations2 Oct 2023 Wenjie Xu, Yuning Jiang, Bratislav Svetozarevic, Colin N. Jones

Additionally, the algorithm guarantees an $\mathcal{O}(N\sqrt{T})$ bound on the cumulative violation for the known affine constraints, where $N$ is the number of agents.

A Generalized Stopping Criterion for Real-Time MPC with Guaranteed Stability

no code implementations8 Sep 2023 Kristína Fedorová, Yuning Jiang, Juraj Oravec, Colin N. Jones, Michal Kvasnica

Most of the real-time implementations of the stabilizing optimal control actions suffer from the necessity to provide high computational effort.

Hierarchical Masked 3D Diffusion Model for Video Outpainting

no code implementations5 Sep 2023 Fanda Fan, Chaoxu Guo, Litong Gong, Biao Wang, Tiezheng Ge, Yuning Jiang, Chunjie Luo, Jianfeng Zhan

Our pipeline benefits from bidirectional learning of the mask modeling and thus can employ a hybrid strategy of infilling and interpolation when generating sparse frames.

Image Outpainting

Federated Linear Bandit Learning via Over-the-Air Computation

no code implementations25 Aug 2023 Jiali Wang, Yuning Jiang, Xin Liu, Ting Wang, Yuanming Shi

In this context, we propose a customized federated linear bandits scheme, where each device transmits an analog signal, and the server receives a superposition of these signals distorted by channel noise.

Distributed AC Optimal Power Flow for Generic Integrated Transmission-Distribution Systems

no code implementations25 Aug 2023 Xinliang Dai, Junyi Zhai, Yuning Jiang, Colin N. Jones, Veit Hagenmeyer

Coordination of transmission and distribution power systems is increasingly critical in the context of the ongoing energy transition.

energy management Management

Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks

no code implementations17 Aug 2023 Junkai Qian, Yuning Jiang, Xin Liu, Qing Wang, Ting Wang, Yuanming Shi, Wei Chen

To effectively learn the optimal EV charging control strategy, a federated deep reinforcement learning algorithm named FedSAC is further proposed.


Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized Sentences

no code implementations31 Jul 2023 Dingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge, Yuning Jiang, Qin Jin

To address these limitations, we explore the problem of Few-Shot Stylized Visual Captioning, which aims to generate captions in any desired style, using only a few examples as guidance during inference, without requiring further training.

Image Captioning Language Modelling

Bayesian Optimization of Expensive Nested Grey-Box Functions

no code implementations8 Jun 2023 Wenjie Xu, Yuning Jiang, Bratislav Svetozarevic, Colin N. Jones

We consider the problem of optimizing a grey-box objective function, i. e., nested function composed of both black-box and white-box functions.

Bayesian Optimization

COPR: Consistency-Oriented Pre-Ranking for Online Advertising

no code implementations6 Jun 2023 Zhishan Zhao, Jingyue Gao, Yu Zhang, Shuguang Han, Siyuan Lou, Xiang-Rong Sheng, Zhe Wang, Han Zhu, Yuning Jiang, Jian Xu, Bo Zheng

In this architecture, the pre-ranking model is expected to be a lightweight approximation of the ranking model, which handles more candidates with strict latency requirements.

Edit As You Wish: Video Description Editing with Multi-grained Commands

no code implementations15 May 2023 Linli Yao, Yuanmeng Zhang, Ziheng Wang, Xinglin Hou, Tiezheng Ge, Yuning Jiang, Qin Jin

In this paper, we propose a novel Video Description Editing (VDEdit) task to automatically revise an existing video description guided by flexible user requests.

Video Alignment Video Captioning +1

Primal-Dual Contextual Bayesian Optimization for Control System Online Optimization with Time-Average Constraints

1 code implementation12 Apr 2023 Wenjie Xu, Yuning Jiang, Bratislav Svetozarevic, Colin N. Jones

This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual disturbances.

Bayesian Optimization Gaussian Processes

Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generation

no code implementations CVPR 2023 Chenchen Xu, Min Zhou, Tiezheng Ge, Yuning Jiang, Weiwei Xu

This paper focuses on using the GAN-based model conditioned on image contents to generate advertising poster graphic layouts, which requires an advertising poster layout dataset with paired product images and graphic layouts.

Domain Adaptation

Video Object of Interest Segmentation

no code implementations6 Dec 2022 Siyuan Zhou, Chunru Zhan, Biao Wang, Tiezheng Ge, Yuning Jiang, Li Niu

Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are relevant to the target image.

Semantic Segmentation Video Object Segmentation +1

CONFIG: Constrained Efficient Global Optimization for Closed-Loop Control System Optimization with Unmodeled Constraints

no code implementations21 Nov 2022 Wenjie Xu, Yuning Jiang, Bratislav Svetozarevic, Colin N. Jones

In this paper, the CONFIG algorithm, a simple and provably efficient constrained global optimization algorithm, is applied to optimize the closed-loop control performance of an unknown system with unmodeled constraints.

Distributed data-driven predictive control for cooperatively smoothing mixed traffic flow

1 code implementation24 Oct 2022 Jiawei Wang, Yingzhao Lian, Yuning Jiang, Qing Xu, Keqiang Li, Colin N. Jones

This algorithm achieves both computation and communication efficiency, as well as trajectory data privacy, through parallel calculation.


Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

no code implementations4 Oct 2022 Zixuan Zhang, Yuning Jiang, Yuanming Shi, Ye Shi, Wei Chen

This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments to maximize EV users' benefits.

reinforcement-learning Reinforcement Learning (RL)

Motion Transformer for Unsupervised Image Animation

1 code implementation28 Sep 2022 Jiale Tao, Biao Wang, Tiezheng Ge, Yuning Jiang, Wen Li, Lixin Duan

Image animation aims to animate a source image by using motion learned from a driving video.

Image Animation

Lower Bounds on the Worst-Case Complexity of Efficient Global Optimization

no code implementations20 Sep 2022 Wenjie Xu, Yuning Jiang, Emilio T. Maddalena, Colin N. Jones

In this paper, we study the worst-case complexity of the efficient global optimization problem and, in contrast to existing kernel-specific results, we derive a unified lower bound for the complexity of efficient global optimization in terms of the metric entropy of a ball in its corresponding reproducing kernel Hilbert space~(RKHS).

Geometry Aligned Variational Transformer for Image-conditioned Layout Generation

no code implementations2 Sep 2022 Yunning Cao, Ye Ma, Min Zhou, Chuanbin Liu, Hongtao Xie, Tiezheng Ge, Yuning Jiang

First, self-attention mechanism is adopted to model the contextual relationship within layout elements, while cross-attention mechanism is used to fuse the visual information of conditional images.

Layout Design Object Localization

Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model

no code implementations12 Aug 2022 Xiang-Rong Sheng, Jingyue Gao, Yueyao Cheng, Siran Yang, Shuguang Han, Hongbo Deng, Yuning Jiang, Jian Xu, Bo Zheng

It can be attributed to the calibration ability of the pointwise loss since the prediction can be viewed as the click probability.

Click-Through Rate Prediction

Scheduling Delays and Curtailment for Household Appliances with Deterministic Load Profiles using MPC

no code implementations12 Jun 2022 Yingzhao Lian, Yuning Jiang, Colin N. Jones, Daniel F. Opila

Smart home appliances can time-shift and curtail their power demand to assist demand side management or allow operation with limited power, as in an off-grid application.

Management Scheduling

Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information

no code implementations7 May 2022 Zhipeng Zhang, Xinglin Hou, Kai Niu, Zhongzhen Huang, Tiezheng Ge, Yuning Jiang, Qi Wu, Peng Wang

Therefore, we present a dataset, E-MMAD (e-commercial multimodal multi-structured advertisement copywriting), which requires, and supports much more detailed information in text generation.

Text Generation Video Captioning

Dual-Level Decoupled Transformer for Video Captioning

no code implementations6 May 2022 Yiqi Gao, Xinglin Hou, Wei Suo, Mengyang Sun, Tiezheng Ge, Yuning Jiang, Peng Wang

As for the latter, \textbf{\textit{"couple"}} means treating the generation of visual semantic and syntax-related words equally.

Descriptive Video Captioning

Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs

no code implementations30 Apr 2022 Min Zhou, Chenchen Xu, Ye Ma, Tiezheng Ge, Yuning Jiang, Weiwei Xu

Through both quantitative and qualitative evaluations, we demonstrate that the proposed model can synthesize high-quality graphic layouts according to image compositions.

CapOnImage: Context-driven Dense-Captioning on Image

no code implementations27 Apr 2022 Yiqi Gao, Xinglin Hou, Yuanmeng Zhang, Tiezheng Ge, Yuning Jiang, Peng Wang

Existing image captioning systems are dedicated to generating narrative captions for images, which are spatially detached from the image in presentation.

Dense Captioning Image Captioning

Self-Supervised Text Erasing with Controllable Image Synthesis

no code implementations27 Apr 2022 Gangwei Jiang, Shiyao Wang, Tiezheng Ge, Yuning Jiang, Ying WEI, Defu Lian

The synthetic training images with erasure ground-truth are then fed to train a coarse-to-fine erasing network.

Image Generation

Estimation of Reliable Proposal Quality for Temporal Action Detection

1 code implementation25 Apr 2022 Junshan Hu, Chaoxu Guo, Liansheng Zhuang, Biao Wang, Tiezheng Ge, Yuning Jiang, Houqiang Li

For the region perspective, we introduce Region Evaluate Module (REM) which uses a new and efficient sampling method for proposal feature representation containing more contextual information compared with point feature to refine category score and proposal boundary.

Action Detection

Structure-Aware Motion Transfer with Deformable Anchor Model

1 code implementation CVPR 2022 Jiale Tao, Biao Wang, Borun Xu, Tiezheng Ge, Yuning Jiang, Wen Li, Lixin Duan

Specifically, inspired by the known deformable part model (DPM), our DAM introduces two types of anchors or keypoints: i) a number of motion anchors that capture both appearance and motion information from the source image and driving video; ii) a latent root anchor, which is linked to the motion anchors to facilitate better learning of the representations of the object structure information.

Rapid Scalable Distributed Power Flow with Open-Source Implementation

1 code implementation30 Mar 2022 Xinliang Dai, Yichen Cai, Yuning Jiang, Veit Hagenmeyer

This new variant is characterized by using a reduced modelling method of the distributed AC PF problem, which is reformulated as a zero-residual least-squares problem with consensus constraints.

Over-the-Air Federated Learning via Second-Order Optimization

1 code implementation29 Mar 2022 Peng Yang, Yuning Jiang, Ting Wang, Yong Zhou, Yuanming Shi, Colin N. Jones

To address this issue, in this paper, we instead propose a novel over-the-air second-order federated optimization algorithm to simultaneously reduce the communication rounds and enable low-latency global model aggregation.

Federated Learning

Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning

1 code implementation24 Jan 2022 Wenzhi Fang, Ziyi Yu, Yuning Jiang, Yuanming Shi, Colin N. Jones, Yong Zhou

Under non-convex settings, we derive the convergence performance of the FedZO algorithm on non-independent and identically distributed data and characterize the impact of the numbers of local iterates and participating edge devices on the convergence.

Federated Learning Second-order methods

Move As You Like: Image Animation in E-Commerce Scenario

1 code implementation19 Dec 2021 Borun Xu, Biao Wang, Jiale Tao, Tiezheng Ge, Yuning Jiang, Wen Li, Lixin Duan

Creative image animations are attractive in e-commerce applications, where motion transfer is one of the import ways to generate animations from static images.

Image Animation

Robust Resource-Aware Self-triggered Model Predictive Control

no code implementations1 Dec 2021 Yingzhao Lian, Yuning Jiang, Naomi Stricker, Lothar Thiele, Colin N. Jones

The wide adoption of wireless devices in the Internet of Things requires controllers that are able to operate with limited resources, such as battery life.

Boosting Image Outpainting with Semantic Layout Prediction

no code implementations18 Oct 2021 Ye Ma, Jin Ma, Min Zhou, Quan Chen, Tiezheng Ge, Yuning Jiang, Tong Lin

Secondly, another GAN model is trained to synthesize real images based on the extended semantic layouts.

Image Outpainting Semantic Segmentation

We Know What You Want: An Advertising Strategy Recommender System for Online Advertising

no code implementations25 May 2021 Liyi Guo, Junqi Jin, Haoqi Zhang, Zhenzhe Zheng, Zhiye Yang, Zhizhuang Xing, Fei Pan, Lvyin Niu, Fan Wu, Haiyang Xu, Chuan Yu, Yuning Jiang, Xiaoqiang Zhu

To achieve this goal, the advertising platform needs to identify the advertiser's optimization objectives, and then recommend the corresponding strategies to fulfill the objectives.

Recommendation Systems

Over-the-Air Computation via Reconfigurable Intelligent Surface

no code implementations11 May 2021 Wenzhi Fang, Yuning Jiang, Yuanming Shi, Yong Zhou, Wei Chen, Khaled B. Letaief

Over-the-air computation (AirComp) is a disruptive technique for fast wireless data aggregation in Internet of Things (IoT) networks via exploiting the waveform superposition property of multiple-access channels.

Robust Uncertainty Bounds in Reproducing Kernel Hilbert Spaces: A Convex Optimization Approach

1 code implementation19 Apr 2021 Paul Scharnhorst, Emilio T. Maddalena, Yuning Jiang, Colin N. Jones

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered.

Learning the Best Pooling Strategy for Visual Semantic Embedding

1 code implementation CVPR 2021 Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang

Visual Semantic Embedding (VSE) is a dominant approach for vision-language retrieval, which aims at learning a deep embedding space such that visual data are embedded close to their semantic text labels or descriptions.

Cross-Modal Information Retrieval Retrieval +3

Distributed Optimization for Massive Connectivity

no code implementations10 Jun 2020 Yuning Jiang, Junyan Su, Yuanming Shi, Boris Houska

Massive device connectivity in Internet of Thing (IoT) networks with sporadic traffic poses significant communication challenges.

Action Detection Activity Detection +1

ALADIN-$α$ -- An open-source MATLAB toolbox for distributed non-convex optimization

no code implementations2 Jun 2020 Alexander Engelmann, Yuning Jiang, Henrieke Benner, Ruchuan Ou, Boris Houska, Timm Faulwasser

This paper introduces an open-source software for distributed and decentralized non-convex optimization named ALADIN-$\alpha$.

Distributed Optimization

Controllable Person Image Synthesis with Attribute-Decomposed GAN

2 code implementations CVPR 2020 Yifang Men, Yiming Mao, Yuning Jiang, Wei-Ying Ma, Zhouhui Lian

This paper introduces the Attribute-Decomposed GAN, a novel generative model for controllable person image synthesis, which can produce realistic person images with desired human attributes (e. g., pose, head, upper clothes and pants) provided in various source inputs.

Continuous Control Pose Transfer

DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories

no code implementations17 Feb 2020 Hao Wu, Hanyuan Zhang, Xin-Yu Zhang, Weiwei Sun, Baihua Zheng, Yuning Jiang

We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map.

FoveaBox: Beyound Anchor-based Object Detection

no code implementations ICLR 2020 Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, Lei LI, Jianbo Shi

While almost all state-of-the-art object detectors utilize predefined anchors to enumerate possible locations, scales and aspect ratios for the search of the objects, their performance and generalization ability are also limited to the design of anchors.

object-detection Object Detection

Task-Aware Monocular Depth Estimation for 3D Object Detection

1 code implementation17 Sep 2019 Xinlong Wang, Wei Yin, Tao Kong, Yuning Jiang, Lei LI, Chunhua Shen

In this paper, we first analyse the data distributions and interaction of foreground and background, then propose the foreground-background separated monocular depth estimation (ForeSeE) method, to estimate the foreground depth and background depth using separate optimization objectives and depth decoders.

3D Object Detection 3D Object Recognition +3

Effective Domain Knowledge Transfer with Soft Fine-tuning

no code implementations5 Sep 2019 Zhichen Zhao, Bo-Wen Zhang, Yuning Jiang, Li Xu, Lei LI, Wei-Ying Ma

However, the datasets from source domain are simply discarded in the fine-tuning process.

Transfer Learning

FoveaBox: Beyond Anchor-based Object Detector

6 code implementations8 Apr 2019 Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, Lei LI, Jianbo Shi

In FoveaBox, an instance is assigned to adjacent feature levels to make the model more accurate. We demonstrate its effectiveness on standard benchmarks and report extensive experimental analysis.

Ranked #94 on Object Detection on COCO test-dev (APM metric)

object-detection Object Detection

Acquisition of Localization Confidence for Accurate Object Detection

4 code implementations ECCV 2018 Borui Jiang, Ruixuan Luo, Jiayuan Mao, Tete Xiao, Yuning Jiang

The network acquires this confidence of localization, which improves the NMS procedure by preserving accurately localized bounding boxes.

General Classification object-detection +2

Unified Perceptual Parsing for Scene Understanding

18 code implementations ECCV 2018 Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang, Jian Sun

In this paper, we study a new task called Unified Perceptual Parsing, which requires the machine vision systems to recognize as many visual concepts as possible from a given image.

Scene Understanding Semantic Segmentation

Learning Visually-Grounded Semantics from Contrastive Adversarial Samples

1 code implementation COLING 2018 Haoyue Shi, Jiayuan Mao, Tete Xiao, Yuning Jiang, Jian Sun

Begin with an insightful adversarial attack on VSE embeddings, we show the limitation of current frameworks and image-text datasets (e. g., MS-COCO) both quantitatively and qualitatively.

Adversarial Attack Image Captioning

Repulsion Loss: Detecting Pedestrians in a Crowd

2 code implementations CVPR 2018 Xinlong Wang, Tete Xiao, Yuning Jiang, Shuai Shao, Jian Sun, Chunhua Shen

In this paper, we first explore how a state-of-the-art pedestrian detector is harmed by crowd occlusion via experimentation, providing insights into the crowd occlusion problem.

Ranked #9 on Pedestrian Detection on Caltech (using extra training data)

Pedestrian Detection regression

MegDet: A Large Mini-Batch Object Detector

6 code implementations CVPR 2018 Chao Peng, Tete Xiao, Zeming Li, Yuning Jiang, Xiangyu Zhang, Kai Jia, Gang Yu, Jian Sun

The improvements in recent CNN-based object detection works, from R-CNN [11], Fast/Faster R-CNN [10, 31] to recent Mask R-CNN [14] and RetinaNet [24], mainly come from new network, new framework, or novel loss design.

object-detection Object Detection

What Can Help Pedestrian Detection?

no code implementations CVPR 2017 Jiayuan Mao, Tete Xiao, Yuning Jiang, Zhimin Cao

Aggregating extra features has been considered as an effective approach to boost traditional pedestrian detection methods.

Pedestrian Detection

UnitBox: An Advanced Object Detection Network

no code implementations4 Aug 2016 Jiahui Yu, Yuning Jiang, Zhangyang Wang, Zhimin Cao, Thomas Huang

In present object detection systems, the deep convolutional neural networks (CNNs) are utilized to predict bounding boxes of object candidates, and have gained performance advantages over the traditional region proposal methods.

Face Detection object-detection +2

Learning Deep Face Representation

no code implementations12 Mar 2014 Haoqiang Fan, Zhimin Cao, Yuning Jiang, Qi Yin, Chinchilla Doudou

Our basic network is capable of achieving high recognition accuracy ($85. 8\%$ on LFW benchmark) with only 8 dimension representation.

Face Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.