no code implementations • NIDCP (LREC) 2022 • Juhong Zhan, Yue Jiang, Christopher Cieri, Mark Liberman, Jiahong Yuan, Yiya Chen, Odette Scharenborg
This paper describes our use of mixed incentives and the citizen science portal LanguageARC to prepare, collect and quality control a large corpus of object namings for the purpose of providing speech data to document the under-represented Guanzhong dialect of Chinese spoken in the Shaanxi province in the environs of Xi’an.
no code implementations • 21 Apr 2024 • Yue Jiang, Changkong Zhou, Vikas Garg, Antti Oulasvirta
Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics, and interactive elements such as buttons and menus, but representations of GUIs have not kept up.
no code implementations • 15 Apr 2024 • Yue Jiang, Zixin Guo, Hamed Rezazadegan Tavakoli, Luis A. Leiva, Antti Oulasvirta
From a visual perception perspective, modern graphical user interfaces (GUIs) comprise a complex graphics-rich two-dimensional visuospatial arrangement of text, images, and interactive objects such as buttons and menus.
no code implementations • 11 Mar 2024 • Jiawei Chen, Yue Jiang, Dingkang Yang, Mingcheng Li, Jinjie Wei, Ziyun Qian, Lihua Zhang
We show the different impacts of fine-tuning methods for large models on medical VLMs and develop the most efficient ways to fine-tune medical VLP models.
no code implementations • 10 Jan 2024 • Jiawei Chen, Dingkang Yang, Yue Jiang, Yuxuan Lei, Lihua Zhang
However, most methods in the medical field treat VQA as an answer classification task which is difficult to transfer to practical application scenarios.
no code implementations • 8 Dec 2023 • Yue Jiang, Yueming Lyu, Tianxiang Ma, Bo Peng, Jing Dong
Extensive empirical evaluations demonstrate that the introduced \themodel effectively corrects the racial stereotypes of the well-trained Stable Diffusion model while leaving the original model unchanged.
no code implementations • 7 Nov 2023 • Wenjun Peng, Guiyang Li, Yue Jiang, Zilong Wang, Dan Ou, Xiaoyi Zeng, Derong Xu, Tong Xu, Enhong Chen
In the realm of e-commerce search, the significance of semantic matching cannot be overstated, as it directly impacts both user experience and company revenue.
1 code implementation • 12 Oct 2023 • Yueming Lyu, Kang Zhao, Bo Peng, Yue Jiang, Yingya Zhang, Jing Dong
Based on DeltaSpace, we propose a novel framework called DeltaEdit, which maps the CLIP visual feature differences to the latent space directions of a generative model during the training phase, and predicts the latent space directions from the CLIP textual feature differences during the inference phase.
no code implementations • 7 Oct 2023 • Yue Jiang, Eldon Schoop, Amanda Swearngin, Jeffrey Nichols
Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data.
no code implementations • 3 Oct 2023 • Maryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng, Yue Jiang, Jeffrey Nichols
Recently, Large Language Models (LLMs) have been used for a variety of tasks including automation of UIs, however to our knowledge no one has yet explored their use in controlling assistive technologies for the purposes of supporting accessibility testing.
no code implementations • 29 Sep 2023 • Jie Zhao, Ziyu Guan, Wei Zhao, Yue Jiang, Xiaofei He
Recent works considering professional legal-linguistic style (PLLS) texts have shown promising results on the charge prediction task.
no code implementations • 30 Jul 2023 • Yueming Lyu, Yue Jiang, Bo Peng, Jing Dong
InfoStyler formulates the disentanglement representation learning as an information compression problem by eliminating style statistics from the content image and removing the content structure from the style image.
no code implementations • 26 Jun 2023 • Yueming Lyu, Yue Jiang, Ziwen He, Bo Peng, Yunfan Liu, Jing Dong
The privacy and security of face data on social media are facing unprecedented challenges as it is vulnerable to unauthorized access and identification.
no code implementations • 11 Oct 2022 • Yue Jiang, Marc Habermann, Vladislav Golyanik, Christian Theobalt
Furthermore, we show that HiFECap outperforms the state-of-the-art human performance capture approaches qualitatively and quantitatively while for the first time capturing all aspects of the human.
1 code implementation • 30 Jun 2022 • Bo Peng, Wei Xiang, Yue Jiang, Wei Wang, Jing Dong, Zhenan Sun, Zhen Lei, Siwei Lyu
There is a two-party game between DeepFake creators and defenders.
no code implementations • 23 Feb 2022 • Yue Jiang, Wolfgang Stuerzlinger, Christof Lutteroth
Furthermore, it can be used to detect and fix problems in legacy UIs, extend UIs with enhanced layout behaviours, and support the creation of flexible UI layouts.
1 code implementation • 15 Feb 2022 • Meng Zhou, Xin Li, Yue Jiang, Lidong Bing
Prompting shows promising results in few-shot scenarios.
no code implementations • 15 Sep 2021 • Yunyao Zhu, Stephen Hahn, Simon Mak, Yue Jiang, Cynthia Rudin
Algorithmic harmonization - the automated harmonization of a musical piece given its melodic line - is a challenging problem that has garnered much interest from both music theorists and computer scientists.
1 code implementation • 23 Feb 2020 • Yue Jiang, Wolfgang Stuerzlinger, Matthias Zwicker, Christof Lutteroth
OR-constrained (ORC) graphical user interface layouts unify conventional constraint-based layouts with flow layouts, which enables the definition of flexible layouts that adapt to screens with different sizes, orientations, or aspect ratios with only a single layout specification.
no code implementations • 17 Dec 2019 • Yue Jiang, Ruofei Du, Christof Lutteroth, Wolfgang Stuerzlinger
We propose a novel approach for constraint-based graphical user interface (GUI) layout based on OR-constraints (ORC) in standard soft/hard linear constraint systems.
Human-Computer Interaction Graphics
1 code implementation • CVPR 2020 • Yue Jiang, Dantong Ji, Zhizhong Han, Matthias Zwicker
We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs).
Ranked #1 on Single-View 3D Reconstruction on ShapeNet (using extra training data)