Can ChatGPT advance software testing intelligence? An experience report on metamorphic testing

no code implementations • 30 Oct 2023 • Quang-Hung Luu, Huai Liu, Tsong Yueh Chen

We show that ChatGPT can be used to generate new correct MRs to test several software systems.

Chatbot

Using Metamorphic Relations to Verify and Enhance Artcode Classification

no code implementations • 5 Aug 2021 • Liming Xu, Dave Towey, Andrew French, Steve Benford, Zhi Quan Zhou, Tsong Yueh Chen

An approach to software testing that alleviates the oracle problem is metamorphic testing (MT).

Classification Image Classification

Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing

1 code implementation • CVPR 2021 • Yuanyuan Yuan, Shuai Wang, Mingyue Jiang, Tsong Yueh Chen

MetaVQA checks whether the answer to (i, q) satisfies metamorphic relationships (MRs), denoting perception consistency, with the composed answers of transformed questions and images.

Benchmarking DNN Testing +2

Use of Metamorphic Relations as Knowledge Carriers to Train Deep Neural Networks

no code implementations • 10 Apr 2021 • Tsong Yueh Chen, Pak-Lok Poon, Kun Qiu, Zheng Zheng, Jinyi Zhou

Based on the concept of metamorphic testing and MRs (which play the role of a test oracle in software testing), we make use of the notion of metamorphic group of inputs as concrete instances of MRs (which are abstractions of knowledge) to train a DNN in a systematic and effective manner.