pix2code: Generating Code from a Graphical User Interface Screenshot

22 May 2017  ·  Tony Beltramelli ·

Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies)...

PDF Abstract


  Add Datasets introduced or used in this paper

Results from the Paper

 Ranked #1 on Code Generation on 100 sleep nights of 8 caregivers (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Code Generation 100 sleep nights of 8 caregivers anv 14 gestures accuracy 10 # 1


No methods listed for this paper. Add relevant methods here