Font Style that Fits an Image -- Font Generation Based on Image Context

19 May 2021  ·  Taiga Miyazono, Brian Kenji Iwana, Daichi Haraguchi, Seiichi Uchida ·

When fonts are used on documents, they are intentionally selected by designers. For example, when designing a book cover, the typography of the text is an important factor in the overall feel of the book. In addition, it needs to be an appropriate font for the rest of the book cover. Thus, we propose a method of generating a book title image based on its context within a book cover. We propose an end-to-end neural network that inputs the book cover, a target location mask, and a desired book title and outputs stylized text suitable for the cover. The proposed network uses a combination of a multi-input encoder-decoder, a text skeleton prediction network, a perception network, and an adversarial discriminator. We demonstrate that the proposed method can effectively produce desirable and appropriate book cover text through quantitative and qualitative results.

PDF Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Font Generation Book Cover Dataset Proposed MAE 0.035 # 1
PNSR 21.58 # 1
SSIM 0.876 # 1
Font MSE 0.062 # 1
Color MSE 0.064 # 1

Methods


No methods listed for this paper. Add relevant methods here