In this paper, we present a novel text-based augmented reality system that performs optical character recognition on natural images and replaces the recognized texts with other informative contents. For the goal, we implement text detection and recognition functions, and develop an image augmentation algorithm for the realistic contents replacement. To be precise, we reconstruct background with a linear interpolation method and insert new contents to the reconstructed backgrounds. Finally, we get natural results by applying proper geometric distortions to them. In order to reduce visual artifacts caused by noisy boundaries, we also develop an optimal path selection method based on dynamic programming. Experimental results show that our method provides very natural results and runs in real-time even in mobile devices.
['Hyung Il Koo', 'Beom Su Kim', 'Young Ki Baik', 'Nam Ik Cho']
Fast and simple text replacement algorithm for text-based augmented reality