Smart Multilingual Sign Boards

Abstract

The Project is based on design & implementation of smart hybrid system for street sign boards recognition, text and speech conversions through character extraction and symbol matching. The default language use to pronounce signs on the street boards is English. Here we are proposing a novel method to convert identified character or symbol into multiple languages like Hindi, Marathi, Urdu, etc. This Project is helpful to all starting from the visually impaired, the tourists, the illiterates and all the people who travel. The system is accomplished with the speech pronunciation in different languages and to display on screen. This Project has a multidisciplinary approach as it belongs to the domains like computer vision, speech processing, & Google cloud platform. Computer vision is used for character and symbol extraction from sign boards.Speech processing is used for text to speech conversion. GCP is used for multiple language conversion of original extracted text. Further programming is done for real time pronunciation and displaying desired output.