REAL TIME OBJECT DETECTION FOR BLIND PEOPLE

Good vision is a precious gift but unfortunately loss of vision is becoming common now a days. To help the blind people the visual world has to be transformed into the audio world with the potential to inform them about objects as well as their spatial locations. Objects detected from the scene are represented by their names and converted to speech. The blind people’s spatial locations are encoded into 2-channel audio with the help of 3D binaural sound simulation. Video is captured with a portable camera device on the client side, and is streamed to the server for real-time image recognition with existing object detection models. The 3D location of the objects is estimated from the location and the size of the boundary boxes from the detection algorithm. Then, a 3D sound generation application based on unity game engine renders the binaural sound with locations encoded.