overTHERE app for iPhone and iPad

overTHERE is a unique accessibility app that helps blind individuals explore and interact with the surrounding environment by using virtual audible signs. overTHERE uses a unique line-of-sight algorithm that lets you point the phone in your hand in any direction to hear the nearest Places as Virtual Talking Signs. When pointing straight at a virtual sign the speech is loud and clear, but as you point away from it, the speech starts to get staticky, so you have quick audio feedback about the exact location of the virtual talking sign.

Holding the phone horizontally lets you explore your surroundings using the virtual talking signs interface, but when the phone is held vertically you can use the screen or VoiceOver to review the list of signs around you. By selecting a sign from the list you can access details about a location such as its address, phone number, or web site.

overTHERE even lets you create your own virtual talking signs, so you can mark special locations that might otherwise be difficult to find again.

This app grew out of Smith-Kettlewell’s Virtual Talking Signs Project and demonstrates the power of this non visual, augmented-reality interface.

Our proof of concept premiered at the Bay Area Makeathon (September 11-13, 2015), where it was recognized with the event’s Improved Mobility Award.

Visit the developer’s website to learn more about overTHERE, its features, and How it works. Follow @overTHERE4iOS to stay up to date on overTHERE news and connect with other users.