← Work
Aisle Be There app icon, a blue chevron.

Aisle Be There

An iOS app that guides blind and low-vision people through a whole errand, from the street to the shelf.

Role
Voice and guidance engineer
Team
Alex Xiang
Tyler Jiang
Alan Chung
Dates
Sep 2026
SteelHacks XIII, NVIDIA "Beyond the Chatbot" track
Tools
React Native
Swift
ARKit
CoreML
Vision OCR
ElevenLabs
Field test in a grocery store: the shopper and the live app, side by side.

Maps gets you to the address, then goes quiet. Aisle Be There covers the rest of the errand, from the sidewalk to the item on the shelf, on the phone a blind person already owns: no beacons, no store partnership, no extra hardware. Four of us built it in one weekend at SteelHacks XIII and field-tested it in a real grocery store.

One errand, three handoffs

  1. Walk there: route geometry and haptic nudges.
  2. Find the aisle: the camera reads signs and shelves.
  3. Reach for it: hand tracking closes the last foot.

Each handoff happens automatically; the user never picks a mode.

The same search from the shopper's side.

My part: the voice and the fail-safes

I owned the voice layer and the fail-safes. The user can't look at the screen, so every output is audio or haptic, and every input can be a held button and a sentence. Two fail-safes: a 2-minute handoff to store staff, and no guessing on unverified WALK signals.

The voice follows strict rules. On course, it stays silent. When it speaks, it uses twelve words at most. Six words are banned outright, including "safe", "go" and "cross now". A build check fails if any line would speak them.

All 508 phrases are synthesized ahead of time with ElevenLabs and shipped inside the app, so a cue never waits on the network.

pre-rendered phrases
508
median phrase length
2.7 s
phrases at or under 3 s
433 / 508
70<1.5 s521.5 s702.0 s2412.5 s673.0 s53.5 s34.0+ sseconds of speech
Spoken length of all 508 phrases. A cue longer than about three seconds is one the walker has already outrun.

Team: Alex Xiang, Tyler Jiang, Alan Chung