VisionOS

Assistive hardware / Early prototype

More of the world.
Within reach.

Wearable assistance for finding everyday objects, understanding surroundings, and taking part, for blind and low-vision people.

Explore the prototype Our mission

Early-stage prototype · Built at Cal Hacks

VisionOS prototype: a pink enclosure connected by cables to a curved wearable assembly with actuators, resting on a white chair.
VisionOS hardware: enclosure and wearable assembly.

01 / Our mission

Everyday moments.
More room to participate.

Finding your cup. Following a shared moment. Choosing what comes next.

Our mission is to make useful context more accessible through sound and wearable feedback, while keeping the person in control. We’re starting with small, everyday tasks and building from there.

02 / What we’re building

Support for the little things
that open up bigger things.

Close-up of the wearable hardware’s curved black band, blue servo actuators, white actuator arms, and wiring.

01

Find what you’re
looking for.

Ask for an everyday object. The prototype identifies and tracks a target, then uses available hand and depth information to guide a reach.

Object finding + hand guidance

Prototype capability. Performance depends on camera view, depth quality and the test setup.

02

Understand the scene.

Ask what’s around you and hear a description of the visible scene. Audio makes the result available without needing to look at a screen.

03

Stay in the moment.

We’re exploring ways to explain recent visible events, so shared experiences can come with more context. This direction is still being developed.

03 / The technology

A camera sees. AI interprets.
Guidance reaches you.

The wearable is the product we’re building. The camera and laptop support today’s prototype.

  1. 01 / Capture

    A view of the scene

    An iPhone supplies the camera feed and available depth information.

  2. 02 / Understand

    Context, on request

    The laptop processes vision and voice requests, connecting scene analysis with object tracking.

  3. 03 / Respond

    Sound + wearable feedback

    Audio explains the result. The hardware work brings physical feedback into the loop.

Current prototype setup: iPhone camera · laptop microphone and audio · wearable hardware

A closer look at the hardware.

Close-up of the pink VisionOS enclosure with the VisionOS name, black straps, and connected wiring.
The VisionOS enclosure.
Another angle of the connected VisionOS prototype, showing the pink enclosure alongside the wearable actuator assembly.
The connected hardware assembly.

04 / Our story

Built with curiosity.
Driven by purpose.

We started VisionOS at Cal Hacks with a question: how can AI move beyond a screen and offer useful help in the physical world?

We’re a team building an early assistive-hardware prototype. Our next step is to learn from blind and low-vision people, accessibility practitioners, and hardware collaborators, so the problems we work on reflect real priorities.

Follow the build on GitHub

Let’s build something useful.

Help shape what
comes next.

Have a perspective, a question, or an idea for collaboration?
We’d like to hear from you.

Get involved on GitHub