← All work

Project 04 · visionOS · ARKit

AirPods media controls

Pick up your AirPods case and your music controls are right there. Apple Vision Pro recognizes the case and puts play, pause and skip on it. No window to find, nothing to open.

Role
Concept, prototyping, film
Platform
visionOS · ARKit · Create ML
Timeline
2026
Status
Demo
FilmRecorded on Apple Vision Pro. 26 seconds, with sound.

01The idea

Controls where your hand already is.

When you’re listening on AirPods, the case is often already in your hand. So why go looking for a window to skip a song? With Vision Pro, the case itself can be the remote.

02How it works

Hold it, tilt it, open it.

  • Hold the closed case and the song’s album art floats just above it.
  • Tilt it forward to skip to the next song. Tilt it back to go to the previous one.
  • Open the case and the full controls appear: the song, a scrubber, back, play/pause and forward.
  • Put it away and the controls fade. There’s nothing to dismiss.
Album art floating above a closed AirPods case held in a hand
1 · HoldAlbum art above the case
A skip-forward arrow appears on the album art as the case tilts
2 · Tilt forwardNext song
A skip-back arrow appears on the album art as the case tilts the other way
3 · Tilt backPrevious song
An open AirPods case with a Now Playing card above it: song, scrubber, back, pause and forward
4 · OpenThe full controls

03Decisions

Quick beats complete.

The point is speed. Every choice was about making the most common actions take the least effort.

Decision 01

Closed for quick, open for everything.

Most of the time you just want to see what’s playing or skip. The closed case does exactly that. Opening it is a natural “I want more,” so that’s when the full controls show up. I trained two reference objects, one open and one closed, so Vision Pro can tell them apart.

Chose
Two states for two jobs
Over
The same panel every time

Decision 02

Tilt forward and back, not side to side.

Left and right felt like the obvious gesture. But rolling the case sideways barely changes its outline from where you’re standing, so Vision Pro couldn’t reliably tell it had moved. Forward and back it reads every time.

Chose
Forward = next, back = previous
Over
Left and right

Decision 03

A small tilt is enough.

A skip fires at just 8 degrees, so a quick flick of the wrist does it. An arrow starts to appear on the album art before that, so you can see a skip coming. It won’t fire again until you bring the case back to level.

Chose
A small flick, with a preview
Over
A big, deliberate turn

04Next

More gestures, same case.

[What you’d try next: volume, play/pause without opening, other Apple devices.]

Your music controls, right in your hand.