MoveMedia | Tim Arterbury

MoveMedia is an accessibility prototype our team of 3 created in Baylor University's HCI Accessibility class in 2019. It allows a user to control macOS media player functions using gestures of their foot. The prototype used a PlayStation Move controller as the motion sensing hardware which was strapped to a shoe. We wrote a program in C which interfaced with the IMU in the PlayStation Move controller (via the PS Move API), recognized 9 foot gestures, and translated those gestures into media player commands for macOS such as play/pause, volume up/down, etc.

See source code on GitHub

Volume Down

A foot wearing a shoe with a PlayStation Move motion controller taped to it. The foot is being pointed downwards towards the floor.

Neutral

A foot wearing a shoe with a PlayStation Move motion controller taped to it. The foot is flat on the floor.

Volume Up

A foot wearing a shoe with a PlayStation Move motion controller taped to it. The foot's heel is touching the floor while the toe part is tilting up.

Skip/Seek Backward

A foot wearing a shoe with a PlayStation Move motion controller taped to it. The leg is being swung to the user's left.

Neutral

Skip/Seek Forward

A foot wearing a shoe with a PlayStation Move motion controller taped to it. The leg is being swung to the user's right.

The prototype supported the following gestures and media commands:

Gestures	Media Commands
Vertical foot tap	Toggle play/pause
Tilt foot up and back to neutral	Increase volume by one unit
Tilt foot up and hold	Increase volume by multiple units until returning to neutral gesture
Tilt foot down and back to neutral	Decrease volume by one unit
Tilt foot down and hold	Decrease volume by multiple units until returning to neutral gesture
Swing leg right and back to neutral	Skip forward to next media item
Swing leg right and hold	Scrub forward through media timeline
Swing leg left and back to neutral	Skip backward to previous media item
Swing leg left and hold	Scrub backward through media timeline