AethericGeometry Turns Hand Gestures Into Music Using a Webcam and Pure Python

A developer has built AethericGeometry, a webcam-based musical instrument that uses hand geometry to generate sound in real time. MediaPipe tracks 21 landmarks per hand, and the shape formed by extended fingertips acts as a polygon whose properties — such as centroid position, area, and vertex count — map directly to musical parameters like pitch, filter cutoff, chord voicing, and reverb. The entire audio engine is written in pure Python from scratch, implementing PolyBLEP oscillators, a TPT filter, and a Schroeder reverb without any external synthesis libraries. Chord ratios are stored as exact fractions rather than decimals to preserve just intonation, since even small floating-point errors cause audible beating between harmonic partials over sustained notes. The project ships as a PyInstaller executable and includes a pytest suite that requires no camera, microphone, or audio hardware to run.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in