Webcam · MediaPipe · OVITO · macOS

Control molecules
with your bare hands.

Atomic Hand turns your laptop camera into a controller. Rotate, zoom, and flip through 3D molecular structures in real time — no mouse, no keyboard, just gestures.

See it

Two clips worth a thousand words

The real thing in action, and the sci-fi moment that inspired it.

Atomic Hand in actionRotating and switching molecules by hand.
The inspirationMinority-Report-style hologram interaction.
How it works

A small vocabulary of gestures

MediaPipe tracks 21 hand landmarks per frame; a lightweight engine maps them to camera moves.

01
Open hand + moveRotate the structure
02
Wrist twistSpin around the vertical axis
03
Two hands spread / pinchZoom in and out
04
FistPause tracking
05
Fist + swipe left / rightSwitch to next structure
06
Mouse / keyboardDrag, scroll, arrows as fallback
Get started

Install on your MacBook

Copy, paste, run. Tested with Python 3.11 on macOS. Grant camera permission when prompted.

Prerequisites: macOS with git and conda. No conda? Install Miniconda. No git? Run xcode-select --install first.

# 1. clone
git clone https://github.com/s-choung/atomic-hand.git
cd atomic-hand

# 2. environment (Python 3.11)
conda create -n atomic-hand python=3.11 -y
conda activate atomic-hand

# 3. dependencies
pip install ovito mediapipe==0.10.14 opencv-python PySide6 numpy

# 4. run with the bundled demo molecules
python src/app_window.py structures/*.xyz

Rendering is powered by OVITO's Tachyon ray tracer, which bundles its own Qt/PySide6 — install ovito first and let it pull its dependencies to avoid Qt conflicts.

Good to know

It's an early prototype

Honest expectations before you try it.

Editing is still rough

Viewing gestures (rotate, zoom, switch, pause) are solid. But hands-on editing — like dragging and dropping individual atoms — is experimental and may not behave reliably yet.

Pinned to older versions

The native stack leans on specific, somewhat older releases (e.g. mediapipe==0.10.14). Newer Python or library versions can break the environment, so stick to the versions in the install steps above.

What's next

Roadmap

01
Blender renderingDrive Blender (e.g. the io_mesh_atomic add-on) for higher-fidelity, GPU-accelerated visuals beyond the CPU ray tracer.
02
Stable atom editingReliable drag and drop, plus bond editing.
03
Browser demoCamera and hand tracking fully client-side, no install.