Capture systems

Observe interaction in context.

Connect what people see, how they move and what they touch.

Observation & action

Complementary perspectives.

First-person vision, spatial context and contact-rich demonstrations.

Lightweight monocular egocentric camera used for first-person data collection01 / Capture system

Field-ready RGB + IMU

Monocular capture

Scalable first-person activity and manipulation capture.

Capture specifications

  • First-person RGB: 1080p at 30 FPS
  • 180° horizontal field of view
  • 9-DOF IMU at 562.5 Hz
  • Camera–IMU sync: <1 ms

Outputs

RGB videoIMUTimestampsCalibration
Global-shutter stereo egocentric headset used for synchronized dual-view collection02 / Capture system

Global-shutter dual RGB + IMU

Stereo capture

Synchronized dual-view capture for spatial learning.

Capture specifications

  • Dual global-shutter RGB cameras
  • Up to 1080p at 60 FPS
  • Up to 194° horizontal field of view
  • IMU sampling up to 1 kHz

Outputs

Synchronized left/right RGBIMUTimestampsCalibration
Portable visuotactile manipulation gripper used for UMI-style data collection03 / Capture system

Pose + gripper + tactile + RGB

UMI capture

Contact-rich manipulation demonstrations in real settings.

Capture specifications

  • Global-shutter RGB at 30 FPS
  • Visual-inertial device pose
  • Gripper-opening state
  • 3D tactile force at 30 FPS

Outputs

RGBDevice poseGripper stateTactile forceTimestamps