(1)
AirTouch
AirTouch Overview:
AirTouch is a sophisticated, native macOS menu bar application that transforms your hand into a high-precision neural interface. By bridging a robust Swift presentation layer with a Python inference engine, the system achieves a Vision Pro-like interaction paradigm directly on your Mac.
Key Features
Native macOS App • Swift
Computer Vision Engine • Python
MediaPipe Integration • Hand landmark detection
Gesture Heuristics • pinch-to-click and swipe navigation
Year
2024
Role
AI / Computer Vision Engineer Design Engineer Software Engineer • Backend
Resources
Objectives:
Deliver high-fidelity cursor control with sub-pixel precision.
Implement smart neural gestures for intuitive pinch-to-click and swipe navigation.
Ensure 100% on-device inference for absolute privacy and security.
Optimize tracking pipeline for 60+ FPS on Apple Silicon.
Create a minimal, native macOS menu bar experience.
Scope of Work:
Our development process for AirTouch focused on blending advanced AI with native OS integration:
Architecture Design: Structuring a hybrid microservices approach using Swift for UI and Python for computer vision.
Vision Pipeline: Integrating Google MediaPipe for sub-millisecond hand landmark detection.
Interaction Tuning: Applying dual-stage Kalman Filtering to mitigate camera noise and ensure butter-smooth cursor stability.
Native Integration: Building a seamless AppKit/SwiftUI menu bar interface with full Apple Security compliance.
Gesture Engineering: Mapping complex hand movements to actionable OS commands like right-click, swipe, and volume dials.
Performance Optimization: Tuning the neural engine to maintain high framerates and low latency on macOS.
A sophisticated neural interface that feels like a natural extension of your body, providing a glimpse into the future of spatial computing on the Mac.
- Get in touch.
- Get in touch.
- Get in touch.
- Get in touch.
- Get in touch.
- Get in touch.
