← Back to portfolio

Advanced Virtual Painter

AI-Powered Hand Gesture Drawing Application

Overview

MediaPipe hand landmarks, gesture-based drawing, AI shape completion (circles/rectangles), voice commands, and flood fill—30+ FPS.

Problem

Traditional digital drawing requires physical input devices. Users desire hands-free, gesture-based drawing with AI-assisted shape completion.

Solution

Webcam feeds into MediaPipe hand tracking (21 landmarks). Index finger up draws on canvas. Two fingers up selects colors (red, green, blue, yellow, purple, white, black) and tools. Three fingers up triggers AI shape completion — fitting circles via least-squares or detecting rectangles via convex hull. Voice commands ("red", "clear", "save", "undo") provide hands-free control. Flood fill uses queue-based algorithm for enclosed areas.

Technologies

  • Python 3.7
  • MediaPipe
  • OpenCV
  • SpeechRecognition
  • pyttsx3
  • NumPy

Results

30+ FPS real-time gesture recognition. 95%+ hand landmark accuracy. Supports 7 colors, 5 tools, 5 brush sizes, 20-level undo/redo. Cross-platform on Windows, macOS, Linux.