AIILA▌

NEURAL INTERFACE TERMINAL — WORKBENCH EDITION v2.4.1

[ GITHUB REPO ] [ VIEW DOCS ]
KERNEL NOMINAL
AR ONLINE
VOICE READY

What Is AIILA?

AR Workbench

Design and build complex electronics circuits directly in mid-air using augmented reality. Interact with virtual components as if they were real.

Gesture Control

Control the entire system with intuitive hand gestures. No mouse, no keyboard – just your hands for seamless interaction.

AI-Powered

Leveraging Google Gemini Vision for object scanning and Gemini Flash 2.0 for voice commands, AIILA provides an intelligent, responsive experience.

Gesture Reference

Master AIILA's intuitive hand gesture system. Priority indicates how quickly the system detects and acts on the gesture.

Icon Gesture How to Perform What It Does
THROW Make a fist, then open hand fast Cast/project screen (Priority: 100)
CLAW ROTATE Form a claw shape, twist wrist Rotate selected component (Priority: 90)
CRUMPLE Two hands open wide, then close into fists Delete a component (Priority: 80)
TWO-HAND ROTATE Both hands in frame, rotate them Rotate view/component (Priority: 70)
SWIPE Open hand, move left/right/up/down Navigate between pages/layers (Priority: 60)
PINCH Bring thumb + index finger together Grab & drag circuit components (Priority: 40)
DWELL Point with index finger, hold still Place a component or select it (Priority: 30)
PEACE ✌ Index + middle finger extended Cycle through AR modes (Default → Draw → Inspect → Measure) (Priority: 20)

Technical Details:

  • > EMA (Exponential Moving Average) smoothing for stability
  • > 21 MediaPipe hand landmarks tracked per hand, up to 2 hands simultaneously
  • > Confidence threshold: 45% minimum to fire a gesture event
  • > Debounce system prevents accidental double-fires

Circuit Component Catalog

Explore over 80 virtual electronics components across 11 categories. Hover to see components in each category.

MCU (Microcontrollers)

6 Components

MCU Components:

  • ESP32
  • Arduino Uno
  • Arduino Nano
  • ESP8266
  • Raspberry Pi Pico
  • STM32

Passives

5 Components

Passives Components:

  • Resistors (1kΩ, 10kΩ)
  • Capacitors (ceramic, electrolytic)
  • Inductors
  • Potentiometer
  • Crystal

LEDs

6 Components

LED Components:

  • Red, Green, Blue, Yellow LEDs
  • RGB LED
  • WS2812 NeoPixel
  • NeoPixel Strip

Sensors

12 Components

Sensor Components:

  • DHT22/DHT11 (temp/humidity)
  • BMP280 (pressure)
  • BME680 (air quality)
  • DS18B20
  • LDR
  • PIR
  • HC-SR04 (ultrasonic)
  • MPU6050/MPU9250 (IMU)
  • Soil Moisture
  • MQ-2 (gas)
  • TCS3200 (color)
  • IR Receiver

Displays

5 Components

Display Components:

  • OLED (SSD1306)
  • LCD 16x2
  • LCD I2C
  • TFT 128x160
  • ePaper

Actuators

9 Components

Actuator Components:

  • Servo, 360 Servo
  • Stepper Motor
  • DC Motor
  • Buzzer (active/passive)
  • Relay, 4-Channel Relay
  • L298N Motor Driver
  • L9110S
  • Solenoid

Communication

8 Components

Communication Components:

  • nRF24L01
  • HC-05/HC-06 Bluetooth
  • LoRa
  • SIM800L (GSM)
  • ESP-01 WiFi
  • MCP2515 (CAN)
  • MAX485 (RS-485)

Power

7 Components

Power Components:

  • 5V/12V PSU
  • 3.3V Regulator
  • LM7805
  • LiPo Battery
  • 9V Battery
  • TP4056 Charger
  • MT3608 Boost

Input

6 Components

Input Components:

  • Push Button
  • Toggle Switch
  • Rotary Encoder
  • Joystick
  • 4x4 Keypad
  • 4x3 Keypad
  • TTP223 Touch

Semiconductors

6 Components

Semiconductor Components:

  • NPN/PNP Transistors
  • N/P-Channel MOSFETs
  • 1N4007
  • Schottky
  • Zener
  • Optocoupler
  • TL431

Connectors

5 Components

Connector Components:

  • GND, VCC
  • 2-Pin/3-Pin Headers
  • Screw Terminal
  • USB-C

System Architecture

A high-level overview of AIILA's modular design and data flow.

Camera
MediaPipe
VisionEngine
GestureEngine
GeminiFlash2.5
AIILAKernel
CircuitEngine
VoiceEngine
AR Overlay
GeminiFlash2.0
UI (PyQt6)
ProjectorWindow

Features Deep-Dive

Advanced Wire Routing

AIILA's circuit engine offers precise and intuitive wire routing capabilities:

  • Pin-to-pin routing: Connect any GPIO pin with exact precision.
  • Manhattan paths: Wires adhere to orthogonal (horizontal/vertical) paths for clean layouts.
  • Named GPIO pins: Easily identify and connect to specific pins on components.
  • Wire preview: See the wire path before finalizing the connection.

Real-time Circuit Simulation

Experience your virtual circuits come alive with real-time simulation:

  • Live sensor data: Integrate with virtual sensors to see dynamic readings.
  • LED animations: Observe LEDs light up, dim, and change color as per your circuit logic.
  • Interactive feedback: Witness the immediate effects of your circuit design changes.

Robust Undo/Redo Stack

Never fear making mistakes with AIILA's comprehensive undo/redo system:

  • 20 levels of history: Revert or re-apply up to 20 previous actions.
  • Non-destructive editing: Experiment freely with your circuit designs.
  • Seamless integration: Undo/redo actions apply to component placement, wiring, and property changes.

Thread-Safe Engine with RLock

AIILA is built for stability and performance, even with complex interactions:

  • Concurrent operations: Perform multiple actions simultaneously without data corruption.
  • RLock protection: Ensures critical sections of the code are safely accessed by multiple threads.
  • Responsive UI: The augmented reality and desktop interfaces remain fluid and responsive during heavy processing.

Persistent Circuit Management

Save and load your intricate circuit designs with ease:

  • JSON format: Circuits are saved as human-readable and editable JSON files.
  • Quick access: Load your projects instantly and pick up where you left off.
  • Portable designs: Share your circuit creations with others by simply sharing the JSON file.

Installation / Getting Started

Get AIILA up and running on your system. Follow these terminal commands.

git clone https://github.com/plgdin/AIILA_Kernel.git cd AIILA_Kernel pip install -r requirements.txt
# Add your API key to .env: # GEMINI_API_KEY=your_key_here
python main.py

Tech Stack & Requirements

The core technologies powering the AIILA experience.

Core Dependencies

  • Python 3.13/3.14
  • OpenCV (opencv-python)
  • NumPy — array math
  • MediaPipe — hand tracking
  • PyQt6 — desktop UI

AI / APIs

  • google-genai — Gemini 2.0/2.5
  • openai (optional)
  • elevenlabs (optional TTS)

Audio

  • SpeechRecognition — mic input
  • sounddevice + soundfile
  • pyttsx3 — TTS
  • pydub — audio processing

UI Enhancements

  • customtkinter (alternative UI)
  • Pillow (PIL) — image processing
  • darkdetect — theme detection

Technology Overview

Categorical distribution of key technologies.