Single Pilot Cockpit

Overview

Desiged and built a proof-of-concept solution in collaboration with Boeing, as part of a design project at NUS IDP. The solution combines smart glasses and an automated cockpit switch system, to enable a single pilot to operate with the same efficiency and safety of a traditional two-pilot setup.

Key Contributions

• Engaged Boeing engineers and pilots to understand real-world cockpit workflows and identify opportunities for innovation.
  • Mapped pilot needs into solution requirements with a strong emphasis on safety, usability, and redundancy.
• Conceptualised smart glasses:
  • Overlay critical information such as checklist items and warnings in the pilot’s field of view.
  • Monitor the pilot’s blinking activity and activate vibration-based alerts if signs of drowsiness are detected (eyes closed for over 10s).
  • Use camera and computer vision to detect procedural errors and alert the pilot.
• Conceptualised automated switch system:
  • Execute cockpit checklists upon pilot approval, with manual override for safety.
• Sourced and integrated all electronic components for the prototype: microcontrollers, mini LCD display, vibration motor, motion sensor, video camera, buttons & switches, actuators.
• Trained a computer vision model (YoloV8) to recognise cockpit switch states as a non-intrusive way to detect pilot errors.
• Implemented all digital functionality of smart glasses and switch system:
  • Electronic circuitry
  • Microcontroller firmware to interface with components
  • Offloading computer vision
  • OLED display content (using Arduino libraries)
  • Interface between smart glasses and switch system

Outcomes

• Improved pilot situational awareness and focus on high-level decision making by offloading lower-level visual and mechanical tasks.
• Reduced checklist completion time by 40% using the automated switch system.
• Monitor pilot alertness and procedural validation, currently roles of a co-pilot.