Windows Sphere: Multi-Modal Operating System Control for Disability Support using Artificial Intelligence

¹ Department of Information Technology, SRM Institute of Science and Technology, Ramapuram, India
² Department of Computational Intelligence, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Chennai, India

^* Corresponding author: gopirajp@srmist.edu.in

Published online: 18 June 2025

Abstract

Most traditional computer systems are based strongly on the standard input devices such as keyboard and mouse and they can pose a huge challenge for people with disabilities. 'Windows Sphere' is a multimodal operating system control system designed to empower individuals with disabilities through the use of artificial intelligence. Two key modules that the system integrates are: a gesture-based control module and a voice driven assistant bot F.R.I.D.A.Y. The gesture-based module allows users with partial hand functionality to operate the operating system with efficiency, thereby reducing the need for standard input devices. At the same time, F.R.I.D.A.Y., a voice recognition-based assistant, allows users without hand functionality to have seamless system control, thus enabling an offline inclusive operating experience. The system provides dual control modalities overcoming the fatigue of using a single input method by allowing additional control modalities. Additionally, the anticipated outcome of this research is a cost-effective AI driven interface that would increase accessibility and autonomy for the user however they have physical capabilities. The focus of this project is on defining a new standard for accessibility through the proposed framework, which offers great potential for extending application beyond its constraints.