Mike Kassam
Consumer Products/Applications
With the advent of smart sensors (e.g. MEMsic Accelerometers & Gyroscope, Magnetic, InfraRed, etc.), the use of such miniaturized sensors is increasing in popularity in specialized gadgets to improve the quality of life of physically challenged kids and adults who are paralyzed from neck down or suffering from other severe physical limitations. The use of personal computer or gaming devices that require use of a pointing device (e.g. mouse) is never a problem for most individuals, and the mobility skill required to operate a mouse is taken for granted. However, for person with reduced motor skills, such an essential pointing device can be extremely challenging to navigate if at all. Thus, some sort of an intelligent “Mouse” emulator, properly designed (with rudimentary Artificial Intelligence - AI). can potentially provide an effective solution to allow a physically-challenged person to emulate a mouse as long as the individual is able to move a single part of his/her body, like the head. Such an intelligent “Mouse” emulator system could make use of Microsoft’s standard mouse protocol via the direct USB interface (or wireless Bluetooth link) to facilitate “Plug-and-Play” without need for any custom mouse driver and/or an App running on a Personal Computer (PC) side.
The key objective is to create and develop a low-cost intelligent “Mouse” emulator system that could incorporate modified headband, or any type of wearable mechanical support, with sensors mounted on it, to enable a physically challenged user to effectively navigate the mouse pointer by tilting & rotating his/her head. In order to make the mouse interface seamless and reliable for the physically-challenged user, the design should incorporate proper algorithms to emulate the mouse functions while minimizing spurious head-movements to not adversely affect the operation of any PC applications. In keeping with good engineering practices, at least two alternate designs (approaches) should be investigated from which the best design approach can be rationalized by the EDP Group for eventual implementation.
The “Mouse” emulator system incorporates the following:
• Head motion sensing technologies (digital and/or analog) and associated electronics to reliably measure and monitor tilt-angles and movements.
• Use of lower power embedded microcontrollers for local sensor interface on the head harness, and for the base station unit.
• Wireless one-way data link between Head sensors and Base Station.
• USB interface between base-unit and PC, with Plug-and-Play based on Microsoft’s standard mouse protocol. That is, the base station unit seamlessly emulates the mouse-PC communication protocol used by a standard mouse. Investigate the use of wireless Bluetooth link to replace/bypass the physical USB connection.
• A Puff-Sip straw switch (may be provided) or any alternate approach (e.g. use of cheek muscle "pinching" movement) that could allow the user to control the “click” & “double-click” functions.
• Demonstrate use of the intelligent “Mouse” on a real application (e.g. web browsing) running on a PC.
• Background research on human head mobility mechanics as it relates to head-tilt motions.
• Research the operations of a Microsoft’s basic Standard Mouse, and the protocol standards used for Plug-N-Play communication between a mouse and PC.
• Research and analyze potential physical “head” movements (incorporating basic AI algorithms) conducive to “comfortable” navigation of normal x-y “mouse” motions by the user.
• Investigate MEMsic type of smart sensors, and their applicability for use in your “Mouse” design. Do the same for other potential alternate motion sensing technologies that could be applicable in your design.
• Identify appropriate number and placements of the sensors on a mechanical cap-like or headband like support mechanism; and investigate appropriate low-power embedded microcontrollers and interface electronics for sensor interface; and for wireless data transfer to a Base Station.
• Investigate low power embedded microcontroller types for the Base Station unit, together with wired USB interface connection from the base-unit to PC.
• Investigate, design and implement proper software structure to emulate the standard mouse communication protocols.
• Investigate, analyze and develop proper smart algorithms to extract the correct motion variables for mouse emulation in a repeatable fashion.
• Investigate software based signal conditioning and signal processing techniques to reliably discriminate spurious head motions.
• Research various miniaturized wireless link technologies, and select the appropriate one for this application
(1) research the background material for the underlying technologies; (2) development of the technical specifications, at least two system level design alternatives, identifying technical challenges and associated design strategies, and then selecting the best design alternative; (2) meeting the technical objectives, (3) seamless integration of the system, (4) design, implementation and testing of the system, and (5) preparing the final technical report.
While coming up with alternative designs and then selecting the best design to implement will be the shared responsibility of the entire Group, the experiential learning and engagement may be best optimized by having Student A and Student B mainly focus on one design approach, whereas Student C and Student D on an alternate design. It is understood that there would be common design elements among the alternative design approaches.
Additional responsibilities to be determined with the FLC after this topic is assigned.
While coming up with alternative designs and then selecting the best design to implement will be the shared responsibility of the entire Group, the experiential learning and engagement may be best optimized by having Student A and Student B mainly focus on one design approach, whereas Student C and Student D on the alternate design. It is understood that there would be common design elements among the alternative design approaches.
Additional responsibilities to be determined with the FLC after this topic is assigned.
While coming up with alternative designs and then selecting the best design to implement will be the shared responsibility of the entire Group, the experiential learning and engagement may be best optimized by having Student A and Student B mainly focus on one design approach, whereas Student C and Student D on an alternate design. It is understood that there would be common design elements among the alternative design approaches.
Additional responsibilities to be determined with the FLC after this topic is assigned.
While coming up with alternative designs and then selecting the best design to implement will be the shared responsibility of the entire Group, the experiential learning and engagement may be best optimized by having Student A and Student B mainly focus on one design approach, whereas Student C and Student D on an alternate design. It is understood that there would be common design elements among the alternative design approaches.
Additional responsibilities to be determined with the FLC after this topic is assigned.
MK01: MOUSE Emulator for the physically challenged | Mike Kassam | Thursday September 8th 2022 at 02:05 PM