SlideShare a Scribd company logo

Eye gaze technology

•Download as PPTX, PDF•
•
K
Ketan Hulaji

This document describes an eye-gaze communication system that allows disabled individuals to communicate using only their eyes. It discusses the motivation for developing such a system and outlines the basic components and functions. The system works by tracking a user's eye movements to determine what they are looking at on screen. It then allows them to control programs and type using only their eyes. Applications mentioned include word processing, making phone calls, and entertainment. Future enhancements could include making the system portable.

1 of 18
S G BALEKUNDRI INSTITUTE OF TECHNOLOGY BELGAUM Mansing Desai 2BU14EC412 Under Guidance of :- Prof. Sidramayya S M Department of ELECTRONICS AND COMMUNICATION ENGINEERING EYE-GAZE COMMUNICATION Presented By: 1
CONTENTS 1. Introduction. 2. Motivation. 3. Skills needed by the user. 4. System overview. 5. Working. 6. Main menu of the system. 7. Application . 8. Future enhancements. 9. Conclusion. 10. References. 2
INTRODUCTION • Communication and control system for people with complex physical disabilities. • Eye tracking . 3
MOTIVATION Every year more than 100,000 people loose their body part by motor accident. Typically, Even when all other ways of communicating are either severely damaged Or completely lost, the eyes still function. If You can't use your hands. Or you can't speak. How do you do your job? How do you stay employed? You can, because of a very good gift from computer Industry The Eye gaze, a communication system you run with your eyes. 4
SKILLS NEEDED BY THE USER • Good control of one eye • Ability to read • Ability to maintain a position on eye monitor 5
SYSTEM OVERVIEW 6
• As a user sits in front of the eye gaze monitor, a specialized video camera mounted below the monitor observes one of the user's eyes. • Image processing software in the eye gaze system's computer continually analyzes the image of the eye and determines where the user is looking . • Nothing is attached to the user's head or body. WORKING 7
HOW DOES THE EYE GAZE SYSTEM WORK? • Pupil-center/corneal-reflection method • An infrared-sensitive video camera, mounted below • The LED reflects a small bit of light off the surface of the eye's cornea. • The light also shines through the pupil and reflects off of the retina, the back surface of the eye, and causes the pupil to appear white. • The computer calculates the person's gaze point, i.e., the coordinates of where he is looking on the screen. • Based on the relative positions of the pupil center and corneal reflection within the video image of the eye. 8
HOW TO RUN THE EYE GAZE SYSTEM? • A user operates the Eye gaze System by looking at rectangular keys that are displayed on the control screen. • To "press" an Eye gaze key, the user looks at the key for a specified period of time. The gaze duration required to visually activate a key, typically a fraction of a second. 9
MENU OF EYE GAZE SYSTEM • The Main Menu appears on the screen as soon as the user completes a 15- second calibration procedure. • The Main Menu presents a list of available Eye gaze programs. • The user calls up a desired program by looking at the Eye gaze key next to his program choice. 10
THE PHRASE PROGRAM • The Phrases program, along with the speech synthesizer, provides quick communications for non-verbal users. • The Phrases program stores up to 126 messages, which can be composed and easily changed to suit the user. CONVERSATION HELLO Good bye Good to see you Where have you been How have you been I’ve missed you I’m happy I’m sad I need a hug I like that Good Talk to me Yes No Pause Menu 11
TYPEWRITER PROGRAM • Simple word processing can be done using the Typewriter Program. The user types by looking at keys on visual keyboards. • The user may "speak" or print what he has typed. He may also store typed text in a file to be retrieved at a later time. The retrieved text may be verbalized, edited or printed. 12
THE TELEPHONE PROGRAM • The telephone program allows the user to place and receive calls. Frequently used numbers are stored in a telephone "book". 13
•Communication system for disabled •Typewrite •Read text •Employee training •Entertain with games APPLICATIONS OF EYE GAZE 14
Latest potable Eye Gaze system FUTURE ENHANCEMENTS • The Portable Eye gaze System can be mounted on a wheelchair and run from a 12-volt battery or wall outlet. • It weighs only 2.7 kg and its dimensions are 2.5"x8"x9" (6.5cm x20cm x23cm). • The Portable Eye gaze System comes with a flat screen monitor and a table mount for its monitor. • The monitor can be lifted off the table mount and slipped into a wheelchair mount. 15
CONCLUSION Today, the human eye-gaze can be recorded by relatively unremarkable techniques. This thesis argues that it is possible to use the eye-gaze of a computer user in the interface to aid the control of the application. The main reason for eye-gaze based user interfaces being attractive is that the direction of the eye-gaze can express the interests of the user-it is a potential porthole into the current cognitive processes-and communication through the direction of the eyes is faster than any other mode of human communication. It is argued that eye- gaze tracking data is best used in multimodal interfaces where the user interacts with the data instead of the interface, in so-called non-command user interfaces. 16
REFERENCES  The Camera Mouse: Visual Tracking of Body features to Provide Computer Access for People with Severe Disabilities. Margret Betke, James Gips, Peter Fleming The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities.   Perceptual Gaze Extent & Level of Detail in VR: Looking outside the Box Hunter Murphy, Andrew T. Duchowski Department of Computer Science, Clemson University {Murphy/Andrew}@vr.clemson.edu   Disability studies Quarterly Spring 2002,Volume 22,N0.2 Pages 159- 174<www.cds.hawaii.edu>  17
THANK YOU…… 18

More Related Content

Eye gaze technology

  • 1. S G BALEKUNDRI INSTITUTE OF TECHNOLOGY BELGAUM Mansing Desai 2BU14EC412 Under Guidance of :- Prof. Sidramayya S M Department of ELECTRONICS AND COMMUNICATION ENGINEERING EYE-GAZE COMMUNICATION Presented By: 1
  • 2. CONTENTS 1. Introduction. 2. Motivation. 3. Skills needed by the user. 4. System overview. 5. Working. 6. Main menu of the system. 7. Application . 8. Future enhancements. 9. Conclusion. 10. References. 2
  • 3. INTRODUCTION • Communication and control system for people with complex physical disabilities. • Eye tracking . 3
  • 4. MOTIVATION Every year more than 100,000 people loose their body part by motor accident. Typically, Even when all other ways of communicating are either severely damaged Or completely lost, the eyes still function. If You can't use your hands. Or you can't speak. How do you do your job? How do you stay employed? You can, because of a very good gift from computer Industry The Eye gaze, a communication system you run with your eyes. 4
  • 5. SKILLS NEEDED BY THE USER • Good control of one eye • Ability to read • Ability to maintain a position on eye monitor 5
  • 7. • As a user sits in front of the eye gaze monitor, a specialized video camera mounted below the monitor observes one of the user's eyes. • Image processing software in the eye gaze system's computer continually analyzes the image of the eye and determines where the user is looking . • Nothing is attached to the user's head or body. WORKING 7
  • 8. HOW DOES THE EYE GAZE SYSTEM WORK? • Pupil-center/corneal-reflection method • An infrared-sensitive video camera, mounted below • The LED reflects a small bit of light off the surface of the eye's cornea. • The light also shines through the pupil and reflects off of the retina, the back surface of the eye, and causes the pupil to appear white. • The computer calculates the person's gaze point, i.e., the coordinates of where he is looking on the screen. • Based on the relative positions of the pupil center and corneal reflection within the video image of the eye. 8
  • 9. HOW TO RUN THE EYE GAZE SYSTEM? • A user operates the Eye gaze System by looking at rectangular keys that are displayed on the control screen. • To "press" an Eye gaze key, the user looks at the key for a specified period of time. The gaze duration required to visually activate a key, typically a fraction of a second. 9
  • 10. MENU OF EYE GAZE SYSTEM • The Main Menu appears on the screen as soon as the user completes a 15- second calibration procedure. • The Main Menu presents a list of available Eye gaze programs. • The user calls up a desired program by looking at the Eye gaze key next to his program choice. 10
  • 11. THE PHRASE PROGRAM • The Phrases program, along with the speech synthesizer, provides quick communications for non-verbal users. • The Phrases program stores up to 126 messages, which can be composed and easily changed to suit the user. CONVERSATION HELLO Good bye Good to see you Where have you been How have you been I’ve missed you I’m happy I’m sad I need a hug I like that Good Talk to me Yes No Pause Menu 11
  • 12. TYPEWRITER PROGRAM • Simple word processing can be done using the Typewriter Program. The user types by looking at keys on visual keyboards. • The user may "speak" or print what he has typed. He may also store typed text in a file to be retrieved at a later time. The retrieved text may be verbalized, edited or printed. 12
  • 13. THE TELEPHONE PROGRAM • The telephone program allows the user to place and receive calls. Frequently used numbers are stored in a telephone "book". 13
  • 14. •Communication system for disabled •Typewrite •Read text •Employee training •Entertain with games APPLICATIONS OF EYE GAZE 14
  • 15. Latest potable Eye Gaze system FUTURE ENHANCEMENTS • The Portable Eye gaze System can be mounted on a wheelchair and run from a 12-volt battery or wall outlet. • It weighs only 2.7 kg and its dimensions are 2.5"x8"x9" (6.5cm x20cm x23cm). • The Portable Eye gaze System comes with a flat screen monitor and a table mount for its monitor. • The monitor can be lifted off the table mount and slipped into a wheelchair mount. 15
  • 16. CONCLUSION Today, the human eye-gaze can be recorded by relatively unremarkable techniques. This thesis argues that it is possible to use the eye-gaze of a computer user in the interface to aid the control of the application. The main reason for eye-gaze based user interfaces being attractive is that the direction of the eye-gaze can express the interests of the user-it is a potential porthole into the current cognitive processes-and communication through the direction of the eyes is faster than any other mode of human communication. It is argued that eye- gaze tracking data is best used in multimodal interfaces where the user interacts with the data instead of the interface, in so-called non-command user interfaces. 16
  • 17. REFERENCES  The Camera Mouse: Visual Tracking of Body features to Provide Computer Access for People with Severe Disabilities. Margret Betke, James Gips, Peter Fleming The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities.   Perceptual Gaze Extent & Level of Detail in VR: Looking outside the Box Hunter Murphy, Andrew T. Duchowski Department of Computer Science, Clemson University {Murphy/Andrew}@vr.clemson.edu   Disability studies Quarterly Spring 2002,Volume 22,N0.2 Pages 159- 174<www.cds.hawaii.edu>  17