as shown in fig1 , one embodiment of the present invention includes a user visual interface , such as device 22 , which communicates with processor 12 via processing circuit 30 . the program code or algorithm for a game program may be stored in a memory device , such as memory 14 , and executed by processor 12 . the processing shown in circuit 30 ( as will be discussed with respect to fig3 ) can be accomplished in circuitry , in software as part of an algorithm , or partially in each . the processing or circuitry can be separate from , or integral to , processor 12 . user interface 22 may be a stand alone device as shown in fig2 where the visual input device is shown marked on top of display 201 , or it can be incorporated into a computer mouse , a game controller , a joystick , or any other device , such as keyboard 202 , through which the player is able to input his / her actions into processor 12 . device 22 can be an analog or digital camera or an led display for capturing images , such as eye blinks , head movements , frequency of face touches , swinging motion of arms or legs , head nods , etc . processor 12 may include memory devices , microprocessors , and any components which are utilized to execute the program code for a game program . the processor system may be a part of a computer system , a video game console , or a hand held gaming device . the visual image , for example , eye blinks , head nods , changes in facial images , etc ., can be used as an indicator of a player &# 39 ; s response level . for example , fast eye blinks may suggest a player becoming frustrated or confused . changes of a player &# 39 ; s response level during game play can be used to change a game program aspect , for example the play difficulty could be adjusted . as shown in fig3 , in one embodiment , amplifier 31 of image processing circuit 30 receives the image signal , for example , from device 22 shown in fig2 a and 2b . this signal would typically , but not always , be in analog form and would be amplified by amplifier 31 and filtered by filter 32 . the filtering would remove signals outside certain ranges as desired . this filtered signal would be conditioned by circuit 33 and , if necessary , converted to digital format by a / d converter 34 . this signal would then be presented to processor 12 . note that as part of the filtering and / or conditioning , changes of the image could be detected and signaled to the processor , or , if desired , the entire conditioned signal could be presented to the processor for a determination of image change and a determination of what such an image change means in terms of user discomfort , etc . once the player &# 39 ; s response level is determined , processor 12 may modify the system , for example by adjusting the difficulty level of the game being played . in one embodiment of the invention , this includes switching between preset difficulty levels defined in the game or to use a difficulty level that is indicated by a database or algorithm to be appropriate with the determined response level . in another embodiment , the processing system may increase or decrease the speed with which it executes the game algorithm . in a still further embodiment , the difficulty can be continuously adjusted until the user response moves within a defined range . fig4 represents a flowchart of one embodiment 40 of the system used to adjust skill level of a game , or other application , based on received visual images . process 402 acquires a signal from user interface 22 and by image analysis of the signal as discussed with respect to fig3 , as performed by process 403 and process 404 , a determination is made by process 405 if some significant feature of the image has changed . if it has changed from a previous reading ( or a previous set of readings as stored in memory ), then process 406 determines the response level of the player based on the nature of the received visual images . process 402 then adjusts the skill level of the game or other parameters based on the received visual image data . images can be stored for a period of time in a memory ( not shown ) and an image can be compared against the previous image , or against a composite ( or average ) of previous images to determine of the user is agitated , bored , wondering , intense , etc . rapid eye changes could , for example , mean the user is agitated . if desired , data can be maintained on a user by user basis such that for a particular user a correlation can be made between visual image changes and action ( poor , good , etc .) taken by that user . this correlation then can be the foundation of changes made to the program upon future detection of similar visual changes . note that there could be a table established of user levels such that the received visual images are averaged ( or otherwise saved ) over a period of time can be used to determine an actual graded level of user comfort . based on the gradation at any point in time the same ( or other ) program can be adjusted harder or easier . note that while a game system has been described , the concepts taught herein can be used to control the operation aspects of any program running on any processor . for example , a spread sheet program can have different instructions presented based on the frequency of eye movement or other visual image . although the present invention and its advantages have been described in detail , it should be understood that various changes , substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims . moreover , the scope of the present application is not intended to be limited to the particular embodiments of the process , machine , manufacture , composition of matter , means , methods , and steps described in the specification . as one of ordinary skill in the art will readily appreciate from the disclosure of the present invention , process , machines , manufacture , compositions of matter , means , methods , or steps , presently existing or later to be developed that perform substantially the same results as the corresponding embodiments described herein may be utilized according to the present invention . accordingly , the appended claims are intended to include within their scope such process , machines , manufacture , composition of matter , means , methods or steps .
advantage is taken of the fact that as a player becomes uncomfortable , visually observable aspects of the player &# 39 ; s physiological state , such as the frequency of eye blinks , may change . by analyzing such changes and / or other image changes , as obtained from signals generated by an input device , the system is able to determine changes in a player &# 39 ; s comfort level and change the game accordingly .