Abstract: A system and method for determining an operational status of a firearm based on a discharge event is provided. A first acceleration is measured on the firearm at a first time. A second acceleration is measured on the firearm at a second time. A measured shot separation of first and second accelerations between the first and second times is calculated. The measured shot separation is compared to at least one shot separation threshold. A speed of a movement member in the firearm is assigned based on the comparing. The operational status of the firearm is determined based on the assigned speed. The operational status is communicated to a first user of the firearm in real-time.

Abstract: A three-dimensional (3D) animation system automatically assigns accurate animation physics to points of a point cloud to realistically simulate motion of the points in response to different applied forces. The 3D animation system receives the points that are defined with positions in a 3D space and with visual characteristics. The 3D animation system analyzes one or more of the positions and the visual characteristics of the points, classifies the points based on a commonality in the positions or the visual characteristics of the points being associated with a particular classification, and maps a set of animation physics that is defined for the particular classification to the points. The 3D animation system may then animate the points based on the set of animation physics generating an effect in response to a force that is applied to the points.

Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.

Abstract: A virtual object control method is provided. The method includes: displaying a user interface, the user interface including a virtual object and a displacement control; receiving a first operation signal corresponding to the displacement control; controlling, based on the first operation signal, the virtual object to perform a first displacement operation; and controlling, in response to a second operation signal corresponding to the displacement control being received in a process of performing the first displacement operation by the virtual object, the virtual object to perform a second displacement operation based on the second operation signal after the first displacement operation is performed.

Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with a current task and predetermined vigilance requirements. The system determines if the user is exhibiting an appropriate level of vigilance based on the task or is becoming fixated. When fixation is detected, the system may engage in remedial action. A task flow diagram represents the operator tasks. Interactions between the user and the instrumentation are used to estimate the probability distribution of the task the user is currently conducting. The system correlates eye tracking data and physiological data such as electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRs) to determine neuroactivity. Monitoring neuroactivity reduces the probability of a false positive for fixation.

Abstract: A system comprises a teleoperational manipulator configured to control operation of a medical instrument in a surgical environment. The system further comprises an operator input system including an input device and a processing unit including one or more processors. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu including a set of directionally arranged menu options. The processing unit is further configured to transition the input device from a first constraint state for interaction with the medical instrument to a second constraint state for interaction with the menu. In the second constraint state, the input device is constrained to move in one or more directions based on the set of directionally arranged menu options.

Abstract: A head-mounted display apparatus is provided. The head-mounted display apparatus includes at least one camera, at least one sensor, and at least one processor operatively connected to the at least one camera and the at least one sensor. The at least one processor may be configured to acquire information about head pose and head-based gaze direction of a user, based on data input from the at least one sensor and multiple key points input from the at least one camera according to recognizing rotation of a user's head, estimate gaze lines of the user, based on the acquired information about head pose and head-based gaze direction, and estimate a distance to a target point, based on the gaze lines of the user, according to identifying that vestibulo-ocular reflex is activated based on the gaze lines of the user.

Abstract: A remote control system and related method for controlling a video device are presented. The remote control system contains a plurality of buttons arranged in a grid pattern that correspond to user selectable options displayed on a display screen arranged in the same grid pattern. The user selects options on the screen by pressing the corresponding button on the remote control.

Abstract: A handheld controller is suitable for controlling an electronic device. The handheld controller includes a first body, a second body and a connecting portion. The first body is suitable for being held by a hand of a user. The connecting portion connects the first body and the second body. The second body is electrically connected to the first body through the connecting portion, and the connecting portion is suitable for being clamped between fingers of the user.

Abstract: A flexible layer support structure and a retractable device is disclosed. The flexible layer support structure includes a first thin sheet and a second thin sheet arranged in parallel with each other, as well as and a folding spring group sandwiched between the first thin sheet and the second thin sheet and arranged in parallel. The curved elastic pieces in the folding spring group are smoothly overlapped and connected with the thin sheets, so as to enclose a hollow thin-walled elastic structure that can be overlapped and rolled up, can be automatically straightened and has a flat surface. The retractable device includes a winding shaft, a pressure roller, and a flexible layer support structure installed on the winding shaft. The flexible layer support structure of the present disclosure has the advantages in lightweight, high storage ratio, large unfolded area, simple winding, large load bearing capacity, and less damage.

Abstract: Image display device and method have a display arranged at a user's preferred position and displaying images with comfortable image quality and arrangement that match a user's viewing position and preference. The image display device includes an external input interface, a memory for storing image data, an arithmetic processing unit, a graphics processing unit, a display, and a setting mode suitable for the user.

Abstract: A computing device determines that the computing device is within wireless proximity to a secondary wireless device. Based on the computing device being within wireless proximity to the secondary wireless device, the computing device determines at least one function of the secondary wireless device, and generates an aggregate user interface for display on a display screen of the computing device. The aggregate user interface identifies the secondary wireless device and indicates the at least one function of the secondary wireless device. The computing device receives, via the aggregate user interface, a user input selecting the secondary wireless device. Responsive to the user input, the computing device presents a second user interface including one or more selectable features for operating the secondary wireless device.

Abstract: A messaging apparatus for sending a multimedia message includes a processor and a memory coupled to the processor and including instructions stored thereon. The instructions, when executed by the processor, cause the messaging apparatus to send display a list of multimedia contents on a screen based on a search term, receive a user's selection of one of displayed multimedia contents, obtain text content corresponding to the selected multimedia content, receive a user's selection of a graphical representation of the user's emotion, combine, in order, the selected multimedia content, as a first layer, the selected graphical representation of the user's emotion, as a second layer, and the text content, as a third layer, to generate a flattened multimedia message, and send the flattened multimedia message via a messaging application.

Abstract: A system in accordance with present embodiments includes a source of electromagnetic radiation that operates to emit electromagnetic radiation into an active playing area. The system also includes a sensing device that operates to receive the electromagnetic radiation after being reflected from a retro-reflective material of an article positioned in the active playing area and operable to generate data based on receiving reflected electromagnetic radiation from a series of article positions. Further, the system includes a controller that operates to process the data generated by the sensing device to determine whether the series of article positions correlate to a stored gesture and output a control signal to actuate an effect when the series of article positions correlate to the stored gesture.

Abstract: A rotary shifter includes a knob, a cam mechanism to hold the knob at holding positions corresponding to respective predetermined shift positions whose number is N, an electromagnetic brake including a yoke and an armature to restrict the rotation of the armature and the knob, and a hardware processor to determine a predetermined shift position of the knob to control the operation of the electromagnetic brake. The rotation pitch angle between the holding positions of the knob at the time of switching the predetermined shift positions is set to an angle obtained by dividing 360 degrees by a first integer A (A?N). The rotation pitch angle between stopping positions of the armature corresponding to the holding positions at the time of switching the predetermined shift positions is set to an angle obtained by dividing 360 degrees by a second integer B (A>B?N).

Abstract: An electronic device with a first off-display input region detects a first portion of an input on the input region. In response to the first portion of the input: when the first portion of the input meets first criteria without a characteristic intensity of the first input increasing above a first intensity threshold, the electronic device provides a first output that indicates a current state of a first attribute of the electronic device without altering the first attribute. The electronic device detects a second portion of the input. In response to the second portion of the input: if the second portion of the first input meets second criteria that require the characteristic intensity of the input increases above the first intensity threshold, the electronic device performs a first operation that alters the first attribute of the electronic device; and otherwise, the electronic device forgoes performing the first operation.

Abstract: Controlling an avatar in an XR environment can be based on input(s) from external, non-XR computing devices, such as mobile devices. An external device can capture sensor data, audio data, and/or image data, which are processed by an avatar control system to determine a gesture performed by the user, gauge the level of intensity or excitement of the user, and/or infer the user's sentiment or emotional state. The avatar control system can generate a motion plan based on these inferences drawn from the external device sensor data based on a baseline animation or motion template. The system can generate avatar animations that have exaggerated or understated expressions relative to the user's real-world gestures, possibly exceeding limitations of a kinematic model that otherwise constrain the avatar's animations. The technology can enable users to control an avatar in an XR environment without specialized XR equipment.

Abstract: A virtual image display system includes a virtual image display device and a hand-held control device. The virtual image display device is coupled to the hand-held control device. The hand-held control device is configured to capture image information of the virtual image display device and analyze the image information to obtain relative angle information between the virtual image display device and the hand-held control device. The virtual image display device adjusts a pointing direction of a displayed virtual hand-held control device image according to the relative angle information.

Abstract: A foldable touch screen display device made up of flexible or tiled display segments that can be folded from a compact state to an expanded state which also includes a gaming motion control interface. The form factor of the compact state is roughly the size of a typical handheld phone or smaller. The form factor of the expanded state is roughly the size of a larger phone or tablet computer, which may also have the mechanical functionality of a laptop. The gaming motion control interface can provide enhanced interaction and viewing of a game application by utilizing the inherent folding mechanics and position of each display segment relative to each other such that a virtual object or point of reference shown on the display corresponds with the device's folding motion. Other applications that do not relate to gaming may also be applied utilizing the same techniques disclosed.

Abstract: A radar signal processing device is provided. The radar device may include processing circuitry. The processing circuitry is configured to generate a processing signal based on a beat signal of a transmission signal and a reception signal, and generate a plurality of extracted beat signals by applying a plurality of window functions on the processing signal, and convert the plurality of extracted beat signals to amplitude data indicating a relationship between a distance and an amplitude, and integrate a plurality of the amplitude data into integrated data.

Abstract: An operating device includes a touchpad having an operating surface for detecting touch inputs, which operating surface has multiple regions which are delimited from each other at least in part by one or more structural elements, each structural element being designed to have a first haptic effect on a finger when the finger swipes over the structural element; and a haptic actuator which is designed to have a second haptic effect which enhances the first haptic effect on the finger when the finger touches or swipes over a structural element. The operating device has a first operating mode in which the actuator is activated to produce the second haptic effect on the finger when the finger touches or swipes over a structural element, and a second operating mode in which the actuator is deactivated when the finger touches or swipes over a structural element.

Abstract: A method of selecting wagers inside a micro-market with on-screen gestures. A user can use a gesture, such as swipe right for a run, swipe left for a pass, or swipe to other bets.

Abstract: A hand-wearable device outfitted with data interface electronics is provided. The device is secured to its user by means of a comfortable material integrated across the top of the hand. The device includes a central palm section containing complex three-dimensional geometry and modular features for adjustable structures to house switch sensors. These structures account for each fingertip's location and orientation relative to the rest of the user's hand. Features to accommodate the comfortable securing material are built into the device to ensure the device does not shift or move around relative to the user's hand while being worn and operated. Integrated switch sensor and various power and transistor-based electronics allow the device to function and communicate with other computers and like devices. The device is worn on the left, right, or both hands simultaneously to enable access to the maximum number of potential sensor commands for a user.

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide retinal imaging-based gaze tracking In some implementations, a user's gaze is tracked based on a retinal imaging technique that selectively uses a subset of multiple light sources (222, 310, 610) that illuminate different portions of the user's retina (352). In some implementations, a method (700) includes selecting (710) a subset of light sources, where the subset of the light sources includes less than all of the light sources. In some implementations, one or more portions of a retina (352) are illuminated (720) by producing light using the subset of the light sources. In some implementations, sensor data is received (730) at a sensor (224, 340, 814), the sensor data corresponding to the light detected during retinal imaging, and an eye characteristic is determined (740) based on the sensor data.

Abstract: Systems and methods for enhancing computer-generated visualization of items, including enhancing visualization of product images in a web-based augmented reality (AR) user interface, displaying elements that enable users to select AR-enabled images of products (e.g., room décor, furniture, or other products), and transmitting AR-enabled images of the products in a room to one or more distributed computer systems (e.g., in real time). These and other images may be saved or selected in the various platforms, web-based documents, or locally-run applications as AR-enabled images of products to view a set of user-selected AR-enabled images in a single view (e.g., on a web page), and, when in a room, selectively display and interact with an AR-enabled view in the room of the corresponding products from the AR-enabled images list.

Abstract: Disclosed herein is a touch sensing device including a first touch controller configured to transmit and receive data, wherein the first touch controller includes a clock terminal and a plurality of input/output terminals, and ternary data is transmitted and received through the clock terminal and at least two terminals among the plurality of input/output terminals of the first touch controller, and binary data is transmitted through the remaining input/output terminals.

Abstract: A game object control method is provided in embodiments of the present disclosure. The method includes: at least one target game object is determined in at least one game object, in response to object selecting operation. A grouping control is provided in response to object grouping trigger operation. The grouping control includes at least one grouping sub-control. A target grouping sub-control is determined in the at least one grouping sub-control, in response to a group selecting operation, and the at least one target game object is determined as a target group corresponding to the target grouping sub-control. In the present embodiment, by means of a grouping control and a group selecting operation, a group of a target game object can be determined as a target group corresponding to a target grouping sub-control, thereby quick grouping of the at least one game object to improve the operation efficiency of games is realized.

Abstract: Devices, systems and methods related to systems and methods including user input devices with a user-actuatable trigger and a force-feedback soft actuator that is movably disposed with respect to the trigger. The soft actuator is made of a flexible material and is activatable based upon a force-feedback signal associated with the trigger to provide a user-perceived resistance to the trigger based upon the force-feedback signal.

Abstract: The present invention relates to a computer keyboard provided with an optical mouse (light mouse) used with a thumb, for improving the inconvenience of moving between a keyboard and a mouse when using a computer, wherein while both hands remain positioned on the computer keyboard, the thumb of one hand may move a mouse pointer and the thumb of the other hand may perform a clicking operation, and the clicking operation can also be performed using the index finger, the middle finger, and the ring finger of the hand that moves the mouse pointer.

Abstract: In one embodiment, an apparatus includes a human-interface-device (HID) controller that includes at least one of an extended reality (XR) controller or a mouse controller. The apparatus further includes an undetachable, fully retractable stylus pointed tip configured to extend from the HID controller, configured so that the stylus tip does not protrude beyond an exterior of the HID controller when in a fully retracted position.

Abstract: A pointing electronic device is provided with: an inertial measurement module, to generate motion input data, indicative of motion of the pointing electronic device, at an input data rate; a pointing determination unit, to implement a pointing algorithm at a processing data rate based on the motion input data, to generate screen-frame displacement data corresponding to 3D-space movements of the pointing electronic device, the processing data rate being higher than the input data rate. The pointing electronic device is further provided with a rate upscaling unit, interposed between the inertial measurement module and the pointing determination unit, to implement a data-rate upscaling of the motion input data, to generate upscaled motion input data to be processed by the pointing determination unit at a data rate matching the processing data rate, via a predictive data reconstruction of missing samples based on the actual motion input data.

Abstract: The disclosure provides a method for determining a location of a focus, an apparatus for determining a location of a focus, and an electronic device, and relates to the field of electronic devices. The method includes: obtaining a current location of the focus in an electronic device; determining a current page element located by the focus based on the current location of the focus; obtaining an instruction for controlling the focus; obtaining a movement direction of the focus based on the instruction; obtaining a layout direction of the current page element; returning to a parent page element of the current page element in response that the movement direction of the focus is inconsistent with the layout direction; and determining the location of the focus in the parent page element.

Abstract: There is provided a user-vehicle interface, comprising: a gesture control system, arranged to sense a gesture of a user of the vehicle; the gesture control system being arranged to process the sensed gesture to control interaction with content on a display, in accordance with that sensed gesture; the vehicle comprising a physical actuator for controlling the vehicle, and the gesture control system is arranged to facilitate interaction with content on the display, when a body part of the user associated with a provision of the gesture is engaged with the actuator.

Abstract: Disclosed is a touchless engagement system for a user having at least one computer processor and user interface operable with at least one memory storage medium on which operates a gesture-reading software platform, an access portal, and at least one data collection software program. The system includes at least one digital display. The system includes at least one motion sensing input interface has at least one RGB camera assembly and at least one infrared projector and detector assembly. At least one gesture-reading software platform is designed to assess the user within a selected physical area via the motion sensing input. A data collection software program is designed to collect data about at least one or more of user gestures, user commands, data retrieved because of commands, and identifiers, and assess data for user needs. The system may display advertisement, textual information, and statistics, and offers one or more command pathways.

Abstract: A hand-worn data-input device is provided. The hand-worn data-input device is wearable on a hand, for entering data-inputs into electronic/computing devices by reading and interpreting, via electromagnetic sensing, static/dynamic user-inputted gestures between digits, other portions of the hand and other hand-worn components of the data-input device, relative to each other, wherein sensing units are configured to be placed at/by specific spots/regions of the hand and comprise fixation, insulating and/or electromagnetic shielding means, and wherein the hand-worn data-input device comprises at least one energy unit, at least one thumb-worn sensing unit, at least one body-contact sensing unit, at least one signals/data connection unit and at least one data-inputs connection unit, and wherein when fingertip sensing units are worn, the fingertip sensing units are uniquely identified and simultaneous multi-channeled electromagnetic coupling between the fingertip sensing units and other sensing units is enabled.

Abstract: Aspects of the disclosure relate to controlling an autonomous vehicle to respond to a detected collision. An autonomous vehicle control system may receive sensor data associated with an autonomous vehicle in which the autonomous vehicle control system is installed. The autonomous vehicle control system may analyze the sensor data in real-time as the sensor data is received and may detect an occurrence of a collision involving the autonomous vehicle. In response to detecting the occurrence of the collision, the autonomous vehicle control system may generate claim information based on the sensor data and may process the claim information based on at least one insurance profile maintained by the autonomous vehicle control system. Then, the autonomous vehicle control system may generate a claim notification based on processing the claim information and may send the claim notification to a vehicle management computer system.

Abstract: A foot operated controller apparatus is disclosed. The apparatus includes a ball large enough for a human to manipulate with two feet, and a support apparatus configured to support the ball from below, restrict translation of the ball and permit rotation of the ball about its center with respect to at least two axes. One or more position encoders are disposed proximate a surface of the ball. The encoder(s) are configured to determine a rotational displacement of the ball with respect to two or more axes.

Abstract: Methods and systems are provided that can include accessing a three-dimensional (3D) model of an object with a visualization tool including a touchscreen, displaying, via the touchscreen, an image of the 3D model, detecting a pressure based and/or contact based input at the touchscreen, and changing a display parameter of a first component of the 3D model as a result of the input. Selecting the component and/or changing the display can be indicated by visual and/or haptic signals. A method is provided that can include selectively making components of the 3D model transparent or non-transparent, and changing a center of rotation of the 3D model based on the remaining non-transparent components. A method is provided that can include identifying gestures of a selection tool via a stereo camera and changing display parameters based on the detected gesture(s).

Abstract: A system for synchronization of multiple clocks in a vehicle network includes a processor that is programmed to synchronize a time follower clock to a primary grand leader clock. The primary grand leader clock is monitored and the time follower clock is synchronized to a standby grand leader clock upon a failure of the primary grand leader clock. The time follower clock is synchronized to the primary grand leader clock if a new ignition cycle has occurred between a failure of the primary grand leader clock and a recovery after failure of the primary grand leader clock. The time follower clock continues to be synchronized to the standby grand leader clock if a new ignition cycle has not occurred between the failure of the primary grand leader clock and the recovery after failure of the primary grand leader clock.

Abstract: A computer implemented system provides a cruise control function, during a fitness equipment-based workout, to report a power output amount based on a cruise control set-point. The system includes a piece of fitness equipment, a control device, and a computing device. The fitness equipment produces an output corresponding to actual power produced on the fitness equipment. The control device transmits an indication of power being produced to the computing device as an input to a fitness training game. In a first operational state, the indication represents the actual amount of power being produced via operation of the fitness equipment by the user, but in a second operational state, the numerical indication is a virtual power amount corresponding to a cruise control set-point amount established via the control device.

Abstract: The present invention discloses an adjustable supporting assembly for a user of a conventional mouse, and an ergonomic adjustable computer mouse. The adjustable supporting assembly comprises at least one height adjustment member adapted to be coupled on a body of the conventional mouse for palm comfort. The adjustable supporting assembly also comprises at least one finger adjustment member protruding laterally from the at least one height adjustment member for finger support. The adjustable supporting assembly comprises a width adjustment member configured to extend laterally. The width adjustment member comprises a receptacle member for placing the conventional mouse, the receptacle member includes a plurality of holes for incorporating screws and a pair of adjusting plates attached to a base of the receptacle member, each of the pair of adjusting plates having a slot to incorporate a screw to be extended laterally along the slot.

Abstract: A computer implemented method for identifying a section of a first display corresponding to a user's initial gaze, identifying a string of text within the identified section of the first display, detecting a shift in the user's gaze from the identified section on the first display to an area on a second display, calculating coordinates corresponding to the area on the second display, identifying an input field in the second display closest to the calculated coordinates, and inputting the identified string of text within the input field in the second display. The method may further include determining whether content currently exists within the input field and subsequently removing the existing content from the input field, and replacing said existing content with the identified text.

Abstract: A method for determining a discharge event of a firearm includes receiving by an event detection module, (i) acceleration input signals over time including first acceleration input signals along a first axis, a second acceleration input signals along a second axis and a third acceleration input signals along a third axis; and (ii) rotation input signals over the time including first rotation input signals around the first axis, a second rotation input signals around the second axis and a third rotation input signals around the third axis. A sample event candidate is generated based on the plurality of acceleration and rotation input signals over the time. The sample event candidate is compared to a stored data collection of acceleration and rotation inputs known to represent at least one state of a user of the firearm. A state of the user is determined based on the comparing.

Abstract: A game processing system for processing a game having a first mode and a second mode according to an aspect includes one or more computer processors. The one or more computer processors are configured to provide an interaction with a virtual character in the first mode and the second mode. In a switch process for switching the game from the first mode to the second mode, the one or more computer processors are configured to, start the second mode if a switch object is selected by a player of the game gazing at the switch object during a predetermined period of time since the switch object is displayed, and return to the first mode if the switch object is not selected during the predetermined period of time.

Abstract: A touch control method, a touch control circuit system, and a touch device, the touch device includes a plurality of touch electrodes, the touch control method includes: step S1, sending a scanning signal to the plurality of touch electrodes; step S2, acquiring first touch data and second touch data according to the scanning signal; and step S3, the touch device defining a plurality of touch nodes, each of the plurality of touch nodes corresponding to the first touch data and the second touch data, defining at least one target touch node according to a difference between the first touch data and the second touch data, and calculating a current touch position according to the first touch data and the second touch data of the at least one target touch node.

Abstract: A computer input device includes a housing having an opening, a ball holder supported relative to the housing and being concentric with the opening, a ball positioned within the ball holder and extending through the opening in the housing, and a scroll ring concentric with and rotatable relative to the ball holder. The ball is movable relative to the ball holder. The ball holder has a track, and the scroll ring has at least one projection received in the track of the ball holder to guide the scroll ring.

Abstract: A system and method for determining a discharge event of a firearm includes receiving, by an event detection module, acceleration input signals and rotation input signals. An acceleration vector magnitude is calculated from the acceleration signals. The acceleration vector magnitude is compared to a threshold acceleration. A sample event candidate is assigned to the acceleration vector magnitude based on the comparing. The sample event candidate comprises the acceleration input signals and the rotation input signals for a predetermined duration of time. The sample event candidate is received at a machine learning module. Characteristics of the discharge event detected are determined including ammunition type based on the acceleration and rotation input signals in the sample event candidate.

Abstract: In an image displayed on a display under a normal condition, the locations where items to choose from are located are indicated by icons. When a user touches a contact point, icons located within a predetermined range from the contact point are detected from among the icons. Then the locations of the detected icons are varied such that they are located on a circle, with the circle's center at the contact point, at equal spaces between the detected icons. A pointer graphic that indicates the original position of each icon in the original image is added to each icon.

Abstract: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.

Abstract: A game processing system for processing of a game that provides interaction with a virtual character according to one embodiment includes a storage that stores action data for specifying one or more actions of the virtual character and one or more computer processors. The game includes a VR mode in which the game progresses in accordance with detection information obtained by a head mounted display. The one or more processors determine an action of the player performed toward the virtual character based on the detection information obtained by the head mounted display attached to the head of the player, cause the virtual character to interact with the player based on the action of the player; and suspend execution of the VR mode if a suspension condition is satisfied.