Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: Methods and systems are provided for assisting operation of a vehicle by monitoring a physiological state of an operator and automatically initiating a remedial action responsive to a change in the physiological state. One method involves determining a biometric indication of the current physiological state based on measurement data from one or more sensing devices, determining an activity-based indication of the current physiological state based on output signals from one or more user interface elements and determining an aggregate indicator of the current physiological state as a function of the biometric indication and the activity-based indication using one or more weighting factors that vary during operation of the vehicle. One or more remedial actions are automatically initiated based on the aggregate indicator, for example, in response to a change in physiological state indicated by the value of the aggregate indicator.

Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable medium for data input with multi-format validation. The method may include receiving data input via a microphone mounted on a user device and receiving the data input via a camera mounted on the user device. Additionally, the method may include comparing the data input via the microphone and the data input via the camera and determining whether the comparison of the data input exceeds a predetermined confidence level. Additionally, the method may include storing the data input, upon determining that the comparison of the data input exceeds the predetermined confidence level and presenting to the user a notification of validation upon determining that the comparison of the data input does not exceed the predetermined confidence level. Additionally, the method may include receiving from the user a validation of the data input based on the notification of validation and storing the data input based on the validation of the data input.

Abstract: Systems and methods for augmented reality (AR) safe visualization for use with a near to eye (NTE) display system worn by a user are provided. The system includes: a processor programmed with an AR program and a task database storing task data; and, a camera mounted to the NTE display system and providing video input. The processor receives the video input and coordinates video image processing of the video input to identify therein a user's hand and an object. The processor receives an intended task from the user and retrieves associated task data based thereon. The processor processes the task data with the intended task to render a visualized item, such as a job card. The processor determines when the visualized item is in front of the hand while the user is performing the task and removes the visualized item responsive thereto.

Abstract: According to certain aspects of the disclosure, a computer-implemented method may be used for overlay display. The method may include displaying, by the one or more processors, information in an overlay; determining, by the one or more processors, a field of view of the user based on determining a positioning of the user device; determining, by the one or more processors, whether the overlay meets a minimum visibility criteria based on the positioning of the user device; and displaying, by the one or more processors, a minimum viewable portion of the overlay in the field of view of the user upon determining that the overlay does not meet the minimum visibility criteria.

Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: According to certain aspects of the disclosure, a computer-implemented method may be used for overlay display. The method may include displaying, by the one or more processors, information in an overlay; determining, by the one or more processors, a field of view of the user based on determining a positioning of the user device; determining, by the one or more processors, whether the overlay meets a minimum visibility criteria based on the positioning of the user device; and displaying, by the one or more processors, a minimum viewable portion of the overlay in the field of view of the user upon determining that the overlay does not meet the minimum visibility criteria.

Abstract: Systems and methods for augmented reality (AR) safe visualization for use with a near to eye (NTE) display system worn by a user are provided. The system includes: a processor programmed with an AR program and a task database storing task data; and, a camera mounted to the NTE display system and providing video input. The processor receives the video input and coordinates video image processing of the video input to identify therein a user's hand and an object. The processor receives an intended task from the user and retrieves associated task data based thereon. The processor processes the task data with the intended task to render a visualized item, such as a job card. The processor determines when the visualized item is in front of the hand while the user is performing the task and removes the visualized item responsive thereto.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable medium for data input with multi-format validation. The method may include receiving data input via a microphone mounted on a user device and receiving the data input via a camera mounted on the user device. Additionally, the method may include comparing the data input via the microphone and the data input via the camera and determining whether the comparison of the data input exceeds a predetermined confidence level. Additionally, the method may include storing the data input, upon determining that the comparison of the data input exceeds the predetermined confidence level and presenting to the user a notification of validation upon determining that the comparison of the data input does not exceed the predetermined confidence level. Additionally, the method may include receiving from the user a validation of the data input based on the notification of validation and storing the data input based on the validation of the data input.

Abstract: A method and system for generating attention pointers, including: displaying, in a display of a mobile device, an object within and outside a field of view (FOV) of an user wherein the object outside the FOV are real objects; monitoring, by a processor of the mobile device, for a change in the object within and outside the FOV; in response to a change, generating by the processor one or more attention pointers within the FOV of the user for directing user attention to the change in the object which is either inside or outside the FOV; and displaying, by the processor, on a virtual screen within the FOV to the user, the one or more attention pointers wherein the one or more attention pointers are dynamically configured to interact with the user in response to detections based on a movement of the user or the object within or outside the FOV of the user.

Abstract: Systems and methods for augmented reality (AR) safe visualization for use with a near to eye (NTE) display system worn by a user are provided. The system includes: a processor programmed with an AR program and a task database storing task data; and, a camera mounted to the NTE display system and providing video input. The processor receives the video input and coordinates video image processing of the video input to identify therein a user's hand and an object. The processor receives an intended task from the user and retrieves associated task data based thereon. The processor processes the task data with the intended task to render a visualized item, such as a job card. The processor determines when the visualized item is in front of the hand while the user is performing the task and removes the visualized item responsive thereto.

Abstract: Systems and methods for augmented reality (AR) safe visualization for use with a near to eye (NTE) display system worn by a user are provided. The system includes: a processor programmed with an AR program and a task database storing task data; and, a camera mounted to the NTE display system and providing video input. The processor receives the video input and coordinates video image processing of the video input to identify therein a user's hand and an object. The processor receives an intended task from the user and retrieves associated task data based thereon. The processor processes the task data with the intended task to render a visualized item, such as a job card. The processor determines when the visualized item is in front of the hand while the user is performing the task and removes the visualized item responsive thereto.

Abstract: A method to augment, virtualize, or present mixed reality of content to display a larger amount of content on a head worn device (HWD) including: creating a set of virtual screens in the display of the HWD deployed in a manner to both surround and positionally shift from a movement of the viewer to provide an immersive viewing experience wherein the set of virtual screens include: at least a primary virtual screen and one or more secondary virtual screens; enabling the immersive viewing experience by generating dynamic virtual screen arrangements; connecting a first sensor attached to a head of the viewer and a second sensor attached to a torso of the viewer for generating sensed data of rotating differences of the positionally shift of the viewer; and configuring the content on each of the virtual screens to determine a particular virtual screen having a visual attention of the viewer.

Abstract: A method to augment, virtualize, or present mixed reality of content to display a larger amount of content on a head worn device (HWD) including: creating a set of virtual screens in the display of the HWD deployed in a manner to both surround and positionally shift from a movement of the viewer to provide an immersive viewing experience wherein the set of virtual screens include: at least a primary virtual screen and one or more secondary virtual screens; enabling the immersive viewing experience by generating dynamic virtual screen arrangements; connecting a first sensor attached to a head of the viewer and a second sensor attached to a torso of the viewer for generating sensed data of rotating differences of the positionally shift of the viewer; and configuring the content on each of the virtual screens to determine a particular virtual screen having a visual attention of the viewer.

Abstract: Systems and methods for an enhanced computer vision module are presented. The system receives host locating information, and determines a position and a location of the host based on the host locating information. The system determines a field of view (FOV) of the host based on the host locating information, and controls a camera associated with the host that is configured to record a video stream comprising the FOV. The system and method provide an improvement over conventional computer vision (CV) systems by utilizing object locating information that is transmitted, and also by keeping a storage table of learned and fixed objects. The provided system and method improve the efficiency of object recognition and computer aided maintenance (CAM).

Abstract: Systems and methods for an enhanced computer vision module are presented. The system receives host locating information, and determines a position and a location of the host based on the host locating information. The system determines a field of view (FOV) of the host based on the host locating information, and controls a camera associated with the host that is configured to record a video stream comprising the FOV. The system and method provide an improvement over conventional computer vision (CV) systems by utilizing object locating information that is transmitted, and also by keeping a storage table of learned and fixed objects. The provided system and method improve the efficiency of object recognition and computer aided maintenance (CAM).

Abstract: A maintenance assistance system and method of operating are provided.