Abstract: A system including a power source, one or more stimulating devices for stimulating the visual cortex of a user to present a perceived virtual image responsive to the stimulating, one or more sensing devices for sensing electrical signals in the motor and/or pre-motor cortex of the user and a processor/controller connected to the stimulating and sensing devices and programmed to sense signals from the motor and/or pre-motor cortex of the user. The sensed signals result from the user performing a movement and/or intending to perform a movement and/or imagining the performing of a movement and are used to interact with the presented virtual image. The processor/controller processes the sensed signals to obtain computed data indicative of a user's interaction with the virtual image, and performs a general computing task responsive to the computed data.

Abstract: A digital content operating apparatus, including: a communication unit which communicates with an external device which has a display for displaying the digital content; a user operation interface which receives a user operation to control the digital content which is displayed on the external device; a display which displays either a linear content operation panel or an interactive content operation panel; and a controller which controls the user operation interface corresponding to information on the digital content which is displayed on the external device; wherein either the linear content operation panel or the interactive content operation panel is displayed alternatively as the user operation interface on the display.

Abstract: A method for performing an action associated with a motion based input. the method comprises: measuring, using a motion sensor of a computing device, motion data representing a detected motion of the computing device; measuring, using a proximity sensor of the computing device, proximity data representing a proximity of the computing device to an object over a duration of the detected motion; matching the measured motion data and measured proximity data to a gesture based on the detected motion and the proximity of the computing device to the object over the duration of the detected motion; and in response to matching the measured motion data and measured proximity data to the gesture, performing an action associated with the gesture.

Abstract: According to one embodiment, a calculation system includes a detector, a combiner, and a duration calculator. The detector refers to a plurality of images of an object imaged from mutually-different angles, detects the object in each of the images, and calculates a provisional position of the object in a coordinate system for each of the images. The coordinate system is prescribed. The combiner calculates a combined position of the object in the coordinate system by using the calculated plurality of provisional positions. The duration calculator refers to process information and a plurality of execution regions and calculates a duration of at least a portion of a plurality of processes based on the combined position and the execution regions. The process information includes information relating to the processes. The execution regions are represented using the coordinate system. The processes are executed in the execution regions.

Abstract: One or more systems and/or methods for adjusting a user interface based upon an orientation of an input object are provided. An input provided by an input object (e.g., a hand of the user) may be received through a display of a device (e.g., a touchscreen display of a smartphone). The input may comprises gesture data corresponding to a gesture performed relative to the display. The input may be evaluated to determine an orientation, such as a hand orientation, of the input object. In an example, curvature associated with the gesture may be evaluated to determine the orientation of the input object. A user interface displayed by the device may be adjusted based upon the orientation of the input object. In an example, a location, a size, an appearance, an output, and/or a functionality of a user interface element displayed within the user interface may be adjusted.

Abstract: A light filed (LF) display system for displaying holographic content to viewers in an amusement park (e.g., as part of an amusement park ride). The LF display system in an amusement park includes LF display modules tiled together to form an array of LF modules. In some embodiments, the LF display system includes a tracking system and/or a viewer profiling module. The tracking system and viewer profiling module can monitor and store characteristics of viewers on the amusement park ride, a viewer profile describing a viewer, and/or responses of viewers to the holographic content during the amusement park ride. The holographic content created for display on an amusement park ride can be based on any of the monitored or stored information.

Abstract: A display device displays a guidance display for guiding a control operation on a display screen when receiving the control operation. The display device includes an operation source determination part that determines a source of the control operation based on the control operation received and a guidance display generator that, according to the determined source, displays the guidance display corresponding to the source on the display screen.

Abstract: A system for rendering a heads-up display element oriented to the surrounding terrain to alleviate cognitive fatigue and eye strain defines buffer regions around a useable region. An orientation element tracks the movement and/or orientation of the user's head and adjusts the useable region via corresponding movements within the buffer regions to align the useable region with the terrain. The orientation element may include a motion tracking camera, micro-electromechanical motion tracking device, etc. Text within the useable region is anchored to a relative location with respect to the horizon for small movements via small translations of the useable region within the buffer regions. For larger movements, the useable is allowed to drift outside the display area completely, and gradually dragged back to a default location according to some time function.

Abstract: In certain embodiments, an input device includes a housing, a processor disposed in the housing, and an image sensor to track a movement of the input device with respect to an underlying surface. The image sensor includes a pixel array and operates in two modes of operation including a first mode of operation where the processor causes the image sensor to utilize a first plurality of pixels in the pixel array when tracking the movement of the input device or a second mode of operation where the processor causes the image sensor to utilize a second plurality of pixels in the pixel array when tracking the movement of the input device, where the second plurality of pixels has fewer pixels than the first plurality of pixels.

Abstract: A method for displaying at least one additional item of display content on a display panel which is arranged in an interior of a vehicle, in which at least one sensor is used, using which a spatial corridor in the interior of the vehicle is optically monitored. The spatial corridor is delimited by two virtual boundary surfaces. At least one spatial virtual reference surface is defined in the spatial corridor between the virtual boundary surfaces, to which the at least one additional item of display content is assigned. The at least one sensor is used to detect whether a hand of a user is located in the corridor.

Abstract: A head-mounted display may display images in eye boxes. Right and left gaze tracking sensors may gather left eye gaze information from a left eye box and right eye gaze information from a right eye box. During operation in a first mode in which the right and left gaze tracking sensors are not impaired, gaze information from the right and left gaze tracking sensors may be used in presenting foveated and distortion-corrected image content on the displays and/or in otherwise operating the left and right displays. During operation in a second mode in which one of the gaze tracking sensors is impaired, gaze information for the impaired sensor may be estimated from gaze information for the unimpaired sensor in combination with an object depth estimate based on depth buffer information, vestibulo-ocular-reflex gain information, and historical information.

Abstract: Disclosed are examples of a system for automated verification of the identity of a user accessing a physical resource using a client device. The client device can broadcast data to a security device. If the data includes a user credential, the security device can provide the user credential to a verification server to obtain profile information. If the data does not include a user credential, the security device can provide a verification request to the client device. If the user accepts the verification request, the client device can provide a user credential and an identity token to the security device. The security device can provide the user credential to a verification server to obtain profile information. The security device can validate the identity token using the profile information. If the user declines the verification request, the client device can instruct the user to proceed to a verification terminal.

Abstract: Systems and methods are described for estimating a direction of interest of a user. In some embodiments, a method of estimating a direction of interest of a user includes tracking a head orientation of the user, detecting a shift in the head orientation, determining a head rotation rate during the shift in the head orientation, and estimating the direction of interest of the user based at least in part on the head rotation rate.

Abstract: A smartphone case for holding and protecting a smartphone, while also having various features for controlling an app, such as a video game running on the smartphone. The smartphone case includes a case body having a case back, and a case side wall that extends circumferentially around the case back, including four corners. The case side wall also extends above and below a smartphone held by the case, thereby forming a front rim and a back rim. The case side wall also includes corner connectors configured to connect with a swappable input control module. The case back also includes dedicated controls, and at least one recess for storing a swappable control module while not in use. A long side of the case side wall includes a left bumper and a right bumper. An app provides a GUI for assigning the dedicated and swappable controls for an app to be controlled.

Abstract: A robot operating in an environment provides cues to users. These cues provide information to the user as to operation of the robot. Some cues may involve physical movement of at least a portion of the robot. For example, as the robot passes a user, the robot may tilt a display head up and down to simulate a nodding motion. The cues may comprise one or more motions of one or more parts of the robot. The cues may also comprise visual output, such as graphics, pictures, text, and so forth, being presented on a display device of the robot, or changing the color or brightness of a light. In some implementations, the cues may include audio output, such as sounds.

Abstract: An antenna for receiving wireless power from a transmitter is provided. The antenna includes multiple antenna elements, coupled to an electronic device, configured to receive radio-frequency (RF) power waves from the transmitter, each antenna element being adjacent to at least one other antenna element. Furthermore, the multiple antenna elements are arranged so that an efficiency of reception of the RF power waves by the antenna elements remains above a predetermined threshold efficiency when a human hand is in contact with the electronic device, the predetermined threshold efficiency being at least 50%. Lastly, at least one antenna element is coupled to conversion circuitry, which is configured to (i) convert energy from the received RF power waves into usable power and (ii) provide the usable power to the electronic device for powering or charging of the electronic device.

Abstract: A method and a communication device for changing the shape of a flexible communication device is suggested. The suggested method is initiated by recognizing a request for actuating a haptic effect on the communication device. At least one property associated with the requested haptic effect, and at least one property of the communication device, where the latter is being caused by the shape of the communication device, are determined. Based on the mentioned properties, a determination is made on whether conditions, specifying requirements for reproducing the haptic effect on the communication device, are met or not. In case the mentioned conditions are not met, a modification of the shape of the device is determined, such that after such a modification the conditions are met with respect to the mentioned properties.

Abstract: Provided is a game system or the like capable of setting a game field relatively wide. This game system provides a training game that progresses through a navigation character or a waiting character that moves in accordance with a user instruction in a game field of a monitor that displays a room screen including the game field. Further, for example, the game system specifies a position relationship between a waiting position and a guide position, when the user instructs the waiting character to move from the waiting position to the guide position in the game field, and changes a moving speed of the waiting character between a normal speed and a special speed in accordance with the specified position relationship, when the waiting character moves from the waiting position to the guide position.

Abstract: A digital content operating apparatus, including: a communication unit which communicates with an external device which has a display for displaying the digital content; a user operation interface which receives a user operation to control the digital content which is displayed on the external device; a display which displays either a linear content operation panel or an interactive content operation panel; and a controller which controls the user operation interface corresponding to information on the digital content which is displayed on the external device; wherein either the linear content operation panel or the interactive content operation panel is displayed alternatively as the user operation interface on the display.

Abstract: Methods and devices for minimizing and maximizing displayed output associated with applications are provided. More particularly, an application presented across two or more screens of a device in a landscape mode can be minimized to present portion of the application in one of the screens. With respect to a maximization operation received with respect to a page of an application results in the expansion of the displayed portion of the application to multiple screens of the device. Input to effect minimization and maximization operations can be entered in one or more gesture capture regions associated with the screens.

Abstract: An eye open or closed state detection method, in addition to an eye opening feature, an iris shape feature and/or a vertical direction feature are added to identify the eye open or closed state, where the eye opening feature is used to represent an eye opening degree, the iris shape feature is used to represent a shape of an iris of an eye, and the vertical direction feature is used to represent a change degree of an eyelid curve.

Abstract: A display device displays a guidance display for guiding a control operation on a display screen when receiving the control operation. The display device includes an operation source determination part that determines a source of the control operation based on the control operation received and a guidance display generator that, according to the determined source, displays the guidance display corresponding to the source on the display screen.

Abstract: A vehicle control method and an intelligent computing device for controlling a vehicle are disclosed. An intelligent computing device for controlling a vehicle according to an embodiment of the present disclosure acquires a direction of a line of sight of a passenger of a vehicle through at least one sensor included in the vehicle and displays driving information of the vehicle through at least one of a plurality of displays included in the vehicle on the basis of the direction of the line of sight of the passenger, to thereby provide convenience to the passenger. One or more of the autonomous vehicle, the intelligent computing device and the server of the present disclosure can be associated with artificial intelligence (AI) modules, unmanned aerial vehicle (UAV) robots, augmented reality (AR) devices, virtual reality (VR) devices, 5G service related devices, etc.

Abstract: Systems and methods for managing graphics processor usage by modern workspaces are described. In an embodiment, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: determine a graphical processing characteristic of each of a plurality of workspaces, and identify a responsive action for a given one of the plurality of workspaces based, at least in part, upon the graphics processing characteristic of the given workspace.

Abstract: Systems and methods are provided to enable users to interact with user terminals having a touch screen interface without requiring the user to physically contact a surface of the touch screen interface.

Abstract: There is provided an information processing device enabling reduction in cost and identification of input devices, the information processing device including: a light emission control unit that performs control such that a first light emission instruction is output to a first input device, if first identification information has been received from the first input device; and a processing unit that associates first light emission position information with the first identification information, if the first light emission position information has been acquired, the first light emission position information indicating a position where light has been emitted by a first light emission unit of the first input device.

Abstract: A mobile computing device with a touch-sensitive display wherein: a pointer is displayed; a control icon is displayed; a contact on the touch-sensitive display is detected; and in response to detecting a change in a horizontal position of the contact beginning anywhere on the control icon, a horizontal position of the pointer is changed wherein the horizontal position of the pointer with respect to the control icon is changed; and in response to detecting a change in a vertical position of a contact beginning anywhere on the control icon: a vertical position of the pointer is changed; and a vertical position of the control icon is changed.

Abstract: Inventive concepts are configured to protect a passenger by processing an area in a windshield, which matches to a position of a spot on a road, wherein the spot is defined as desirable to not be seen by the passenger when a vehicle is travelling. To this end, the area in the windshield, which matches to a spot on an actual road defined in advance as desirable to not be seen by the passenger, is processed as an invisible area for passenger protection so that the passenger is prevented from visually recognizing the spot. However, when road information required for driving of the vehicle is occluded due to the invisible area which is processed or displayed on the windshield, safe driving is significantly disrupted so that actual road information is overlaid on the invisible area.

Abstract: An offset calculation device includes a determination unit configured to determine a rotation state of an object having an angular velocity sensed by a gyro sensor based on a moving average value of sensed angular velocity during a plurality of time periods differing from each other, the moving average value being calculated from chronological data of numerical values corresponding to the sensor data output from the gyro sensor. The offset calculation device further includes a calculation unit configured to calculate an offset value of the sensor data based on the sensor data corresponding to a time period in which the target object was deemed to be in a non-rotation state by the determination unit.

Abstract: An image capturing apparatus is provided that is configured to generate an operation screen relating to an image stored in a storage unit, output the generated operation screen to a display apparatus, acquire attitude information relating to an attitude of the image capturing apparatus, converting the acquired attitude information into position information relating to a position of a position display component on the operation screen and display the position display component on the operation screen based on the converted position information, accept an initialization operation of initializing the position of the position display component, and display the position display component at an initial position of the operation screen in response to accepting the initialization operation.

Abstract: In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, one or more input devices, and a display. The method includes displaying, on the display, a reader interface including one or more portions of reading content. The method further includes detecting, via the one or more input devices, a first positional change input. The first positional change input is indicative of the electronic device changing from a first position to a second position. The method further includes, in response to detecting the first positional change input, ceasing to display the reader interface including the one or more portions of reading content, and displaying, on the display, one or more computer-generated representations corresponding to the one or more portions of reading content.

Abstract: Control of a display of a wearable device is described herein. The wearable device may receive, from the camera, a video stream that depicts a physical environment according to a first level of magnification. The wearable device may present, on the display, the video stream at the first level of magnification. The wearable device may determine that a movement measurement from the movement sensor satisfies a measurement threshold. The wearable device may present, based on determining that the movement measurement satisfies the measurement threshold, the video stream at a second level of magnification.

Abstract: A visibility improvement method using gaze tracking includes detecting a gaze of a user using a camera; determining a focus object at which the user gazes from among at least one object viewed through a display unit of an electronic device; and displaying, on the display unit, an image with high visibility that corresponds to the focus object and has higher visibility than the focus object.

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

Abstract: A method for object tracking. The method includes capturing, using a camera device, a sequence of images of a scene, detecting, based on a pattern of local light change across the sequence of images, a light source in the scene, comparing, in response to detecting the light source, a location of the light source in at least one image of the sequence of images and a current position of a transport robot to generate a result, and generating, based on the result, a control signal for moving the transport robot toward the light source such that the light source aligns with a target position within the field-of-view.

Abstract: The system according to the invention for haptic interaction with virtual objects comprises a visualisation unit for visualising virtual objects and the user's hand, a haptic output unit for reproducing haptic impressions at least by means of force feedback on fingertips of the user's hand, and a data processing unit for processing input data and controlling the visualisation unit and the output unit. The output unit has at least two movement-coupled segments of the interaction region, a finger-based positioning system, and a global positioning system, as well as a sensor system and actuator system. The movement-coupled segments are designed as touch surfaces, and each movement-coupled segment is assigned to one fingertip of the user's hand and can be moved by the latter. The position of the fingertip on the movement-coupled segment can be changed.

Abstract: Systems and methods are provided for generating, selecting, modifying and/or otherwise configuring occluder(s) used in mixed-reality environments. Pose information of a trackable device worn or carried by a user is determined. Based on that pose information, an assumption regarding the user's own pose is determined. An occluder is then configured in a manner to correspond to the assumed pose of the user for use in the mixed-reality environment. By generating the occluder in this manner, improved battery life by the trackable device can be achieved relative to conventional systems that rely entirely on iterative scanning of the user's body to determine body position.

Abstract: The present disclosure relates to methods, apparatus or systems for determining an aiming direction (22) of a remote motorized camera (10). The immersive video content captured by the camera (10) is associated with reference directions (13). Parameters of a discrepancy function (32, 42, 53) are calculated. This function is used to control the aiming direction (22) of the camera. It introduces a discrepancy between the rotation wanted by the user (21) and the rotation of the camera (22). An example purpose of the present disclosure is to encourage a user to rotate the camera toward reference directions, preventing him/her to rotate the camera toward the opposite direction. The present principles have the advantage to create pseudo-haptic effects, inciting the user to look toward a reference direction without making him/her sick.

Abstract: An information processing apparatus includes: an imaging unit having an image sensor to detect a plurality of pieces of pixel information, the imaging unit being configured to generate an image made up of the plurality of pieces of pixel information detected by the image sensor; an image processor to detect whether a user is present or not in a predetermined detection range, based on an image made up of a plurality of pieces of pixel information detected by the image sensor; and an operation control unit to, when the image processor detects the user in the predetermined range, cancel a standby state where a part of the system functions stops. In the standby state, the imaging unit increases at least one of resolution and a frame rate in a stepwise manner to detect the plurality of pieces of pixel information.

Abstract: A method for controlling a robot includes: establishing a reference coordinate system; capturing a user's gaze direction of an indicated target; acquiring a sight line angle of the robot; acquiring a position of the robot; acquiring a linear distance between the robot and the user; calculating in real time a gaze plane in a user's gaze direction relative to the reference coordinate system based on the sight line angle of the robot, the position of the robot and the liner distance between the robot and the user; and smoothly scanning the gaze plane by the robot to search for the indicated target in the user's gaze direction.

Abstract: Technology for determining at least one physical property of a physical volumetric substance within a container over a time interval and rendering a virtual representation of the physical volumetric substance in a virtual reality environment. At least one physical property of the physical volumetric substance is captured by a plurality of snapshots over a time interval. The plurality of snapshots is captured by one or more components capable of identifying at least one physical property of the physical volumetric substance. The plurality of snapshots is transmitted to process, render and/or display a virtual representation of the physical volumetric substance. The virtual representation of the physical volumetric substance is based, at least in part, on the captured plurality of snapshots. An indicator data set, indicative of the one or more physical properties of a physical volumetric substance, may be transmitted to an external client.

Abstract: There is provided an information processing device, an information processing method, and a program are provided that enable displaying predetermined contents at the user-intended timing.

Abstract: Disclosed are a gesture recognition method and apparatus, an electronic device, and a storage medium. The method includes: obtaining a hand detection result by detecting a to-be-processed image; in response to the hand detection result including a bounding box of hand, determining that a hand pose in the bounding box of hand conforms to a hand pose in a target gesture; determining that the hand is located in a pre-defined area of the to-be-processed image; and determining that the hand makes the target gesture.

Abstract: A telepresence communication uses information captured by a first capture device about a first user and information captured by a second capture device about a second user to generate a first avatar corresponding to the first user and a second avatar corresponding to the second user. A scene can be rendered locally or by a remote server in which the first avatar and the second avatar are both rendered in a virtual space. The first avatar is rendered to move based on movements made by the first user as captured by the first capture device, and the second avatar is rendered to move based on movements made by the second user as captured by the second capture device. The avatars may be realistic, based on avatar templates, or some combination thereof. The rendered scene may include virtual interactive objects that the avatars can interact with.

Abstract: The present application provides a virtual reality interaction method. The virtual reality interaction method includes acquiring a reference pupil image of a user; determining a pupil position in the reference pupil image; determining a gaze point in a virtual image based on the pupil position in the reference pupil image and a mapping relationship between first coordinates in a first coordinate system of the reference pupil image and second coordinates in a second coordinate system of the virtual image; and executing an operation based on a determination that the gaze point is in an activatable region of the virtual image and a determination of a gaze state.

Abstract: An optical mouse includes a pixel array and a light source. A method for determining when the optical mouse is in a lifted condition above a surface includes: accumulating pixel values of a first column of the pixel array, the first column being closest to the light source; accumulating pixel values of a second column of the pixel array, the second column being different from the first column; comparing the accumulated pixel values of the first column with the accumulated pixel values of the second column; and when a difference between the accumulated pixel values of the first column and the accumulated pixel values of the second column is greater than a threshold value, determining the optical mouse to be in a lifted condition.

Abstract: An information processing apparatus that includes a display control unit that generates display information for controlling a display device to display a first virtual object defined in a virtual space, and a second virtual object different from the first virtual object, and a controller that controls the display device are provided. The controller controls, when determining that a reference position of the first virtual object is located inside the second virtual object, the display device to display the first virtual object at a position at which the first virtual object is externally tangent to the second virtual object, and controls, when determining that an operation to space the first virtual object away from the second virtual object is performed, a display position of the first virtual object such that the reference position and the display position of the first virtual object gradually become the same in association with the operation.

Abstract: This relates to a device that detects a user's motion and gesture input through the movement of one or more of the user's hand, arm, wrist, and fingers, for example, to provide commands to the device or to other devices. The device can include a plurality of myoelectric sensors configured to detect one or more electrical signals from a body part of a user indicative of one or more movements. A plurality of signals indicative of the detected one or more electrical signals may be generated. The device may also include a wireless communication transmitter configured to communicate with a peripheral device and a processor. The processor may be configured to receive the plurality of signals from the plurality of myoelectric sensors, use the plurality of signals together to determine a gesture, and communicate one or more of: the plurality of signals and the gesture to the peripheral device.

Abstract: Methods, systems, and media for object grouping and manipulation in immersive environments are provided.

Abstract: The present disclosure relates to a method for providing assistance to a colorist in color grading of a virtual reality video content, called VR content. The method includes receiving the VR content being graded by a color grading station and receiving position information representative of the position of at least one hand of a colorist versus the color grading station. The method further includes generating, based on the position information, visual control information showing the position of the at least one hand of the colorist versus at least one grading control element of the color grading station and displaying the visual control information together with the graded VR content on a head mounted display carried by the colorist in order to help the colorist manipulating the at least one grading control element.