Abstract: Implementations of the subject technology provide systems and methods for displaying virtual content that is supplemental to video content being displayed to a user. The virtual content can be generated based on the video content being displayed, including based on scene content obtained for the video content and/or detected in the video content. The scene content can be identified, by the device providing the supplemental virtual content, in real time during playback of the video content.

Abstract: Techniques for managing electronic user profiles are presented herein. An example method includes accessing, from a data structure, a user profile. The user profile can include a profile identifier and a plurality of data fields. The method also includes displaying, on a display device, an interactive user interface. The user interface can include a plurality of user interface action elements. Each of the user interface action elements can be associated with a data field in the data structure. Each of the user interface action elements can also be individually selectable by a respective user action to transmit the associated data field to a remote device. In response to receiving a selection of a user interface action element, the method can further include transmitting the associated data field and the profile identifier to a router configured to send, based on the profile identifier, the associated data field to the remote device.

Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

Abstract: Visual-inertial tracking of an eyewear device using sensors. The eyewear device monitors the sensors of a visual inertial odometry system (VIOS) that provide input for determining a position of the device within its environment. The eyewear device determines the status of the VIOS based information from the sensors and adjusts the plurality of sensors (e.g., by turning on/off sensors, changing the sampling rate, of a combination thereof) based on the determined status. The eyewear device then determines the position of the eyewear device within the environment using the adjusted plurality of sensors.

Abstract: In some implementations, a method includes: determining a location for virtual content; detecting a user interaction with the virtual content; in response to detecting the user interaction with the virtual content, determining a position of a hand gesture during the user interaction with the virtual content; in accordance with a determination that the position of the hand gesture is within a threshold distance relative to the location of the virtual content, generating corrected hand tracking data associated with the user interaction with the virtual content; and in accordance with a determination that the position of the hand gesture is outside of the threshold distance relative to the location of the virtual content, generating uncorrected hand tracking data associated with the user interaction with the virtual content.

Abstract: In some embodiments, an electronic device navigates between user interfaces based at least on detecting a gaze of the user. In some embodiments, an electronic device enhances interactions with control elements of user interfaces. In some embodiments, an electronic device scrolls representations of categories and subcategories in a coordinated manner. In some embodiments, an electronic device navigates back from user interfaces having different levels of immersion in different ways.

Abstract: An electronic device, with a display, a touch-sensitive surface, one or more processors and memory, displays a first representation of a first controllable external device, where the first controllable external device is situated at a location. The device detects a first user input corresponding to a selection of the first representation of the first controllable external device. The device, after detecting the first user input, adds data identifying the first controllable external device and a first state of the first controllable external device in a scene profile.

Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.

Abstract: In aspects of providing user feedback via a rollable screen device, a mobile device has a housing and a screen moveable relative to the housing such that the mobile device has a compact form factor and an expanded form factor. The mobile device includes one or more sensors positioned relative to the screen for detecting user input including one or more forces applied to an expanded portion of the screen, where the expanded portion of the screen has extended from a compact portion of the screen. The mobile device implements a configuration manager configured to activate one or more components of the mobile device to indicate that the mobile device received the user input based on the one or more forces satisfying a threshold value.

Abstract: An information processing device is provided which includes a first acquisition unit (214) configured to acquire a control command that is inputted by a first user and corresponds to presentation unit information for designating a presentation unit for presenting a tactile stimulus by a tactile presentation device and mode information for designating a mode of the tactile stimulus; a generation unit (218) configured to generate a tactile control signal for presenting the tactile stimulus to the presentation unit in accordance with the control command; and a first distribution unit (222) configured to distribute the tactile control signal to the tactile presentation device worn on a body of a second user.

Abstract: A knob apparatus includes a touch panel, a touch-sensing controller, and a knob. The touch panel has multiple touch-sensing electrodes. The touch-sensing controller is coupled to the touch-sensing electrodes of the touch panel. The touch-sensing controller detects a touch event of the touch panel through the touch-sensing electrodes. The knob has a base and a knob cap. The knob cap is pivoted on the base. The base is attached to the touch panel. Multiple conductive electrodes are disposed at different positions of the base. The touch-sensing controller detects the conductive electrodes of the base of the knob through the touch-sensing electrodes of the touch panel to learn a rotation direction of the knob cap on the base.

Abstract: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) camera includes pairing an interactable augmented reality (AR) overlay with the IoT device. The interactable overlay includes control information for generating a control signal for controlling the IoT device when the interactable overlay is interacted with by the AR camera. The interactable overlay is presented on a display of the AR camera when the IoT device is in a field of view of the AR camera. An indication that the user has pointed the AR camera at the interactable overlay associated with the IoT device on the display of the AR camera is provided, and a control signal associated with the interactable overlay pointed at by the AR camera is provided to the at least one IoT device associated with the interactable overlay pointed at by the AR camera.

Abstract: The technology disclosed also initializes a new hand that enters the field of view of a gesture recognition system using a parallax detection module. The parallax detection module determines candidate regions of interest (ROI) for a given input hand image and computes depth, rotation and position information for the candidate ROI. Then, for each of the candidate ROI, an ImagePatch, which includes the hand, is extracted from the original input hand image to minimize processing of low-information pixels. Further, a hand classifier neural network is used to determine which ImagePatch most resembles a hand. For the qualified, most-hand like ImagePatch, a 3D virtual hand is initialized with depth, rotation and position matching that of the qualified ImagePatch.

Abstract: A touch screen device is disclosed. The touch screen device includes a touch screen panel having a capacitive sense array, and a passive dial including first, second and third conductive parts. The first conductive part and the third conductive part are in proximity to a surface of the touch screen panel, and the second conductive part is conductively coupled to the third conductive part when the passive dial is pressed and is not conductively coupled to the third conductive part when the passive dial is not pressed. A position of the first conductive part above the capacitive sense array corresponds to a touch index in the capacitive sense array and a position the third conductive part above the capacitive sense array corresponds to a button press index in the capacitive sense array. The first, second and third conductive parts are movable in conjunction with a rotation of the passive dial.

Abstract: Disclosed is an imaging system of a display apparatus with gaze-tracking means and processor(s). The processor(s) is/are configured to: process gaze-tracking data, collected by the gaze-tracking means, to detect gaze directions of a user's eyes; determine a gaze convergence distance, based on a convergence of the gaze directions of the user's eyes; identify a region of interest in a given image frame, based on a gaze direction of a given eye of the user from a perspective of which the given image frame is rendered; and generate a reprojected image frame, by reprojecting the region of interest using six degrees-of-freedom reprojection, whilst considering the gaze convergence distance as an optical depth of pixels of the region of interest.

Abstract: A device implementing a system for power management includes at least one processor configured to, detect first gesture state associated with motion of a device, the first gesture state being associated with meeting a first threshold of device motion, and set, in response to detecting the first gesture state, the device to a first power state. The at least one processor is further configured to detect, subsequent to detecting the first gesture state, a second gesture state associated with motion of the device, the second gesture state being associated with meeting a second threshold of device motion, and set, in response to detecting the second gesture state, the device to a second power state. The at least one processor is further configured to update, based on setting the device to the second power state, image data on a display of the device.

Abstract: A training apparatus has an input device and a wearable computing device with a bio-signal sensor and a display to provide an interactive virtual reality (“VR”) environment for a user. The bio-signal sensor receives bio-signal data from the user. The user interacts with content that is presented in the VR environment. The user interactions and bio-signal data are scored with a user state score and a performance scored. Feedback is given to the user based on the scores in furtherance of training. The feedback may update the VR environment and may trigger additional VR events to continue training.

Abstract: According to an example embodiment, an electronic device outputs, on a second display screen, a page layout output on a first display screen along with another page layout grouped together with the page layout in response to a screen switch from the first display screen to the second display screen having a greater display area than a display area of the first display screen, and switches the grouped page layouts in response to a swipe input being detected.

Abstract: Provided is a computing device of a group based communication system configured to initiate and execute a group-based communication browser session. An example computing device is configured to receive a group-based communication browser session initiation request. After receiving a group-based communication browser session initiation request, the example computing device will determine whether the computing is connected to an Internet. If the computing device is determined to be connected to the Internet, the example computing device determine whether a group-based communication service cache is available. If the group-based communication service cache is available, the example computing device will fetch a group-based application asset set from the group-based communication service cache. Then the example computing device will determine whether a group-based communication browser cache is available.

Abstract: There is provided a human operable controller for controlling an application on an external computer system, the controller comprising: a controller body comprising a front and a back, wherein the front is opposite to the back; a thumb-operable control area arranged at the front of the controller body; a plurality of depressible buttons and a touch sensor arranged at the thumb-operable control area; wherein the controller body is shaped to be held in a hand or hands of a user of the controller such that the plurality of depressible buttons is operable by a thumb of the user with or without touching the touch sensor; a processing circuitry for generating at least one control signal based on user interaction with the plurality of depressible buttons and the touch sensor; and a communication interface for communicatively coupling with the external computer system and for providing the control signal to the external computer system to control the application.

Abstract: Systems, apparatuses, and methods are described for synchronizing output of a plurality of user devices. An immersive experience for users may be provided by mapping what the users are watching into functionalities of the user devices. Manifest files may comprise information determined for audio and/or video features of segments of audiovisual content. The manifest files may be used by secondary user devices to output visual effects in synchronization with output of audiovisual content by a primary user device.

Abstract: A wearable electronic device according to an embodiment may comprise a plurality of speakers, a plurality of vibration devices, and at least one processor. The at least one processor may be configured to identify a first object corresponding to a first sound and a position of the first object in a virtual space of VR content displayed through the display. The at least one processor may be configured to obtain a second sound corresponding to the movement of the first object based on the first sound and the position of the first object. The at least one processor may be configured to output the second sound through the plurality of speakers. The at least one processor may be configured to determine one or more vibration devices corresponding to the movement of the first object among the plurality of vibration devices. The at least one processor may be configured to control the one or more vibration devices to vibrate while the second sound is output through the plurality of speakers.

Abstract: A work machine comprises a joystick to control a movement of the work machine, a lock lever to control a hydraulic system of the work machine, a display to output information to an operator inside the work machine, and processing circuitry. The processing circuitry is configured to lock the hydraulic system without receiving an input from the lock lever, perform an idling stop operation of an engine of the work machine, output, on the display, an instruction for the operator to operate the joystick to restart the engine of the work machine, detect a predetermined operation of the joystick, perform an engine restart operation, under a condition that the predetermined operation of the joystick is detected, and unlock the hydraulic system without receiving the input from the lock lever.

Abstract: A projector controlling method includes causing at least one of a first projector and a second projector to accept an instruction of movement of a region where a first image is projected from a first region to a third region and movement of a region where a second image is projected from a second region to a fourth region, upon reception of the instruction, causing the first projector to move the first image from the first region to the third region at a first movement speed, and causing the second projector to move the second image from the second region to the fourth region at a second movement speed.

Abstract: A display panel includes: a substrate including a main display area, a component area, and a peripheral area; a main sub-pixel at the main display area on the substrate; a main pixel circuit connected to the main sub-pixel, and including a main storage capacitor; an auxiliary sub-pixel at the component area on the substrate; an auxiliary pixel circuit at the peripheral area on the substrate, and including an auxiliary storage capacitor; and a connecting line connecting the auxiliary sub-pixel to the auxiliary pixel circuit. A capacity of the auxiliary storage capacitor is greater than a capacity of the main storage capacitor.

Abstract: A system and method for compensating for reflections caused by light-generating objects in the scene facing a display device includes capturing images of the scene. Reflection-inducting zones corresponding to the light generating objects are identified from the captured images. The reflection effect on the display device from the reflection-inducing zones are estimated. A target image to be displayed on the display device is adjusted based on the estimated reflection effect.

Abstract: An immersive scene monitoring system presents a monitoring interface providing a virtual reality (VR)/augmented reality (AR) view of a scene associated with production operation(s) for a (e.g., pharmaceutical) product. The VR/AR view of the scene may be displayed with interactable graphical elements representing input fields corresponding to attributes of quality management events to be generated. The system generates the quality management events based on input (e.g., voice, gesture) received via the monitoring interface. The VR and/or AR view of the scene may be displayed with indicators of detected anomalies, and the input fields and/or corresponding attributes may be automatically populated by the system based on recognized objects and/or anomalies depicted in captured image data of the VR/AR view of the scene. The system can be configured for different scenes pertaining to different production operations and/or different products via a configuration interface.

Abstract: A geo-spatial augmented reality (AR) content anchoring and non-fungible token (NFT) minting system and associated processes are disclosed for linking one or more user-owned AR content item(s) to a particular geo-spatial location by NFT and blockchain technology. The geo-spatial AR content anchoring and NFT minting system and processes provide geo-spatial location NFT minting (“geo-minting”) and geo-spatial location NFT storage (“geo-storage”) on blockchain technology. The geo-spatial AR content anchoring and NFT minting system and processes support a process for re-addressing of NFT geo-storage by way of a location indexing system that aggregates NFTs of user-owned AR content within a perimeter, a defined circumference, or an area encapsulated within a circular boundary defined by a radial distance. The geo-spatial AR content anchoring and NFT minting system and processes also support merged NFTs and evolutionary NFTs.

Abstract: Provided is a fingerprint sensor, including: a substrate; a plurality of photosensitive devices disposed on the substrate; a light-emitting module disposed on a side, distal to the substrate, of the plurality of photosensitive devices; and a protective cover disposed on a side, distal to the substrate, of the light-emitting module, wherein the protective cover is provided with a plurality of conductive structures electrically connected to the light-emitting module, the plurality of conductive structures being in one-to-one correspondence with the plurality of photosensitive devices, and an orthographic projection of each conductive structure onto the substrate at least partially being overlapped with an orthographic projection of the photosensitive device corresponding to the conductive structure onto the substrate.

Abstract: A method for operating an electronic device includes transmitting signals to an external electronic device. The method also includes receiving signals from the external electronic device. The method further includes generating location information of the external electronic device relative to the electronic device based on a differences between the transmitted signals and the received signals. Additionally, the method includes determining an action for changing a state on at least one of the electronic device or the external electronic device based on the location information. In response to determining that the action is associated with the electronic device, the method includes performing the action. Additionally or alternatively, in response to determining that the action is associated with the external electronic device, the method includes sending an instruction to the external electronic device to perform the action.

Abstract: Three-dimensional data can be synchronized between a first electronic device and a second electronic device. A content creation application may be running on the first electronic device and may utilize a data file describing a three-dimensional content item. A two-dimensional representation of the content item may be displayed on the first electronic device. A user may request to preview the two-dimensional representation of the content item in three-dimensions. The first electronic device may initiate a data transfer with the second electronic device. The three-dimensional data of the data file may be transferred, via a communication link, from the content creation of the first electronic device to a three-dimensional graphic rendering application at the second electronic device. The three-dimensional graphic rendering application may generate a preview of the content item in three-dimensions based on the received three-dimensional data.

Abstract: Provided is an information processing system that includes an estimation section and a display section. The estimation section estimates emotional information about a target living body on the basis of at least one of biological information or motion information about the target living body acquired by a sensor. The display section displays the emotional information on a display surface.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, receiving at a computer device a plurality of stimulus signals generated by one or more gaming accessory devices of a gamer controlling a gaming application, generating a plurality of gaming stimulations based on the plurality of stimulus signals, generating a plurality of gaming action results from the gaming application responsive to the plurality of gaming stimulations, combining the plurality of gaming action results and the plurality of gaming stimulations to generate a plurality of hardware statistics associated with the gamer, and transmitting to a social network the plurality of hardware statistics associated with the gamer.

Abstract: A display assembly for an automotive interior comprises a dynamically bendable cover panel having first and second panel portions a flexible panel portion connecting the first and second panel portions, a display positioned adjacent the first and second panel portions, and a frame that supports the cover panel and comprises a first frame portion for supporting the first panel portion, a second frame portion for supporting the second panel portion, and a hinge portion coupling the first frame portion and the second frame portion, the hinge portion configured to induce a curvature having smoothly connected arc segments in the flexible panel portion between the first panel portion and the second panel portion when the second frame portion is articulated relative to the first frame portion from a straight position to a deployed position.

Abstract: A position indicator includes a pen-shaped body; control circuitry housed in the pen-shaped body and configured to generate position detection signals and generate additional information about the position indicator; a first receiver; a second receiver different from the first receiver; a first transmitter provided near a distal end of the pen-shaped body and configured to transmit the position detection signals to a sensor of a position detection system; and a second transmitter, which is different from the first transmitter and configured to transmit wireless signals to the position detection system. The control circuitry, in response to a control signal from the position detection system received by the first receiver or the second receiver, controls transmission of the position detection signals and transmission of the additional information via a transmitter selected from the first transmitter and the second transmitter, to the position detection system.

Abstract: A display method for a device having a foldable screen includes: detecting a status of the foldable screen; displaying an application interface on one or more of a first screen of the foldable screen or a second screen of the foldable screen according to a first display policy if the status of the foldable screen is a support state or a folded state; or if the status of the foldable screen is an unfolded state, displaying the application interface on the foldable screen in the unfolded state according to a second display policy, where in the unfolded state the first screen and the second screen form a same plane or form an approximately same plane, and where the first display policy is different from the second display policy.

Abstract: An object orientation indicator for indicating the orientation of an object, such as the vertical positioning of an object to be inserted or being inserted into a surface. The object orientation indicator is configured to determine or indicate when an object being inserted into a surface parallel or non-parallel to the ground is vertically level, i.e. perpendicular to the ground. The object orientation indicator may also be configured to determine or indicate if a preexisting vertical object inserted into a surface parallel or non-parallel to the ground remains in its originally inserted orientation. The object orientation indicator may include a housing assembly and a display panel.

Abstract: Examples of an imaging system for use with a head mounted display (HMD) are disclosed. The imaging system can include a forward-facing imaging camera and a surface of a display of the HMD can include an off-axis diffractive optical element (DOE) or hot mirror configured to reflect light to the imaging camera. The DOE or hot mirror can be segmented. The imaging system can be used for eye tracking, biometric identification, multiscopic reconstruction of the three-dimensional shape of the eye, etc.

Abstract: A grip force sensing and shape-changing steering wheel configured to serve as an intuitive means of communication between a human driver and automatic driving system or driver assist system.

Abstract: Systems and methods for obtaining metrics relating to an extended reality experience and using the obtained metrics to perform remedial actions, such as managing user motion sickness, determining user performance relating to a designed game difficulty, and performing home automation are disclosed. The methods include determining a starting and ending checkpoint in an extended reality experience. Data from a plurality of users as they navigate between the determined checkpoints is obtained and used to determine a metric, such as a median, average, or other representative data. The current user's navigation through the same checkpoints is monitored and compared with the metric. The results from the comparison are used to enhance extended reality experience, which includes customizing the experience for motion sickness, game difficulty level, and home automation.

Abstract: A watching system by which a game video is distributed to display devices of a plurality of watching users has: a computer; the computer accepting viewer operations by the plurality of watching users; the computer evaluating a mutual relationship of input of the viewer operation by each of the plurality of watching users; and the computer controlling an operation effect corresponding to the viewer operation so as to change based on evaluation result of the mutual relationship.

Abstract: Provided is a system for controlling digital cinematic content based on emotional state of characters. A focus on one or more computer-controlled characters appearing in digital cinematic content is determined based on emotion indicators of a first user actively interacting with at least the one or more computer-controlled characters. A set of emotion indicators is inferred for each of the one or more computer-controlled characters based on one or more criteria and multifactor feedback loops are created. A story line of the digital cinematic content and behavioural characteristics of the one or more computer-controlled characters are controlled to achieve a target emotional arc of the first user based on the multifactor feedback loops.

Abstract: The disclosure generally relates to devices and techniques for operating an electronic apparatus that controls a sensor, the devices and techniques including acquiring first sensing data through the sensor, identifying a data variation based on the first sensing data and sensing data for a first time point and a second time point acquired in advance based on a sampling period of the sensor, identifying target data among a plurality of predetermined meaningful data based on the identified data variation and determining a time point at which the target data is to be acquired, and controlling the sampling period based on the determined time point.

Abstract: Systems, devices, and methods are described for mitigating or eliminating distortion patterns (such as those caused by one or more high-volume audio sources) in a display system such as a laser projection system. Frequency components of an incoming sound that correspond to one or more resonant frequencies of an optical reflector of the display system are determined to exceed a defined volume threshold. Responsive to that determination, a magnitude and phase of one or more harmonic motions of the optical reflector are measured. Sound waves are generated to destructively interfere with at least one frequency component corresponding to the resonant frequencies of the optical reflector.

Abstract: When a joystick is positioned within a first dead zone including a neutral position, a controller pauses a shifting action and steering of a propulsion device regardless of a tilt operation and a twist operation of the joystick. When the joystick is positioned within a second dead zone located rearward of the first dead zone, the controller pauses the shifting action of the propulsion device regardless of the tilt operation of the joystick and controls the steering of the propulsion device in accordance with the twist operation of the joystick.

Abstract: A method for controlling effects on a live video stream includes providing a video image from a content creator device and displaying the video image on a first viewer device. A selection of a sticker graphic is received on the first viewer device. A position of a user input operation on the displayed video image is determined. The determined position of the user input operation on the displayed video image is converted to a position of the user input operation on the video image. The selected sticker graphic is applied to the video image at the position of the user input operation on the video image. The applied sticker graphic is displayed along with the video image on at least the first viewer device.

Abstract: An optical device may include (i) a heat source that produces heat while operating, (ii) a thermally conductive optical element that is optically transparent and that dissipates the heat produced by the heat source, and (iii) a thermally conductive connector that transfers the heat between the heat source and the thermally conductive optical element. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Video or graphics, received by a render engine within a graphics processing unit, may be segmented into a region of interest such as foreground and a region of less interest such as background. In other embodiments, an object of interest may be segmented from the rest of the depiction in a case of a video game or graphics processing workload. Each of the segmented portions of a frame may themselves make up a separate surface which is sent separately from the render engine to the display engine of a graphics processing unit. In one embodiment, the display engine combines the two surfaces and sends them over a display link to a display panel. The display controller in the display panel displays the combined frame. The combined frame is stored in a buffer and refreshed periodically.

Abstract: Packaging media for optimizing immersive media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation; acquiring asset information associated with media assets corresponding to a set of scenes included in the immersive media data for the immersive presentation; analysing characteristics of the media assets based on the asset information, the characteristics comprising an asset type associated with a respective media asset and a frequency that indicates a number of times the respective media asset is used among the set of scenes included in the immersive presentation; ordering the media assets in a sequence based on the asset type and the frequency associated with each of the media assets; and streaming the immersive media data for the immersive presentation based on the ordered sequence of the media assets.

Abstract: Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object, upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.