Abstract: A method for an electronic device includes detecting, by one or more processors, a first user operating a first application on the electronic device presenting content on a companion electronic device operating as a primary display for the electronic device while the electronic device is electronically in communication with a smartwatch. The method then redirects one or more first application controls to a user interface of the smartwatch when a second user is physically manipulating the electronic device and operating a second application presenting content on a local display of the electronic device while both the first application and the second application are operating on the electronic device.

Abstract: Aspects discussed herein are directed to ergonomic pointing device systems. In one example, a pointing device system includes an elongate base member, a sleeve disposed to fit over at least a portion of the elongate base member, the sleeve configured to rotate about the elongate base member in a first direction and slide about the elongate base member in a second direction substantially orthogonal to the first direction, and multiple optical sensors disposed within the elongate base member and positioned to detect at least one of a rotational movement of the sleeve relative to the multiple optical sensors and an axial movement of the sleeve relative to the multiple optical sensors.

Abstract: Systems and methods are described in which a light beam generated by a handheld device is used to point toward a selected object or location within a printed page containing visual content, for example displayed in a book or magazine. The object(s) and/or location being pointed at may be determined using a device camera pointed in the same direction as the beam coupled with computer vision methods to determine locations of camera-acquired images within a database of page-content templates. The database may include interactive sequences and/or scenarios associated with page objects and locations. Such interactive sequences may augment the visual content of a printed book to include audible elements, additional visual components, and/or haptic stimulation enacted by the handheld device. Systems and methods may provide simple and intuitive methods for human-machine interactions that may be particularly well-suited for children and other learners.

Abstract: Disclosed is a smart magic cube controller. The smart magic cube controller includes: a controller body, the controller body has a plurality of surfaces, and at least one surface of the controller body is configured to be a display module; an posture sensing module; and a control module in signal connection with the posture sensing module, wherein the control module is configured to determine a current top surface of the controller body according to placement state information collected by the posture sensing module, and transmits, according to the determined current top surface, a scene mode control instruction corresponding to the current top surface, and when the display module is located on a surface, other than the current top surface and the bottom surface of the controller body, the control module is configured to control a display picture of the display module to be displayed upright.

Abstract: Techniques for controlling and/or moving a cursor, such as by using air gestures, are described.

Abstract: A head mounted display system for use on a watercraft is disclosed. The head mounted display system comprises circuitry to determine orientation information of a head mounted display system relative to the watercraft and a display configured to superimpose graphical information over objects in a field of view of at least one eye of a user of the head mounted display system. The graphical information is based on sensor data and the orientation information of the head mounted display. The sensor data is provided by at least one data source associated with the watercraft.

Abstract: A method is provided. The method comprises obtaining, by a processing system and using a piezoelectric device, piezoelectric signals associated with user input on a sensing region of an input device; obtaining, by the processing system and using a corrective device, corrective signals associated with the user input on the sensing region of the input device; determining, by the processing system and based on the piezoelectric signals and the corrective signals, one or more events to be performed in response to the user input; and performing, by the processing system, the one or more events.

Abstract: A method for depicting location attributes in a map environment. The method includes receiving a request for parameters about a first type of location. The method includes determining a first set of directional arrows, where each directional arrow is associated with a location and has a first set of properties based on the parameters about the first type of location. The method further includes determining a selection of a first directional arrow, which is associated with a first location, from the first set of directional arrows. Modifications to the first set of directional arrows are made based on the selection of the first directional arrow.

Abstract: A non-transitory computer-readable recording medium stores an information processing program for causing a computer to execute processing including: acquiring data that indicates a relationship between element actions for a plurality of element actions in an object period; acquiring an effective time that corresponds to an object action; and searching for a combination of two or more element actions that form the object action among the plurality of element actions for each divided section set by dividing the object period according to the acquired effective time on the basis of the acquired data.

Abstract: An identification method applicable to a wireless motion capturing system with multiple wearable devices, which is used to capture the movements of a user operating a virtual avatar model. The identification method includes: receiving a sensor data, where the sensor data is associated with a motion feature, and the motion feature corresponds to nodes of the virtual avatar model; and analyzing the sensor data and identifying the wearable devices as at least one of the nodes.

Abstract: According to an aspect of the present disclosure, a ventilation system includes at least one user directed component and a plurality of sensors configured to detect a plurality of control gestures within a gesture field designated for presentation of control gestures by a user. The ventilation system may further be configured such that a control gesture of the plurality of control gestures is presented within the gesture field for detection of said control gesture by the plurality of sensors, and the plurality of sensors recognizes the control gesture as corresponding to an operation of the at least one user directed component. The ventilation system may still further include a controller for polling the plurality of sensors and converting a recognized control gesture to a command signal for operating the at least one user directed component.

Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

Abstract: A user may interact and select positions in three-dimensional space arbitrarily through conversion of a two-dimensional positional input into a three-dimensional point in space. The system may allow a user to use one or more user input devices for pointing, annotating, or drawing on virtual objects, real objects or empty space in reference to the location of the three-dimensional point in space within an augmented reality or mixed reality session.

Abstract: A system and method for determining a discharge event of a firearm is provided. An event detection module receives (i) acceleration input signals including a first acceleration input signal along a first axis, a second acceleration input signal along a second axis and a third acceleration input signal along a third axis; and (ii) rotation input signals including a first rotation input signal around the first axis, a second rotation input signal around the second axis and a third rotation input signal around the third axis. An acceleration vector magnitude is calculated from the acceleration signals. The acceleration vector magnitude is compared to a threshold acceleration. A sample event candidate is assigned to the acceleration vector magnitude based on the comparing. The sample event candidate comprises the acceleration input signals and the rotation input signals for a predetermined duration of time.

Abstract: Embodiments are directed to intent driven dashboard recommendations. A plurality of collection specifications that declare visualization declarations may be provided such that each collection specification is associated with an author intent. And attributes-of-interest selected from a data source may be provided. A plurality of collections may be generated based on the plurality of collection specifications, the attributes-of-interest, or data from the data source such that each collection may include visualizations that may be based on the visualization declarations. A preference score may be generated for each collection based on the author intent, visualizations in each collection, or the attributes-of-interest. The plurality of collections may be classified based on the preference scores associated with the classified collections such that the classified collections may be displayed based on the preference scores.

Abstract: The subject technology provides for displaying applications on a display while avoiding the display's irregular or undesirable features. The disclosed techniques include determining whether a triggering condition related to an application executing on an electronic device is present, and if so, determining a user interface (UI) adjustment value. The UI adjustment value is applied to a frame that represents all of the content including a user interface of the application to be rendered on the display. The UI adjustment value represents an adjustment to the frame such that, when the adjusted frame is rendered, the user interface of the application is presented on the display except on a predefined portion (e.g., a portion including an irregular feature or region) of the display. The adjusted frame is then rendered to present the user interface of the application on the display except on the predefined portion of the display.

Abstract: A video processing method includes obtaining, in response to an interaction operation received on a portion of a first image, an adjustment parameter corresponding to the interaction operation. The adjustment parameter indicates an adjustment range of a display position of one or more pixels corresponding to the portion of the first image based on the interaction operation. The method further includes obtaining a displacement parameter of the one or more pixels in the portion of the first image, the displacement parameter representing a displacement of the one or more pixels between the first image and a second image displayed after the first image. The method also includes adjusting a display position of one or more pixels in the second image based on the adjustment parameter and the displacement parameter, and displaying the second image based on the adjusted display position of the one or more pixels.

Abstract: An apparatus and method for generating the surface contour of a bone model, a storage medium, and an electronic device. The method comprises: step S101, on the basis of the real-time coordinates of the center of a positioning device acquired by a positioning tracking device, acquiring the real-time coordinate of the tip of a probe moving on the surface of a bone model; and step S102, performing three-dimensional reconstruction on all the real-time coordinates of the tip, so as to obtain a three-dimensional digital model of the surface contour of the bone model.

Abstract: A handwriting input device includes a display section which includes a display surface and which, in operation, displays handwritten input information that is handwritten on the display surface, a position detection sensor which is disposed such that a position detection area of the position detection sensor is superimposed on a display area of the display surface and which, in operation, detects a position corresponding to the handwritten input information, a memory which, in operation, stores electronic data according to the position that corresponds to the handwritten input information and that has been detected by the position detection sensor, a transmission circuit which, in operation, transmits the electronic data stored in the memory to an external device, and a control circuit which, in operation, controls the transmission of the electronic data stored in the memory to the external device via the transmission circuit.

Abstract: A device comprising at least one camera, a display, a memory and a processor, the memory storing instructions which, when executed by the processor, cause the device to: display, using the display of the device, a content to be reviewed by the user; detect, using the camera of the device, user's eyes; detect, using the camera of the device, user's eye movements; determine, based on the detected user's eye movements, whether the user has reviewed the content.

Abstract: A method and a system for filtering ill corpus are provided. The method includes following steps: acquiring a text corpus to be recognized, and preprocessing the text corpus to be recognized to obtain a basic text corpus; extracting entities in the basic text corpus, and performing matching search on the entities of the basic text corpus according to an ill-text knowledge graph to obtain a first recognition result; detecting and recognizing the basic text corpus according to a corpus recognition model to obtain a second recognition result; and filtering the text corpus to be recognized according to the first or/and the second recognition result, and updating the ill-text knowledge graph according to the second recognition result. With semantic network essence and strong correlation ability of knowledge graph technology, candidate ill entities can be obtained, thus facilitating filtering of obscure ill information in forms of pinyin, homophonic words and split words.

Abstract: A display device is disclosed. According to an aspect of the present disclosure, the display device of the present disclosure may include: a flexible display panel; a panel roller which is elongated, and around which the display panel is rolled or unrolled; and a side frame coupled to a lateral side of the display panel and rolled around or unrolled from the panel roller along with the display panel, wherein the side frame may include: a core elongated along the lateral side of the display panel and facing the lateral side of the display panel; a first part covering the core; a second part extending from the first part and facing one surface of the display panel; and a third part extending from the first part and opposite to the second part with respect to the display panel.

Abstract: A computer implemented method and system for determining a communication mode for recording a media message on a communication device is provided. An adaptive recording application detects activation of an interface element, for example, a push or a touch of a button on the communication device and determines duration of the activation of the interface element. The adaptive recording application, in response to the detection of the activation of the interface element, selects a communication mode, for example, a push to talk communication mode, a tap to start communication mode, etc., based on a comparison of the duration of the activation of the interface element with one or more configurable timing parameters and/or a determination of a presence or an absence of a media signal during and/or after the activation of the interface element. The adaptive recording application initiates recording of the media message in the selected communication mode.

Abstract: A gesture-based display interface control method and apparatus, a device and a storage medium, belonging to the technical field of intelligent devices. The method includes: acquiring a first gesture of a user, and determining whether the first gesture is kept for more than a preset time; if the first gesture is kept for more than the preset time, displaying a target virtual gesture point on the current display interface; and acquiring a second gesture of the user, and moving the target virtual gesture point on the current display interface according to the second gesture. According to the method, the virtual gesture point is displayed on the display interface, and the virtual gesture point is randomly moved on the display interface, so that any interactive control on the current display interface can be operated, and gesture control is more intelligent and comprehensive while improving the accuracy of gesture control.

Abstract: An apparatus includes an optoelectronic module including a light emitting die and a light receiver die mounted on a PCB substrate. The optoelectronic module further includes an optical element on the light emitting die and an optical element on the light receiver die, the optical elements being composed of a first epoxy. A second epoxy laterally surrounds and is in contact with respective side surfaces of the light emitting die, the light receiver die and the optical elements, wherein the second epoxy provides an optical barrier between the light emitting die and the light receiver die. A method of manufacturing such modules is described as well.

Abstract: Implementations relate to an automated assistant that provides augmented reality content, via a display interface of computerized glasses, resulting from post-processing of application content. The application content can be identified based on prior interactions between a user and one or more applications, and the application content can be processed to determine objects, and/or object classifications, that may be associated with the application content. When the user is wearing the computerized glasses, and the object is detected within a field of view of the computerized glasses, the automated assistant can cause certain content to be rendered at the display interface of the computerized glasses. In some implementations, the content can be generated to supplement, and/or be different from, existing content that the user may have already accessed, in furtherance of preventing duplicative usage of applications and/or preserving computational resources.

Abstract: Disclosed herein is a sensor system that detects a stylus on at least one panel surface having an effective region. The sensor system includes a memory device including computer-executable instructions, and a processor. The processor, when loaded with the computer-executable instructions, performs: and obtaining a position of the stylus and a pen pressure value indicating a pressure applied to a pen tip of the stylus; outputting the position and the pen pressure value to a host processor. In response to the position being outside the effective region, the processor performs processing to conceal from the host processor occurrence of at least one of a pen-down indicating the stylus contacting the panel surface and a pen-up indicating the stylus being removed from the panel surface.

Abstract: An input device comprising: a printed circuit board (PCB) comprising non-linear circuitry; resistive circuitry including a force-sensitive resistor (FSR) coupled to the PCB in parallel with the non-linear circuitry; and a hinge coupled to the PCB and the FSR configured to strain the FSR in response to a force applied to a tip of the input device.

Abstract: An electronic device has an input which, in operation, receives an input stream of accelerometer data samples indicative of acceleration values along at least one axis. The devices includes circuitry, coupled to the input. The circuitry, in operation, executes an automatic-learning algorithm on blocks of samples of the input stream of accelerometer data samples to identify, for each block, a corresponding condition-of-user-movement from among a plurality of determined conditions-of-user-movement. The circuitry generates a plurality of streams of samples based on the input stream of accelerometer data samples, and for each condition of movement identified, selects a corresponding stream of samples of the plurality of streams of samples. The circuitry executes a wrist-tilt gesture detection algorithm using samples of the selected stream of the plurality of streams of samples.

Abstract: A system for providing discharge monitoring of a firearm includes an event detection module, a signal processing module and a trigger pull sensor assembly. The event detection module has at least one sensor that senses an acceleration and generates an acceleration signal. The signal processing module receives the acceleration signal. The signal processing module is configured to determine whether the acceleration signal is a discharge event and generate an event detection signal based on the determination and is configured to maintain a shot count of the firearm based on the determination that the event detection signal is a discharge event. The trigger pull sensor assembly senses mechanical movement of a trigger of the firearm and communicates a trigger actuation signal to the signal processing module corresponding to a position of the trigger. The event detection signal is further based on the trigger actuation signal.

Abstract: A gamepad and a joystick feedback force device therefor are disclosed. The joystick feedback force device comprises a joystick that is configured to accept a user's operation and is rotatably installed in a casing of the gamepad. The joystick feedback force device further comprises a torque output device, and an output shaft of the torque output device is connected with a rotating shaft of the joystick, so that a torque is applied to the rotating shaft to form a feedback force to the joystick.

Abstract: A wearable electronic device includes one or more processors identifying one or more companion electronic devices operating within a wireless communication radius of the wearable electronic device. One or more sensors identify the wearable electronic device being within a predefined distance of a companion electronic device. A wireless communication circuit, responsive to the one or more processors, delivers an authentication credential to the companion electronic device in response to the one or more sensors identifying that the wearable electronic device is within the predefined distance of the companion electronic device. The one or more sensors thereafter detect a gaze of an authorized user of the wearable electronic device being directed at the companion electronic device, where the wireless communication circuit delivers an actuation command to the companion electronic device.

Abstract: A method of viewing a live image from a microscope through a camera lens of a first personal electronic device is described. The method includes receiving one or more optic powers of a microscope taking the live image entered into a first graphical user interface displayed on a screen of the first personal electronic device, and projecting a measurement tool on a second graphical user interface displayed on the screen of the first personal electronic device with units of measurement based on the entered optic powers. One or more non-transitory, computer-readable storage media and a computer or computer system are also described. Hardware designed to connect a personal electronic device such as a smartphone to a microscope for viewing of a live microscope image through the camera lens of the personal electronic device is also described.

Abstract: Examples of the disclosure enable image augmentations to be used with images of users wearing head mounted items. In examples of the disclosure an apparatus can be configured to use gaze tracking to determine a location of a user's pupil wherein the user is wearing a head mounted item. The apparatus can also be configured to enable display of an indication of the location of the user's pupil so that the indication is visible on a surface of the head mounted item. The indication is configured to be used for positioning at least one image augmentation for a captured image comprising the user.

Abstract: A method for identifying and selecting an object in a virtual or real environment is disclosed. The method comprises: determining a target finder area, at a computing device, within an area displayed by the user interface based on a user profile; determining a list of one or more objects within the target finder area; and presenting one or more of the determined list of one or more objects on the user interface.

Abstract: Provided is an information processing apparatus capable of improving detection accuracy of a position pointed by a target object. An acquisition unit acquires a distance image indicating a distance to each object present within a predetermined range. Subsequently, a vector calculation unit calculates a vector extending from the target object present within the predetermined range in a direction pointed by the target object on the basis of the acquired distance image. Subsequently, an intersection calculation unit calculates a position of an intersection of a predetermined surface present within the predetermined range and the calculated vector on the basis of the acquired distance image. Subsequently, a processing execution unit executes processing corresponding to the calculated position of the intersection.

Abstract: Implementations set forth herein relate to an automated assistant that can adapt to circumstances in which a user may invoke an automated assistant with an intention of interacting with the automated assistant via a non-default interface. For example, in some instances, a user may invoke an automated assistant by selecting a selectable GUI element. In response, the automated assistant can determine that, in the current context, spoken utterances may not be suitable for providing to the automated assistant. Based on this determination, the automated assistant can cause a keyboard interface to be rendered and/or initialized for receiving typed inputs from the user. Should the user subsequently change contexts, the automated assistant can determine that voice input is now suitable for user input and initialize an audio interface in response to the user providing an invocation input in the subsequent context.

Abstract: In some embodiments, an electronic device enhances interactions with virtual objects in a three-dimensional environment. In some embodiments, an electronic device enhances interactions with selectable user interface elements. In some embodiments, an electronic device enhances interactions with slider user interface elements. In some embodiments, an electronic device moves virtual objects in a three-dimensional environment and facilitates accessing actions associated with virtual objects.

Abstract: Systems and methods are provided for performing AR button selection operations on an augmented reality (AR) device. The system displays, by an AR device, a plurality of AR objects on a display region that overlaps a first real-world object, each of the plurality of AR objects being associated with an object selection region. The system computes a first spatial relationship factor for a first AR object of the plurality of AR objects based on a position of the first AR object relative to a position of a second real-world object and adjusts the object selection region of the first AR object based on the first spatial relationship factor. The system activates the first AR object in response to determining that the second real-world object overlaps the object selection region of the first AR object.

Abstract: An activity care zone system includes: an image output module including a plurality of image output devices disposed at predetermined positions in an indoor care zone to project images onto multiple surfaces of six surfaces that constitute the indoor care zone except for an open rear side, in which installation positions and irradiation angles of the image output devices are set such that a shadow of a user is not generated within a field of view of the user located at least in a central area of the bottom surface and facing a front surface; a sensing module installed in one area of the indoor care zone to sense a position and a motion of the user; and a control module configured to control such that the image output devices output synchronized images according to a sensing result of the sensing module and a pre-stored scenario.

Abstract: An object control method and an object control device are disclosed. The disclosed object control method: detects a control activation/deactivation command generated by a user; detects, in a state in which the control activation/deactivation command is detected, a user command including a movement variation command and a rotation variation command; determines a user input by the movement variation command and the rotation variation command; and controls an object according to the user input.

Abstract: An information handling system enables a first human interface device and a second human interface device for simultaneous use with an application in the information handling system, wherein the application includes a first region and a second region. The system associates the first human interface device with the first region and associates the second human interface device with the second region, and associates the first human interface device with a first pointer and associates the second human interface device with a second pointer. The system also controls a first movement of the first pointer within the first region via the first human interface device while simultaneously controlling a second movement of the second pointer within the second region via the second human interface device.

Abstract: In some embodiments, an electronic device facilitates cursor interactions in different regions in a three-dimensional environment. In some embodiments, an electronic device facilitates cursor interactions in content. In some embodiments, an electronic device facilitates cursor movement. In some embodiments, an electronic device facilitates interaction with multiple input devices. In some embodiments, a computer system facilitates cursor movement based on movement of a hand of a user of the computer system and a location of a gaze of the user in the three-dimensional environment. In some embodiments, a computer system facilitates cursor selection and scrolling of content in the three-dimensional environment.

Abstract: A system and method for determining an operational status of a firearm based on a discharge event is provided. A first acceleration is measured on the firearm at a first time. A second acceleration is measured on the firearm at a second time. A measured shot separation of first and second accelerations between the first and second times is calculated. The measured shot separation is compared to at least one shot separation threshold. A speed of a movement member in the firearm is assigned based on the comparing. The operational status of the firearm is determined based on the assigned speed. The operational status is communicated to a first user of the firearm in real-time.

Abstract: A three-dimensional (3D) animation system automatically assigns accurate animation physics to points of a point cloud to realistically simulate motion of the points in response to different applied forces. The 3D animation system receives the points that are defined with positions in a 3D space and with visual characteristics. The 3D animation system analyzes one or more of the positions and the visual characteristics of the points, classifies the points based on a commonality in the positions or the visual characteristics of the points being associated with a particular classification, and maps a set of animation physics that is defined for the particular classification to the points. The 3D animation system may then animate the points based on the set of animation physics generating an effect in response to a force that is applied to the points.

Abstract: A virtual object control method is provided. The method includes: displaying a user interface, the user interface including a virtual object and a displacement control; receiving a first operation signal corresponding to the displacement control; controlling, based on the first operation signal, the virtual object to perform a first displacement operation; and controlling, in response to a second operation signal corresponding to the displacement control being received in a process of performing the first displacement operation by the virtual object, the virtual object to perform a second displacement operation based on the second operation signal after the first displacement operation is performed.

Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.

Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with a current task and predetermined vigilance requirements. The system determines if the user is exhibiting an appropriate level of vigilance based on the task or is becoming fixated. When fixation is detected, the system may engage in remedial action. A task flow diagram represents the operator tasks. Interactions between the user and the instrumentation are used to estimate the probability distribution of the task the user is currently conducting. The system correlates eye tracking data and physiological data such as electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRs) to determine neuroactivity. Monitoring neuroactivity reduces the probability of a false positive for fixation.

Abstract: A system comprises a teleoperational manipulator configured to control operation of a medical instrument in a surgical environment. The system further comprises an operator input system including an input device and a processing unit including one or more processors. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu including a set of directionally arranged menu options. The processing unit is further configured to transition the input device from a first constraint state for interaction with the medical instrument to a second constraint state for interaction with the menu. In the second constraint state, the input device is constrained to move in one or more directions based on the set of directionally arranged menu options.

Abstract: A handheld controller is suitable for controlling an electronic device. The handheld controller includes a first body, a second body and a connecting portion. The first body is suitable for being held by a hand of a user. The connecting portion connects the first body and the second body. The second body is electrically connected to the first body through the connecting portion, and the connecting portion is suitable for being clamped between fingers of the user.