Abstract: An image display method is provided, the method is applied to a mobile terminal provided with a first screen and a second screen, and includes: receiving, in a case that the first screen displays a 2D image, a press operation on the 2D image; displaying a 3D image corresponding to the 2D image on the second screen.

Abstract: Techniques are described for automated musical-score-referenced evaluation of haptic-based rhythmic performance. An audiovisual representation of real-time progress through a musical score is output to a user. The output corresponds to progress through a sequence of score-notated rhythm (SNR) events at a tempo. During the outputting, haptic performance (HP) events are received from a user via a haptic interface as the user's rhythmic performance of the SNR events at the tempo. Automated techniques evaluate the user's performance to determine a rhythmic compatibility between the received HP events and evaluation data for the SNR events. Visual feedback is provided to the user to graphically map the evaluated performance to the SNR events on the musical score.

Abstract: Methods for providing guidance to a user wearing a head mounted display (HMD) are provided. One example method includes using a camera of the HMD to track the user wearing the HMD in a real-world space, and identifying a safe zone within the real-world space for interacting with a virtual reality space via the HMD. The method further includes detecting movements of the user in the real-world space. The method includes integrating content into the virtual reality space. The content is configured to provide guidance in direction of movement of the user toward the safe zone of the real-world space. If the user continues to move away from safe zone, pausing presentation of the virtual reality space, and resuming the presentation when the user is in the safe zone.

Abstract: A peripheral device with an adaptive scroll wheel can be used to provide additional control of a host computing device. A variable force is used to change friction on the adaptive scroll wheel for different situations. Examples include stopping a scroll wheel at an end of a document, changing a number of ratchet steps based on a number of items on a list, and changing scroll profiles based on application, such as a scroll profile for document processing and a scroll profile for gaming.

Abstract: An input device includes a display that displays buttons visible through an operation surface of a top panel, a detector that detects a center position of a finger facing the operation surface, and a distance from the operation surface to the finger, and a controller that controls the display based on a detector output and determines an input with respect to a button. The controller displays a cursor image on the display at a finger opposing position based on the finger center position, varies a cursor size according to the above described distance, determines a selected button based on the finger center position, and offsets a cursor center position from the finger center position, and surrounds the selected button with the cursor, in a case where the selected button protrudes from the cursor when the cursor center position is aligned to match the finger center position.

Abstract: A data collection system that performs data collection of human-driven robot actions for robot learning. The data collection system includes: i) a wearable computation subsystem that is worn by a human data collector and that controls the data collection process and ii) a human-machine operation interface subsystem that allows the human data collector to use the human-machine operation interface to operate an attached robotic gripper to perform one or more actions. A user interface subsystem receives instructions from the wearable computation subsystem that direct the human data collector to perform the one or more actions using the human-machine operation interface subsystem. A visual sensing subsystem includes one or more cameras that collect raw visual data related to the pose and movement of the robotic gripper while performing the one or more actions. A data collection subsystem receives collected data related to the one or more actions.

Abstract: A three-dimensional virtual reality environment.

Abstract: An input device includes an manipulating part, a movable member fixed to the manipulating part and having a rotating shaft, a fixing member configured to rotatably support the rotating shaft so that the movable member is rotatable, a flex sensor disposed on the manipulating part and configured to detect flexing of the manipulating part, a switch disposed on the movable member or the fixing member, pressed by a rotating operation of the movable member, and configured to switch between an on state and an off state when a flexing amount of the manipulating part reaches a predetermined amount, and a signal processor configured to output a control signal, based on a first output signal of the flex sensor, and a second output signal of the switch.

Abstract: One embodiment of a computer-implemented method for generating mouse sensitivity recommendations includes generating mouse movement data corresponding to one or more mouse movements performed by a user while interacting with a software application; generating a predicted efficiency for each mouse sensitivity level included in a plurality of mouse sensitivity levels based on the mouse movement data; and determining one or more mouse sensitivity levels to provide to the user based on the predicted efficiencies.

Abstract: A cold worked stainless steel bezel for a portable electronic device is provided. The bezel is secured flush to a housing to form part of the case of the portable electronic device. A brace that includes a slot for receiving a wall extending from the bezel is fixed to the housing. When the bezel engages the housing, the wall of the bezel is inserted in the slot of the brace and releasably held by a spring that engages both the brace and the wall. The bezel can be released by disengaging the spring, (e.g., using a special tool or a magnetic field). Because the bezel is manufactured from cold worked stainless steel, it is hard and resistant to impacts. Cold worked steel also facilitates manufacturing within design constraints and tolerances, and requires very little machining after manufacturing to comply with those constraints.

Abstract: A display device according to an exemplary aspect of the present disclosure may include a display panel including a non-display area, a back cover supporting the display panel on one surface of the display panel, a roller for winding or unwinding the display panel and the back cover and side covers covering a portion of the non-display area of the display panel and a portion of a side surface of the back cover corresponding thereto, and including a plurality of unit side covers to thereby support the non-display area of the display panel when the roller is wound. Thus, stress generated during rolling can be reduced and accordingly, it is possible to prevent cracks and damage to the GIP unit.

Abstract: A method of controlling a wearable tap detection system having a processor and a plurality of sensors for detecting contact by one or more fingers against a surface, including at least one mechanical sensor, includes detecting, as a tap event, a signal from the at least one mechanical sensor that exceeds a predetermined threshold. When the tap event is detected, the processor is switched from a first power mode to a second power mode, the second power mode using more power than the first power mode. Then, using the processor in the second power mode, processing of one or more signals from the plurality of sensors is performed to generate processed signal data. After the processed signal data is generated, the processor is switched from the second power mode to the first power mode.

Abstract: A system and method for operating a keyboard and wearable extended reality appliance combination to control a virtual display are disclosed. The system may include a processor configured to receive, from a first hand-position sensor associated with the wearable extended reality appliance, first signals representing first hand-movements; receive, from a second hand-position sensor associated with the keyboard, second signals representing second hand-movements, wherein the second hand-movements include actions other than interactions with a feedback component; and control the virtual display based on the first signals and the second signals.

Abstract: Methods and systems used in calibrating the position and/or orientation of a wearable device configured to be worn on a wrist or forearm of a user, the method comprises sensing a plurality of neuromuscular signals from the user using a plurality of sensors arranged on the wearable device, and providing the plurality of neuromuscular signals and/or signals derived from the plurality of neuromuscular signals as inputs to one or more trained autocalibration models, determining based, at least in part, on the output of the one or more trained autocalibration models, a current position and/or orientation of the wearable device on the user, and generating a control signal based, at least in part, on the current position and/or orientation of the wearable device on the user and the plurality of neuromuscular signals.

Abstract: Tactile user participation and control feedback is introduced into a virtual reality training simulator environment. A computer for generating the simulator environment includes a control bus to which nonvirtual copies of virtual controls can be connected along with the camera showing the positioning of the trainee operator in relation to the control cab. Physical manipulation of the nonvirtual controls, along with the positioning of the limbs of the operator in relation thereto, is rendered inside the virtual environment. Tactical interaction with the physical controls maximizes mental reinforcement and training outcomes in the simulator.

Abstract: A system includes a screen and a computer that detects an object near the screen and allows interaction between the object and the computer.

Abstract: The embodiments of the disclosure provide a finger touch detecting method and a handheld device. The method includes: detecting a finger distribution area touched by a plurality of fingers on a touch detection area, wherein the touch detection area comprises a plurality of touch sensors, and the finger distribution area includes a plurality of specific sensors of the touch sensors; distributing a predetermined data size over the specific sensors, wherein each specific sensor is distributed with a corresponding bit size; obtaining a raw data detected by each of the specific sensors; quantizing the raw data of each of the specific sensors based on the corresponding bit size; and providing the quantized raw data of each of the specific sensors.

Abstract: The present disclosure provides a method and apparatus of a computer interface device using an open kinetic chain with retractable links. It comprises a two-link robot arm that rotates along a shoulder and elbow joint. Each link can also be extendable in length. The end effector stylus has a ball tip that fits into a socket on the distal end of the second link, meaning that the stylus is detachable and interchangeable. The device can achieve a very high refreshing rate and a high spatial resolution. The links, elbow joint, and shoulder joint have sensors that record linear position and rotational data, respectively, which get transmitted and processed in an MPU on the main PCB. The PCB communicates with a PC as a haptic input device. The method and apparatus improve: (1) device control accuracy and comfort; (2) refreshing rate and responsiveness; (3) device resolution and/or input area size.

Abstract: A human body portion tracking method is provided and including obtaining a first image from an image capturing apparatus; identifying a first reference point and a second reference point from the first image; determining a position relationship between a first section and a second section of the human body portion according to three-dimensional coordinates of the first reference point and the second reference point; obtaining a second image from the image capturing apparatus; identifying a third reference point from the second image.

Abstract: An activity classifier system and method that classifies human activities using 2D skeleton data. The system includes a skeleton preprocessor that transforms the 2D skeleton data into transformed skeleton data, the transformed skeleton data comprising scaled, relative joint positions and relative joint velocities. The system also includes a gesture classifier comprising a first recurrent neural network that receives the transformed skeleton data, and is trained to identify the most probable of a plurality of gestures. The system also has an action classifier comprising a second recurrent neural network that receives information from the first recurrent neural networks and is trained to identify the most probable of a plurality of actions.

Abstract: One embodiment is directed to a system for human-computer interface, comprising an input device configured to provide two or more dimensions of operational input to a processor based at least in part upon a rubbing contact pattern between two or more digits of the same human hand that is interpreted by the input device. The input device may be configured to provide two orthogonal dimensions of operational input pertinent to a three-dimensional virtual environment presented, at least in part, by the processor. The input device may be configured to detect the rubbing between a specific digit in a pen-like function against one or more other digits. The input device further may be configured to detect the rubbing between the specific digit in a pen-like function and one or more other digits in a receiving panel function.

Abstract: A method of controlling a projector includes projecting an achromatic area image representing a drawing area in which the projector receives drawing using a pointer on a projection surface at a first luminance at a ratio on the projection surface, the ratio being smaller than or equal to a specific ratio to a maximum luminance at which the projector capable of project an image on the projection surface, detecting a position on the projection surface pointed by the pointer while projecting the area image, determining whether or not the position is included in the drawing area, and displaying, by the projector, an area including at least a part of an outline of the drawing area at a luminance higher than the first luminance when it is determined that the position is included in the drawing area.

Abstract: A computer mouse for carrying out inputs into a computer unit that can be coupled to the mouse. The mouse has a mouse body that can be at least partially gripped and a mouse wheel that is rotatably supported on a carrying structure of the mouse body. The mouse wheel is able to be rotated by a finger to carry out an input. The mouse wheel has at least two actuation zones. A movement of the mouse wheel can be damped by a controllable brake device in a targeted manner in dependence on the actuation zone from which the mouse wheel is actuated and/or in dependence on which actuation zone has been previously activated.

Abstract: The present invention provides a motion detecting system, which includes a light source module, a plurality of image sensors and a control unit. The light source module illuminates at least one object. The image sensors respectively detect the object under the light emitted by the light source module to generate a plurality of detection results. The control unit is coupled to the image sensors, and generates a control command according to the detection results.

Abstract: A computer-readable medium including computer-executable instructions providing a method of displaying arrays of computer-readable files, the method comprising causing a first array of computer-readable files to be displayed, said first array of computer-readable files being displayed along a timeline according to a first timescale; causing a second array of computer-readable files to be displayed, said second array of computer-readable files being displayed along a timeline according to a second timescale. An interface, a computerized system and a method for providing same is also disclosed therein.

Abstract: A remote control system and related method for controlling a video device are presented. The remote control system contains a plurality of buttons arranged in a grid pattern that correspond to user selectable options displayed on a display screen arranged in the same grid pattern. The user selects options on the screen by pressing the corresponding button on the remote control.

Abstract: Content data of a display target is acquired in accordance with a user's operations and is used to determine a configuration of a display image. Of the regions to be rendered using fonts in the display image, the region in which a character is to be displaced by a very small amount is determined. The characters targeted for displacement are rendered while being displaced over time in accordance with predetermined displacement rules. The characters not targeted for displacement are rendered in a reference position. With all characters rendered, the display image is completed and output. The processes of S12 to S24 are repeated until display is terminated.

Abstract: Disclosed is a spatial computing system and associated methods that provide multi-modality interactions for precise and imprecise interactions with two-dimensional (“2D”) and three-dimensional (“3D”) user interfaces (“UI”) that are presented in a 3D interactive space. The multi-modality interactions are provided by a dynamic spatial pointer. The dynamic spatial pointer has a first 3D representation for navigating the 3D interactive space and selecting one of the presented UI elements. The dynamic spatial pointer converts from the first 3D representation to a different second 3D representation in response to attaching to one of the 3D UI elements, and converts to a first 2D representation in response to attaching to one of the 2D UI elements. The second 3D representation remains attached to and tracks the 3D form of the 3D UI element, and the first 2D representation remains attached to and tracks the 2D plane of the 2D UI element.

Abstract: Systems and methods are provided for weapon system monitoring and virtual reality presentation, including a connection point that receives signals from a plurality of sensors within a deployment location, a server device running application software that receives the signals from the connection point and processes the signals to generate a virtual reality depiction of the deployment location, and a graphical user interface presenting a field of view of the virtual reality depiction of the deployment location.

Abstract: A method is provided for displaying information on a display device of an aircraft. The method comprises determining, by the processor, a first point along a flight path when a flight mode associated with a flight plan will be armed; determining, by the processor, a second point along the flight path when the flight mode associated with the flight plan will be engaged; determining, by the processor, a third point along the flight path when the flight mode associated with the flight plan will be disengaged; generating, by the processor, graphics data that represents the first point, the second point and the third point; incorporating, by the processor, the graphics data into a user interface that displays the flight path; and generating, by the processor, the user interface for display on the display device of the aircraft.

Abstract: Augmented reality headgear includes transparent displays that allow a user to simultaneously view the real world and virtual content positioned in the real world and further includes at least one source of coherent light and at least one sensor array for sensing, at a series of times, speckle patterns produced when the coherent light impinges environment surfaces. Circuitry is provided for sensing shifts in the speckle pattern and determining motion which caused the shift of the speckle pattern and adjusting the display of virtual objects displayed by the augmented reality headgear to compensate for the motion.

Abstract: Ordering systems for a plurality of retailer service providers are integrated and provided through a single mobile application (app) to users for user-defined orders. Moreover, payment processing of the retailer service providers are integrated and available for processing payments of the orders through the single mobile app. Retailer-specific branding is maintained and provided through the app.

Abstract: A mobile and adaptable fitness system allows a fitness device to be used to control an application running on a host device. The system includes one or more controllers, a motion sensing device, and a host device. The hand controllers may be mounted on the handlebars of the fitness device or held in a user's hands and include buttons that the user can press. The motion sensing device may be mounted on the user or on a moving part of the fitness device and contains sensors that capture motion performed by the user. The host device receives input data from the hand controllers and the motion sensing device and generates an activity vector representing the intensity at which the user performs a fitness activity. Based on the activity vector, the host device controls an object in an application, such as a character, based on the input data.

Abstract: A method for capturing and measuring translation and/or rotation of a component moving relative to a reference system includes providing a marker on the component and providing a measurement system having a camera arranged in the reference system. The marker has at least three points which do not lie on a straight line on an upper side of the marker and the camera has an evaluation unit and memory that stores a geometry of the upper side including the at least three points. The camera is aligned with the at least three points and a first image of the marker located in a first portion is captured and stored and a second image of the marker in a second position that is different than the first position is stored. Also, translation and/or rotation of the component in three-dimensional space between the first position and the second position is calculated.

Abstract: A computer implemented method and system for determining a communication mode for recording a media message on a communication device is provided. An adaptive recording application detects activation of an interface element, for example, a push or a touch of a button on the communication device and determines duration of the activation of the interface element. The adaptive recording application, in response to the detection of the activation of the interface element, selects a communication mode, for example, a push to talk communication mode, a tap to start communication mode, etc., based on a comparison of the duration of the activation of the interface element with one or more configurable timing parameters and/or a determination of a presence or an absence of a media signal during and/or after the activation of the interface element. The adaptive recording application initiates recording of the media message in the selected communication mode.

Abstract: A method for interactive video content is disclosed. The method may include receiving a first video program stream from a first content provider server; displaying the first video program stream received from the first content provider server; displaying an on-screen tracking overlay selector, the on-screen tracking overlay selector including one or more selectable buttons, the one or more selectable buttons including a first selectable button associated with information from one or more third-party providers; receiving a second video program stream from a second content provider server, the second video program stream including embedded overlay content associated with the first selectable button from the at least one of the one or more third-party service providers; and displaying the second video program stream including the embedded overlay content associated with first selectable button from the at least one of the one or more third-party providers.

Abstract: A computer-implemented method includes receiving first and second movement data corresponding to a movement of a first and second computer mouse, respectively, wherein the first and second computer mice are oriented in a same direction are moving in unison over a same trajectory while the first and second movement data is contemporaneously received; determining a movement distance for the first and second computer mice based on the first and second movement data, respectively; determining a performance characteristic for the first computer mouse based on the determined first movement distance; determining the performance characteristic for the second computer mouse based on the determined second movement distance; determining a difference in the performance characteristic for the first computer mouse with respect to the second computer mouse; and calibrating the performance characteristic of the second computer mouse to match the performance characteristic of the first computer mouse.

Abstract: Systems and methods for enhancing computer-generated visualization of items, including enhancing visualization of product images in a web-based augmented reality (AR) user interface, displaying elements that enable users to select AR-enabled images of products (e.g., room décor, furniture, or other products), and transmitting AR-enabled images of the products in a room to one or more distributed computer systems (e.g., in real time). These and other images may be saved or selected in the various platforms, web-based documents, or locally-run applications as AR-enabled images of products to view a set of user-selected AR-enabled images in a single view (e.g., on a web page), and, when in a room, selectively display and interact with an AR-enabled view in the room of the corresponding products from the AR-enabled images list.

Abstract: An innovative palmrest assembly for a computer has fewer components and reduces costs. The palmrest assembly has a cover that holds a tactile pointing device (such as a touch/click pad). The cover, though, is integrally molded with a holder for the tactile pointing device. The cover thus includes a molded pocket or recess into which the tactile pointing device is inserted, perhaps in a snap-fit arrangement. Because the tactile pointing device snuggly fits into the cover, the palmrest assembly has fewer components and fastening screws may be eliminated. Moreover, the cover may further include one or more elastomeric springs that are integrally molded with the holder for the tactile pointing device. The integrally-molded elastomeric springs further reduce componentry and eliminate complicated assembly operations. When a user taps or clicks the tactile pointing device, the elastomeric springs slightly compress and then rebound, thus providing a return motion to the tactile pointing device.

Abstract: A CAD model comprises an entity comprising an input face comprising a normal direction. Via user input, a translation for the input face in the normal direction is obtained. From the CAD model, a list of faces parallel to the input face is automatically determined. From the list of faces, a snap face comprising a distance along the normal direction to the current position of the input face which is minimal over the list of faces is automatically selected, without acquiring the snap face via user input. Via a visualization means, a snap plane comprising the snap face, and either a coplanar alignment of the input face in the snap plane; or a distance indicator from the input face to the snap plane, are automatically displayed. Via user input, validation of the coplanar alignment or a numerical value for the distance indicator is obtained. The entity is automatically adjusted accordingly.

Abstract: A controller for use in interfacing with a virtual reality system is provided. The controller having a body with a proximate end and a distal end, and the distal end is opposite the proximate end. A handgrip portion of the body is disposed at the proximate end of the body. An extension portion of the body is coupled at the distal end of the body. The extension portion has a loop shape. A plurality of lights is disposed on a surface of the extension portion, such that lights illuminate at least part of the loop shape.

Abstract: Systems, methods, apparatus, and articles of manufacture to provide content to a playback network are disclosed. An example method includes displaying an indicator of multimedia content to a user via a graphical user interface. The example method includes enabling a multiselect state to allow the user to select multiple items from a browseable list of indicators associated with multimedia content. The example method includes providing a context-sensitive menu including a plurality of options associated with playback of selected items based on enablement of the multiselect state. The example method includes applying an option to each of the selected items based on user selection. The example method includes passing information regarding the multimedia content to a playback system including one or more multimedia playback devices in response to user selection of the option.

Abstract: A computerized medical diagnostic system uses a training dataset that is updated based on reports generated by a radiologist. AI and/or CAD is used to make an initial determination of no finding, finding, or diagnosis based on the training dataset. Normal results with a high confidence of no finding are not reviewed by the radiologist. Low confidence results, findings, and diagnosis are reviewed by the radiologist. The radiologist generates a report that associates terminology and weighting with marked 3D image volumes. The report is used to update the training dataset.

Abstract: Systems and methods are provided for combining video and virtual reality presentations, comprising a server device running application software that receives, at a connection point, a plurality of video signals from a plurality of assets within a deployment location, a video processing facility configured to sync the plurality of video signals to generate a time-matched, unified video depiction of the deployment location, where the unified video depiction presents at least one of positions, orientations, actions or affiliations of the plurality of the assets within the deployment location, and a graphical user interface presenting a field of view of the unified video depiction of the deployment location.

Abstract: Augmented reality eyewear devices allow users to experience a version of our “real” physical world augmented with virtual objects. Augmented reality eyewear may present a user with a graphical user interface that appears to be in the airspace directly in front of the user thereby encouraging the user to interact with virtual objects in socially undesirable ways, such as by making sweeping hand gestures in the airspace in front of the user. Anchoring various input mechanisms or the graphical user interface of an augmented reality eyewear application to a wristwatch may allow a user to interact with an augmented reality eyewear device in a more socially acceptable manner. Combining the displays of a smartwatch and an augmented reality eyewear device into a single graphical user interface may provide enhanced display function and more responsive gestural input.

Abstract: Systems and methods are provided for weapon system monitoring, historical usage analysis, and performance evaluation of a plurality of assets within a deployment location, where each asset of the plurality includes one or more sensors that record operational information of each asset and are used to produce at least one signal, including a server device running application software that uses the signal received from each asset to detect and store situational state data of each asset and performance level data of a party associated with each asset, and a machine learning system that uses the situational state data and the performance level data to determine an operational profile of the party.

Abstract: An information processing apparatus, which may include a display unit that displays a virtual space, an operating unit that outputs input operation data associating an input operation of a user with coordinate information, and a storage unit that stores the input operation data and may execute a game where a character moves based on the input operation. The information processing apparatus may retrieve the input operation data from the storage unit, perform control including moving the character in a predetermined direction when the input operation is determined to be a first input operation and when the input operation is determined to be the second input operation, and may determine that the input operation is the second input operation when a distance, in the predetermined direction, between an intermediate point and an end or start point is larger than a distance in the predetermined direction between the start and end point.

Abstract: An ambient lighting system for automobiles configured to illuminate a passenger compartment, comprises: an optical system in turn comprising: a plurality of RGB LED light sources; a structural support on which the light sources are placed; and a contact surface on which a user can interact, and through which light rays can exit. The ambient lighting system also includes: a control unit configured to control the RGB LED light sources in order to present light animations; and a touch sensor configured to detect touch of the contact surface in a defined region, which is configured to define, along the optical system at least one soft key. The ambient lighting system further includes: a voice command recognition system electronically connected to the control unit and configured to recognize voice commands; and a projector configured to project an image, such as a symbol and/or logo, on the contact surface.

Abstract: A computing system includes a mobile device having a wireless transceiver and an orientation sensor that senses orientation of the mobile device and generates orientation data based on the sensed orientation. A controller converts the orientation data to graphical pointer data, which is transmitted via the wireless transceiver to a local computing device, which translates the graphical pointer data to represent a graphical pointer being displayed on its display. The graphical pointer is controlled on the display of the local computing device by changing orientation of the mobile device.

Abstract: A wireless device includes a user interface that generates a pairing signal in response to an indication from a user to pair the wireless device to at least one remote device and generates a first location request signal in response to a second indication from a user to locate the at least one remote device. A short-range wireless transceiver communicates RF signals to pair the wireless device to the at least one remote device and that transmits a first RF paging signal to the at least one remote device in response to the location request signal.