Abstract: A head-mounted display comprises a display device and an outward-facing depth camera. A storage machine comprises instructions executable by a logic machine to present one or more virtual objects on the display device, to receive information from the depth camera about an environment, and to determine a position of the head-mounted display within the environment. Based on the position of the head-mounted display, a position of a joint of a user's arm is inferred. Based on the information received from the depth camera, a position of a user's hand is determined. A ray is cast from a portion of the user's hand based on the position of the joint of the user's arm and the position of the user's hand. Responsive to the ray intersecting with one or more control points of a virtual object, the user is provided with an indication that the virtual object is being targeted.

Abstract: Apparatuses and methods are disclosed for form operation on a mobile terminal. An exemplary method may include detecting an input hand gesture on a screen, and acquiring a trajectory of the input hand gesture. The method may also include matching the acquired trajectory of the input hand gesture with the hand gestures in correspondence in accordance with the hand-gesture comparison rules. The correspondence between hand gestures, hand-gesture comparison rules, and form operations is preset. The method may further include triggering a corresponding form operation if the matching is successful.

Abstract: Among other things, first signals are received representing manipulation of a physical feature of a physical device by one or more fingers of a hand of a user. Second signals are received representing tissue electrical activity indicative of and occurring prior to the manipulation. The first signals and the second signals are processed to identify the occurrence of the manipulation. A control signal is sent to a game or other application with which the user is interacting. The control signal corresponds to the identified occurrence of the manipulation.

Abstract: An information handling system enhanced user interface distinguishes native operating system touch inputs from enhance touch gestures based upon context, such as the number and types of displays interfaced with the information handling system. Enhanced touch gestures include multi-finger touches with symmetrical movement that command start events, move events and end events to interact with content at plural displays through touches at one of the plural displays, such as moving windows, selecting an active window, minimizing windows, maximizing content of one window and restoring minimized content.

Abstract: An information processing apparatus includes an obtaining unit that obtains image data and a recognition result, the image data being data obtained by digitizing a document including plural areas in one document, the recognition result being a result obtained by recognizing the image data, and a control unit that performs control to display an area image corresponding to each of the plural areas in the image data obtained by the obtaining unit and an area recognition result corresponding to each of the plural areas in the recognition result in accordance with a display mode predetermined according to a degree of necessity of a confirming operation corresponding to each of the plural areas.

Abstract: An electronic device and method for operating an electronic device are provided. A user input is received to edit at least one object. A first page and a plurality of thumbnail images are displayed. A drag input is detected on an object. When the drag input is directed toward a first area, the object is displayed in the first area and a representation of a first thumbnail image is changed to correspond to the object displayed in the first area. When the drag input is directed toward a second area, the object is moved to the second page, the representation of the first thumbnail image is changed to correspond to moving the object to the second page, and a representation of a second thumbnail image is changed to correspond to moving the object to the second page.

Abstract: Disclosed embodiments describe a system for completing a transaction using an electronic transaction card by receiving, from a user device executing a software application, a selection of a first account function associated with a financial transaction; determining that the account function requires user verification; detecting, via a motion detection component, a motion pattern performed on the electronic transaction card by the user; authenticating an identity of the user, by the electronic transaction card, based on the detected motion pattern; and completing, by the user device, the financial transaction.

Abstract: The technology disclosed can provide capabilities to view and/or interact with the real world to the user of a wearable (or portable) device using a sensor configured to capture motion and/or determining the path of an object based on imaging, acoustic or vibrational waves. Implementations can enable improved user experience, greater safety, greater functionality to users of virtual reality for machine control and/or machine communications applications using wearable (or portable) devices, e.g., head mounted devices (HMDs), wearable goggles, watch computers, smartphones, and so forth, or mobile devices, e.g., autonomous and semi-autonomous robots, factory floor material handling systems, autonomous mass-transit vehicles, automobiles (human or machine driven), and so forth, equipped with suitable sensors and processors employing optical, audio or vibrational detection.

Abstract: The present disclosure relates to a sensor network, Machine Type Communication (MTC), Machine-to-Machine (M2M) communication, and technology for Internet of Things (IoT). The present disclosure may be applied to intelligent services based on the above technologies, such as smart home, smart building, smart city, smart car, connected car, health care, digital education, smart retail, security and safety services. A method of providing a user interface (UI) by an electronic device is provided. The method includes displaying a control UI, receiving a first drag input via the displayed control UI, and, when a direction of the first drag input corresponds to a first direction, displaying a cursor UI at a preset location. According to an embodiment of the present disclosure, a UI through which an electronic device can easily receive a user input may be provided.

Abstract: In some embodiments, an electronic device displays and allows user interaction with content on multiple displays. In some embodiments, an electronic device displays three-dimensional content using coordinated views on multiple displays. In some embodiments, an electronic device shares content while displaying a video conferencing user interface. In some embodiments, an electronic device facilitates the display or keeping private of content on multiple displays. In some embodiments, an electronic device facilitates the display of information from applications using a shared graphical input coordinate space. In some embodiments, an electronic device presents indications of notifications. In some embodiments, an electronic device presents representations of items of content that are related to content presented on the one or more electronic devices. In some embodiments, an electronic device presents user interfaces including a soft keyboard.

Abstract: The technology disclosed relates to automatically interpreting a gesture of a control object in a three dimensional sensor space by sensing a movement of the control object in the three dimensional sensor space, sensing orientation of the control object, defining a control plane tangential to a surface of the control object and interpreting the gesture based on whether the movement of the control object is more normal to the control plane or more parallel to the control plane.

Abstract: The present invention enables a user to accurately perform operation when the user operates a touch panel of a terminal to control propulsion of a vehicle.

Abstract: An apparatus including a touch screen is provided. The apparatus includes the touch screen to display a first window for executing a first application and a second window for executing a second application, and a controller to detect whether a display change event for changing a screen display occurs in at least one of the first window and the second window, and to analyze the display change event in order to rotate a display direction of the at least one of the first window and the second window in which the display change event occurs.

Abstract: An interactive digital map of a geographic area is provided via a user interface of a user device, with the currently visible portion of the interactive digital map visible within a viewport. The viewport is repositioned from an initial position on the digital map to a target position on the digital map along a trajectory in accordance with one or more user commands. For different positions on the trajectory of the viewport, navigation directions to a geographic location near a center of the viewport are automatically retrieved, without receiving commands via the user interface to obtain navigation directions to the geographic location. The navigation directions having a first and second levels of detail are retrieved for a first and second points on the trajectory, respectively, the first level of detail including less information than the second level of detail. The navigation directions are displayed via the user interface.

Abstract: A non-transitory computer readable medium including program instructions, a method of controlling a game, and an information processing device make a game more amusing.

Abstract: Provided is an information processing device, which is configured to inhibit an unintended operation of a user from being erroneously detected when a flick operation is performed on a curved touch panel. An operation content including a direction of a flick performed with a finger on a curved front surface of a touch panel is detected, and a curvature ratio of the front surface corresponding to the detected direction is acquired. Further, a flick threshold value using a curvature ratio as a parameter is determined, and characteristics of the detected operation content are quantified as a flick score. Then, through comparison between the flick threshold value and the flick score, it is judged whether or not a touch operation is the flick operation.

Abstract: A method and apparatus for identifying a trajectory on a touch screen solves many limitations that the stylus and the gesture operation currently subjected to in the operation state of the touch screen. For example, due to the chaotic operation caused by the stylus and the gesture operation, it is difficult to distinguish the actual operation attributes such that the operation is too cumbersome and not straightforward, resulting in the technical problem of low user experience.

Abstract: A portable information terminal includes an imaging unit that captures a storage location image displayed on a display device to acquire information indicating a storage location in a storage device, a display panel including a display screen that displays a data image and a display device image indicating the display device, and a manipulation detection unit that detects, on the display screen, a manipulation of moving the data image toward the display device image. The portable information terminal stores data in the storage location when the manipulation detection unit detects the manipulation.

Abstract: In implementations of user interaction determination within a webinar system, a computing device implements a webinar system that exposes interactive elements on user devices during a webinar and monitors device interactions reflecting user interactions with webinar content on the user devices. The webinar system determines amounts of user interaction based on the device interactions, and can output the interactive elements based on the device interactions. The webinar system can receive user responses to the interactive elements, and maintain a pipeline that assigns levels to the users based on the user responses and the interactive elements. Users are determined as sales leads based on the levels for the users in the pipeline.

Abstract: Non-transitory computer-readable media, systems, apparatus, and computer-implemented methods are described herein for facilitation of generation and selective provision of a modular advertising unit over a plurality of communication channels to a plurality of end user computing devices. In various embodiments, the modular advertising unit comprising may include a first graphic configured to be operable by a user with an end user computing device to reveal, in place of at least a portion of the first graphic, a second graphic to the user. In various embodiments, the modular advertising unit may also include instructions configured to cause the end user computing device, in response to execution of the instructions by the end user computing device, to automatically provide a report, to the computing device or another computing device associated with an advertising entity, about operation of the first graphic.

Abstract: A non-transitory computer readable medium including program instructions, a method of controlling a game, and an information processing device make a game more amusing.

Abstract: The present disclosure relates to a digital experience system that non-intrusively obtains valuable user feedback by strategically prompting users for feedback during a user's journey of a digital content experience. For example, in one or more embodiments, the digital experience system detects when various discrete touchpoints are triggered throughout a user's journey. In response to detection a triggered touchpoint, the digital experience system can provide the user with a prompt from a template of prompts. In this manner, the digital experience system can receive valuable and meaningful feedback from users without disrupting the user's digital content experience. Indeed, the digital experience system enhances the content experience for the user by providing prompts to the user throughout the user's journey of the content experience.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: An augmented reality device operates in concert with an artificial intelligence (AI) voice assistance system, to generate and display an avatar for user interaction with the AI voice assistance system. The avatar displays animated traits and body language, based on the context and content of the user interaction, to enrich the user's interactive experience with the AI voice assistance system. The body language includes simulating eye-contact with the user.

Abstract: Devices and related methods are disclosed herein that generally involve detecting and interpreting gestures made by a user to generate user input information for use by a digital data processing system. In one embodiment, a device includes first and second sensors that observe a workspace in which user gestures are performed. The device can be set to a keyboard input mode, a number pad input mode, or a mouse input mode based on the positioning of the user's hands. Subsequent gestures made by the user can be interpreted as keyboard inputs, mouse inputs, etc., using observed characteristics of the user's hands and various motion properties of the user's hands. These observed characteristics can also be used to implement a security protocol, for example by identifying authorized users by the anatomical properties of their hands or the behavioral properties exhibited by the user while gesturing.

Abstract: Method and apparatus for executing function on a plurality of items on list are provided, one of methods comprises, receiving a touch gesture in a first direction on a first item on a list, determining the first item to be an execution target of a preset function in response to the touch gesture in the first direction, receiving a touch gesture in a second direction on a second item, adding the second item as an execution target of the preset function in response to the touch gesture in the second direction, receiving a touch gesture in the first direction, which is successive to the touch gesture in the second direction, on the added second item and executing the preset function on the first item and the second item in response to the touch gesture in the first direction on the added second item.

Abstract: Provided are a method and an electronic apparatus for a touch input performed via an edge screen. The method includes: sensing a first touch with respect to a first edge screen and a second touch with respect to a second edge screen; determining a first location on the first edge screen, the first location corresponding to the first touch, and a second location on the second edge screen, the second location corresponding to the second touch; sensing a first gesture having the first location as a start point thereof and a second gesture having the second location as a start point thereof; and performing a pre-set operation of the electronic apparatus, based on a combination of the first gesture and the second gesture.

Abstract: A method, an electronic device, and a storage medium are provided for a sliding event. The method includes: when a first sliding event is received, it is determined whether a second sliding event is received within a preset time interval, where the first sliding event and the second sliding event refer to two adjacent sliding operations on a sliding cover of an electronic device, which are detected by the electronic device; and when the second sliding event is received within the preset time interval, neither of the first sliding event and the second sliding event is responded, or either of the first sliding event and the second sliding event is responded.

Abstract: A viewpoint control unit 204 detects a user operation on a display surface for displaying a virtual-viewpoint video (S801) and controls at least one of the position and the orientation of a virtual viewpoint concerning generation of the virtual-viewpoint video in accordance with the user operation (S805, S808, S812, S814).

Abstract: There are provided a game program and a game system for achieving a game in which, even when it is difficult to determine the location of an enemy character while searching for the enemy character in a virtual game space, it is not too difficult to find the enemy character. A game program 30a causes a CPU 10 to function as a virtual-space generating unit 40, a character control unit 42, a trace generating unit 43 that generates a trace of a non-player character and locates it in the virtual game space, a point managing unit 45 that manages a trace point obtained when a trace located in the virtual game space is collected, and a guidance executing unit 47 that performs the guidance regarding the non-player character to the user when an accumulated value Vs of the trace points reaches a predetermined threshold value.

Abstract: A manufacturing monitoring system is disclosed. The manufacturing monitoring system comprises a manufacturing workspace. Technicians wearing force sensor and/or motion capture marker equipped gloves may work within the manufacturing workspace. Motion capture cameras may ring the manufacturing workspace. Motion data from the cameras and/or force data from the gloves may be sent to a remote workstation where they may be processed and analyzed. The workstation may produce quality assessment and/or training outputs based on the motion and/or force data.

Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

Abstract: A system comprises one or more processors of a machine and a memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations. The operations comprise: receiving an image; generating an avatar with a trained neural network based on the image, the trained neural network predicting multiple trait values for the avatar; and sending a message with the generated avatar.

Abstract: A computer system with ultra touch functions comprises a pointing input device with an ultra touch control button and a computer input device application program configured to execute the ordinary input device function when ultra_Mode=“Ordinary”; select specific ultras touch type and set ultra_Mode=“Gesture” when the movement pattern of the type-select operation matches a predefined type pattern; specify a plurality of ultra touch gestures from the operations on the input device button and movement; specify a plurality of ultra touch gesture functions for every ultra touch type wherein each ultra touch gesture function is driven by its respective ultra touch gesture; execute the specific ultra touch gesture function for the selected ultra touch type when detected its respective ultra touch gesture during ultra_Mode=“Gesture”; set ultra_Mode=“Ordinary” whenever detected an ultra touch end operation.

Abstract: An electronic device includes an audio capture device operable to receive audio input, a fingerprint sensor operable to receive fingerprint data, and one or more processors, operable with the audio capture device and the fingerprint sensor. The fingerprint sensor can authenticate a person as an authorized user of an electronic device while device commands are being received in the form of audio input to allow for secure voice interactions without requiring a trigger phrase. The fingerprint sensor can be used in combination with the receipt of voice input to perform two-factor authentication. The fingerprint sensor and audio capture device can be used in combination to enroll, or update enrollment, of a user interacting with a voice assistant as well.

Abstract: Devices, systems, and method are provided for tracking items in a store for processing a cashier-less purchase transaction. In one example, a method includes identifying a shopper in a store using sensors and associating the shopper to a shopping account. Monitoring the shopper in the store using one or more sensors, and output of the one or more sensors is an input to one or more deep learning models that generate classification data in connection with a scenario. The method includes receiving natural language voice input containing words spoken from the shopper. And, processing the voice input along with the classification data to generate a response to the words spoken by said shopper. The response is made in a context of the scenario.

Abstract: Implementations of the disclosure describe systems and methods for a user that interacts with an interface for playback/consumption of media content (e.g. video, audio, e-book text, etc.) to be accurately guided back to one or more positions on a scrubber. Current scrubber positions (e.g., timecodes) may be dynamically saved each time that a user interacts with the scrubber. Thereafter, the saved position may be used to help guide the user back to their previous position along the scrubber. In some implementations, a scrubber may snap back to a saved position if it is within a predetermined threshold distance of the saved position. In some implementations, sensory cues such as haptic, visual, and/or auditory feedback may be provided when the scrubber snaps back to a saved position.

Abstract: Systems and methods including one or more processing modules and one or more non-transitory storage modules storing computing instructions configured to run on the one or more processing modules and perform acts of retrieving a first product offer from a first seller for a first product to offer for sale on a website of an online retailer, determining if the first product offer for the first product matches one or more existing candidate product offers in a catalog of the online retailer using one or more sets of rules, and, if the first product offer matches the one or more existing candidate product offers, coordinating displaying at least a portion of the first product offer on the website of the online retailer.

Abstract: A voice interaction system capable of appropriately handling a situation to effectively prevent a response error from occurring. A speech acquisition unit 102 acquires user speech. A feature extraction unit 104 extracts a feature of the acquired user speech. A response determination unit 120 determines a response corresponding to the extracted feature using any one of a plurality of learning models. A response execution unit 130 performs control in order to execute the determined response. A response error determination unit 140 determines whether the executed response is an error. A learning model selection unit 150 selects the learning model from the plurality of learning models stored in a learning model database 160 according to a result of the determination by the response error determination unit 140. The response determination unit 120 determines the response using the selected learning model.

Abstract: A mobile computing device has a display and a user interface UI input device that has a control system for manipulating displayed data. The display and UI can be part of a touchscreen or the UI can be decoupled as an input device that is separate from the display. The UI can be used for scrolling, zooming, and selecting specific data on the visual display. The basic operation of the UI includes a touch circle being formed around a control point where the user touches the touchscreen. The user can swipe on the touchscreen with radial and arcuate gestures which can be interpreted by the UI for zooming, selecting, and inputting data.

Abstract: Gesture input with multiple displays, views, and physics is described. In one example, a method includes generating a three dimensional space having a plurality of objects in different positions relative to a user and a virtual object to be manipulated by the user, presenting, on a display, a displayed area having at least a portion of the plurality of different objects, detecting an air gesture of the user against the virtual object, the virtual object being outside the displayed area, generating a trajectory of the virtual object in the three-dimensional space based on the air gesture, the trajectory including interactions with objects of the plurality of objects in the three-dimensional space, and presenting a portion of the generated trajectory on the displayed area.

Abstract: A mobile terminal includes a wireless communication unit configured to provide wireless communication; a touch screen configured to display an execution screen; and a controller. The controller is configured to receive a touch input to one end of the touch screen that continuously moves in a direction toward the other end of the touch screen, if a start point of the touch input is a first end edge of the touch screen, display a first control screen on the touch screen, and if a start point of the touch input is a second end edge of the touch screen, display a second control screen on the touch screen. Further, the first control screen is a different control screen for controlling the mobile terminal than the second control screen, and the second control screen comprises a control center screen include control settings for controlling the mobile terminal.

Abstract: In one embodiment, a method includes determining, by a first application installed on the client system, that a second application is installed on the client system, wherein the first application is configured to switch contexts to the second application; receiving, by the client system, a context-switching gesture input within a first context of the first application, detecting, by the client system, the context-switching gesture has passed a first threshold within the first context, presenting, by the client system, a preview associated with the second application on a portion of a display of the client system in response to the context-switching gesture passing the first threshold within the first context, detecting, by the client system, the context-switching gesture has passed a second threshold within the first context, and switching contexts to a second context of the second application in response to passing the second threshold.

Abstract: An electronic game subscribes to events—such as a physical gesture or appearance of the user, certain spoken user commands, or the like—identified by a game mediation infrastructure. The game mediation infrastructure receives user input data received from the user's client device, analyzes the data, and determines whether one of the events subscribed to by the electronic game has occurred. If so, the game mediation infrastructure notifies the electronic game of the occurrence of the event, and the electronic game alters the state of the game accordingly. The electronic game may additionally and/or alternatively use an API of the game mediation infrastructure to cause alteration of a user interface of a game mediator component in which the electronic game is displayed, based on actions taking place within the game.

Abstract: A fingerprint sensing method based on touch pressure in a black screen mode of a touch input device according to the embodiment of the present invention includes: sensing first pressure which has a value equal to or greater than a first predetermined threshold value and is applied by an object in the black screen mode; determining continuously after sensing the first pressure whether second pressure which has a value equal to or greater than a second predetermined threshold value and is different from the first pressure is sensed or not; recognizing a fingerprint of the object when the second pressure is sensed; determining whether or not the recognized fingerprint is identical to a fingerprint previously registered in the touch input device; and performing a predetermined operation when the recognized fingerprint is identical to the previously registered fingerprint.

Abstract: The present application provides a method for responding to an incoming call by means of fingerprint recognition. The method comprises: when a mobile terminal detects an incoming call, the mobile terminal starts a fingerprint sensor of a fingerprint recognition module; the fingerprint sensor collects a feature point in user fingerprint information, and records a moving track of the feature point; the fingerprint sensor recognizes a fingerprint operation action of a user according to the moving track of the feature point, and uploads the fingerprint operation action to a call system; and the call system marks the fingerprint operation action as a corresponding event and makes a response.

Abstract: A computer-implemented method is disclosed. The method includes: receiving a first signal from a first sensor of the device, the first signal indicative of a grounding condition of the device; setting one or more touch detection thresholds based on the grounding condition; receiving a touch signal from a touch sensor of the device, the touch signal indicative of a touch by an object; and determining whether one or more parameters of the touch signal exceeds the one or more touch detection thresholds.

Abstract: An electronic device with a touch-sensitive surface and a display displays a representation of a clock on the display, detects an input directed to the representation of the clock, while detecting the input directed to the representation of the clock, and provides tactile feedback that corresponds to the clock, wherein the tactile feedback includes a regular pattern of tactile outputs on the touch-sensitive surface. While providing the tactile feedback, the device detects that the input is no longer directed to the representation of the clock, and in response to detecting that the input is no longer directed to the representation of the clock, ceases to provide the tactile feedback corresponding to the clock.

Abstract: Systems and methods for enhancing trackability of a passive stylus. A six degree of freedom (6DoF) location and orientation of a passive stylus may be tracked by a tracking system via a retroreflector system disposed on the passive stylus. Additionally, characteristic movements of one of a user's finger, hand, and/or wrist may be recognized by the tracking system. The passive stylus may useable to interact with a virtual 3D scene being displayed via a 3D display. A user input via the passive stylus may be determined based on the tracked 6DoF location and orientation of the passive stylus and/or the recognized characteristic movements. The retroreflector system may include multiple patterns of retroreflectors and one of the patterns may be a spiral pattern of retroreflectors disposed along a longitudinal axis of the passive stylus.

Abstract: An input circuitry includes: a touch key layer and a pressure sensing layer. The touch key layer is positioned above the pressure sensing layer; the touch key layer is configured to receive touch operation. The pressure sensing layer is configured to acquire touch pressure of the touch operation performed on the touch key layer. The touch pressure is acquired through the pressure sensing layer, a response instruction is generated according to the touch pressure, and the terminal executes the touch instruction.