Abstract: An electronic device with a touch-sensitive surface and a display displays a representation of a clock on the display, detects an input directed to the representation of the clock, while detecting the input directed to the representation of the clock, and provides tactile feedback that corresponds to the clock, wherein the tactile feedback includes a regular pattern of tactile outputs on the touch-sensitive surface. While providing the tactile feedback, the device detects that the input is no longer directed to the representation of the clock, and in response to detecting that the input is no longer directed to the representation of the clock, ceases to provide the tactile feedback corresponding to the clock.

Abstract: Systems and methods for enhancing trackability of a passive stylus. A six degree of freedom (6DoF) location and orientation of a passive stylus may be tracked by a tracking system via a retroreflector system disposed on the passive stylus. Additionally, characteristic movements of one of a user's finger, hand, and/or wrist may be recognized by the tracking system. The passive stylus may useable to interact with a virtual 3D scene being displayed via a 3D display. A user input via the passive stylus may be determined based on the tracked 6DoF location and orientation of the passive stylus and/or the recognized characteristic movements. The retroreflector system may include multiple patterns of retroreflectors and one of the patterns may be a spiral pattern of retroreflectors disposed along a longitudinal axis of the passive stylus.

Abstract: An input circuitry includes: a touch key layer and a pressure sensing layer. The touch key layer is positioned above the pressure sensing layer; the touch key layer is configured to receive touch operation. The pressure sensing layer is configured to acquire touch pressure of the touch operation performed on the touch key layer. The touch pressure is acquired through the pressure sensing layer, a response instruction is generated according to the touch pressure, and the terminal executes the touch instruction.

Abstract: The technology disclosed relates to a method of realistic displacement of a virtual object for an interaction between a control object in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a 2D sub-component free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting rotation of the virtual object by the 3D solid control object model.

Abstract: An apparatus and method for gesture recognition in a portable terminal. An operation of the portable terminal includes determining a user situation by using at least one situation information, determining a user's gesture by using at least one sensor measurement value, and performing a function corresponding to the user situation and the gesture.

Abstract: Methods and electronic devices are provided in which first fingerprint information of a first portion of the user's fingerprint is obtained upon the user's fingerprint contacting the fingerprint sensor. A display object is output within a target area for the fingerprint registration, in response to obtaining the first fingerprint information. A guiding object is output to guide contact of a next portion of the user's fingerprint that is adjacent to the first portion. Next fingerprint information of the next portion of the user's fingerprint is obtained upon the user's fingerprint contacting the fingerprint sensor guided by the guiding object. Upon modifying the display object based on the obtained next fingerprint information, the steps of outputting a guiding object and obtaining a next fingerprint information are repeated until fingerprint information at least partially surrounding the first portion is obtained.

Abstract: Disclosed in the embodiments of the present disclosure are a method and a device for reducing the power consumption of a mobile terminal, a storage medium and a mobile terminal. The method may include: acquiring, in a screen-off state, a fingerprint detected by a fingerprint recognition module; controlling, if the fingerprint is a non-unlocking fingerprint, a touch chip to output a touch sensing control signal to a touch display screen; finding, according to the fingerprint, a matching application program on which the user has rights to operate, and acquiring a set of blank screen gestures corresponding to the application program; and reporting, upon detection of a blank screen gesture belonging to the set of blank screen gestures, a blank screen gesture event to an application layer to execute an operation corresponding to the blank screen gesture.

Abstract: Respective actions are taken by two electronic devices based upon information captured by cameras of the devices. An image of a subject is captured with a first camera equipped in the first electronic device with a second camera equipped in the second electronic device. Form feature information of the subject is then recognized from the captured images. The first electronic device performs a first operation and the second electronic device performs a second operation responsive to recognizing the form feature of the subject.

Abstract: In one embodiment, a method includes sending information configured to render a virtual space on a display device associated with a first user, wherein the virtual space provides a virtual experience to the first user; receiving a pause input from the first user to enter a pause mode; and causing the first user to enter the pause mode, wherein the virtual experience within the virtual space is paused for the first user.

Abstract: An audio device is provided which distributes via the Internet a telephone talk between a distributer and a viewer, with a simple structure. An audio interface device can be connected to a PC, and distributes via the Internet a sound signal which is input from a microphone along with a BGM by outputting the sound signal to the PC. When a call is made with a caller, the audio interface device branches the sound signal which is input from the microphone into a first sound signal and a second sound signal, and supplies the second sound signal to the caller. Also, the first sound signal, the sound signal from the caller, and the BGM are synthesized and output to the PC, and the telephone talk is distributed via the Internet.

Abstract: Disclosed herein are systems and methods that enable low-vision users to interact with touch-sensitive secondary displays. An example method includes, while operating a touch-sensitive secondary display in an accessibility mode: displaying, on the primary display, a first user interface for an application, and displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) application-specific affordances, and (ii) a system-level affordance, where each application-specific affordance and the system-level affordance are displayed with a first display size. The method includes detecting an input at the application-specific affordance.

Abstract: A computer-implemented technique is described herein for facilitating a user's interaction with digital content in a mixed reality environment. The technique involves: displaying digital content to the user in a mixed reality environment in one or more two-dimensional graphical pages, via a display device of a mixed reality device; receiving input information from one or more environment-sensing devices that capture movement of the user; and detecting, based on the input information, whether the user has performed a telltale gesture directed to a graphical page. Each such telltale gesture includes physical action(s) that a user might perform on a physical object, such as a physical piece of paper. If the gesture-detecting engine detects such a gesture, the technique updates the display device of the mixed reality device to show an appropriate outcome. The telltale gestures include a part-removing gesture, a moving gesture, and a page-flipping gesture, etc.

Abstract: A method, comprising: at a computing device running applications under a touch-based operating system: receiving data from a touchpad device; detecting a contact on the touchpad device; in response to detecting a contact comprising a tap gesture or click gesture, displaying a selection of length equal to zero within editable text content; in response to detecting a contact comprising a long-press gesture or long-click gesture, displaying a selection of length equal to one character within read-only text content; detecting a contact on the touchpad device; and in response to detecting a change in a position of the contact on the touchpad device, changing a position of the selection.

Abstract: A method for displaying a background screen in a mobile terminal is provided. The method includes resizing at least one of a plurality of background screens according to a first input, displaying at least one of the at least one resized background screen, detecting a second input, and transitioning among the resized background screens based on the detected second input, wherein the background screens respectively include an icon that may represent a grouping of a first icon and a second icon respectively displayed on one of the plurality of background screens.

Abstract: A computing device runs multiple activities concurrently and provides at least two modes for interacting with the activities. The user may toggle between the modes as desired. In a full-screen mode, one activity occupies substantially an entire display screen. In a windowed mode, the activity is visible within a window, and a portion of at least one other window is also visible. In the windowed mode, the user can cause windows to move, thereby changing focus from one activity to another. For example, the window having focus can be moved off the screen, to be replaced by a new window that is then given focus. The windows are ordered in a sequence and move in concert with one another; pushing one window off one edge of the screen causes a new window to appear at the opposite edge. A persistent positional relationship can be established among windows.

Abstract: An apparatus for interactive image processing including a first camera, a second camera, an image processing circuit, a vision processing unit, an image signal processor, a central processing unit, and a memory device is disclosed. The present disclosure utilizes the image processing circuit to calculate depth data according to raw images generated by the first and second cameras at the front-end of the interactive image processing system, so as to ease the burden of depth calculation by the digital signal processor in the prior art.

Abstract: Methods and electronic devices are provided in which first fingerprint information of a first portion of the user's fingerprint is obtained upon the user's fingerprint contacting the fingerprint sensor. A display object is output within a target area for the fingerprint registration, in response to obtaining the first fingerprint information. A guiding object is output to guide contact of a next portion of the user's fingerprint that is adjacent to the first portion. Next fingerprint information of the next portion of the user's fingerprint is obtained upon the user's fingerprint contacting the fingerprint sensor guided by the guiding object. Upon modifying the display object based on the obtained next fingerprint information, the steps of outputting a guiding object and obtaining a next fingerprint information are repeated until fingerprint information at least partially surrounding the first portion is obtained.

Abstract: A method for controlling a screen in a data processing system to generate displays that include portions of an underlying scene is disclosed. The method includes displaying on the screen a first displayed scene, detecting a long touch gesture, and displaying a second scene on the screen. The first displayed scene is characterized by a first magnification and a first offset relative to the underlying scene. The second displayed scene includes a different portion of the underlying scene and is characterized by a second magnification that is different from the first magnification. In one aspect of the invention, the second displayed scene is characterized by a second offset that is determined by the long touch gesture, and the second offset depends on the first displayed scene and the long touch gesture.

Abstract: Examples described herein may include a computing device of a media playback system receiving a display map corresponding to a media service provider. The display map may associate a data field with a location within a display of the computing device. The computing device may further receive a data item associated with a media item of the media service provider. The received data item may correspond to the data field. The computing device may display an indication of the received data item at the location in accordance with the display map.

Abstract: Disclosed are various embodiments for using gestures to deliver content to predefined destinations. After a user designates a content item, a flick gesture is detected, where the flick gesture has a point of origin and crosses a trip line surrounding the point of origin. A destination associated with the flick gesture is identified from a plurality of predefined destinations. Each predefined destination is associated with a region in a predefined plurality of display regions. The content item is delivered to the determined destination.

Abstract: A method comprising: causing definition of a display window in a displayed virtual scene; displaying window content inside the display window, in the displayed virtual scene; in dependence upon a first user action, causing a first change in the window content displayed inside the display window to first window content different to the window content, without changing the display window; and in dependence upon a second user action causing a second change in the window content displayed in the display window to second window content, different to the first window content and the window content, and causing a variation in the display window to become a modified display window different to the display window.

Abstract: Image data of a vehicle occupant are collected from a plurality of cameras. A dimensional model of substantially an entire body of the vehicle occupant is generated based on the image data. A gesture performed by the vehicle occupant is recognized based on the dimensional model. A vehicle subsystem is adjusted based on the gesture.

Abstract: There is provided a floorplan visualisation system comprising a visualisation studio; a matrix of ceiling mounted edge-blended overlapping projectors projecting onto a floor surface of the visualisation studio; a controller computer comprising: a user interface; and a video output operably coupled to the matrix of projectors for controlling the video projected from such. In use the controller computer is configured for: receiving floor plan representative data; segmenting the floor plan representation data into a plurality of display segments; and outputting the plurality of display segments to respective projectors, and wherein the controller computer is configured to receiving scale adjustment commands via a scale adjustment control of the user interface and adjusting the scale of the segments to display a floor plan representation on the floor surface to a real world scale.

Abstract: According to one embodiment, a terminal display control method for using as a controller of a game a terminal device including a touch panel, which is configured to be integral with a display, includes selecting a controller image which is used in the game; setting at least one of a presence/absence of a function, a number, a size, a shape and a position of disposition, with respect to an operation element in the controller image; and making variable, in accordance with a content of the setting, a state of the controller image displayed on the display, and an operation standard of the operation element corresponding to an input on the touch panel.

Abstract: Gesture functionality is provided in a computing environment. In example embodiments, a gesture input is received. A style difference is identified between a known gesture input of a set of known gesture inputs and the received gesture input. The set of known gesture inputs is caused to be modified to include the style difference by updating a database that stores the set of known gesture inputs.

Abstract: Disclosed are a user interface, a computer program product, a signal sequence, a transportation vehicle and a method for the multiple use of a display unit of a user interface included in a transportation vehicle. Said method may comprise the steps: displaying, on a first display unit, display elements representing a range of information; detecting the approach of a user, and in response thereto, displaying control elements representing a range of functions in place of the display elements.

Abstract: The present disclosure discloses a virtual reality (VR) helmet and a method for using same. The virtual reality helmet has two optional playing modes: playing a VR video stored in the storage module, or playing a VR video inputted by the video input device when it is detected that the video input device is connected. Therefore, the VR helmet does not only have the function of inputting a video in a wired way in traditional helmets, but also can play a video which is stored in advance locally, so the user can move around freely without the limitation of the wired input when a local video is played. In a preferred embodiment, the VR helmet, by having a proximity sensor used to monitor the wearing state of the user, enters a standby mode and turns off the display module to reduce the power consumption of the helmet when it is detected that the user takes off the helmet, and exits the low power consumption standby mode and turns on the display module when it is detected that the user is wearing the helmet.

Abstract: A method of manipulation of content provided by a hosting server using swipe gesture recognition on a user device having a touch input display. The method includes storing the content, combined with a swipe gesture recognition module to form a content package, on the hosting server. The swipe gesture recognition module is associated with at least one displayable content element of the content. The method further includes receiving, at the hosting server, a request for the content package from the user device and transmitting the content package from the hosting server to the user device for display by an application running on the user device. A defined action is applied to the at least one displayable content element if it is determined that a swipe gesture has occurred on the at least one displayable content element.

Abstract: A mobile terminal with unlock function is provided.

Abstract: A method includes receiving, at a controller device, a request to initiate a sharing action between at least two visual devices wirelessly paired with the controller device. The method also includes selecting, using at least one user interface feature of the controller device, a source visual device for the sharing action and a destination visual device for the sharing action. The method further includes providing one or more resources from a display of the source visual device to a display of the destination visual device by streaming the resources to the controller device in a first display format supported by the source visual device, converting the resources from the first display format to a second display format supported by the destination device, and streaming the resources in the second display format from the controller device to the destination device.

Abstract: Various embodiments wirelessly detect micro gestures using multiple antenna of a gesture sensor device. At times, the gesture sensor device transmits multiple outgoing radio frequency (RF) signals, each outgoing RF signal transmitted via a respective antenna of the gesture sensor device. The outgoing RF signals are configured to help capture information that can be used to identify micro-gestures performed by a hand. The gesture sensor device captures incoming RF signals generated by the outgoing RF signals reflecting off of the hand, and then analyzes the incoming RF signals to identify the micro-gesture.

Abstract: The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface.

Abstract: A system for calculating a consensus foreground object, relative to a background within a series of video frames is disclosed. The system relies upon a multi-prong approach that takes a consensus selection for the foreground object reliant upon at least three different models, then outputs the foreground object for application of alpha matting for use in augmented realty or virtual reality filmmaking.

Abstract: A motion detection device is provided. The motion detection device includes a first image recording unit, a first storage unit, a motion detection unit, a depth calculation unit, and a determination unit. The first image recording unit is configured to record a first video. The first storage unit is configured to store the first video. The motion detection unit is configured to detect a moving object in the first video. The depth calculation unit is configured to calculate a depth of the moving object. The determination unit is configured to determine whether or not the moving object is a concerned event according to the depth of the moving object.

Abstract: An input device includes a touch sensor, a pressure detection unit configured to detect pressure on the touch sensor, and a control unit that performs control to execute predetermined processing when, in a state such that the touch sensor detects contact inside a predetermined region, data based on pressure detected by the pressure detection unit satisfies a predetermined standard, and performs control not to execute the predetermined processing when, in a state such that the data based on pressure detected by the pressure detection unit satisfies a predetermined standard, the touch sensor detects contact that transitions from outside the predetermined region to inside the predetermined region.

Abstract: A method and an apparatus for three-dimensional (3D) visual effect simulation are provided. A viewpoint movement distance is detected in a display plane. Subsequently, a first movement distance of a first graphic element in the display plane and a second movement distance of a second graphic element in the display plane are determined respectively according to the viewpoint movement distance. The first movement distance is not equal to the second movement distance. Further, a first location of the first graphic element is changed in the display plane according to the first movement distance, and a second location of the second graphic element is changed in the display plane according to the second movement distance.

Abstract: Method for controlling an object, wherein the object is arranged in the real space and is linked to at least one virtual element of a character space, wherein the object, a depiction device, an operator control device and/or a control device are functionally connected to one another, having the steps of ascertaining a position and an orientation of the operator control device and/or of the depiction device in relation to the object, generating a virtual pointer from the ascertained position and the ascertained orientation of the operator control device and/or of the depiction device, selecting the object by means of the virtual pointer, depicting the object, augmented with the at least one element of the character space, by means of the depiction device, and/or controlling the object by means of the operator control device.

Abstract: Disclosed herein is a system comprising a user interface comprising an edit region in operative communication with a processor; where the processor is in operative communication with one or more modules; where the processor is operative to receive from the user interface a selection of words in the form of a sentence; use a grammar test to determine if the sentence is grammatically accurate; to parse the sentence and offer a user a choice of words to improve an accuracy of the sentence; where the choice of words is based upon a weighted probability of several possible words that can improve the accuracy of the sentence; and permitting the user to install his/her word choice in the sentence by performing an action involving one or more of swiping, tilting, steering or tapping of the user interface.

Abstract: In one embodiment, an apparatus is provided, comprising: at least one non-transitory memory; a touch screen; an actuator; and one or more processors in communication with the at least one non-transitory memory, the touch screen, and the actuator, wherein the one or more processors execute instructions stored in the at least one non-transitory memory, to cause the apparatus to: detect, via the touch screen, a touch on an object of a duration that is greater than a duration threshold; in response to detection of the touch of the duration that is greater than the duration threshold, display the object as being selected; detect, via the touch screen, another touch; in response to detection of the another touch: rotate the selected object, and open content associated with the selected object in a background virtual display layer.

Abstract: A method of controlling a display of a plurality of objects according to an input related to operation of a mobile terminal is provided. The method includes changing, if an input related to operation of the mobile terminal is received when a layout including a plurality of areas in which a plurality of objects are respectively displayed is displayed, one or more of the plurality of areas corresponding to the input related to the operation of the mobile terminal, and displaying a layout including the changed areas. The input related to the operation of the mobile terminal may be a motion of the mobile terminal, a user's breath, or a gesture. If an input related to operation of the mobile terminal is detected while one of the areas constituting the layout is being touched, the remaining areas except for the touched area are rearranged.

Abstract: Systems and methods for multi-user shared virtual and augmented reality-based haptics are disclosed. One illustrative method for multi-user shared virtual and augmented reality-based haptics includes determining a position of an object; determining a viewpoint of at least one observer with respect to the object; determining a haptic effect to be output based at least in part on the position and the viewpoint; and outputting the haptic effect.

Abstract: Apparatuses, methods, and program products are disclosed for controlling appliances. One apparatus includes a processor, and a memory that stores code executable by the processor. The code is executable by the processor to receive control data from an application. The control data corresponds to multiple appliance types. The code is executable by the processor to control a first appliance type of the multiple appliance types as a direct result of receiving the control data. The code is executable by the processor to control a second appliance type of the multiple appliance types as a direct result of receiving the control data.

Abstract: A system and method is disclosed for transferring notifications between multiple computing devices. A notification is provided for display at a first computing device associated with a user account. An indication is received of a user gesture for moving the notification to a second computing device associated with the user account, the second computing device being remote from the first computing device. In response to the indication, the notification is provided to the second computing device for display at the second computing device and removed from the first computing device so that the notification is no longer displayed at the first computing device.

Abstract: A display operator control unit, a propulsion means, and a method for displaying additional instructions relating to display elements displayed on a display unit. The method detects an input in a first input region in front of the display unit and, in response thereto, outputs a first instruction relating to a first display element and a second instruction relating to a second display element. The method also detects an input in a second input region in front of the display unit and, in response thereto, suppresses the second instruction relating to the second display element.

Abstract: Embodiments of this application provide a method for displaying a graphical user interface (GUI) based on a gesture. The method is implemented in an electronic device including a touchscreen, and the method includes: displaying a first GUI on the touchscreen, where the first GUI includes two or more entries, and the entry includes at least two interface elements; receiving, by the electronic device, a first gesture of a user on the touchscreen; and displaying a second GUI on the touchscreen in response to the first gesture, where the second GUI includes two or more entries, and the entry includes at least one interface element, where a quantity of entries in the second GUI is greater than a quantity of entries in the first GUI, and a quantity of interface elements in the second GUI is less than a quantity of interface elements in the first GUI.

Abstract: A head-mounted display system is provided, including a head-mounted display configured to display one or more virtual objects in a physical environment. The head-mounted display system may further include a processor configured to receive a three-dimensional push notification at an application program via an application program interface (API) of one or more APIs included in a volumetric operating system. The three-dimensional push notification may indicate a first location in the physical environment of an application program virtual object included in the one or more virtual objects. The application program virtual object may be associated with the application program. The processor may generate a three-dimensional push notification virtual object based on the three-dimensional push notification. The processor may output the three-dimensional push notification virtual object for display on the head-mounted display at a second location relative to the first location in the physical environment.

Abstract: For the purpose of improving the usability of an electronic whiteboard in, for example, setting work by a user, an electronic whiteboard (2) of the present invention includes: an event acquisition unit (22, 24) configured to acquire information indicating an object coming into contact with a display (3, 115) and event information such as the coordinates of a contact location; an identifying unit (25, 38) configured to identify whether the contact object is an electronic pen (4) or a user's hand, and identify the event type, such as stroke drawing, UI operation, or gesture operation, from the coordinates of a contact location and the model name of an electronic whiteboard; and a processing unit (26, 27, 32) configured to perform processing on the event the type of which has been identified.

Abstract: A device with a touch-sensitive display may be unlocked via gestures performed on the touch-sensitive display. The device is unlocked if contact with the display corresponds to a predefined gesture for unlocking the device. The device displays one or more unlock images with respect to which the predefined gesture is to be performed in order to unlock the device. The performance of the predefined gesture with respect to the unlock image may include moving the unlock image to a predefined location and/or moving the unlock image along a predefined path. The device may also display visual cues of the predefined gesture on the touch screen to remind a user of the gesture.

Abstract: Systems, methods, and computer media for calibrating user-mounted devices are provided. An external device capable of providing calibration data to a user-mounted device worn by a user is identified. An identification acknowledgement is received from the external device. A device calibration mode is entered in which calibration data describing the user-mounted device is received by the user-mounted device. The calibration data is based at least in part on sensor data acquired and normalized by the external device. The calibration data is then received. The calibration data includes at least one determined pose or body measurement of the user and a calculated alignment of the user-mounted device relative to the user. The user-mounted device is calibrated using the received calibration data.

Abstract: An apparatus control system includes smart glasses worn by a user, a home electrical apparatus that is a target of control, and a controller that controls the home electrical apparatus. In the smart glasses, a sensor detects information including at least one of image information, motion information, biological information, or environmental information. A communicator transmits to the controller the information detected by the sensor. The controller, based on the information detected by the sensor, determines a recommended operation indicating operational content recommended with respect to a recommended apparatus, and transmits the determined recommended operation to the smart glasses. The communicator receives the recommended operation transmitted from the controller. The display displays a candidate group for selection of the home electrical apparatus along with a recommended operation received from the communicator.