Abstract: A template built by a user may be converted by a Server Script Generation Engine (SSGE) into script code. In converting, the SSGE may load and parse a framework file containing static script syntax to locate insertion points, each associated with an iteration number, and may iteratively parse the template, utilizing the iteration number to resolve, in order, tags and sub-tags contained in the template. If a tag is set to respond to the iteration number, a function of the tag is invoked to process any related sub-tags and return a script associated therewith at the appropriate insertion point. The framework file (with the appropriate script code inserted) is compiled and stored in a compiled script object which can be run multiple times to perform all of the output functions expected by the user in lieu of the need to reconvert the template.

Abstract: A display apparatus includes circuitry to receive an input of a plurality of strokes representing a drawing that includes one or more drawing components including a first drawing component. The plurality of strokes is divided under a predetermined condition to obtain the one or more drawing components. The circuitry stores, in a memory, each of the one or more drawing components and drawing data representing the drawing. The circuitry displays, on a display screen, in response to receiving an input of a second drawing component, the drawing represented by the drawing data based on the first drawing component and the second drawing component.

Abstract: A method for dynamically changing a graphical user interface element occurs in response to detecting that a temporal user interface element displayed on a user interface of user device. The method includes receiving, at the user device, a contextual signal characterizing a state of a user. The method further includes determining, by the user device, that the contextual signal characterizing the state of the user is indicative of the user intending to interact with a temporal user interface element. The methods also include, in response to determining that the contextual signal characterizing the state of the user is indicative of the user intending to interact with a temporal user interface element, modifying a respective state of the temporal user interface element displayed on the user interface of the user device.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for navigating through a shared artificial reality environment. Various aspects may include receiving an indication of a virtual object in the shared artificial reality environment. Aspects may also include receiving an input gesture indicative of a navigation command associated with the virtual object. Aspects may also include determining at least one type of the input gesture comprising flexion and extension, pronation and supination, or radial and ulnar. Aspects may also include determining a control method. Aspects may include determining a scrolling parameter. Aspects may include identifying the navigation command based on the type of the input gesture, the control method, and the scrolling parameter. Aspects may include applying the navigation command to the virtual object.

Abstract: An information processing apparatus includes a control unit that performs control according to a result of recognition of a user located near a presentation screen on which an object is presented, and a result of detection of a shooting preparation movement of the user, to present a given object such that the given object does not overlap a recognition area of the user.

Abstract: In one embodiment of the present invention, a method for multiple device interaction includes detecting an orientation of a first device relative to a second device. The method also includes detecting a first gesture performed with either the first device or the second device, wherein the first gesture causes a first action that is based at least in part on the orientation of the first device relative to the second device.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: An apparatus, method, and computer readable medium that access a frame buffer of a graphics processing unit (GPU), analyze, in the frame buffer, a frame representing displayed data, based on the analyzed frame, identify a reference patch that includes an instruction to retrieve content, generate an overlay including an augmentation layer which includes the content, superimpose the overlay onto the displayed data such that the content is viewable while a portion of the base layer is obscured, detect a user input, determine a location of the user input in the augmentation layer, associate the location in the augmentation layer with a target location in the base layer, and associate, within memory, the target location with an operation such that the user input in the augmentation layer activates an input in the base layer.

Abstract: A device control method, a device control apparatus, an electronic device, and a storage medium are provided. The electronic device includes an ultrasonic emitter and an ultrasonic receiver. The method includes that operating gesture recognition is performed by the electronic device through ultrasonic waves, a recognition result is generated, a motion parameter of the electronic device is obtained, the recognition result is verified based on the motion parameter, and the electronic device is controlled based on a verification result.

Abstract: A graphical user interface for trimming a video may include a timeline representation of a duration of the video. A trim duration for the video may be selected based on movement of the timeline representation. The amount of time represented by a portion of the timeline representation may be independent of the duration of the video. The movement of the timeline representation may correspond to moment through the duration of the video at a constant scale regardless of the duration of the video.

Abstract: The embodiments of the disclosure provide a method for improving quality of a visual content, a host, and a computer readable storage medium. The method includes: determining a first gesture of a first hand and accordingly providing a first hand object in the visual content; determining a second gesture of a second hand and accordingly providing a second hand object in the visual content; in response to determining that the first gesture and the second gesture respectively correspond to a first predetermined gesture and a second predetermined gesture, determining a specific distance between the first gesture and the second gesture; and in response to determining that the specific distance is smaller than a distance threshold, refining the first hand object and the second hand object.

Abstract: Hot-word free adaptation of one or more function(s) of an automated assistant. Sensor data, from one or more sensor components of an assistant device that provides an automated assistant interface (graphical and/or audible), is processed to determine occurrence and/or confidence metric(s) of various attributes of a user that is proximal to the assistant device. Whether to adapt each of one or more of the function(s) of the automated assistant is based on the occurrence and/or the confidence of one or more of the various attributes. For example, certain processing of at least some of the sensor data can be initiated, such as initiating previously dormant local processing of at least some of the sensor data and/or initiating transmission of at least some of the audio data to remote automated assistant component(s).

Abstract: This document describes techniques and systems that enable a visual indicator for paused radar gestures. The techniques and systems use a radar field to enable an electronic device to accurately determine radar gestures, or other movement, by a user. Further, the electronic device can determine certain conditions that can make it difficult for the electronic device to properly determine the user's radar gestures. When the device includes an application that can be controlled using radar gestures (a radar-gesture application), and the conditions are present, the device can enter a gesture-paused mode. When the device enters this mode, the techniques provide a gesture-paused feedback element on a display, which lets the user know that there is at least one radar-gesture application available or running on the electronic device but that radar gestures cannot presently be used to control the application.

Abstract: A security system (10) includes an image information acquisition unit (11) that acquires input image information on an image taken of a person in a store, a tracking unit (12) that tracks an action of a hand of the person based on the input image information, and a suspicious action detection unit (13) that detects a suspicious action of the person based on the tracked action of the hand. A security system, a security method, and a security program capable of accurately detecting a suspicious action are thereby provided.

Abstract: Method, computer program product, and system to prioritize the execution of processing task requests in a task request queue, where the processing task requests are related to an environment. The method includes adding processing task requests to a task request queue in response to the detection of predefined actions in an environment. The method also includes adding additional processing task requests or adjusting a priority level of not yet completed task requests in the task request queue, in response to detecting subsequent predefined actions in the environment.

Abstract: A device with a touch-sensitive display may be unlocked via gestures performed on the touch-sensitive display. The device is unlocked if contact with the display corresponds to a predefined gesture for unlocking the device. The device displays one or more unlock images with respect to which the predefined gesture is to be performed in order to unlock the device. The performance of the predefined gesture with respect to the unlock image may include moving the unlock image to a predefined location and/or moving the unlock image along a predefined path. The device may also display visual cues of the predefined gesture on the touch screen to remind a user of the gesture.

Abstract: Detection device is provided and includes first and second electrodes disposed facing or close to first electrodes; first drive circuit configured to supply first drive signal; second driver circuit configured to supply second drive signal; and detector configured to detect detection signal output from first electrodes, wherein detection device has first period in which detector detects first detection signal output from first electrodes in response to supply of second drive signal to second electrodes, if first detection signal detected in first period is equal to or higher than predetermined threshold, detector is configured to output an output signal including panel coordinates generated based on first detection signal, if first detection signal detected in first period is lower than predetermined threshold, detection device is transitioned to a second period in which detector detects second detection signal output from first electrodes in response to supply of first drive signal to first electrodes and su

Abstract: An extended reality (XR) handheld controller to operate with a head-mounted display (HMD) device and information handling system includes the HMD device having an HMD processor, a data storage device, and an HMD display device to present to a user an XR image of an environment and the XR handheld controller may include a handheld controller microcontroller, a handle portion, a multimodal joystick, and a fingerprint reader formed into the multimodal joystick, wherein the multimodal joystick provides directional input when the fingerprint reader detects a user's fingerprint and the user tilts the multimodal joystick in a direction, and wherein the multimodal joystick provides push-button input when the fingerprint reader does not detect the user's fingerprint and the user presses a side of the multimodal joystick.

Abstract: Systems and methods for generating pseudo haptic feedback for a virtual widget are disclosed. The method includes computing, from a force profile of the virtual widget, a virtual displacement value based on a force value and a type of the virtual widget. The force profile describes a user's perception of physical characteristics of the virtual widget. The method generates a visual haptic feedback based on the virtual displacement value and the type of the virtual widget. Further, in response to the force value, the method may display on a display screen the visual haptic feedback.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: The embodiments of the disclosure provide a screenshot capturing method, an electronic device and a computer-readable medium. The method includes operations as follows. A duration of a pressing operation is obtained, in response to detecting the pressing operation. In response to determining the duration reaches a preset duration, a page currently displayed on the touch screen is determined as a specified page, and a selection box is displayed on the display screen. A sliding operation acting on the touch screen is obtained. One side of the selection box is controlled to move with the sliding operation, and a position of an opposite side of the selection box is controlled to remain unchanged. In response to determining the sliding operation ends, a screenshot mode is entered based on a positional relationship between an end point of the sliding operation and the specified page, so as to capture a screenshot image.

Abstract: An apparatus is configured to: cause a display to display a GUI comprising a plurality of items; receive user input that is scribed over any of the plurality of items displayed on the display; provide the user with a substantially real-time feedback of the scribing by applying digital ink indicating a scribed line on the GUI; select a first item of the plurality of items based on a position of the scribing within the GUI; recognize a trail of the scribed line; in response to the trail of the scribed line being recognized as a first predetermined trail, perform, on the first item, first processing corresponding to the first predetermined trail; and in response to the trail of the scribed line being recognized as a second predetermined trail, perform second processing on the first item. The second processing corresponds to the second predetermined trail and is from the first processing.

Abstract: A method for detecting and responding to snap motions. The method includes detecting a triggering event that switches a mobile device into a snap motion gesture detection state to commence a finger-snap gesture motion detection process. The method includes activating, based on detecting the triggering event, an image capturing device to capture a series of image frames of a scene and capturing, using the image capturing device, the series of image frames of the scene that includes a hand. The method includes determining, by analyzing at least two frames among the series of image frames, that a finger-snap gesture is detected in the series of image frames. The method includes executing an action corresponding to a determination that a finger-snap gesture is detected in the series of image frames.

Abstract: A virtual image display device and a setting method for an input interface are provided. The virtual image display device includes a virtual image display and a handheld electronic device. The virtual image display executes an application to provide multiple prompt commands to perform a setting action of the input interface. The handheld electronic device displays the input interface and receives multiple input touch actions corresponding to each of the prompt commands through the input interface in the setting action. The virtual image display calculates multiple effective touch areas respectively corresponding to the prompt commands according to a position distribution of each input touch action corresponding to each of the prompt commands.

Abstract: An electronic device includes instructions for receiving a first communication; in response to receiving the first communication, generating a first notification for the first communication received at the device, the first notification including content of the first communication; receiving a second communication at the device; and in response to receiving the second communication: determining whether the second communication and the first communication are received from the same sender. The instructions include, in accordance with a determination that the second communication and the first communication are from the same sender, updating the first notification such that the updated first notification concurrently includes the content of the first communication and the second communication; and in accordance with a determination that the second communication and the first communication are not from the same sender, generating a second notification, for concurrent display with the first notification.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: A method for generating human-machine hybrid predictions of answers to forecasting problems includes: parsing text of an individual forecasting problem to identify keywords; generating machine models based on the keywords; scraping data sources based on the keywords to collect scraped data relevant to the individual forecasting problem; providing the scraped data to the machine models; receiving machine predictions of answers to the individual forecasting problem from the machine models based on the scraped data; providing, by the computer system via a user interface, the scraped data to human participants; receiving, by the computer system via the user interface, human predictions of answers to the individual forecasting problem from the human participants; aggregating the machine predictions with the human predictions to generate aggregated predictions; and generating and outputting a hybrid prediction based on the aggregated predictions.

Abstract: A server and computer implemented method for sharing physical writing actions, the method comprising the steps of: detecting, at each of a plurality of computing devices associated with a meeting, one or more physical writing actions being performed on physical writing surfaces; generating writing signals based on the physical writing actions; transmitting the generated writing signals to a server; forwarding, via the server, the writing signals for receipt at the plurality of computing devices associated with the meeting; and each computing device outputting a representation of the physical writing actions.

Abstract: The present invention relates to a head-mounted display system (1) for controlling a medical imaging device (20), comprising: a head-mounted display (10) to be worn by an operator, comprising a display (12) configured to display a medical image with a predetermined center of view (121) and a command menu (122) providing at least a first set of commands (123) as distinct first command fields, a tracking system (14) to track a movement representative of the operator's eye (30) and/or head movement, wherein a command of the at least first set of commands (122a) of the command menu (122) is selectable based on the tracked eye and/or head movement, and a control device (40) configured to receive a selected command and to control the medical imaging device (20) accordingly.

Abstract: An information processing apparatus creates a first virtual object expressing a physical object that is detected from physical object information obtained from a physical object information acquisition unit. The information processing apparatus determines a display state of the first virtual object in accordance with a result of detecting collision between the first virtual object and a second virtual object. The information processing apparatus creates, on the basis of a virtual space including the first virtual object and the second virtual object, position-orientation of an HMD, the determined display state, and a physical space image obtained from the HMD, a mixed reality image in combination of an image of the virtual space and the physical space image, and displays the created mixed reality image on the HMD.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: Systems, interfaces, and methods for implementing the systems and interfaces include a dynamic environment generation subsystem that changes objects and subobjects based on locations of the motion sensors and/or the nature, time and/or location of sensed motion and include selection attractive movement as the selection protocol, where a selection object is used to discriminate between selectable objects and attract a target object toward the selection objects, where the direction and speed of the motion controls, discriminates, attracts, and activates the selected objects.

Abstract: The technology disclosed relates to user interfaces for controlling augmented reality environments. Real and virtual objects can be seamlessly integrated to form an augmented reality by tracking motion of one or more real objects within view of a wearable sensor system using a combination a RGB (red, green, and blue) and IR (infrared) pixels of one or more cameras. It also relates to enabling multi-user collaboration and interaction in an immersive virtual environment. In particular, it relates to capturing different sceneries of a shared real world space from the perspective of multiple users. The technology disclosed further relates to sharing content between wearable sensor systems. In particular, it relates to capturing images and video streams from the perspective of a first user of a wearable sensor system and sending an augmented version of the captured images and video stream to a second user of the wearable sensor system.

Abstract: The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.

Abstract: A fingerprint recognition-based synchronous application starting method and device. By providing a sensing unit below a fingerprint recognition area of a display unit, when a user needs to start an application, the user only needs to synchronously click an icon corresponding to an application to be started in the fingerprint recognition area of the screen; the sensing unit acquires fingerprint information of the user, and then compares the acquired fingerprint information with preset fingerprint information, to start the application or perform unlocking. Compared with an existing approach for a mobile apparatus to start an application by means of fingerprint recognition, the method and device improves the operability of application icons on a screen and enhances user experience, and can also effectively reduce the overall thickness of a mobile apparatus, making the mobile apparatus thinner and lighter to meet the market demands.

Abstract: An information processing apparatus creates a first virtual object expressing a physical object that is detected from physical object information obtained from a physical object information acquisition unit. The information processing apparatus determines a display state of the first virtual object in accordance with a result of detecting collision between the first virtual object and a second virtual object. The information processing apparatus creates, on the basis of a virtual space including the first virtual object and the second virtual object, position-orientation of an HMD, the determined display state, and a physical space image obtained from the HMD, a mixed reality image in combination of an image of the virtual space and the physical space image, and displays the created mixed reality image on the HMD.

Abstract: A method for invoking a procedure by a first network node in a computer system comprising the first network node and a second network node is provided. The method includes detecting a gesture or a user interaction event contacting a plurality of locations on a screen space of the first network node, obtaining an identification of a workflow procedure in dependence upon an interpretation of the gesture, the workflow procedure having an input parameter, mapping locations, included in the plurality of locations contacted by the gesture, to the location of the graphical object on the screen space, to obtain, from a data set, an identification of corresponding information associated with the graphical object, obtaining an identification of the input parameter of the identified workflow procedure in dependence upon the identified corresponding information, and invoking the identified workflow procedure according to the identified input parameter.

Abstract: Concepts and technologies disclosed herein are directed to pictograms as digitally recognizable tangible controls. According to one aspect disclosed herein, a user system can include a processing component and a memory component. The memory component can include instructions of a pictogram digitization module. The user system can capture, via a camera component, an image containing a pictogram that is a digitally recognizable tangible manifestation of a digital control. The user system can determine, via the pictogram digitization module, the digital control associated with the pictogram. The user system can implement, via the pictogram digitization module, the digital control. The digital control can include a digital content, an action, or a context. The user system can create, via the pictogram digitization module, a digital interface that includes the digital control. In some embodiments, the pictogram includes a formal pictogram. In other embodiments, the pictogram includes an informal pictogram.

Abstract: A remote display device includes processing circuitry. The processing circuitry display a display screen. The processing circuitry generate a plurality of display data corresponding to mutually different display areas, each being a part of the display screen. The processing circuitry transmit the plurality of display data generated to a plurality of terminal devices, respectively. The processing circuitry update the display screen based on operation data indicative of an operation performed by the terminal device to the display area corresponding to the display data.

Abstract: An electronic device and method are disclosed. The electronic device includes a main body housing, a pop-up module extendable and retractable from the main body housing, and a processor. The processor implements the method, including identifying, by at least one processor, a state where a pop-up module of the electronic device is extended to an external environment of the electronic device, based on receiving a first control signal, maintaining extension of the pop-up, based on receiving a second control signal, retracting the pop-up module into the electronic device, and based on receiving a third control signal indicating that the electronic device is in free fall, retracting the pop-up module into the electronic device.

Abstract: A method of selecting an entity from a list of entities, includes providing a manually applied pressure to a touch-sensitive device and activating a range of entities in response to the manually applied pressure. The range of entities includes first and second lists of entities. Scrolling in a first direction enables selection of an entity from the first list of entities and scrolling in a second direction enables selection of an entity from the second list of entities.

Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

Abstract: Developer and runtime environments supporting multi-modal input for computing systems are disclosed. The developer environment includes a gesture library of human body gestures (e.g., hand gestures) that a previously-trained, system-level gesture recognition machine is configured to recognize. The developer environment further includes a user interface for linking a gesture of the gesture library with a semantic descriptor that is assigned to a function of the application program. The application program is executable to implement the function responsive to receiving an indication of the gesture recognized by the gesture recognition machine within image data captured by a camera. The semantic descriptor may be additionally linked to a different input modality than the gesture, such as a natural language input.

Abstract: Techniques are described for use with a wide range of consumer and other electronic devices to facilitate a user's control of such features as volume, as well as song, channel or page selection, depending on the application. A method includes emitting light out of a module, receiving signals from light detectors in the module, wherein the signals represent, at least in part, light reflected by a person's finger or other object passing in front of the light detectors, detecting movement of the person's finger or other object based on the received signals, and controlling a feature of a device in response to the detected movement.

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; selecting, by the electronic mirroring device, a first whole-body outfit; displaying, by the electronic mirroring device, a representation of the user wearing the first whole-body outfit; detecting, by the electronic mirroring device, a hand gesture performed by the user in the video feed; and in response to detecting the hand gesture, transitioning, by the electronic mirroring device, the representation of the user from wearing the first whole-body outfit to wearing a second whole-body outfit.

Abstract: To provide an image forming apparatus having an excellent operability for inputting a numerical value, an image forming apparatus (1) includes a touch panel (20), an angle change calculating portion (100), and a numerical value counting portion (130). The touch panel (20) is configured to detect touches of a plurality of fingers. The angle change calculating portion (100) is configured to, when it is detected that a first finger and a second finger have been touched to the touch panel (20), calculate an angle change of the second finger with the first finger as a fulcrum. The numerical value counting portion (130) is configured to count a numerical value that is input, in response to the angle change calculated by the angle change calculating portion (100).

Abstract: A mobile terminal including a display configured to display a rotatable graphic interface; a Time of Flight (TOF) camera configured to obtain a depth image of an object; and a controller configured to control the TOF camera to enter a rotation detection mode based on the object included the depth image, obtain a relative rotation amount of a plurality of specific points of the object included in the depth image, and rotate the graphic interface on the display based on the obtained relative rotation amount.

Abstract: A method of determining a proximity of an antenna located in a payment instrument to an antenna located within an electronic device may include receiving, at the antenna located within the electronic device, a first signal from the antenna located in the payment instrument, the first signal received at a first time, receiving, at the antenna located within an electronic device, a second signal from the antenna located in the payment instrument, the second signal received at a second time, the second time being later than the first time, determining a difference in a signal strength between the first and second signals, and displaying, on a display of the electronic device, an indication based on the determination.

Abstract: A communication robot for operating a massage providing apparatus by executing an artificial intelligence algorithm (AI) and/or machine learning algorithm in a 5G environment connected for the Internet of things and a method for operating the communication robot are provided. The method for operating the communication robot may include acquiring a spoken utterance of a user positioned within a prescribed range from the massage providing apparatus, tracking a spoken utterance direction of the user from the spoken utterance of the user, orienting the communication robot towards the spoken utterance direction of the user, acquiring a voice command included in the spoken utterance in relation to operation of the massage providing apparatus, and operating the massage providing apparatus according to the voice command.

Abstract: The present invention discloses an interactive control method executed during instant video communication between a user and one or more other users. The method comprises: monitoring video information collected by a camera during the instant video communication between the user and the one or more other users; performing recognition on the video information after acquiring the video information, to acquire user behavior data inputted by the user in a preset manner; determining whether the user behavior data comprises preset trigger information; when it is determined that the user behavior data comprises the preset trigger information, further determining whether the user behavior data comprises a preset gesture action; and when it is determined that the user behavior data comprises the preset gesture action, determining an operation instruction corresponding to the preset gesture action in a preset operation instruction set, and performing an event corresponding to the operation instruction.