Abstract: Disclosed herein is a system that allows for the real-time build out of a virtual environment. The system and methods receive, via a web browser, a user selection of a three-dimensional (3D) model in a virtual environment. The user selection is made during an active user session of the user. Based on receiving the user selection, an editor is launched from within the web browser. The editor is used to modify properties of the 3D model in real-time during the active user session. One or more user inputs are received indicating the properties of the 3D model to be modified. Based on the one or more user inputs, the properties of the 3D model are modified in real-time. The 3D model is rendered to reflect the properties within the virtual environment during the active user session.

Abstract: An apparatus and/or method for providing an augmented reality service in an electronic device. The electronic device may include a memory configured to store first gesture information and second gesture information, a camera, a display, and a processor, wherein the processor may be configured to detect a gesture on the basis of image information obtained via the camera, identify the gesture on the basis that a detection location of the gesture is included in a first region different from a second region corresponding to a viewing angle of a user wearing the electronic device, from among the image information obtained via the camera, output a first visual effect related to the gesture via the display when the gesture corresponds to the first gesture information, and output guide information related to the gesture via the display when the gesture corresponds to the second gesture information. Other embodiments may also be possible.

Abstract: A wearable computing device includes a display, a motion sensor, and a controller that: defines a pose of a simulated input object with selectable input elements; using the motion sensor, determines current poses of the display, and for each pose: (i) based on the pose and the pose of the input object, selects a portion of the input object, including a subset of the input elements, and (ii) renders the portion of the input object on the display; for at least one of the current poses, detects a simulated key press associated with one of the subset of input elements, and generates input data corresponding to the one of the subset of input elements. The device includes a housing containing the display, the motion sensor, and the controller; and a mounting component, coupled to the housing and configured to removably affix the housing to a forearm of an operator.

Abstract: A method of authenticating a passcode entered by a user on an unstable electronic computing device. The method includes receiving an indication that an input is unstable, impacting the ability of a user to provide the input; generating a dynamic keyboard including at least one alphanumeric key, the dynamic keyboard being configured to address the unstable input; presenting the dynamic keyboard to the user; receiving the input from the user, the input comprising a selection of at least one alphanumeric character of a passcode on the dynamic keyboard; and authenticating the input received from the user by comparing the at least one alphanumeric character and a stored passcode.

Abstract: Systems and Methods are disclosed herein for automatically indexing multiple informational fields in digital data records, the method comprising: identifying, based on rules defining target information fields, for each target field of the target information fields, at least one page in a digital data record comprising content related to the target field; extracting, for each target field, from the identified at least one page, at least one portion of text comprising the content; feeding, for each target field, a pre-processed version of the at least one portion of text into a machine learning (ML) model, wherein the ML model is trained on the target field; determining, for each target field, via the ML model trained on the target field, at least one candidate text comprising the content; and extracting, for each target field, the at least one candidate text.

Abstract: Examples are disclosed relating to computing devices and methods for performing touch detection within a virtual trackpad area of a touch screen display. In one example, a non-trackpad touch input signal is received from outside the virtual trackpad area and processed with at least one touch detection algorithm applying a non-trackpad threshold value. A virtual trackpad touch input signal is determined to be received from within the virtual trackpad area. On condition of determining that the virtual trackpad touch input signal is received from within the virtual trackpad area, the virtual trackpad touch input signal is processed with the touch detection algorithm applying a virtual trackpad threshold value different from the non-trackpad threshold value.

Abstract: Disclosed herein are systems and method for automatic activation of a service on a computing device. In an exemplary aspect, a service activation module may link, using an activation model, user behavioral data to an automated activation of the service based on the detecting a prior activation of the service subsequent to receiving the user behavioral data. The service activation module may receive, at a later time, additional sensor data from a plurality of sensors of a computing device. The service activation module may parse the additional sensor data to generate additional user behavioral data. The service activation module may compute, using the activation model, a degree of similarity between the user behavioral data and the additional user behavioral data, and in response to determining that the degree of similarity is greater than a predetermined threshold value, may automatically activating the service on the computing device.

Abstract: In some embodiments, an electronic device displays an incoming call user interface in response to receiving an indication of an incoming call. In some embodiments, the incoming call user interface is displayed overlaid on a respective user interface that is optionally associated with an application other than the application associated with the incoming call.

Abstract: A garage door is controlled to open using an audio/video (A/V) recording and communication device. The device detects a vehicle within an area about the garage door and receives, using a camera, image data representative of an object associated with the vehicle. The device also compares the image data representative of the object associated with the vehicle with previously stored image data and identifies the object based on the comparing of the image data representative of the object with the previously stored image data. The device also authenticates an electronic device within the vehicle that is associated with the object by wirelessly communicating with the electronic device and determines, based at least in part on the authenticating of the electronic device within the vehicle, that the vehicle is an authorized vehicle. The device also transmits an actuation command to the garage door to cause the garage door to open.

Abstract: The present disclosure relates to management of synthetic media detection determinations and automatic generation of notifications thereof. Processing of the present disclosure provides a synthetic media detection component, able to be integrated with a plurality of host application/services, where the synthetic media detection component is adapted to work as a trust factor that automatically generates predictive determinations as to whether digital content has been digitally altered. In doing so, trained artificial intelligence processing is applied that executes a contextual analysis of digital content and generates a determination as to whether digital content (or a portion thereof) may be synthetic media. Notifications are automatically generated and provided for rendering across any host application/service endpoints that provide a representation of the digital content including future representations of digital content.

Abstract: A method includes detecting a touch input by a user at a position on a virtual keyboard. The method further includes applying a spatial model to map the touch input to one or more first candidate keys of the virtual keyboard, wherein the spatial model maps the touch input to the one or more first candidate keys based on a heatmap of prior touch inputs by the user. The method further includes applying a language model to map the touch input to one or more second candidate keys of the virtual keyboard, wherein the language model maps the touch input to the one or more second candidate keys based on comparing the position of the touch input to one or more predicted next keys. The method further includes selecting a particular key of the one or more first and second candidate keys as indicated by the touch input.

Abstract: Disclosed are aspects of a camera assembly, including a sensor for sampling image data in a sampling step. A lens is provided for focussing light onto the sensor. A window is supported in front of the lens. The window includes a transparency changing material for varying the transmittance of light through the window in response to an input signal. The camera assembly is configured to thereby increase the transmittance of light through the window during the sampling step of the sensor.

Abstract: A Head Mounted Display (HMD) device includes a display configured to display an augmented reality effect in relation to an Electromyography (EMG) device. The HMD device also includes at least one processor configured to control the display of the augmented reality effect in relation to the EMG device according to a user motion detected by the EMG device. The HMD device may further include a communication unit configured to communicate with the EMG device, and the at least one processor may be configured to receive, from the EMG device via the communication unit, information about data stored on the EMG device. At least some of the received information may be displayed in relation to the EMG device as the augmented reality effect. Information sent from the EMG device to a mobile terminal may be displayed in relation to the EMG device as the augmented reality effect.

Abstract: Methods and systems for performing automated keyboard mapping for virtual desktops are described herein. A system may generate a keyboard mapping table containing a plurality of keyboard inputs. The system may simulate a keyboard input locally at the system and using a virtual desktop hosted by a remote desktop platform to generate keyboard simulation outputs in response to a first keyboard input. In response to determining a discrepancy between the keyboard simulation outputs, the system may modify a key value in the keyboard mapping table resulting in a corrected keyboard mapping table, where the key value corresponds to the first keyboard input. In response to receiving a second keyboard input, the system may apply the corrected keyboard mapping table to display a keyboard output at the virtual desktop hosted by the remote desktop platform, where the second keyboard input has the same key value as the first keyboard input.

Abstract: A method for adjusting a touch hotspot of a terminal is provided. The method includes: obtaining touch point coordinates of touch actions received in a at least one predetermined time period; determining at least one effective coordinate point from the touch point coordinates; selecting, from the touch point coordinates, at least one deviated coordinate point associated with the application icon; and adjusting current hotspot of an application icon based on the at least one deviated coordinate point of the application icon to obtain a new hotspot of the application icon, where the new hotspot includes the current hotspot.

Abstract: A touch-panel cellular phone specifies an invalid area not accepting a user's input operation on a touch panel in advance. The cellular phone detects a user's touch area on the touch panel so as to execute a function pre-assigned to the touch area not encompassed by the invalid area. Additionally, it is possible to reduce and display menu icons in the display area precluding the invalid area on the touch panel. Thus, it is possible to prevent an error operation when a user holding a cellular phone inadvertently touches the touch panel.

Abstract: Consistent with disclosed embodiments, systems, methods, and computer readable media including instructions for implementing hybrid virtual keys in an extended reality environment are disclosed. Embodiments may include a processor to receive signals from a touch-sensitive surface, wherein a wearable extended reality appliance may virtually project a plurality of virtual activatable elements on the touch-sensitive surface. The plurality of virtual activatable elements virtually projected on the touch-sensitive surface may be a proper sub-set of a group of virtual activatable elements, based on the action of a user. The processor may receive touch inputs from the user via the touch-sensitive surface and identify one of the plurality of virtual activatable elements. The processor may cause a change in virtual content based on the identified virtual activatable element.

Abstract: An electronic device is disclosed. The electronic device includes a display, a storage unit configured to store a combination rule of letters constituting a word; and a processor configured to provide a letter input UI of a specific language, to predict a first letter inputted on the letter input UI and a second letter to be selected based on the letter combination rule of the specific language stored in the storage unit, and to control the display such that an active area of a key corresponding to the second letter is expansively provided.

Abstract: In one embodiment, a method includes receiving, from a client system, a text input comprising one or more n-grams, determining, using a deep-learning model, a vector representation of the text input based on the one or more n-grams, determining an embedding of the vector representation of the text input in a d-dimensional embedding space, identifying one or more labels based on, for each of the one or more labels, a respective similarity of an embedding of a vector representation of the label in the embedding space to the embedding of the vector representation of the text input, and sending, to the client system in response to the received text input, instructions for presenting a user interface comprising one or more of the identified labels as suggested labels.

Abstract: A display control method includes: obtaining, by a terminal, orientations and display statuses of a first screen and a second screen; determining, by the terminal, whether a trigger event used for adjusting the display statuses of the first screen and the second screen occurs; and when the trigger event occurs, displaying, by the terminal, adjusted display content on the first screen and the second screen based on the orientations and the display statuses of the first screen and the second screen. By obtaining an orientation and a display status of a terminal screen, when the trigger event occurs, the terminal can adjust the display status of the screen in a timely manner, so that a user can perform an interaction operation and interaction display between different screens.

Abstract: Techniques described herein are directed to, among other things, utilizing a self-centering user interface to receive information associated with a transaction. For instance, a computing device may receive a first input at a first location of a display. The computing device may then determine a positioning for the user interface, where the user interface may be substantially centered about the first location. In some instances, the computing device may display the user interface using the positioning. The computing device may then receive a second input corresponding to swipe from the first location of the display to a second location of the display. The computing device may then determine a symbol included in the user interface based at least in part on the second input. In some instances, the user interface includes a keypad for entering a personal identification number associated with a payment instrument.

Abstract: An information processing apparatus displays a software keyboard on a display screen, selects a template including an image area to which image data is assigned and a text area to which text data is assigned, arranges the image data in the image area of the selected template, displays a text input area for inputting text corresponding to the text area on the screen, assigns text inputted in the text input area using the keyboard to the text area of the selected template, and displays a layout result in which the image data is arranged in the image area and the text is arranged in the text area on the screen, the text area being displayed at a predetermined position, and changes the text area of the layout result from the predetermined position to a position not overlapping with the software keyboard when the software keyboard is displayed on the screen.

Abstract: Examples are disclosed relating to computing devices and methods for performing touch detection within a virtual trackpad area of a touch screen display. In one example, a non-trackpad touch input signal is received from outside the virtual trackpad area and processed with at least one touch detection algorithm applying a non-trackpad threshold value. A virtual trackpad touch input signal is determined to be received from within the virtual trackpad area. On condition of determining that the virtual trackpad touch input signal is received from within the virtual trackpad area, the virtual trackpad touch input signal is processed with the touch detection algorithm applying a virtual trackpad threshold value different from the non-trackpad threshold value.

Abstract: A multi-functional human interface device includes a control unit and a first multi-functional input button. The first multi-functional input button includes a cover unit configured to receive a touch input of a user's finger, an electrode unit including a transmitter and a receiver to form an electric field, an elastic unit configured to move from a first height to a second height when a first pressure is applied from the cover unit and configured to move back to the first height when the first pressure from the cover unit is released, and a switch unit configured to generate an electric signal representing an input of a predetermined letter.

Abstract: Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC).

Abstract: An apparatus can include a processor; memory accessible to the processor; a base housing; a display housing that includes a center panel and folding wings that fold over the center panel to form a recess for the base housing; and a hinge assembly that couples the display housing to the base housing.

Abstract: An electronic device is provided, which includes a display member including at least one piece of glass, a housing surrounding at least a portion of the display member to form a space inside the electronic device, a mounting member coupled to at least one side of the housing, a light output device disposed inside the mounting member to output light to the display member, a light refracting member refracting light emitted from the light output device, and a heat radiating member including at least a first portion disposed adjacent to the light output device and at least second portion extending to the housing to surround at least a portion of the at least one piece of glass, wherein at least a part of the heat radiating member contacts the space.

Abstract: A system that allows users of augmented reality environments to interact with each other across instances. For each user, the system recognizes real-world objects in an image of a real-world environment and retrieves augmented reality assets to overlay according to each user's selected theme. A user can open a multi-dimensional region in which the augmented reality assets of their augmented reality environment are replaced with those of a different augmented reality environment, giving the user a way to tunnel into another user's augmented reality environment. The augmented reality assets may include commands linked to real-world objects capable of receiving commands, allowing for users to interact with the real-world objects in the environment, such as a streamer's environment.

Abstract: A touch panel may include a transparent substrate and a light blocking layer in a touch area and on a side of the transparent substrate. The light blocking layer may include a keyboard pattern, and the keyboard pattern may include hollow characters. The light blocking layer may be configured to display the characters of the keyboard pattern on the light blocking layer by light passing through the hollow characters.

Abstract: A method includes detecting a touch input by a user at a position on a virtual keyboard. The method further includes applying a spatial model to map the touch input to one or more first candidate keys of the virtual keyboard, wherein the spatial model maps the touch input to the one or more first candidate keys based on a heatmap of prior touch inputs by the user. The method further includes applying a language model to map the touch input to one or more second candidate keys of the virtual keyboard, wherein the language model maps the touch input to the one or more second candidate keys based on comparing the position of the touch input to one or more predicted next keys. The method further includes selecting a particular key of the one or more first and second candidate keys as indicated by the touch input.

Abstract: System, method, and device of detecting identity of a user and authenticating a user; as well as detecting a possible attacker or impostor, and differentiating among users of an electronic device or of a computerized service. A mobile or portable electronic device is utilized to capture a self-taken image or video of a user, which is utilized as a user-authentication factor. The accelerometer and gyroscope or device-orientation sensor of the mobile device, sense and measure spatial and physical device properties during, before or after the submission of the self-taken image or video. Based on such spatial and physical device properties, in combination with computer-vision analysis of the content shown in the self-taken image or video, the system determines liveness of the user and freshness of the submitted self-taken image or video, and differentiates between a legitimate user and an attacker.

Abstract: A selection device (100) displays objects that are selection subjects on a touch screen, and selects an object according to an operation performed on the touch screen. In this selection device (100), a detector (130) detects a touch operation performed on the touch screen. A divider (150) divides the detection area of the touch screen into a plurality of sections on the basis of the positions of the objects that are currently displayed and the detection position where the detector (130) detected the touch operation. When an operation of selecting one of the sections divided by the divider (150) is detected, a confirmer (160) confirms the selection of the object that corresponds to the selected section.

Abstract: The disclosed technologies address various technical and user experience problems by augmenting the functionality provided by virtual on-screen trackpads without requiring users to switch between modes. In this way, users can access extended functionality without interfering with expected traditional trackpad functionality (e.g. moving a cursor, clicking, and scrolling). In particular, technologies are disclosed for modeless digital pen input to a virtual trackpad, modeless gestures for summoning user interfaces, modeless gestures utilizing position relative to adjacent user interfaces, and modeless cursor control and interaction with virtual touch targets.

Abstract: Described herein is a computer implemented method. The method comprises detecting user input activating a text effect selection control. In response to the first user input the method further comprises: automatically generating and displaying a first shadow for a selected design element, the first shadow having a first colour, a first offset value, and a first direction; and automatically generating and displaying a second shadow for the selected design element, the second shadow having a second colour, the first offset value, and a second direction, the second direction being opposite the first direction.

Abstract: An application window display method and a terminal. The method is applied to a terminal that supports displaying a plurality of application windows, and includes displaying, by the terminal, a first graphical user interface (GUI), where the first GUI comprises a first application window, receiving, by the terminal, an input operation performed on the first application window, and displaying, by the terminal, a second GUI in response to the input operation, where the second GUI comprises a soft keyboard at a fixed display location, and an area in the second GUI other than the soft keyboard includes the first application window, with the first application window being completely displayed, and where the display location of the soft keyboard in the second GUI partially or completely overlaps a display location of the first application window in the first GUI.

Abstract: Embodiments of the present invention provide an application display method and a terminal, where the method includes: acquiring a first flicking gesture, where a start position of the first flicking gesture is located in a first preset operating area; and when the terminal detects that the first flicking gesture is a first preset flicking gesture, displaying an application that is in a first state, where the first state includes at least one of the following states: a state of running in the foreground, a state of running in the background, and a state of being buffered in the background. Therefore, a recently used application can be displayed to a user according to a gesture of the user, without a need to dispose a dedicated button, thereby improving operation and control efficiency.

Abstract: In an example method, a user interface is presented by a device on a touch sensitive surface of the device. The device presents a keyboard image on a touch sensitive surface of the device. The device then receives a first touch input selecting a key of the keyboard image and responsive to receiving the first touch input, displays a primary character associated with the selected key. While maintenance of physical contact is detected by the touch sensitive surface, the device receives a touch gesture starting at the key of the keyboard image and continuing in a diagonal direction along a face of the key. Responsive to receiving the touch gesture, the device displays an alternative character associated with the selected key.

Abstract: A method of providing a user defined user keypad and a mobile terminal supporting the same are provided. The method includes displaying guide information when entering a user keypad setting mode, determining a designation range for the user keypad according to a user interaction inputted based on the guide information, computing a key arrangement of the user keypad in response to the determined range, and configuring the user keypad according to the computed key arrangement.

Abstract: Disclosed is an electronic apparatus including a flexible display of which at least a portion is located at a first surface of the electronic apparatus and a first-surface exposed display size is changed, and a controller configured to display, when a first input corresponding to a first icon is received, content corresponding to at least one application of an application set corresponding to the first icon on the display based on layout information and application set information of the application set in response to the first input.

Abstract: After the user touches anywhere within a designated “group key” area of multiple characters or functions on the touch screen keyboard, a “keypad” is created that is centered around the user's touch. The keypad has the same layout of characters and functions as the group key, but the keypad moves as necessary from the location of the group key to re-centre at the point of the user's touch. Maintaining the touch, the user swipes a fingertip from a central dead zone on the keypad to one of the keys to select it. Audio and haptic indicators may also be provided. The keyboard may be active without being displayed.

Abstract: A radiography apparatus includes a radiation generation unit that has a plurality of radiation sources generating radiation toward a subject, a C-arm that supports the radiation generation unit in a first end portion as one end, a radiography unit that is provided in a second end portion as the other end of the C-arm to face the radiation generation unit and images the subject using radiation, an imaging direction designation unit that designates an imaging direction of the subject, and a radiation source selection unit that selects the radiation source for use in imaging among the plurality of radiation sources using the designation of the imaging direction.

Abstract: A foldable computing device provides user interface (“UI”) transitions and optimizations while operating in a productivity mode. When the foldable computing device is operating in productivity mode, it can present a UI below a hardware keyboard placed over a display region and occluding only a top portion of the display region or a software keyboard presented in the display region occluding only the top portion of the display region. If the hardware keyboard or the software keyboard occlude only the bottom of the display region, a UI can be shown above the hardware keyboard or the software keyboard. The foldable computing device can adjust the position of UI windows that are occluded when the hardware or software keyboard is placed on the display region. The foldable computing device can move the UI windows back to their original positions if the hardware or software keyboard no longer occlude the display region.

Abstract: An electronic device is provided. The electronic device includes a substrate and the electronic device also includes a light-emitting element, a sensing element and a black matrix disposed on the substrate. The sensing element is disposed adjacent to the light-emitting element. The black matrix has a plurality of openings and a light-shielding portion. The electronic device further includes a driving element disposed adjacent to and electrically connected to the light-emitting element. The sensing element includes a first thin-film transistor, and the driving element includes a second thin-film transistor. In a normal direction of the substrate, one of the openings is disposed corresponding to the sensing element, and the light-shielding portion is disposed corresponding to the driving element.

Abstract: An example electronic apparatus for providing voice recognition control includes a display; and a processor, wherein the processor may be configured to obtain a content including at least one object; distinguish the at least one object within the content; display an instruction text in correspondence with a non-text object among the at least one object; and select the non-text object corresponding to the instruction text if a voice command corresponding to the instruction text is inputted.

Abstract: An image processing apparatus described in the present specification includes a display unit configured to display a software keyboard, a reception unit configured to receive a signal transmitted from the information processing apparatus based on a depression of a keyboard, a storage unit configured to store the signal received by the reception unit in association with information about a hardware key provided on the image processing apparatus, and a control unit configured to display a character based on the signal received by the reception unit on the display unit in a case where the software keyboard is being displayed by the display unit, and to perform processing corresponding to a depression of the hardware key information about which is stored in the storage unit in association with the signal received by the reception unit in a case where the software keyboard is not being displayed by the display unit.

Abstract: Methods and systems for providing a mixed reality (MR) interaction are provided. In one example, the method comprises: capturing a first image of a user's appendage and a physical peripheral input device, wherein the user's appendage covers at least a part of the physical peripheral input device; performing a segmentation of the first image into a first region of pixels corresponding to the user's appendage, wherein a second region of pixels corresponds to the physical peripheral input device; generating a composite image from the first image based on rendering, in place of the second region of pixels, pixels representing a virtual peripheral input device, such that the virtual peripheral input device appears in the composite image as at a same spatial location as the physical peripheral input device and covered at least partially by the user's appendage; and displaying the composite image to the user.

Abstract: Systems and methods for assessing quality of input text using recurrent neural networks is disclosed. The system obtains input text from user and performs a comparison of each word from input text with words from dictionary (or trained data) to determine a closest recommended word for each word in the input text. The input text is further analyzed to determine context of each word based on at least a portion of input text, and based on determined context, at least one of correct sentences, incorrect sentences, and/or complex sentences are determined from the input text. Each word is converted to a vector based on concept(s) by comparing each word across sentences of input text to generate vectors set, and quality of the input text is assessed based on vectors set, the comparison, determined context and at least one of correct sentences, incorrect sentences, complex sentences, or combinations thereof.

Abstract: Providing assistance using a device can include determining, using a processor, an application that is currently executing and displayed by the device and determining, using the processor, information that accelerates user interaction with the application. The information can be displayed on the device as application-specific assistance.

Abstract: A method for inputting characters capable of being performed in a device is disclosed. The device is configured to input characters in a text input area that is displayed on the device itself or on an external display device. The method for inputting characters includes receiving, at the device, a key input which corresponds to a language character to be inputted in the text input area, and causing the device to input a plurality of Unicode characters in the text input area in response to the key input, the plurality of Unicode characters representing a shape of the language character over at least two text lines.

Abstract: A centralized control apparatus includes: an operation panel on which a plurality of operation buttons used to set a plurality of controlled instruments are displayed; and a system controller, the system controller being configured to register the operation buttons, which are displayed when the plurality of controlled instruments satisfy respective operation state conditions, in advance as operation button display conditions, acquire operation states of the plurality of controlled instruments, compare the operation states and the operation state conditions, extract the plurality of operation buttons to be displayed on the operation panel according to a result of the comparison, and display the plurality of extracted operation buttons side by side in time-series order in a predetermined direction of the operation panel.