Abstract: A method, an electronic device, and a non-transitory computer readable storage medium for interacting with a virtual reality (VR) environment are provided. The method includes: displaying a first portal in a first virtual scene of the virtual reality environment, wherein the first portal is for a virtual scene switching, and the first portal comprises a frame; determining whether the frame is dragged toward a center of the first portal; and in response to determining the frame is dragged toward the center of the first portal, removing the first portal from the virtual reality environment.

Abstract: A desktop switcher provides equally convenient user interface navigational access to remote virtual desktops as to local virtual desktops for reliable and convenient human-computer interaction. Underlying mechanisms transparently confirm remote computer availability and compatibility, transfer thumbnails between computers, and support remoting sessions. Virtual desktops may share a clipboard, a geographic location setting, and application thumbnails, despite being based on computers that are remote from one another, e.g., when only one of a session's computers resides in a cloud. Virtual desktop context menus may be shown and utilized remotely. A visual separator in the desktop switcher may distinguish local virtual desktops from remote virtual desktops.

Abstract: There is disclosed a smartphone, tablet or other computing device comprising: (a) a touch sensitive display; (b) one or more processors; (c) computer memory; (d) an operating system computer program stored in the computer memory and configured to be executed by the one or more processors and including instructions for detecting a swipe gesture, and, in response to the detected swipe gesture, displaying a search bar.

Abstract: A terminal device control method includes: a window mode information acquisition step of acquiring window mode information indicating any one of a single-window mode, which is a mode in which one application runs, and a multi-window mode, which is a mode in which a plurality of applications run in parallel, for a screen of a terminal device configured to cause an external device to perform operation by communicating to/from the external device; a switching step of making a switch, in a case in which the window mode information acquired in the window mode information acquisition step indicates the multi-window mode, to enable or disable a first operation, which is an operation to be performed at least in a time period in which a first application for causing the external device to perform operation runs, and is an operation regarding information to be transmitted from the external device to the terminal device; and a first operation execution step of executing the first operation in a case in which the switch

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.

Abstract: A system and method for dynamically adjusting the architecture of an application on a device based on user responsiveness. The application determines relevant changes to apply based on the user's interactivity with the application through a plurality of inputs and data analysis. The application adapts the architecture to provide preferred application containers, features, workflow, and interface elements. User data, indicating characteristics of the user, is obtained and used to select adaptions to the user architecture through selection of specific application container units, application features, workflow segments and other elements. The application determines and selects the appropriate application container units, application features, and workflow segments to vary the features available, the content displayed, the workflow of the application, the form of the content and the interface for different users.

Abstract: At least certain embodiments of the present disclosure include an environment with a framework of software code interacting with a plurality of applications to provide gesture operations in response to user inputs detected on a display of a device. A method for operating through an application programming interface (API) in this environment includes displaying a user interface that includes a respective view that is associated with a respective application of the plurality of applications. The method includes, while displaying the respective view, detecting, via the software code, a user input within the region of the touch-sensitive surface that corresponds to the respective view, and, in response, in accordance with a determination that the user input is an inadvertent user input, ignoring the user input. The determination that the user input is an inadvertent user input is made based on an inadvertent user input call transferred through the API.

Abstract: Appearance driven automatic three-dimensional (3D) modeling enables optimization of a 3D model comprising the shape and appearance of a particular 3D scene or object. Triangle meshes and shading models may be jointly optimized to match the appearance of a reference 3D model based on reference images of the reference 3D model. Compared with the reference 3D model, the optimized 3D model is a lower resolution 3D model that can be rendered in less time. More specifically, the optimized 3D model may include fewer geometric primitives compared with the reference 3D model. In contrast with the conventional inverse rendering or analysis-by-synthesis modeling tools, the shape and appearance representations of the 3D model are automatically generated that, when rendered, match the reference images.

Abstract: In some embodiments, a multifunction device with a display and a touch-sensitive surface creates a plurality of workspace views. A respective workspace view is configured to contain content assigned by a user to the respective workspace view. The content includes application windows. The device displays a first workspace view in the plurality of workspace views on the display without displaying other workspace views in the plurality of workspace views and detects a first multifinger gesture on the touch-sensitive surface. In response to detecting the first multifinger gesture on the touch-sensitive surface, the device replaces display of the first workspace view with concurrent display of the plurality of workspace views.

Abstract: A system includes an electronic device and VR glasses. The electronic device receives a notification message in a VR mode. The notification message is designated to be displayed by a first user interface in a normal mode. The electronic device is configured to generate a second interface based on the first interface and display the second interface for displaying the notification message in the VR mode. The electronic device is configured to receive a first user input corresponding to a first location on the second interface. The electronic device is configured to determine a second location on the first interface corresponding to the first location on the second interface to respond to the first user input for interacting with the notification.

Abstract: Provided is a method of operating a device having a plurality of operating systems installed therein, the method including: receiving a first user input for selecting at least one application installed in a first operating system among the plurality of operating systems; receiving a second user input for selecting a second operating system, in which a shortcut icon for execution of the selected application is to be displayed, among the plurality of operating systems; creating the shortcut icon based on the first user input and the second user input; and displaying the created shortcut icon on a user interface of the second operating system.

Abstract: A planar placement system can generate virtual surfaces (e.g., floors, walls) to simulate items in an augmented reality display. The system can generate the virtual surfaces using image feature tracking and plane intersection approaches that create an accurate visual simulation. The items simulated can be variable items that have unit data (e.g., rolls of wallpaper) that can be simulated on the virtual surfaces, and unit data can be displayed and updated in real time or near real time on a mobile device, such as a user's smartphone.

Abstract: A mobile terminal and a method for split screen control thereof, and a computer readable storage medium are provided. The method includes the following. The mobile terminal determines, in a split screen mode, a first split screen. The mobile terminal detects, in the split screen mode, an instruction for desktop display. The mobile terminal acquires a desktop icon and displays the desktop icon on the first split screen, upon receiving the instruction for desktop display.

Abstract: A method and an apparatus for changing a screen in an electronic device that provides a plurality of windows are provided. The method includes providing, by an electronic device, a plurality of windows functionally connected to the electronic device, selecting at least one window displaying a first application among the plurality of windows, obtaining an input related to a second application being executed in the selected at least one window, and displaying the second application through the at least one window, based on the obtained input. The present disclosure is not limited to a specific embodiment, but various embodiments based on a technical spirit of the present disclosure may be implemented.

Abstract: A monitor's OSD can be selectively controlled with a keyboard, mouse or other human interface device. A microcontroller of a keyboard, mouse or other human interface device can be configured to detect the occurrence of input representing an OSD command. In response, the microcontroller can commence sending input to the monitor rather than to the computing device so that the input can control the OSD. Similarly, a filter driver on the monitor can be configured to detect the occurrence of input representing the OSD command. In response, the filter driver can commence sending input to the monitor's scalar rather than to the computing device.

Abstract: A wireless communication device includes at least two subscriber identification modules (SIMs), including a first SIM and a second SIM. The wireless communication device includes multiple electronic displays, including at least a first electronic display and a second electronic display. The wireless communication device includes a processor coupled to each of the at least two SIMs and the multiple electronic displays. The processor executes program code that enables the wireless communication device to: selectively channel data operations associated with a graphical user interface (GUI) of a currently active electronic display to one SIM that is user-assigned to the currently active electronic display. The processor executes program code that enables the wireless communication device to: associating input/output (I/O) functions with the currently active electronic display from among the multiple electronic displays.

Abstract: An electronic apparatus, computer-readable recording medium, and method of providing a plurality of work group objects are provided. The method includes providing a plurality of work group objects respectively representing a plurality of work groups, providing a plurality of window objects in response to a selection of a work group object and representing a plurality of windows, providing a window in response to a selection of a window object, and providing an object representing windows corresponding to all of the window objects associated with one of the work groups.

Abstract: Disclosed are a method of controlling applications in a terminal and a terminal, which may extend the control methods of the applications installed in the terminal. The method includes: receiving a user operation instruction including a voice instruction or a gesture instruction that is not in contact with the terminal, during a display of a first operation interface of a first application by the terminal; determining a first control corresponding to the user operation instruction from at least one control on the first operation interface; and executing a response program of the first control.

Abstract: Described herein is a computer implemented method for generating a calendar interface. The method includes determining a total time period value indicating a total time period to be displayed, determining a segment duration, determining an interval duration, calculating timeline coordinates defining a timeline extending from a foreground of the display to a background of the display and having a perspective appearance, and displaying a timeline in accordance with the timeline coordinates. The timeline coordinates define the timeline to have a plurality of segments, each segment representing a period of time within the total time period equal to the segment duration. Each segment is composed of a plurality of timeline intervals, each timeline interval representing a period of time within the total time period equal to the interval duration.

Abstract: The present invention relates to a display device and a control method therefor and, more specifically, provides a display device comprising: a sensing unit for sensing a touch pen; a touchscreen; and a control unit, wherein the control unit controls at least one of a plurality of pieces of content on the basis of a position of the touch pen in a state of executing a multi-tasking mode in which the plurality of pieces of content is simultaneously being executed on the touchscreen, the plurality of pieces of content including note content.

Abstract: Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.

Abstract: A collaboration system can be configured to support a large number of active clients in a workspace where the workspace is distributed into disparate groups of objects. While participating in the workspace, a first active client can configure their viewport to follow the viewport of a second active client. This configuration synchronizes the first active client's viewport with the second active client's viewport, including a translation or a zoom of the second active client's viewport. The system can be configured so that the second active client is informed that it is being followed by the first active client.

Abstract: A system and method for dynamically adjusting the architecture of an application on a device based on user responsiveness. The application determines relevant changes to apply based on the user's interactivity with the application through a plurality of inputs and data analysis. The application adapts the architecture to provide preferred application containers, features, workflow, and interface elements. User data, indicating characteristics of the user, is obtained and used to select adaptions to the user architecture through selection of specific application container units, application features, workflow segments and other elements. The application determines and selects the appropriate application container units, application feature, and workflow segments to vary the features available, the content displayed, the workflow of the application, the form of the content and the interface for different users.

Abstract: A method and apparatus for a graphical user interface system are provided. The graphical user interface system includes one or more display devices that provide a passive display space, an active display space, and an exchange area. The active display space and the exchange area are provided on a single display device. One or more objects are displayed in the passive display space and a visual representation of each object of the one or more object is displayed in the exchange area. A selection is received in the exchange area of a visual representation of a first object displayed in the passive display space. In response to receiving the selection, the first object is displayed in the active display space. While displayed in the active display space, the first object is operable in response to commands received through the graphical user interface system.

Abstract: Provided are a device and a method which facilitate continued focusing of a used on specific content information by increasing the opportunities for said content information to appear (be exposed) even in case that said specific content information has been moved off the display screen by scrolling. At least one set of copy content information is generated which is a copy of focus content information identified from content information contained in a content list displayed on the display screen of a terminal device. Then, said generated copy content information is inserted at any insertion position in the sequence of the content list, and said inserted copy content information is displayed on the display screen in response to operations in which the user scrolls the display content on the display screen.

Abstract: In a medical support system, a patient list or work list is displayed on a display panel of a client terminal apparatus. An information item number window area and a patient number window area are contained in the patient list. The information item number window area displays a number of items in an undisplayed portion outside an active display area. The patient number window area displays a number of datasets of personal information of patient bodies (number of patient bodies) in the undisplayed portion. A display form of the number window areas is translucent and in achromatic gray, in a tapered triangular shape to point a location of the undisplayed portion. Numbers are indicated in the number window areas. Thus, the patient list can be viewed by a medical professional with good visual perceptibility.

Abstract: Systems and methods are provides for changing a window stack for a multi-screen device. The window stack can change based on the movement of a window. The system can receive a gesture indicating a change in the position of a window in the device. Upon receiving the gesture, the system determines a new position in the window stack for the moved window. Then, the system can determine a display associated with the moved window and change the logic data structure associated with the moved window to describe the new position of the moved window in the window stack.

Abstract: A system for presenting a common user interface (UI) of multiple applications on diverse client computing devices as a web page that includes a set of UI elements leading to the multiple applications. The diverse client computing devices have display screens of diverse sizes. In the system, backend servers host a UI infrastructure including the common UI and one or more object page floorplans of respective UI object pages representing the multiple applications and representing application information and data on the diverse client computing devices. Design tools are available to process the object page floorplans to display, create, or edit the UI object pages. The object page floorplans include a first object page layout including a title bar, a header, an expanded default state, a navigation control, a content area, and a footer toolbar containing actions that are performed upon a corresponding first UI object page.

Abstract: User interfaces for multiple display regions are described. One embodiment provides an array of non-overlapping windows that are created from a set of overlapping windows, and a user can select one of the non-overlapping windows to obtain an enlarged view of that selected window while keeping the other windows in their non-overlapping state. In one embodiment, the array of non-overlapping windows can include minimized windows or windows in other virtual desktops (e.g. windows in other “Spaces”) or both. In one embodiment, only windows of a selected application are shown in non-overlapping mode while opened windows of other applications are not shown.

Abstract: A food inventory system, including a portable device which may include a bar code scanner and camera to add and remove inventory items to and from the inventory. The scanner may be mounted on an inventory storage container to facilitate inventory control from one or more domestic storage devices, including refrigerators, freezers, and pantries. The inventory system may display a table listing the inventory items along with variable details. Based on the food inventory list, the inventory system may suggest recipes, display the ingredients in stock for suggested recipes, and create a shopping list of the ingredients not in stock for a desired recipe. The portable device may be configured with wireless capability, connection to the internet, phones, tablets, laptops, and personal computer.

Abstract: Mobile phone application graphically shrinks a display in response to a flick down in right or left diagonal direction, thereby enabling easier operation with a single hand. Soft keys in a menu bar are provided at the bottom of the display conveniently to facilitate single hand use.

Abstract: Desktop as an immersive application techniques are described. In one or more implementations, an immersive environment module is configured to provide an immersive shell through which a user may interact with applications of a computing device. The immersive environment module is further configured to provide a desktop shell within the immersive shell to support additional techniques for interaction with the application of the computing device. The desktop shell, for instance, may be configured for accessibility similar to that provided to applications in the immersive shell.

Abstract: A user-centric management application system and method for a security system that conceptualizes the security devices and the tasks to perform on the security devices as separate objects with common properties and behavior. Operators of the system create abstract containers, called dockviews, which the operator adds objects to in order to perform specific tasks. Because the operator assigns user access to dockviews and objects, the system tailors system access for both application users and tenants of the security system based on policy objectives. Dockviews have the ability to open in separate application windows to support priority display and isolation of critical management tasks. The system provides integrated user administration, event management and reports capability, a consistent “look and feel,” and system-wide automated event notification via a watchlist window.

Abstract: This disclosure generally relates to systems and methods that facilitate querying a content publisher for their goal(s) in employing a content sharing site and providing customized suggestions, such as recommendations, site tools, site dashboards, and site displays to assist in achieving the goal(s). Additionally, the specified goals are employed in conjunction with monitoring publisher interactions with the content sharing site to learn behaviors that that predict a publisher goal.

Abstract: The invention introduces a screen-sharing method, executed by a processing unit of a screen-sharing source, which contains at least the following steps. Application windows being opened on a display unit are obtained. For each application window, screen-sharing receivers, which are connected to the screen-sharing source, are detected and items are appended to a system menu instance of the application window, where each item corresponds to one screen-sharing receiver.

Abstract: Disclosed is a method of displaying a notification on a device with a plurality of operating systems (OSes) installed therein. The method includes identifying a first OS displayed on a first display of the device among the plurality of OSes, detecting a notification generated in a second OS running in a background of the device among the plurality of OSes, converting the generated notification based on a preset format of the first OS when the notification is generated, and displaying the converted notification on the first display on which the first OS is displayed.

Abstract: In some implementations, windows can be displayed based on a global z-order. The global z-order can be maintained for all open windows. The global z-order can include windows that are not currently displayed. The global z-order can define a display order of windows across multiple workspaces. In some implementations, workspaces can be associated with respective levels. The workspace levels can be used to determine how to display windows associated with each workspace when multiple workspaces are displayed simultaneously.

Abstract: Disclosed are various embodiments for providing multi-factor authentication credentials. In one embodiment, in response to a request from an application, a notification is generated in a notification area of a display. Entry of a user approval is facilitated via the notification. In response to receiving the approval, a security credential is transferred to the application. In another embodiment, the security credential may be shown in the notification area so that a user may enter it in a form field of the application.

Abstract: A user interface can have one or more spaces presented therein. A space is a grouping of one or more program windows in relation to windows of other application programs, such that the program(s) of only a single space is visible when the space is active. A view can be generated of all spaces and their contents.

Abstract: Provided are graphical user interface “baskets” that hold collections of windows on a large display (or collection (or array) of small displays) and confine respective windows into a particular screen region (that is, basket) as if that screen region (that is, basket) were the entire display. In one example, the basket layout(s) and window layout(s) may be saved. In another example, multiple windows may be organized/managed such that a “maximize” of a window does not take up the entire large display.

Abstract: A system can include computer instructions that can cause a computing device to obtain a request to access an application on behalf of a user. The request can be obtained from a client device associated with the user. The computer instructions can further cause the computing device to determine whether the client device is required to execute a virtual machine that executes the application. The computer instructions can further cause the computing device to identify whether the virtual machine is installed in the client device. The computer instructions can further cause the computing device to cause the virtual machine to be installed in the client device.

Abstract: In some embodiments, a multifunction device with a display and a touch-sensitive surface creates a plurality of workspace views. A respective workspace view is configured to contain content assigned by a user to the respective workspace view. The content includes application windows. The device displays a first workspace view in the plurality of workspace views on the display without displaying other workspace views in the plurality of workspace views and detects a first multifinger gesture on the touch-sensitive surface. In response to detecting the first multifinger gesture on the touch-sensitive surface, the device replaces display of the first workspace view with concurrent display of the plurality of workspace views.

Abstract: Embodiments related to analysis system for analyzing biological samples, a data processing method and a computer program product are disclosed. An analyzer is coupled to an control computer and has a control application program which receives control data, sends analytical data, and generates a host screen image. A remote computer is coupled to the control computer, and provides a data manager application program which sends the control data to the control computer, receives the analytical data, and generates a first window. A remote application program interoperates with a host application program which generates a second window containing a duplicate of the host screen image. A user interface program displays a first display window and a second display window, the first display window being one of the first and second windows and the second display window containing a screen shot of the other one of the first and second windows.

Abstract: Systems, methods and products are described that provide taskbar grouping by user task. One aspect includes identifying a plurality of applications open on a computing device; identifying one or more objects open in said plurality of applications; determining one or more objective measures of said one or more objects belonging to a particular task; and automatically grouping objects sharing one or more objective measures of belonging to a particular task together in a common taskbar icon of a display.

Abstract: Provided is an information processing apparatus including a novel user interface capable of switching a number of images for display on a screen. The information processing apparatus displays a menu image representing one or more menu item images on a screen, displays, when any one of the one or more menu item images is selected, a selection target image associated with the selected menu item image on the screen, stores a selected order of already-selected ones of the one or more menu item images, displays, when one direction along one side of the screen is specified, another selection target image, which is selected in accordance with the stored selected order and the one direction, and redisplays the menu image when an opposite direction to the one direction is specified in a state in which the selection target image associated with the menu image selected most recently is displayed.

Abstract: In some implementations, a method for managing virtual workspaces is described. In some implementations, workspace images corresponding to different virtual workspaces can be displayed on a user interface of a computing device. When an application window is moved onto one of the workspace images, the window can be scaled down to fit within the workspace image. In some implementations, a window grouping or cluster can be moved onto one of the workspace images and scaled down accordingly. In some implementations, a method for generating a new virtual workspace is described. In some implementations, a placeholder workspace image that has no corresponding virtual workspace can be displayed on a user interface of a computing device. In response to an application window being moved onto the placeholder workspace image, a new virtual workspace (and new workspace image) can be generated that includes the windows that were moved onto the placeholder workspace image.

Abstract: An interfacing device for providing a user interface (UI) exploiting a multi-modality may recognize at least two modality inputs for controlling a scene, and generate scene control information based on the at least two modality inputs.

Abstract: Techniques for optimizing window move actions for a remoted application are provided, where the remoted application has an application window running within a remote desktop of a server system, and where the application window is made accessible to a user of a client system in the form of a client-side application window displayed in a client desktop of the client system. In one embodiment, the client system can receive from the server system a notification that the application window has begun moving in the remote desktop, and can determine that the user is currently entering one or more input commands for moving the client-side application window in the client desktop. The client system can further send a command to the server system for stopping the movement of the application window in the remote desktop, such that the application window is fixed in a stationary position.

Abstract: Disclosed are methods and systems for immersive system interfacing. A stimulus is defined in the form of a gesture or posture with an end-effector such as a hand. The stimulus is sensed within an environment and communicated to a processor. In response to the stimulus the processor generates a user interface, the interface being outputted near the end-effector. The stimulus may be identical for all times, all places, and all conditions in the environment. The interface may be generated and outputted in response to the stimulus for all times, places, and conditions in the environment. The apparatus includes a processor adapted to define a stimulus in the form of an end-effector gesture or posture, and to generate a user interface in response to the stimulus. A sensor is adapted to sense the stimulus, and a display is adapted to output the interface to an environment.

Abstract: The method provides a graphical user interface for an electronic transaction with a handheld touch screen device. An input display is oriented to be operable by actions of a thumb of a user and accepts inputs from the user. If the user swipes in a vertical direction, additional information about an object is displayed. If a user swipes down, less information about an object is displayed. If a user swipes laterally, an additional object is displayed, and if a user taps, the object for use in an electronic transaction is displayed.