Abstract: The present disclosure generally relates to user interfaces for facilitating operations. In some examples, computer systems provide indications that educate and/or guide users for performing an operation. In some examples, computer systems perform a first operation based on a first type of user input corresponding to a first hardware input device and perform a second operation based on a second type of user input corresponding to the first hardware input devices. In some examples, computer systems adjust audio output of an emergency siren based on detecting a particular type of event. In some examples, computer systems display different types and/or sizes of notifications based on an operating mode of a respective computer system. In some examples, computer systems forgo performing one or more operations when a respective computer system operates in a low power mode.

Abstract: A user can share (show) multimedia information while simultaneously communicating (telling) with one or more other users over a network. Multimedia information is received from at least one source. The multimedia information may be manually and/or automatically annotated and shared with other users. The multimedia information may be displayed in an integrated live view simultaneously with other modes of communication, such as video, voice, or text. A simultaneous sharing communication interface provides an immersive experience that lets a user communicate via text, voice, video, sounds, music, or the like, with one or more other users while also simultaneously sharing media such as photos, videos, movies, images, graphics, illustrations, animations, presentations, narratives, music, sounds, applications, files, and the like. The simultaneous sharing interface enables a user to experience a higher level of intimacy in their communication with others over a network.

Abstract: Embodiments of the present invention are directed to facilitating folding of virtual objects via a three-dimensional folding tool. In embodiments, a foldable virtual object having a set of one or more fold lines is presented. A user may select a particular fold line. Based on the user selection, a three-dimensional folding tool is presented in association with the selected fold line. The three-dimensional folding tool can include a first handle on a first panel adjacent to the selected fold line and a second handle on a second panel adjacent to the selected fold line. In accordance with detecting movement of the first handle in a direction, the first panel is folded or rotated about the fold line in the direction of the movement of the first handle, while the position of the second panel is maintained.

Abstract: Methods of controlling the display and use of a UI element are disclosed. In an embodiment, the UI element may configured so that it initially maintains a topmost position but eventually allows other applications to assume the topmost position. In an embodiment, the display of the element may be adjusted in response to an input so that the UI element is not visible on the display. In an embodiment, the use of the UI element may allow for seamless dragging of the UI element even if the user inadvertently fails to make consistent contact with the touch-sensitive display while dragging the UI element.

Abstract: A computer-implemented method for simulating the behavior of a hand interacting with objects in a virtual environment is provided, having acquiring a skeleton of a tracked hand using a hand-tracking device; computing a simulated hand interacting with objects in a virtual environment; establishing a coupling between the skeleton of a simulated hand and the tracked skeleton using coupling energies (Ucrb); establishing an internal energy of the simulated hand that accounts for joint constraints of the skeleton, skeleton-tissue coupling, and nonlinear soft-tissue deformation; establishing frictional contact between the simulated hand and virtual objects using a penalty energy considering relative interpenetration at contact points and a frictional energy considering the deviation between each contact point and its corresponding sliding anchor point; computing an updated skeleton and tissue of the simulated hand by minimizing the total energy involved.

Abstract: A method of compensating for a movement of a device worn by a user is described. The method comprises measuring, using a first sensor, a motion of a user wearing the device; measuring, using a second sensor, a motion of the device; determining a difference in the motion of the device with respect to the motion of the user; and compensating for the difference in the motion of the device with respect to the motion of the user. An electronic device for monitoring a device worn by a user is also disclosed.

Abstract: An electronic apparatus includes a memory, a display, and a processor. The processor obtains an instruction on a figure-related process. If a type of a figure indicated by the instruction is a type unable to be drawn with function data stored in the memory, the processor: sends relevant data to at least one server; receives, from the server, drawing data generated by the server executing, based on the relevant data, an arithmetic operation required for the figure-related process; and performs the process on the display in accordance with the drawing data. If the type is a type able to be drawn with the function data, the processor executes an arithmetic operation required for the figure-related process using the function data without requesting the server to execute the arithmetic operation, and performs the process on the display in accordance with drawing data generated as a result of the arithmetic operation.

Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.

Abstract: A user can share (show) multimedia information while simultaneously communicating (telling) with one or more other users over a network. Multimedia information is received from at least one source. The multimedia information may be manually and/or automatically annotated and shared with other users. The multimedia information may be displayed in an integrated live view simultaneously with other modes of communication, such as video, voice, or text. A simultaneous sharing communication interface provides an immersive experience that lets a user communicate via text, voice, video, sounds, music, or the like, with one or more other users while also simultaneously sharing media such as photos, videos, movies, images, graphics, illustrations, animations, presentations, narratives, music, sounds, applications, files, and the like. The simultaneous sharing interface enables a user to experience a higher level of intimacy in their communication with others over a network.

Abstract: A system, method, and computer-readable medium for performing bezel tiling correction for multiple displays that provides information regarding multiple monitor configuration of a computing system; provides bezel widths of monitors of the multiple monitor configuration; and performs bezel width correction on particular monitors of the multiple monitor configuration based a bezel tiling correction mode that aligns received frames/images that are displayed on the monitors.

Abstract: Embodiments of the disclosure provide a multi-screen display method and a display device including a curved surface display screen. The method is applied to the display device and includes the following steps. Position information of a preset folding line defined in the curved surface display screen is obtained when screen is bent according to the preset folding line, wherein the preset folding line is a boundary between the two adjacent sub-curved surface display screens formed thereby. A display interface of the screen is divided into a plurality of display sub-interfaces according to the position information, wherein a screen splitting line between two adjacent display sub-interfaces coincides with the preset folding line. The display contents selected by the user in the plurality of display sub-interfaces are obtained; and the adjusted display contents are displayed in the display sub-interfaces.

Abstract: A user can share (show) multimedia information while simultaneously communicating (telling) with one or more other users over a network. Multimedia information is received from at least one source. The multimedia information may be manually and/or automatically annotated and shared with other users. The multimedia information may be displayed in an integrated live view simultaneously with other modes of communication, such as video, voice, or text. A simultaneous sharing communication interface provides an immersive experience that lets a user communicate via text, voice, video, sounds, music, or the like, with one or more other users while also simultaneously sharing media such as photos, videos, movies, images, graphics, illustrations, animations, presentations, narratives, music, sounds, applications, files, and the like. The simultaneous sharing interface enables a user to experience a higher level of intimacy in their communication with others over a network.

Abstract: A modeling application is provided with functionality that adds a bend between two flat sheets.

Abstract: A method to generate a curved connector includes receiving input effective to designate multiple designated points of the curved connector. The designated points include initial and final endpoints and one or more intermediate points between the initial and final endpoints. The method may also include inferring, for each intermediate point, first and second control points without receiving input effective to directly specify the first control point or the second control point. The method may also include calculating: a first curve to include in the curved connector between a corresponding one of the one or more intermediate points and a preceding one of the designated points based at least on the first control point; and a second curve to include in the curved connector between the corresponding one of the one or more intermediate points and a subsequent one of the designated points based at least on the second control point.

Abstract: An electronic device, with a touch-sensitive surface and display, displays a user interface at a first display rate. While displaying the user interface in accordance with the first display rate, the device detects movement of a touch input, including detecting the touch input at a first set of sequential locations on the touch-sensitive surface, including a plurality of locations on the touch-sensitive surface, and predicts for the touch input a first set of one or more predicted locations on the touch-sensitive surface based on multiple locations in the first set of sequential locations. The device updates the user interface in accordance with the first set of one or more predicted locations of the touch input on the touch-sensitive surface.

Abstract: A method of compensating for misalignments along a seam of first and second electronic panels installed for a display device is provided. Each of the first and second electronic panels includes a plurality of pixels formed in an i×j matrix, wherein i and j are integers at least one. The method includes controlling a camera device to be placed over the seam, alternately turning on first pixels in a first column of the first electronic panel, the first column being closest to the seam, capturing, using the camera device, images for the respective first pixels, detecting, using a pattern detector, each of the first pixels based on a corresponding one of the captured images, determining one of at least one horizontal displacement or a vertical displacement along the seam, and compensating for the misalignments along the seam based on the determined at least one horizontal displacement or the vertical displacement.

Abstract: Methods and systems involving navigation of a graphical interface are disclosed herein. An example system may be configured to: (a) cause a head-mounted display (HMD) to provide a graphical interface, the graphical interface comprising (i) a view port having a view-port orientation and (ii) at least one navigable area having at least one border, the at least one border having a first border orientation; (b) receive input data that indicates movement of the view port towards the at least one border; (c) determine that the view-port orientation is within a predetermined threshold distance from the first border orientation; and (d) based on at least the determination that the view-port orientation is within a predetermined threshold distance from the first border orientation, adjust the first border orientation from the first border orientation to a second border orientation.

Abstract: A method is provided for creating at least one image of a graphics scene that is to be played back on a screen. The graphics scene is made up of graphics objects. The position of a user is known. A graphics object is created in at least one image while taking account of the position of the user. A terminal is provided, which includes including an image-creator for creating at least one image of a graphics scene that is to be played back on a screen of a user occupying a position relative to the screen, the scene including at least one graphics object.

Abstract: Embodiments of the present application disclose a display control method and a display control apparatus, relating to the field of near-to-eye display technologies. The method includes: determining a first display area, in the FOV of a user, of an image displayed on a main display device; and using at least one near-to-eye display device according to the first display area to display augmentation information related to the image. In the method and apparatus of the embodiments of the present application, at least one near-to-eye display device is used to supplement a display that is provided at a suitable viewing distance of a user by a device but cannot fully fill the FOV of the user, and augmentation information is used to fill the FOV of the user as far as possible, so that good immersion media viewing experience can be provided.

Abstract: Systems and methods are provided for building digital objects using component modular objects, such as block objects. The block objects have properties defining their appearance and interaction characteristics. When two or more block objects are placed together to form an object, their interaction characteristics define how they behave and so how the computer system will handle the representation of the block objects and the new object.

Abstract: Systems, methods, and non-transitory computer-readable media can acquire a request for a map of a particular region. A first set of one or more map portions for representing a first portion of the particular region can be identified based on the particular region. The first set can be associated with a first map data source. A second set of one or more map portions for representing a second portion of the particular region can be identified based on the particular region. The second set can be associated with a second map data source. The map of the particular region can be generated based on a combination of the first set and the second set.

Abstract: Provided is a mobile terminal including a display unit to which multiple divisional screen regions are output, and a control unit that when an input for entering a division mode in which the display unit is divided into the multiple screen regions is received, generates a list region including a list of multiple applications, divides the display unit into first and second screen regions with the list region in between, and executes first and second applications selected from among the multiple applications on the first and second screen regions, respectively, in which the controller executes an application selected from among the multiple applications included in the list on the list region, and in which when an object included in the application being executed on the list region is selected, at least one of the first and second applications uses the selected object.

Abstract: There is provided a pointing system including an image sensor, a plurality of reference marks and a processing unit. The image sensor is configured to capture image frames containing at least one reference mark image of the reference marks. The processing unit is configured to recognize an image number of the reference mark image and calculate an aiming point coordinate according to a positioning algorithm associated with the image number.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program which when executed on a device by at least one processing unit performs panning operations on a three-dimensional (3D) map. The program displays a first 3D perspective view of the 3D map. In response to input to pan the 3D map, the program determines a panning movement based on the input and a two-dimensional (2D) view of the 3D map. The program pans the first 3D perspective view of 3D map to a second 3D perspective view of the 3D map based on determined panning movement. The program renders the second 3D perspective view of the 3D map for display on the device.

Abstract: Disclosed is a head mounted display (HMD) that provide contents to a user in a state of being worn on a user's head. The HMD includes a display unit configured to include a first region, which displays first contents, and a second region which is disposed next to both sides of the first region and display second contents associated with the first contents, a sensing unit configured to sense a motion of a head of a user wearing the HMD in a state where the HMD is worn on the head of the user, and a controller configured to, based on the sensing result, when a state in which a movement of the HMD is limited is sensed, determine a direction in which the movement of the HMD is limited, and change a display position of at least one portion of second contents which are displayed in a region corresponding to the determined direction in the second region which is disposed next to both sides of the first region.

Abstract: The visual sports score seesaw device includes a miniature seesaw that includes a pair of rival teams and/or mascot-related indicia to be provided on distal ends of the seesaw. The base of the seesaw includes a first score and a second score to be entered in order to reflect the final score of an important rival game. Moreover, the rival team that won the important rival game is raised upwardly while the losing rival team is lowered. An embodiment may include a manual score adjustment knob for both the first score and the second score. Another embodiment may include an electronic display to be used and inputted for the first score and the second score.

Abstract: Systems and methods for initializing motion tracking of human hands within bounded regions are disclosed. One embodiment includes: a processor; reference and alternate view cameras; and memory containing a plurality of templates that are rotated and scaled versions of a base template. In addition, a hand tracking application configures the processor to: obtain reference and alternate view frames of video data; generate a depth map; identify at least one bounded region within the reference frame of video data containing pixels having distances from the reference camera that are within a specific range of distances; determine whether any of the pixels within the at least one bounded region are part of a human hand; track the motion of the part of the human hand in a sequence of frames of video data obtained from the reference camera; and confirm that the tracked motion corresponds to a predetermined initialization gesture.

Abstract: Systems and methods for tracking human hands using parts based template matching within bounded regions are described. One embodiment of the invention includes a processor; an image capture system configured to capture multiple images of a scene; and memory containing a plurality of templates that are rotated and scaled versions of a finger template. A hand tracking application configures the processor to: obtain a reference frame of video data and an alternate frame of video data from the image capture system; identify corresponding pixels within the reference and alternate frames of video data; identify at least one bounded region within the reference frame of video data containing pixels having corresponding pixels in the alternate frame of video data satisfying a predetermined criterion; and detect at least one candidate finger within the at least one bounded region in the reference frame of video data.

Abstract: According to the invention, a method for changing a display based at least in part on a gaze point of a user on the display is disclosed. The method may include receiving information identifying a location of the gaze point of the user on the display. The method may also include, based at least in part on the location of the gaze point, causing the display to scroll content on the display.

Abstract: A system and method for organizing photos and other documents include a user interface for displaying photos and data nodes. A photo may be placed at a data node by selecting a facial image in the photo and then moving the facial image (e.g., using a drop and drag technique) to associate the facial image with the node. In alternative embodiments, a portion of a photo other than a facial image may be selected, or an entire photo may be selected, and then placed at the node. The user can identify nodes based on the person in the facial image and tag the photo with identifying information. In some embodiments, existing nodes (e.g., in a family tree) can be displayed in order to have photos placed therein. Relationship nodes can be suggested as facial images are associated with nodes.

Abstract: A method and an electronic apparatus for achieving translation of a screen display interface are provided. The method comprises sensing a first operation action of a user on a sensing screen generating a first operation instruction when the first operation action is sensed determining whether the first operation instructions belongs to a translation instruction that is preset for translating the display interface; if determining the first operation instruction belongs to the translation instruction, translating the screen display interface to a preset region by a preset distance towards a direction of an action region according to the first operation instruction for displaying, where the action region is a position region mapping the first operation action to the sensing screen. In this way, the present disclosure can allow a user to operate the full screen of a large sensing screen with a single bond.

Abstract: A display device (9) includes a display unit (91) capable of displaying display information in each of a plurality of display areas, an operation unit (92) that detects a position of an action performed on a display surface, the display information being displayed on the display surface in the display unit (91), and a control unit (93) that performs control so that, when a movement of the action position detected by the operation unit (92) from the position on the display information is detected, the display information is displayed in another display area located in a direction of the movement of the action position.

Abstract: In a method for motion detection of an electronic device, data on a touch screen of the electronic device is shared to a user. The method prevents the touch screen from being touched inadvertently when the electronic device is handed to or is picked up by the user. The method determines whether a movement of the electronic device is generated, wherein the movement is a motion generated when the electronic device is handed to the user. When the movement is generated, the method further locks a display of the touch screen, and determines whether the movement is finished. When the movement is finished, the method unlocks the display of the touch screen.

Abstract: An operation control device includes a contact detection unit for detecting contact of an operation body with a display surface of a display unit on which information is displayed, a pressure detection unit, provided on the display unit, for detecting a pressure at which the operation body presses the display surface of the display unit, and an operation control unit for changing a display state of the information displayed on the display unit in a forward or reverse direction on the basis of an amount of pressure detected by the pressure detection unit until the operation body makes contact with and is separated from the display surface of the display unit.

Abstract: A method of using stereo vision to interface with a computer is provided. The method includes capturing a stereo image, and processing the stereo image to determine position information of an object in the stereo image. The object is controlled by a user. The method also includes communicating the position information to the computer to allow the user to interact with a computer application.

Abstract: To provide an information processing device capable of enhancing convenience of a user using the information processing device by considering a dominant hand, habit, or the like, of the user without imposing on the user a task of inputting information of the user's dominant hand, habit, the like. In a case where it is determined that a user's designated position is included in a determination area corresponding to an object, the object is moved in accordance with movement of the designated position. In a case where at least one of one object and another object moves, processing relevant to the objects is executed based on a result of collision determination executed with respect to the objects.

Abstract: An interactive 3-D drawing method supports 3-D modeling of real-world scenes captured in the form of multiple images taken from different locations and angles. The method enables the user manipulate a 3-D drawing primitive without changing its appearance on a selected input image.

Abstract: A screen image displaying image-data items in list form is displayed over a predetermined time period. Then, the display color of an image-data item of the image-data items, the image-data item corresponding to predetermined classification information, is changed so that the image-data item can be differentiated from other image-data items. Consequently, a user can clearly identify the classification of the image-data items and easily find an image-data item satisfying a condition without performing a complicated operation.

Abstract: A map display apparatus includes a display that displays a map viewed at a given angle for bird's eye view with respect to the ground; a touch panel that is disposed on the display; a determining unit that determines strength of touch of an object on the touch panel; a display controller that controls a display format of the map displayed on the display, based on a result of determination by the determining unit, where the display controller scrolls the map when the strength of touch is at most a given strength, and changes the angle for bird's eye view when the strength of touch exceeds the given strength.

Abstract: Techniques for an input object for routing input for visual elements are described. In at least some embodiments, a region of a display area includes multiple graphic elements that can be generated and/or managed by different graphics functionalities. For instance, a graphical user interface (GUI) for an application can include a primary window and visual elements within the primary window, such as banners, control buttons, menus, Tillable fields, and so forth. In at least some embodiments, the primary window of the GUI can be managed by a first graphics functionality, while one or more visual elements within the primary window can be managed by a second graphics functionality. In accordance with one or more embodiments, an input object is employed to route input to visual elements to a graphics functionality responsible for managing the visual elements.

Abstract: Methods of providing usability predictions are set forth herein. A method includes obtaining test cases for analyzing usability of a graphical user interface of a given software application. The method further includes automatically generating, using a processor, a human performance model based on the test cases. The method also includes generating the usability predictions based on the human performance model. At least some of the test cases are generated automatically from an analysis of the given software application.

Abstract: Systems and computer program products for providing usability predictions are set forth herein. A system includes a test case collector for obtaining test cases for analyzing usability of a graphical user interface of a given software application, the test case collector having at least a memory storing the test cases. The system further includes a human performance model generator for automatically generating a human performance model based on the test cases. The system also includes a usability predictor for generating the usability predictions based on the human performance model. The test case collector automatically generates at least some of the test cases from an analysis of the given software application.

Abstract: A method, apparatus, system, article of manufacture, and computer readable storage medium provide the ability to create and edit a surface object in a computer implemented surface modeler. A surface object creation process is commenced and a surface object type is selected. During the surface object creation process, visual affordances are presented. The visual affordances are grips that can be used to inject modification into the surface object creation process. Subsequent to creation of the surface object, the same visual affordances are displayed and used to edit the surface object.

Abstract: Provided is an information processing apparatus including a position determination unit for determining whether or not a position of an information input area included in a display area of a first application and a position of an information output area included in a display area of a second application satisfy a predetermined first positional relationship, and a coordination processing unit for inputting, in a case it is determined that the predetermined first positional relationship is satisfied, output information of the second application that is associated with the information output area to the first application as input information associated with the information input area.

Abstract: There is provided an information processing apparatus including a display section capable of displaying information on its display surface, a touch panel capable of detecting a position in the display surface where an operation tool has contacted with as a contact position, a pressure value detection section detecting a pressure value which is a size of a pressure applied to the contact surface by a contact between the operation tool and the contact surface, a process control section specifying a first processing or a second processing as a processing subject to be executed in accordance with a change of the detected pressure value, a first processing section executing the first processing when the first processing is specified to be a processing subject to be executed, and a second processing section executing the second processing when the second processing is specified to be a processing subject to be executed.

Abstract: A display method and apparatus and an electronic device are provided, in which a second image is displayed in accordance with a relative relationship between a user and a displaying supporter, i.e., the distance between a first operation object and a second operation object in a first image is different from that in a second image, in the case that the relative relationship satisfies a first preset condition. Therefore, when the distance between the operation objects is too small, the distance between the operation objects is enlarged and then the operation objects are displayed in the second image. When the distance between the operation objects is too large, the distance between the operation objects is reduced and then the operation objects are displayed in the second image. Therefore, the distance between the operation objects changes with the relative relationship between the user and the displaying supporter.

Abstract: A graph display control apparatus includes a figure display control unit, a graph figure change unit, a coordinate value calculation unit and a figure prominent display control unit. The figure display control unit sets a coordinate system to a display unit and displays (i) a first graph figure and (ii) a coordinate axis or a second graph figure in the system. The graph figure change unit moves or transforms the first graph figure in the system in response to a user operation to change the first graph figure. The coordinate value calculation unit detects an intersection point of (i) the changed first graph figure and (ii) the coordinate axis or the second graph figure and calculates a coordinate value of the intersection point. The figure prominent display control unit prominently displays the changed first graph figure when the coordinate value is an integer.

Abstract: Multiple views, or windows, of an image of flowgraph nodes can be modified to facilitate viewing the nodes. In one embodiment, each window includes at least one boundary that is shared with another window so that when a window is changed by moving a particular boundary it causes another window sharing the particular boundary to correspondingly change. Window subsections can be used for viewing a different portion of the image.

Abstract: Systems and techniques are disclosed for applying an effect to a digital image using a cursor. An effect can be applied to an image at a region under a cursor. The cursor has an outer periphery and an effect indicating periphery within the outer periphery. The outer periphery defines a maximum extent to which the effect is applied. The effect indicating periphery indicates how the effect will be applied to the image, such as providing a visual indication of a softness setting.

Abstract: A method and device for enhancing scrolling operations in a display of a device is disclosed. The method includes detecting a scrolling operation on a list of objects in a linear direction. During the scrolling operation, it is determined whether the list of objects is reaching an end and at least one object at the end of the list of objects is extended in the linear direction in response to reaching the end of the list of objects. Further, the method includes determining that the object(s) is reaching a peak length of extension in the linear direction and retracting the object(s) in a reverse linear direction in response to reaching the peak length or in response to detecting that the scrolling operation is terminated.