Abstract: The present embodiments relate to generating 3D objects in an artificial reality environment and collapsing 3D objects into 2D images representing the 3D objects. Users operating extra reality (XR) devices controlling the artificial reality environment can collaboratively create or modify content in the artificial reality environment, using real-world creation objects (such as a hand of the user or a pen held by the user) to create 3D objects. In response to a user triggering a collapse for a 3D object, a 2D image of the 3D object can created, from the user's perspective. The 2D image can replace the 3D object in the artificial reality environment. Presenting the 2D image can reduce the amount of data, processing resources, and power needed to provide the artificial reality environment while also reducing clutter and cognitive load on the user.

Abstract: A content management system may maintain a scene description that represents a 3D virtual environment and a publish/subscribe model in which clients subscribe to content items that correspond to respective portions of the shared scene description. When changes are made to content, the changes may be served to subscribing clients. Rather than transferring entire descriptions of assets to propagate changes, differences between versions of content may be exchanged, which may be used construct updated versions of the content. Portions of scene description may reference other content items and clients may determine whether to request and load these content items for lazy loading. Content items may be identified by Uniform Resource Identifiers (URIs) used to reference the content items. The content management system may maintain states for client connections including for authentication, for the set of subscriptions in the publish/subscribe model, and for their corresponding version identifiers.

Abstract: Aspects of the disclosure provide remote training in a virtual reality (VR) environment. Multiple users may engage in the session. For example, a trainee may practice or be evaluated in performing a virtual version of a training task. A trainer may join the trainee's session. Embodiments enable the trainer to switch from a third-person perspective viewing the environment to the trainee's first-person perspective to see what the trainee is seeing. Virtual objects may be highlighted to guide the trainee's steps. Some embodiments may configure the training module to be engaged at various points out of order. For example, a user may select a specific point in a training sequence and work from there, replay or forward the environment in time to other points so that the trainee can skip or practice parts of the procedure.

Abstract: A method and system of representing a virtual object in a view of a real environment is provided which includes providing image information of a first image of at least part of a human face captured by a camera, providing at least one human face specific characteristic, determining an image area of the face in the first image as a face region, determining at least one first light falling on the face according to the face region and the at least one human face specific characteristic, and blending in the virtual object on a display device in the view of the real environment according to at least one first light.

Abstract: Techniques for improving the visualization of three-dimensional (3D) models of items on computing devices for augmented reality (AR) are described. One technique includes obtaining a virtual representation of an item and detecting a plane within a physical environment. A range of distances to the plane from a computing device for visualizing the virtual representation on a screen of the computing device is determined based on (i) physical attribute(s) of the screen and (ii) physical attribute(s) of the virtual representation. The virtual representation is rendered on the screen for positions on the plane that are within the range of distances from the computing device. The virtual representation is not rendered on the screen for positions on the plane that are outside of the range of distances from the computing device.

Abstract: A head mounted display (HMD) device is provided. The HMD has a display panel, a depth or distance sensor to measure distances between the HMD and a real object. The HMD device sets a close transition boundary distance (CTBD) between the HMD and a close transition boundary (CTB). A far transition boundary distance (FTBD) is set between the HMD and a far transition boundary (FTB). The CTBD is less than the FTBD. As a real object that has associated near and far virtual content moves nearer to the HMD device and crosses the CTB, the virtual content transitions to near virtual content for viewing on the HMD. As the real object moves away from the HMD and crosses the FTB, the virtual content transitions to the far virtual content for viewing on the HMD.

Abstract: Systems, methods, and non-transitory computer-readable media can present landscape content through a display screen of the computing device, the landscape content being presented in a landscape viewing mode. A rotation of the display screen to transition to a portrait viewing mode can be determined. The landscape content can be scaled based on the rotation of the display screen, wherein the scaled landscape content is presented through the display screen.

Abstract: According to an example aspect of the present invention, there is provided for an apparatus comprising a User Interface, UI, the method comprising generating or receiving particles, wherein each particle has a first position associated with a first shape, and storing the first positions as current positions, determining a second shape, wherein the second shape forms a first target shape for a first transition from the first shape, and a first target time for the first transition, generating and storing first target positions of the particles associated with the second shape, comparing the first target time to a current time, responsive to the first target time being larger than the current time, determining intermediate positions of the particles, based on the current positions and the first target positions of the particles, wherein the intermediate positions are closer to the target positions than the current positions and updating the user interface by using the intermediate positions of the particles to p

Abstract: Techniques are disclosed for analyzing a graph image in a disconnected mode, e.g., when a graph is rendered as .jpeg, .gif, .png, and so on, and identifying a portion of the graph image associated with a plot/curve of interest. The identified portion of the graph image may then be utilized to generate an adjusted image. The adjusted image may therefore dynamically increase visibility of the plot/curve of interest relative to other plots/curves, and thus the present disclosures provides additional graph functionalities without access to the data originally used to generate the graph. The disconnected graph functionalities disclosed herein may be implemented within an Internet browser or other “app” that may present images depicting graphs to a user.

Abstract: Object display control unit causes an object to be displayed on display surface. Scroll instruction detecting unit detects an instruction to scroll the object displayed on touch-screen as a movement instruction. Gradation level setting unit sets a gradation level of the image displayed on display surface. Gradation level setting unit, when notified by scroll instruction detecting unit that a scroll instruction has been detected, reduces the gradation level of the image, for example, from a 256-gradation level to a 2-gradation level. Object display control unit converts the object represented by object data into an object expressed in the reduced gradation level, and causes the resultant object to be displayed.

Abstract: Augmented reality, computer vision, and digital ticketing system techniques are described that employ a location determination system. In one example, the location determination system is configured to receiving at least one digital image as part of a live camera feed, identify an object included in the at least one digital image using object recognition, determine a location of the object in relation to a digital map of a physical environment, generate augmented reality digital content indicating the determined location in relation to the digital map, and render the augmented reality digital content as part of the live camera feed for display by a display device.

Abstract: A computing device is used to capture image data of a physical environment. The image data is of a live camera view from the camera. The image data includes a representation of a physical environment. A selection of an aspect of the representation is determined. The image data is analyzed using a trained neural network and using the selection to determine one or more types of items for the representation. At least two items associated with the one or more types of items are generated. The at least two items and at least one visible marker associated with the aspect are overlaid in the live camera view to provide an augmented reality view of the physical environment.

Abstract: An information displaying system is configured to display a time axis region and a signal display region on a display device. The time axis region is configured to display a time axis of a biosignal along a first direction and to display a first mark on the time axis, and signal display region is configured to display a plurality of waveforms of the biosignal side by side in a second direction which is different from the first direction. In response to receiving a designation information designating a time, the information displaying system displays, on the signal display region, the plurality of waveforms for a predetermined time range including the time designated by the designation information, and displays a line extending in the second direction at a location of the waveforms corresponding to the first mark.

Abstract: The present disclosure relates to using user biometric characteristics measured while the user is viewing virtual reality content to provide suggestions for downloadable virtual reality content in a virtual reality content store. An exemplary user device determines a criterion based on the user characteristics to filter the virtual reality content so that only virtual reality content that meets the criterion are displayed to the user. The virtual reality content displayed in the virtual reality content store has a corresponding activity level score.

Abstract: An augmented reality system collects sensory data from one or more user devices in a manner that is transparent to the user's augmented reality experience. A customer of an augmented reality system requests sensory data at a specified location. The augmented reality system modifies the augmented reality experience for one or more users to move someone to the specified location. The user device(s) collect the sensory data at the specified location in a manner that is transparent to the augmented reality experience of the user(s). The sensory data is uploaded from the user device(s) to the augmented reality system, which sends the sensory data to the customer.

Abstract: The invention relates to a method for representing a virtual object in a real environment, having the following steps: generating a two-dimensional image of a real environment by means of a recording device, ascertaining a position of the recording device relative to at least one component of the real environment, segmenting at least one area of the real environment unmarked in reality in the two-dimensional image for identifying at least one segment of the real environment in distinction to a remaining part of the real environment while supplying corresponding segmentation data, and merging the virtual object with the two-dimensional image of the real environment with consideration of the segmentation data such that at least one part of the segment of the real environment is removed from the image of the real environment. The invention permits any collisions of virtual objects with real objects that occur upon merging with a real environment to be represented in a way largely close to reality.

Abstract: A system and method for markers with digitally encoded geographic coordinate information for use in an augmented reality (AR) system. The method provides accurate location information for registration of digital data and real world images within an AR system. The method includes automatically matching digital data within an AR system by utilizing a digitally encoded marker (DEM) containing world coordinate information system and mathematical offset of digital data and a viewing device. The method further includes encoding geographic coordinate information into markers (e.g., DEMs) and decoding the coordinate information into an AR system. Through use of the method and corresponding system, marker technology and the basis of geo-location technology can be combined into a geo-located marker, thereby solving the problem of providing accurate registration within an augmented reality.

Abstract: Approaches presented herein enable displaying of a street view or map in the context of a video stream object. Specifically, captured video is analyzed for a plurality of geo-coordinate and direction metadata associated with frames of the video. The video may also be analyzed for visual indicia of location or direction. A user watching the video selects an object therein, which may be then identified by its coordinates and labeled for the user. A map or street view corresponding to the selected object is shown synchronized to the video (e.g., in a side-by-side view), based on the geo-coordinate and direction metadata associated with the video frames. The synchronized video and map speed may be manipulated. The video may also be broken up by frames, and the user permitted to navigate beyond the bounds of the video, where frames are played when the user navigates to areas within the video.

Abstract: There is provided a system and method for adaptive rendered environments using user context. The method comprises determining user context data corresponding to a user of a virtual environment, altering a feature of the virtual environment using the user context data to obtain an altered feature, and rendering the altered feature of the virtual environment for display. The feature may include a non-player character in the virtual environment, such as eyesight focus of the non-player character or a physical action of the non-player character. The user context data may correspond to real world position data of a user and may be determined using a camera, for example through image recognition, or using a user device. Additionally, the virtual environment may include a cinematic, interactive game, or user generated content.

Abstract: Light guide display and field of view techniques are described. In one or more implementations, an apparatus includes one or more modules implemented at least partially in hardware to configure a user interface and a display device communicatively coupled to the one or more modules to output the user interface to be viewable by a user within a range of distances from the display device such that closer distances within the range permit the user to have an increased field of view in comparison with distances within the range that are further away from the user.