Abstract: Approaches presented herein enable displaying of a street view or map in the context of a video stream object. Specifically, captured video is analyzed for a plurality of geo-coordinate and direction metadata associated with frames of the video. The video may also be analyzed for visual indicia of location or direction. A user watching the video selects an object therein, which may be then identified by its coordinates and labeled for the user. A map or street view corresponding to the selected object is shown synchronized to the video (e.g., in a side-by-side view), based on the geo-coordinate and direction metadata associated with the video frames. The synchronized video and map speed may be manipulated. The video may also be broken up by frames, and the user permitted to navigate beyond the bounds of the video, where frames are played when the user navigates to areas within the video.

Abstract: A system and method for markers with digitally encoded geographic coordinate information for use in an augmented reality (AR) system. The method provides accurate location information for registration of digital data and real world images within an AR system. The method includes automatically matching digital data within an AR system by utilizing a digitally encoded marker (DEM) containing world coordinate information system and mathematical offset of digital data and a viewing device. The method further includes encoding geographic coordinate information into markers (e.g., DEMs) and decoding the coordinate information into an AR system. Through use of the method and corresponding system, marker technology and the basis of geo-location technology can be combined into a geo-located marker, thereby solving the problem of providing accurate registration within an augmented reality.

Abstract: There is provided a system and method for adaptive rendered environments using user context. The method comprises determining user context data corresponding to a user of a virtual environment, altering a feature of the virtual environment using the user context data to obtain an altered feature, and rendering the altered feature of the virtual environment for display. The feature may include a non-player character in the virtual environment, such as eyesight focus of the non-player character or a physical action of the non-player character. The user context data may correspond to real world position data of a user and may be determined using a camera, for example through image recognition, or using a user device. Additionally, the virtual environment may include a cinematic, interactive game, or user generated content.

Abstract: Light guide display and field of view techniques are described. In one or more implementations, an apparatus includes one or more modules implemented at least partially in hardware to configure a user interface and a display device communicatively coupled to the one or more modules to output the user interface to be viewable by a user within a range of distances from the display device such that closer distances within the range permit the user to have an increased field of view in comparison with distances within the range that are further away from the user.

Abstract: The present technology relates to an information processing device and an information processing method, in which Synecoculture (registered trademark) can be assisted. An ecosystem object indicating an ecosystem constituent configuring an ecosystem of an agricultural field in which a plurality of types of vegetation are mixed up and a task object indicating a task performed with respect to the ecosystem constituent are acquired, and the ecosystem object is subjected to augmented reality (AR) display in a position in a predetermined background space, corresponding to a real position of the ecosystem constituent, and the task object is subjected to AR display in the background space. The present technology, for example, can be applied to a case or the like where information of assisting Synecoculture (registered trademark) is provided.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: The flow of teams of one or more players is controlled through different geographical areas of a mixed virtual reality and physical experience that takes place on an attraction stage. The geographical areas may include rooms, compartments, or other geographical areas through which a team may progress. Within each geographical area, a team may engage in an experience and accomplish one or more checkpoints. Based on the time to achieve each checkpoint, the experience may be shortened or lengthened, either within the particular geographical area or the experience as a whole, to control the flow of the particular team through the series of geographical areas.

Abstract: An object control system in a location-based game, in which a character in a virtual world is linked with and moved along with a movement of a user in a real world, is provided with: a location information acquiring unit which detects a current location and displacement in the real world of the user; a virtual display data generating unit which selects a boundary line on real map information so as to be an area and a shape according to the current location of the user in the real world and information density on the real map information corresponding to the current location, and generates a virtual fantasy block that partially covers the real map; and a synthesis processing unit which superimposes and displays the fantasy block generated by the virtual display data generating unit on the real map information.

Abstract: This invention relates to panning in a three dimensional environment on a mobile device. In an embodiment, a computer-implemented method for navigating a virtual camera in a three dimensional environment on a mobile device having a touch screen. A user input is received indicating that an object has touched a first point on a touch screen of the mobile device and the object has been dragged to a second point on the touch screen. A first target location in the three dimensional environment is determined based on the first point on the touch screen. A second target location in the three dimensional environment is determined based on the second point on the touch screen. Finally, a three dimensional model is moved in the three dimensional environment relative to the virtual camera according to the first and second target locations.

Abstract: Methods and systems for generating new product images are disclosed. In one aspect, a method includes identifying, via hardware processing circuitry, a template for a category of products, the template defining locations of attributes of products belonging to the category, identifying, via the hardware processing circuitry, common attributes of products of the category based on the template, averaging, via the hardware processing circuitry, corresponding pixel values across images representing the products having the common attributes, generating, via the hardware processing circuitry, a new product image representing a new product based on the averaged pixel values; and generating, via the hardware processing circuitry, a modified new product image by varying attributes of the new product based on the locations of the attributes defined by the template.

Abstract: An information displaying system according to an embodiment of the present disclosure includes a first display section configured to display a time axis of detected signals along a first direction, a second display section configured to display a plurality of signal waveforms based on the detected signals in parallel so that the signal waveforms are arranged side by side in a second direction different from the first direction, and a controller configured to control the first display section and the second display section. When, in the second display section, a location on at least one of the plurality of the signal waveforms or near the at least one of the plurality of the signal waveforms is designated, the controller highlights the designated location, and displays a designated result on a time location in the first display section corresponding to the designated location.

Abstract: There is disclosed a technique for displaying a digital image on a representation of an object, comprising: defining reference point positions on digital image template of a reference item; fitting the reference item to an object; capturing an image of the reference item fitted to the object; mapping positions on a digital image template of a non-reference item to the location positions of the reference points of the captured image to generate a manipulated non-reference digital image; and displaying the manipulated digital image on the reference item fitted to the object.

Abstract: In part, the disclosure related to systems and methods of merging a simulation experience with physical objects and sensory stimuli generated outside of the simulation in a controlled physical environment to enhance the simulated experience.

Abstract: Provided are various systems and methods that establish a self-service AR generation and publication platform. The platform is configured to allow novice users to build AR experiences for rendering to other users. The platform encodes the AR experiences under a universal data format that decouples generation functions from later visualization responsive to a recognizable visual trigger. Access to the file triggers request, retrieval, rendering and display of the user defined AR Media and associated options set for that specific AR Experience. Also provided is a AR universal browser which public and private users can execute to view, share, load, and experience user generated AR Media (e.g., generated on the platform). The browser can provide the connections, logic and security needed to initialize and load the specific aggregation of data for the AR experience.

Abstract: A 360-degree image data processing method performed by a 360-degree video reception apparatus, the method including: receiving 360-degree image data, obtaining information on an encoded picture and metadata from the 360-degree image data, decoding a picture based on the information on the encoded picture, and rendering the decoded picture and an overlay based on the metadata, wherein the metadata includes overlay related metadata, wherein the overlay is rendered based on the overlay related metadata, and wherein the overlay related metadata include packing information of the overlay.

Abstract: This document relates to a medical application of augmented reality in which areal image shows a medical device, or at least a part thereof. In an exemplary application, the real image further shows at least a part of a patient's body which is (to be) treated using the medical device. A part of the medical device might not be visible in the real image, for example because it extends into or behind the patient's body. In this case, the virtual image can comprise an augmentation of the medical device, which, for example, represents at least the part of the medical device which is invisible in the real image. This document in particular addresses a correct alignment of the augmentation with the medical device.

Abstract: An image readjustment system featuring a communication interface, one or more processors, and a persistent storage. The persistent storage is communicatively coupled to the one or more processors. The persistent storage comprises at least image location logic and image cropping logic. The image location logic is configured to receive and analyze an incoming image, using a machine learning analysis, to determine a location of a particular component within the incoming image and to calculate coordinates of a boundary area surrounding the particular component. The image cropping logic is configured to remove portions of the incoming image outside of the boundary area to generate a modified image to be rendered for display.

Abstract: A declarative cross-platform framework for interactive user interfaces is described herein. Commands may define a virtual surface for display in a plurality of streaming applications executing across a plurality of computing platforms. The commands may be expressed in a declarative format that allows the virtual surface to be defined without injecting code into the plurality of streaming applications. The commands may indicate a first position within the virtual surface for display of a display item, and the first position may be expressed based on relative amounts of positional attributes that are relative to total amounts of the positional attributes for the virtual surface in its entirety. The streaming applications may host framework runtime components for respective computing platforms on which the streaming applications execute. The framework runtime components may use the commands to generate respective rendering instructions for rendering the virtual surface on their respective computing platforms.

Abstract: This invention relates to panning in a three dimensional environment on a mobile device. In an embodiment, a computer-implemented method for navigating a virtual camera in a three dimensional environment on a mobile device having a touch screen. A user input is received indicating that an object has touched a first point on a touch screen of the mobile device and the object has been dragged to a second point on the touch screen. A first target location in the three dimensional environment is determined based on the first point on the touch screen. A second target location in the three dimensional environment is determined based on the second point on the touch screen. Finally, a three dimensional model is moved in the three dimensional environment relative to the virtual camera according to the first and second target locations.

Abstract: A splicing screen, a display method for a splicing screen and a display control apparatus are provided. The display method for a splicing screen includes: acquiring physical coordinates of a plurality of display screens constituting a splicing screen; adjusting a size of an image to be displayed to be equal to a size of a virtual display screen after the plurality of display screens are spliced, and acquiring a resolution of the image; respectively calculating pixel coordinates of each of the display screens according to the physical coordinates of the plurality of display screens and the resolution of the image; and distributing pixel data to each of the display screens according to the pixel coordinates of each of the display screens.