Abstract: Multi-angle fiducial markers with different sets of encoded cells are used for the generation of customized enhanced reality experiences on user devices. A device detects a multi-angle fiducial marker from its current position. The device decodes first data from a particular set of cells of the multi-angle fiducial marker that are resolvable from the current position of the device relative to the multi-angle fiducial marker position and one or more cells from the other sets of cells being unresolvable at the device current position. The device retrieves a first presentation of content from a source identified in the first data, defines a second presentation for the content based on the first data, and generates an enhanced reality experience with the second presentation of the content presented at a specific position relative to the position of the multi-angle fiducial maker in a display of the device.

Abstract: The disclosed systems, components, methods, and processing steps are directed to determining user-item fit characteristics of an item for a user body part by accessing a three-dimensional (3D) reconstructed model of the user body part, accessing information about one or more 3D reference models of the item, the information for each 3D reference model including respective dimensional measurement, spatial, and geometrical attributes, performing a 3D matching process based on the 3D reconstructed model and the accessed information of the one or more 3D reference models to determine a best-fitting 3D reference model from the one or more 3D reference models, integrating the best-fitting 3D reference model with the 3D reconstructed model to provide a 3D best fit representation and displaying the 3D best fit representation along with visual indications of user-item fit characteristics.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

Abstract: Disclosed are methods and systems to provided planning tools for surgery, particularly for THA. Images of musculoskeletal structure of a patient (e.g. associated with respective planes and in a same or different functional position) may be displayed together and via co-registration and spatial transformations, 3D implants or other objects may be rendered and overlaid in a same position correctly with respect to each image. Measures may be represented with respect to various planes associated with the respective image and/or with respect to an existing implant. A safe zone (graphical element) may be rendered and overlaid with respect to each displayed image to indicate a clinically accepted safe range of positions for the 3D implant. Different instances of implants having respective characteristics affecting range of motion may be available for use during a procedure. For a set of available implants minimal and maximal safe zones may be presented for planning assistance.

Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.

Abstract: A firearm system includes a firearm and a computer. Electronics in the firearm determine data that includes a pathway between different points of aim of the firearm as the firearm moves. The computer receives this data and builds an image of the pathway between the different points of aim of the firearm.

Abstract: Techniques for nonlinear representations for vector objects are described that support construction of a nonlinear vector graph to represent a vector object. In an implementation, a user input is received including a plurality of points and at least one primitive. A content processing system then generates a vector object by constructing a nonlinear vector graph that specifies a nonlinear connection of the plurality of points with the at least one primitive. In some examples, the vector object is edited by applying an edit to the nonlinear vector graph. Once generated, the content processing system then outputs the vector object for display, e.g., in a user interface.

Abstract: In one implementation, a method of performing late-stage shift is performed at a device including a display, one or more processors, and non-transitory memory. The method includes generating, based on a first predicted pose of the device for a display time period, a first image. The method includes generating a mask indicating a first region of the first image and a second region of the first image. The method includes generating a second image by shifting, based on a second predicted pose of the device for the display time period, the first region of the first image without shifting the second region of the first image. The method includes displaying, on the display at the display time period, the second image.

Abstract: An embodiment of a method of positioning features in a digital design space includes receiving a request from a user to place a first feature in the design space, and based on the request, placing the first feature in the design space, and coupling a first positioning handle to the first feature in the design space. The first positioning handle is graphically represented in the design space and manipulatable by the user, the first positioning handle has a fixed position and fixed orientation relative to the first feature, and the first positioning handle includes a first face surface and defines a first vector. The method also includes moving the first feature into a pre-determined position and orientation relative to a target feature in the design space by mating the first positioning handle to a target positioning handle coupled to the target feature.

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

Abstract: A delivery control device generates a recognition index on a notification space basis, the recognition index used to recognize the notification space, displays the recognition index in the notification space, and stores the recognition index in management information. The delivery control device instead stores an image characteristic extracted from a content to be displayed in the notification space as the recognition index in the management information. In this state, the delivery control device selects a notification space viewable on the augmented reality display terminal based on information on the position of the augmented reality display terminal held by a user and information on the position of the notification space and transmits the recognition index corresponding to the selected notification space and a notification content to the augmented reality display terminal.

Abstract: A computerized method comprising acquiring an image of a physical environment comprising one or more physical entities; generating a virtual view based on the acquired image, the virtual view being a 3D representation of the physical environment and comprising 3D data corresponding to the one or more physical entities of the physical environment; displaying the virtual view overlaid on the acquired image of the physical environment; obtaining bounding volumes for a plurality of 3D object models; merging said bounding volumes for the plurality of 3D object models into a virtual bounding volume, said merging occurring with respect to a particular 3D point within each one of the bounding volumes such that the particular 3D points coincide in the virtual bounding volume; and displaying the virtual bounding volume in the virtual view.

Abstract: In accordance with some embodiments, the render rate is varied across and/or up and down the display screen. This may be done based on where the user is looking in order to reduce power consumption and/or increase performance. Specifically the screen display is separated into regions, such as quadrants. Each of these regions is rendered at a rate determined by at least one of what the user is currently looking at, what the user has looked at in the past and/or what it is predicted that the user will look at next. Areas of less focus may be rendered at a lower rate, reducing power consumption in some embodiments.

Abstract: Methods for parameterizing virtual spaces by matching virtual objects to physical objects, creating shared virtual spaces for users to meet, loading in virtual media objects from personal computing devices, selecting and interacting with virtual objects in virtual spaces, and activating virtual media representations for consumption are described herein.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a storage device, for filling gaps in electric grid models are enclosed. A method includes obtaining vector data representing first portions of paths of electric grid wires over a geographic region; converting the vector data to first raster image data that depicts an overhead view of the electric grid wires including a first set of line segments representing the first portions of the paths; processing the first raster image data using a gap filling model; obtaining, as output from the gap filling model, second raster image data including a second set of line segments corresponding to gaps included in the input raster image data and representing second portions of paths of the electric grid wires; and converting the second raster image data to vector data representing the first portions and the second portions of paths of the electric grid wires.

Abstract: The existence position of the virtual object displayed by the virtual reality or augmented reality is easily grasped. In a head-mounted information processing apparatus 100, a virtual object generation processor 122 generates a virtual object. An input operation unit 121 sets and inputs information. A camera 111 captures a real space. A display unit 130 displays a photographed image captured by the camera 111 and the virtual object generated by the virtual object generation processor 122. The controller 125 controls the virtual object generation processor 122 and the display unit 130. The controller 125 displays the virtual objects generated by the virtual object generation processor 122 in a batch within a display visual field screen of the display unit 130 in accordance with virtual object display instruction information for instructing display of the virtual object input from the input operation unit 121.

Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Abstract: A system and method for texture decompression is described. The method comprises receiving a compressed texture block including two or more disjoint subsets of data and decompressing the compressed texture block. The decompressing includes decompressing each of the two or more disjoint subsets in the compressed texture block to form texels. The two or more disjoint subsets include a first disjoint subset having a first set of color endpoints and a first index value for a first texel, and a second disjoint subset having a second set of color endpoints.

Abstract: A system and method for visual alignment of Reflective Particle Tags (RPT) includes creating a three-dimensional digital model of a reticle; processing a plurality of features based on the digital model; generating an Augmented Reality application; and deploying the Augmented Reality application on a camera platform. The augmented reality alignment system includes processors and memory devices having instructions that, when executed by the processors, cause the processors to perform operations of creating a three-dimensional digital model of a reticle; processing a plurality of features based on the digital model; generating an Augmented Reality application; and deploying the Augmented Reality application on a camera platform. A non-transitory, computer-readable medium comprising instructions that, cause the processors to create a model of a reticle; process features based on the model; generate an Augmented Reality application; and deploy the application on a camera.

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.