Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, are described for combining the crop function with zoom, pan and straighten functions as part of a single cropping environment, such that a user can select a portion of an image for cropping, apply zoom, pan and straighten transformations to the selected image portion and then crop the transformed image portion in a single utility. In one aspect, the methods include the actions of receiving user input defining a crop region within a displayed image. The methods also include the actions of displaying a user interface including a cropping panel that is configured to display a subset of the image corresponding to the defined crop region. Further, the methods include the actions of receiving user input requesting to perform at least one of a zoom, rotate or translate operation on the crop region displayed in the cropping panel.

Abstract: In accordance with some embodiments, the render rate is varied across and/or up and down the display screen. This may be done based on where the user is looking in order to reduce power consumption and/or increase performance. Specifically the screen display is separated into regions, such as quadrants. Each of these regions is rendered at a rate determined by at least one of what the user is currently looking at, what the user has looked at in the past and/or what it is predicted that the user will look at next. Areas of less focus may be rendered at a lower rate, reducing power consumption in some embodiments.

Abstract: In some implementations, a method of reducing latency associated with an image read-out operation is performed at a device including one or more processors, non-transitory memory, an image processing architecture, and an image capture device. The method includes: obtaining first image data corresponding to a physical environment; reading a first slice of the first image data into an input buffer; performing processing operations on the first slice of the first image data to obtain a first portion of second image data; reading a second slice of the first image data into the input buffer; performing the image processing operations on the second slice of the first image data to obtain a second portion of the second image data; and generating an image frame of the physical environment based at least in part on the first and second portions of the second image data.

Abstract: A system and method for modeling visual and non-visual experiential characteristics of a work space environment, the system comprising at least a first emissive surface useable to view a virtual world (VW) representation, a processor that is programmed to perform the steps of (a) presenting a VW representation via the at least a first emissive surface, the VW representation including an affordance configuration shown in the VW representation, (b) model at least one non-visual experiential characteristic associated with an environment associated with the VW representation and (c) present at least some indication of the non-visual experiential characteristic to the system user.

Abstract: A firearm system includes a firearm and a computer. Electronics in the firearm determine data that includes a pathway between different points of aim of the firearm as the firearm moves. The computer receives this data and builds an image of the pathway between the different points of aim of the firearm.

Abstract: In a method facilitating connectivity between at least first and second persons contemplates utilizing one or more computer processors to instantiate a first augmented reality space that mimics a real world space physically in existence about a first person. The first augmented reality space includes at least an avatar of the first person, and a first virtual representation of at least one real world object within the first augmented reality space. Using one or more computer processors, the method provides an interface through which the second person, distal to the first person, can use a second avatar to contemporaneously occupy and enter the first augmented reality space, traverse the space, and interact with the object.

Abstract: Systems and methods are described that obtain depth data associated with a scene captured by an electronic device, obtain location data associated with a plurality of physical objects within a predetermined distance of the electronic device, generate a plurality of augmented reality objects configured to be displayed over a portion of the plurality of physical objects, and generate a plurality of proximity layers corresponding to the at least one scene, wherein a respective proximity layer is configured to trigger display of the auxiliary data corresponding to AR objects associated with the respective proximity layer while suppressing other AR objects.

Abstract: The subject technology identifies a set of graphical elements in an augmented reality (AR) facial pattern. The subject technology determines at least one primitive shape based on the set of graphical elements. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file. The subject technology publishes the IFM data to a product catalog service.

Abstract: A computer-implemented method for lighting subjects for artificial reality scenes may include (i) identifying (a) a physical camera configured to capture a physical subject for insertion into an artificial reality scene, (b) a physical light source that is positioned such that the physical light source lights the physical subject recorded by the physical camera, and (c) lighting conditions in the artificial reality scene, (ii) determining at least one lighting parameter to light the physical subject such that lighting conditions of the physical subject blend visually with the lighting conditions in the artificial reality scene, and (iii) configuring the physical light source to light the physical subject according to the at least one lighting parameter. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An exemplary device can process can generated an augmented reality display of a Wi-Fi coverage map. A mobile device can connect to one or more access points of a wireless network in a physical environment. A camera of the mobile device can be used to capture a live rendering of the physical environment. The mobile device can capture and store current and previous positions in the physical environment. The mobile device can generate a virtual path graphic by linking the current positions and the plurality of previous positions of the mobile device in the physical environment. The augmented reality display is generated by overlaying the virtual path graphic onto the live rendering of the physical environment. The augmented reality interface is output to a display of the mobile device.

Abstract: Embodiments described herein provide a process and method running on a computer for creating an augmented image. According to an embodiment, a graphical user interface gathers data that is programmatically analyzed to obtain photographic properties from a first image. Photographic properties are provided to a user for obtaining a second image containing a fiducial mark. The second image is programmatically analyzed to obtain photographic properties. The first image and the second image are programmatically analyzed and processed to produce an augmented image.

Abstract: Systems, methods, and computer readable media to analyze and improve the performance of applications utilizing graphics hardware are described. In general, techniques are disclosed to monitor the run-time performance of various shader programs from multiple applications executing concurrently on a graphics processing unit (GPU) and present a visualization of such performance to a user. More particularly, the GPU performance profiling comprises sampling data from multiple hardware performance counters and shader programs during the execution of the shader programs on the GPU. The hardware counters may be indicative of the status of various performance and/or architectural limitations of the GPU at a given moment in time. By time-correlating the execution of the various shader programs and the responses of the multiple hardware counters, a more instructive visualization may be presented to the user, which may be used, e.g., as an aid in debugging and/or profiling the applications executing on the GPU.

Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment. Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: A method includes setting a value of a formation parameter for a subsurface formation and creating an initial three-dimensional (3D) model of the subsurface formation based on the formation parameter. The method also includes applying a constrained transformation to one or more inversion variables of the initial 3D model to create a variable-constrained 3D model of the subsurface formation and applying an unconstrained minimization operation to the variable-constrained 3D model to generate a first transformed 3D model. The method also includes inverting the first transformed 3D model to generate a first inverted 3D model of the subsurface formation.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.

Abstract: In some embodiments, an augmented reality system is provided. The augmented reality system is configured to detect real-world objects, create software objects that represent the real-world objects, receive requests from applications to present virtual objects at locations associated with the real-world objects, and to present the virtual objects. In some embodiments, an operating system of the augmented reality system is configured to resolve conflicts between requests from multiple applications. In some embodiments, the operating system of the augmented reality system is configured to provide information to applications to allow the applications to avoid or resolve conflicts amongst themselves.

Abstract: A method for managing a multi-user animation platform is disclosed. A three-dimensional space within a computer memory is modeled. An avatar of a client is located within the three-dimensional space, the avatar being graphically represented by a three-dimensional figure within the three-dimensional space. The avatar is responsive to client input commands, and the three-dimensional figure includes a graphical representation of client activity. The client input commands are monitored to determine client activity. The graphical representation of client activity is then altered according to an inactivity scheme when client input commands are not detected. Following a predetermined period of client inactivity, the inactivity scheme varies non-repetitively with time.

Abstract: In a method modifying a user's virtual environment, a banking module retrieves and analyzes context data associated with the user. The banking module applies user and location parameters to determine whether at least one of an avatar modification and an environment modification is available for rendering. Responsive to determining that the avatar selection is not available for rendering, determining whether the avatar is accessible to the user. Responsive to determining that avatar is not accessible to the user, presenting the avatar selection for redemption.

Abstract: To allow free animation production in virtual space, an animation production method executed by a computer comprising: a step of placing a virtual camera for shooting a character in a virtual space; a step of placing an object to which a size is set in the virtual space; a step of scaling the object according to the size; and a step of generating an image shot by the camera.