Abstract: A display system includes a projector that projects a virtual image onto a target space to allow a target person to visibly recognize the virtual image and a controller that controls display of the virtual image. When the projector projects a virtual image corresponding to a caution object, the controller selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point.

Abstract: The present invention is directed to a see-through near eye optical module that in most cases is fabricated as a standalone unit. The see-through near eye optical module is in certain embodiments then placed in optical communication and alignment with an eyewear lens having appropriate optical power such that when a wearer thereof looks through the see-through near eye optical module he or she can see a real world image and virtual image clearly. In other embodiments the appropriate optical power is provided in the rear section of the see-through near eye optical module. Thus, the combination of both the see-through near eye optical module and the appropriate optical power provides the wearer with a clear augmented reality or mixed reality experience. The placement can be by way of positioning within an open notch, hole, groove, recess, or other section of an eyewear lens.

Abstract: Viewport transformation modules for use in a three-dimensional rendering system wherein vertices are received from an application in a strip. The viewport transformation modules include a fetch module configured to read from a vertex buffer: untransformed coordinate data for a vertex in a strip; information identifying a viewport associated with the vertex; and information identifying a viewport associated with one or more other vertices in the strip. The one or more other vertices in the strip are selected based on a provoking vertex of a primitive to be formed by the vertices in the strip and a number of vertices in the primitive. The viewport transformation modules also include a processing module that performs a viewport transformation on the untransformed coordinate data based on each of the identified viewports to generate transformed coordinate data for each identified viewport; and a write module that writes the transformed coordinate data for each identified viewport to the vertex buffer.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating and providing composition effect tutorials for creating and editing digital content based on a metadata composite structure. For example, the disclosed systems can generate and/or access a metadata composite structure that includes nodes corresponding to composition effects applied to a digital content item, where a given node can include location information indicating where a composition effect is applied relative to a digital content item. The disclosed systems can further generate a tutorial to guide a user to implement a selected composition effect by identifying composition effects of nodes that correspond to a location selected within a composition interface and presenting instructions for a particular composition effect.

Abstract: Described herein are devices, systems, media, and methods using an augmented reality smartphone application to capture measurements of an interior or exterior space in real-time and generate a floorplan of the space and/or a 3D model of the space from the captured measurements in less than 5 minutes.

Abstract: Methods and systems for generating an interactive rotatable 360-degree presentation of an object are disclosed. The methods and systems obtain data describing the object, where the data includes information about a number of images of the object, as well as additional information about the object. The images are automatically obtained and rearranged into at least one sequence of images substantially evenly distributed around 360 degrees. It is determined whether to add hotspot(s) to image(s), and if hotspot(s) are to be added, the hotspot(s) are automatically added to the image(s). The ordered images of the sequence(s) are then merged into an interactive rotatable 360-degree presentation of the object.

Abstract: Methods and systems for generating an interactive rotatable 360-degree presentation of an object are disclosed. The methods and systems obtain data describing the object, where the data includes information about a number of images of the object, as well as additional information about the object. The images are automatically obtained and rearranged into at least one sequence of images substantially evenly distributed around 360 degrees. It is determined whether to add hotspot(s) to image(s), and if hotspot(s) are to be added, the hotspot(s) are automatically added to the image(s). The ordered images of the sequence(s) are then merged into an interactive rotatable 360-degree presentation of the object.

Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.

Abstract: A method and system for improving audio and video multimedia modification and presentation is provided. The method includes receiving an audio/video stream and analyzing objects of the audio/video stream for generating predictions with respect to the objects. Component analysis code is executed with respect to the audio/video stream and an object is removed from the audio/video stream resulting in a modified audio/video stream being generated thereby reducing hardware storage and transfer size requirements of the audio/video stream. The modified audio/video stream is presented to a user via a graphical user interface.

Abstract: A method and system including a central processing unit (CPU), an accelerator, a communication bus and a system memory device for dynamically processing an image file are described. The accelerator includes a local memory buffer, a data transfer scheduler, and a plurality of processing engines. The data transfer scheduler is arranged to manage data transfer between the system memory device and the local memory buffer, wherein the data transfer includes data associated with the image file. The local memory buffer is configured as a circular line buffer, and the data transfer scheduler includes a ping-pong buffer for transferring output data from the one of the processing engines to the system memory device. The local memory buffer is configured to execute cross-layer usage of data associated with the image file.

Abstract: According to embodiments of the invention, the invention is an augmented reality system that utilizes a near eye see-through optical module that comprises a transparent or semi-transparent see-through near eye display that is in optical alignment with a micro-lens array. According to certain embodiments of the invention, the augmented reality system comprises generating a virtual image as perceived by an eye of a wearer of the augmented reality system when looking at an object in space having a location in the real world that forms a real image. When utilizing a certain embodiment of the invention the virtual image changes, by way of example only, one or more of its shape, form, depth, 3D effect, location due to the eye or eyes shifting its (their) fixation position due to changing the location of different lighted pixels of the see-through near eye display(s).

Abstract: Provided are systems and methods for monitoring an asset via an autonomous model-driven inspection. In an example, the method may include storing an inspection plan including a virtually created three-dimensional (3D) model of a travel path with respect to a virtual asset that is created in virtual space, converting the virtually created 3D model of the travel path about the virtual asset into a physical travel path about a physical asset corresponding to the virtual asset, autonomously controlling vertical and lateral movement of the unmanned robot in three dimensions with respect to the physical asset based on the physical travel path and capturing data at one or more regions of interest, and capturing data at one or more regions of interest, and storing information concerning the captured data about the asset.

Abstract: A Resource Dependency Viewer for graphics processing unit (GPU) execution information is disclosed. The Resource Dependency Viewer provides profiling/debugging information concurrently with information about execution flow, resource utilization, execution statistics, and orphaned resources, among other things. A user-interactive graph (“dependency graph”) may be provided via a graphical user interface to allow interactive analysis of code executed on a GPU (e.g., graphics or compute code). Resource utilization and execution flow of encoders may be identified by analyzing contents of a GPU workload representative of a GPU execution trace to generate the dependency graph. Information about dependencies and execution statistics may be further analyzed using heuristics to identify potential problem areas. The dependency graph may include visual indicators of these problem areas.

Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, a 2D (two-dimensional) frame is divided into multiple blocks. The multiple blocks are encoded or decoded using quantization parameters by restricting a delta quantization parameter to be within a threshold for any two blocks corresponding to two neighboring blocks on a 3D sphere. According to another embodiment, one or more guard bands are added to one or more edges that are discontinuous in the 2D frame but continuous in the 3D sphere. Fade-out process is applied to said one or more guard bands to generate one or more faded guard bands. At the decoder side, the reconstructed 2D frame is generated from the decoded extended 2D frame by cropping said one or more decoded faded guard bands or by blending said one or more decoded faded guard bands and reconstructed duplicated areas.

Abstract: Power for on-die heavily used local memories in general purpose graphics processing unit (GPGPU) applications may be reduced by using low latency read and high latency write operations. Power consumption in read heavy graphic operations can be reduced using a small memory footprint design with possible reduction of hot spotting in some embodiments.

Abstract: A virtual reality-based apparatus and method to generate a 3D human face model includes, storage of a 3D face model that is an existing 3D face model or a mean-shape face model in at least a neutral expression. A point cloud of the face of the first user is generated based on the plurality of color images and depth information of the face of the first user. A first 3D face model of the first user having neutral expression is generated by a shape-based model-fitment on the stored 3D face model. A shape of the first 3D face model is refined based on a difference between the first 3D face model, the shape-based model-fitment, and the generated point cloud. The display of the refined first 3D face model is controlled to exhibit a minimum deviation from the shape and appearance of the face of the first user.

Abstract: Systems and methods for rendering displays in interest-driven business intelligence data visualization system of an inter-driven business intelligence system in accordance with some embodiments of the invention are illustrated. In one embodiment, an interest-driven data visualization system includes a processor, a memory configured to store an interest-driven business intelligence application, memory storing reporting data and metadata for the reporting data. The interest-driven business intelligence application includes a rendering process that adjusts the level of robustness of the rendered displays based upon current system performance information. Furthermore, the inter-driven business intelligence application may also include a table scrolling rendering process that periodically determines the location within the table and determines a viewport for the location. The viewport is then rendered and provided to the display.

Abstract: Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for AR recordings, additional virtual content is rendered from an additional perspective specifically for the AR recording. That additional virtual content is combined with image frames generated by a camera to form the AR recording.

Abstract: A method of adjusting a shading normal vector for a computer graphics rendering program. Calculating a normalized shading normal vector pointing outwards from an origin point on a tessellated surface modeling a target surface to be rendered. Calculating a normalized outgoing reflection vector projecting from the origin point for an incoming view vector directed towards the origin point and reflecting relative to the normalized shading normal vector. Calculating a correction vector such that when the correction vector is added to the normalized outgoing reflection vector a resulting vector sum is yielded that is equal to a maximum reflection vector, wherein the maximum reflection vector is on or above the tessellated surface. Calculating a normalized maximum reflection vector by normalizing a vector sum of the correction vector plus the maximum reflection vector.

Abstract: Systems and methods for generating recommendations for animations to apply to animate 3D characters in accordance with embodiments of the invention are disclosed. One embodiment includes an animation server and a database containing metadata describing a plurality of animations and the compatibility of ordered pairs of the described animations. In addition, the animation server is configured to receive requests for animation recommendations identifying a first animation, generate a recommendation of at least one animation described in the database based upon the first animation, receive a selection of an animation described in the database, and concatenate at least the first animation and the selected animation.