Abstract: The disclosure provides image rendering methods and apparatuses. One example method includes that a foreground image is first rendered, and then a panoramic image used as a background is rendered. A pixel corresponding to the foreground image has a corresponding depth value. When the panoramic image is rendered, content corresponding to the panoramic image may be rendered at a pixel corresponding to a depth standard value based on a depth value of a pixel on a canvas. The depth reference value is a depth value of a pixel other than the pixel corresponding to the foreground image.

Abstract: A computer-implemented method for avatar rendering of virtual presentations is disclosed. The computer-implemented method includes extracting visual content from a presentation. The computer-implemented method further includes extracting audio content from the presentation. The computer-implemented method includes correlating the visual content with the audio content of the presentation. The computer-implemented method includes generating a virtual avatar to dynamically render a virtual presentation to a viewer, based at least in part, on the correlated visual content and audio content of the presentation.

Abstract: An image classification system comprises a neural network trained on a synthetic infrared training dataset, including synthetic infrared images of objects rendered from a virtually represented infrared sensor in a virtual three-dimensional scene, the synthetic infrared images being generated using infrared radiation signatures of virtual objects in the virtual three-dimensional scene and an infrared response model of the virtually represented infrared sensor. A system for generating synthetic infrared training data comprises a three-dimensional scene modeling system operable to generate three-dimensional scenes comprising a plurality of objects, each object having an infrared radiation model, and an infrared sensor modeling system operable to model an imaging response for an infrared sensor virtually represented in the three-dimensional scene.

Abstract: A robot and a method for operating the same according to one aspect of the present disclosure can provide emotion based services by acquiring data related to a user and recognizing emotional information on the basis of the data related to the user, and automatically generate a character expressing an emotion of the user by generating an avatar by mapping the recognized emotional information of the user to face information of the user.

Abstract: One embodiment provides a method, the method including: detecting, using a content focus system, an attentive state of a user with respect to a display; determining, using the content focus system, the attentive state corresponds to content displayed on the display; and increasing, using the content focus system, a size of the content, wherein the increasing comprises increasing the content to a size that covers other content displayed on the display. Other aspects are described and claimed.

Abstract: Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.

Abstract: A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.

Abstract: Telematics systems and methods are described for generating interactive animated guided user interfaces (GUIs). A telematics cloud platform is configured to receive vehicular telematics data from a telematics device onboard a vehicle. A GUI value compression component determines, based on the vehicular telematics data, a plurality of GUI position values and a plurality of corresponding GUI time values. A geospatial animation app receives the plurality of GUI position values and the plurality of corresponding GUI time values. The geospatial animation app implements an interactive animated GUI that renders a plurality of geospatial graphics or graphical routes on a geographic area map via a display device. The geospatial graphics or graphical routes are rendered to have different visual forms based on differences between respective GUI position values and corresponding GUI time values.

Abstract: Disclosed is a method of handling thread termination events within a graphics processor when a group of plural execution lanes are executing in a co-operative state. When a group of lanes is in the co-operative state, in response to the graphics processor encountering an event that means that a subset of one or more execution threads associated with the group of execution lanes in the co-operative state should be terminated: it is determined whether a condition to immediately terminate the subset of one or more execution threads is met. When the condition is not met, the group of execution lanes continue their execution in the co-operative state, but a record is stored to track that the threads in the subset of one or more execution threads should subsequently be terminated.

Abstract: Techniques to improve operation of an augmented reality device and/or system utilizing fiducial markers and/or color space conversions are provided. In various embodiments, a color space of an object is altered based on a movement of the object in relation to an environment. The environment may include two or more segments with a distinct environment color space in relation to one another. The object may transition from one of the two or more environment segments into the other one of the two or more segments. The alteration is based on the transition from the color space of the one of the two or more environment segments into the other one of the two or more environment segments.

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

Abstract: Various implementations disclosed herein include devices, systems, and methods that implement rendering processes that performs vector graphic rendering based on information received from a source application. Various implementations disclosed herein include devices, systems, and methods that implement foveated rendering using content received from a source by selectively drawing the content for only some regions based on gaze.

Abstract: Various implementations disclosed herein include devices, systems, and methods that implement rendering processes that performs vector graphic rendering based on information received from a source application. Various implementations disclosed herein include devices, systems, and methods that implement foveated rendering using content received from a source by selectively drawing the content for only some regions based on gaze.

Abstract: A method and apparatus for displaying information. The method comprises: determining a field of view of a user viewing an environment via a display of a display device; using the field of view, determining a focal region of interest of the user in the environment; providing a database comprising a list of objects and, for each object, a location of that object in the environment; using the list of objects and a location of the focal region in the environment, identifying one or more of the objects that are at least partially located in the environment in or proximate to the focal region; acquiring information related to the identified one or more objects; generating an image element comprising the acquired information; and displaying the generated image element on the display of the display device through which the user is viewing the environment.

Abstract: An augmented reality (AR) device is provided. The AR device includes a display module configured to output light of a virtual image, a waveguide configured to transmit the output light of the virtual image to an eye of a user and to pass external light therethrough, a gaze tracking sensor configured to obtain information on the eye of the user, the information including a pupil size, a memory storing instructions, and a processor configured to execute the instructions to control the display module to adjust a brightness of the light of the virtual image based on the pupil size.

Abstract: Techniques for determination of an optimal spatiotemporal sensor configuration for navigation of a vehicle include generating a model of a virtual vehicle operating in an environment. The model of the virtual vehicle includes a virtual sensor having a virtual viewing range. The virtual viewing range of the virtual sensor is segregated into frustums. The virtual viewing range of the virtual sensor corresponds to a viewing range of a sensor of a vehicle operating in the environment. A geometric viewport is generated including pixels. The geometric viewport has a height corresponding to a number of rays emitted from the virtual sensor. The geometric viewport is segregated into sections. Each section corresponds to a frustum. A virtual point cloud of the virtual sensor is rendered. The virtual point cloud includes coordinate positions representing a portion of the environment located within the virtual viewing range of the virtual sensor.

Abstract: A graphics processing system includes a tiling unit configured to tile a first view of a scene into a plurality of tiles, a processing unit configured to identify a first subset of the tiles that are associated with regions of the scene that are viewable in a second view, and a rendering unit configured to render to a render target each of the identified tiles.

Abstract: Recurrent blurring may be used to render frames of a virtual environment, where the radius of a filter for a pixel is based on a number of successfully accumulated frames that correspond to that pixel. To account for rejections of accumulated samples for the pixel, ray-traced samples from a lower resolution version of a ray-traced render may be used to increase the effective sample count for the pixel. Parallax may be used to control the accumulation speed along with an angle between a view vector that corresponds to the pixel. A magnitude of one or more dimensions of a filter applied to the pixel may be based on an angle of a view vector that corresponds to the pixel to cause reflections to elongate along an axis under glancing angles. The dimension(s) may be based on a direction of a reflected specular lobe associated with the pixel.

Abstract: A system may access an image that is captured by an imaging device and that depicts an operational scene illuminated by close-range light. The system may also access a depth map of the operational scene that includes depth data corresponding to each pixel in the image. Based on the depth map, the system may determine a far-range lighting coefficient for each pixel in the image based on a relationship between the corresponding depth data included in the depth map for that respective pixel and a target distance to a virtual light source that is to be simulated to be illuminating the operational scene. Based on the image and these far-range lighting coefficients, the system may generate a processed image depicting the operational scene as being illuminated by the virtual light source and may provide the processed image for presentation on a display screen. Corresponding systems and methods are also disclosed.

Abstract: A system and method are disclosed for image analysis of supply chain planning problems modeled as a linear programming (LP) problems. Embodiments include receiving an LP matrix representing constraints and variables of at least a portion of a supply chain planning problem, generating a sorted variable index for the variables of the LP matrix, generating a sorted constraint index for the constraints of the LP matrix, identifying functions of the variables and the constraints, selecting one or more colors of pixels of a supply chain problem image based, at least in part, on the identified functions of the variables and constraints, selecting locations of the pixels, and displaying a visualization of the supply chain problem image.