Abstract: A system renders display of a second interface on second terminal device, the second interface comprises interactive data as being a selective revealing object which covers at least a portion of a body of a first user. The second user can control transparency of the selective revealing object or make it disappear base on target data provided by the second terminal device.

Abstract: Some implementations relate to translating text within images in a virtual environment while preserving the original style and visual characteristics of the text. In some implementations, the method includes obtaining an original image that includes text in a source language; recognizing content of the text and generating translated text in a target language; determining a text region of the text in the original image; determining a style encoding for the text; generating a masked version and noisy version of the original image; providing the noisy version, masked version, and text region as direct inputs to a pre-trained diffusion model; providing the translated text and the style encoding as conditioning inputs to the diffusion model; and obtaining an output image including the translated text, where a visual style of the translated text in the output image is the same as the visual style of the text in the original image.

Abstract: Devices and methods for rendering objects using ray tracing are provided which include during a build time: generating an accelerated hierarchy structure comprising data representing an approximate volume bounding a group of geometric shapes representing the objects in the scene and data representing the geometric shapes; and generating additional data used to transform rays, to be cast in the scene, from a high precision space to a low precision space; and during a render time occurring after the build time: performing ray intersection tests, using the additional data generated during the build time, for the rays in the scene; and rendering the scene based on the ray intersection tests. Because the additional data is generated prior to render time, the additional data can be used to perform the ray intersection testing more efficiently.

Abstract: Apparatuses, systems, and techniques are presented to reconstruct one or more images. In at least one embodiment, one or more circuits are to use one or more neural networks to adjust one or more pixel blending weights.

Abstract: Predefined mark making tools within graphics applications address initial or final stages of a stroke whilst jitter addresses the intervening section of the stroke. Whilst this allows a brush stroke to be simulated as having increasing pressure initially, pressure variability during the stroke, and ending with decreasing pressure this approach does not reflect or mimic the artist's reality. This reality is that an artist applying multiple strokes of a medium, e.g. watercolour, pastels, oils, etc., with an applicator, e.g. a brush, pen, airbrush, marker, sponge or a knife, to a canvas where brush marks may accumulate. Prior art mark making tools and software do not account for aspects of opacity, grain (of the underlying canvas), and blending (of the multiple strokes). Accordingly, there are provided controls with respect mark making tools that address these aspects providing the digital artist with increased control, increased reproducibility, and incorporation of real world effects.

Abstract: A computer-implemented method for adaptive mesh refinement includes generating a first mesh for a first layer of a stacked model representing a 3D integrated circuit, the first mesh including a first grid for the first layer, performing a simulation for the stacked model using the first mesh to obtain first results, calculating an interpolated value for a particular grid node according to the first results, the particular grid node corresponding to a node of the first grid in the grid hierarchy. The method further includes generating a second mesh for the layer of the stacked model, the second mesh including a second grid for the first layer, performing a simulation for the stacked model using the second mesh to obtain a simulated value of the particular grid node, comparing the interpolated and simulated value, and generating a refined mesh for the first layer including a refined grid.

Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device. rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.

Abstract: The technologies disclosed herein relate to a system and method for transferring markings. The system can include an imaging device for imaging a stained slide and an unstained slide, a display for displaying one or more images of the stained slide and the unstained slide. In various embodiments, the system can include a mechanical stage, such as a scaffold, for positioning or orienting the stained slide with respect to the unstained slide. In various embodiments, the system can be coupled with a first application for aligning the images to enable digital marking of the unstained slide and a second application for digitally marking one or more features and transferring the digital markings into coordinates to be used for further processing, such as for dissection.

Abstract: In one implementation, a method of pipelined blending an image with virtual content is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, with the image sensor, a first portion of an image of a physical environment. The method includes warping the first portion of the image of the physical environment to generate a warped first portion. The method includes blending the warped first portion with a first portion of virtual content to generate a blended first portion. The method includes displaying, on the display, the blended first portion. The method includes capturing, with the image sensor, a second portion of the image of the physical environment. The method includes warping the second portion of the image of the physical environment to generate a warped second portion. The method includes blending the warped second portion with a second portion of the virtual content to generate a blended second portion.

Abstract: A method, non-transitory computer readable medium, apparatus, and system for image generation are described. An embodiment of the present disclosure includes obtaining an input image, an inpainting mask, and a plurality of content preservation values corresponding to different regions of the inpainting mask, and identifying a plurality of mask bands of the inpainting mask based on the plurality of content preservation values. An image generation model generates an output image based on the input image and the inpainting mask. The output image is generated in a plurality of phases. Each of the plurality of phases uses a corresponding mask band of the plurality of mask bands as an input.

Abstract: A system and method for navigation in complete darkness with thermal imaging and virtual-reality headset provide adjustable-base stereopsis and maintain long-range situational awareness. Such a system includes a multiple-aperture thermal imaging subsystem with non-collinear sensors with parallel optical axes and an image processing device, resulting in a significantly more accurate depth map than perceived with a normal human stereo acuity from a pair of raw thermal images. The stereo-video presented to the user is synthetic, allowing vantage point and stereo-base adjustment; it augments natural objects' texture with the generated one to allow a 3D perception of the negative obstacles and other horizontal features that do not provide stereo cues for the horizontal binocular vision.

Abstract: Embodiments of the present disclosure provide an image processing method and apparatus, and a device. The method includes: displaying a number M of first images in a first region, each first image corresponding to a number N of sub-images, the number N of sub-images being images formed by dividing the first image into N parts, M being an integer greater than or equal to 1, and N being an integer greater than 1; in response to a first operation instruction, determining a number K of sub-images from the number of M*N sub-images corresponding to the number M of first images, and displaying some or all of the K sub-images in a second region, K being an integer greater than or equal to 1; and updating a display mode of the number M of first images according to the K sub-images, and displaying a splicing number corresponding to each first image, the splicing number being a number of first images formed by splicing the K sub-images.

Abstract: Techniques for augmenting a view of a first user of a first mixed reality (MR) visualization device in an operating room are described. For example, an intraoperative guidance system is configured to determine a location for a second user to stand within the operating room. A second MR visualization device is configured to be worn by the second user. The second MR visualization device is further configured to present a MR visualization that indicates the location for the second user to stand within the operating room. The first MR visualization device is configured to present a MR visualization that contains a window that show images of a surgical site captured by a camera supported by the second user.

Abstract: A data augmentation method and system for generating enriched training images using diffusion models, hybrid concatenation, and fractal blending. An original image and at least one prompt are input to a diffusion model to generate a corresponding image. A hybrid image is formed by concatenating a portion of the original image with a remaining portion of the generated image, wherein concatenation is performed using a binary pixel-wise mask. The mask comprises pixels valued at zero or one, with at least one entire row or column set to zero. The concatenation includes multiplying pixels of the original image with the mask and multiplying pixels of the generated image with the complement of the mask. A fractal image is blended into the hybrid image using a blending factor to produce an augmented image.

Abstract: An improved interactive graphics tool including an algorithm and technique to efficiently and elegantly render smooth lines to build or develop interactive graphics is disclosed. The new algorithm is configured to render an anti-aliased coverage mask for any path, using a single GPU shader program and a single GPU draw call. The present invention is a solution to prior two-dimensional graphics, by providing an automated process to stroke the entire path with tessellation, by rendering to a floating point “coverage count” buffer to tessellate an antialiasing with triangles running orthogonally from the center.

Abstract: Methods and systems for training a model include training an encoder in an unsupervised fashion based on a backward latent flow between a reference frame and a driving frame taken from a same video. A diffusion model is trained that generates a video sequence responsive to an input image and a text condition, using the trained encoder to determine a latent flow sequence and occlusion map sequence of a labeled training video.

Abstract: A method and apparatus with image processing is provided. The processor-implemented method includes generating a warped image frame by warping a first reconstructed image frame of a first time point based on first change data corresponding to a change between first rendered image frame of the first time point and second rendered image frame of a second time point that is different from the first time point; generating, using a neural reconstruction model based on the second rendered image frame and the warped image frame, a confidence map representing a second reconstructed image frame of the second time point and confidence scores of pixels of the second reconstructed image frame; and generating a third rendered image frame of a third time point, different from the first and second time points, by ray tracing for each of plural pixels of the third rendered image frame based on the confidence map.

Abstract: Systems, methods, and other embodiments described herein relate to using octrees and trilinear interpretation to generate field-specific representations. In one embodiment, a method includes acquiring a latent vector describing an object. The method includes generating an octree from the latent vector according to a recursive network, the octree representing the object at a desired level-of-detail (LoD). The method includes extracting features from the octree at separate resolutions. The method includes providing a field as a representation of the object according to the features.

Abstract: An extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and an XR device is described. The XR streaming method comprises streaming, with a first XR application instance first XR images to the XR device, wherein the first XR images streamed by the first XR application instance are associated with a first XR application. Streaming, by means of a second XR application instance, second XR images to the XR device, wherein the second XR images streamed by the second XR application instance are associated with a second XR application. Blending, by means of the XR device, the first XR images received from the first XR application instance with the second XR images received from the second XR application instance to obtain blended XR images for display on the XR device.

Abstract: Embodiments relate to a method for generating an image comprising a graphical representation. The method includes determining a transformation relationship for a unit cell of a graphical representation of an original image. The transformation relationship is based on position information of grid vertices of the unit cell of the original image graphical representation and position information of grid vertices of a unit cell of a reference grid arrangement of the image to be generated. The method further includes determining position information of a one or more pixels of the unit cell of the original image graphical representation based on the transformation relationship. The method further includes applying data information sampled at the one or more pixels of the unit cell of the original image graphical representation to one or more pixels of the unit cell of the reference grid arrangement.