Abstract: A virtual reality surgical navigation method includes the steps of preparing a multi dimension virtual model associated with an anatomy inside of patient; receiving data indicative of a surgeon's current head position, including direction of view and angle of view; rendering a first virtual three-dimensional image from the virtual model, the virtual three-dimensional image being representative of an anatomical view from a first perspective at a location inside the patient, wherein the perspective is determined by data indicative of the surgeon's current head position; communicating the first rendered virtual image to a virtual headset display; receiving data input indicative of the surgeon's head moving to a second position, wherein the head movement comprises at least one of a change in angle of view and a change in direction of view; and rendering a second virtual three-dimensional image from the virtual model, the second virtual three-dimensional image being representative of an anatomical view from a seco

Abstract: A reduced noise image can be formed from a set of images. One of the images of the set can be selected to be a reference image and other images of the set are transformed such that they are better aligned with the reference image. A measure of the alignment of each image with the reference image is determined. At least some of the transformed images can then be combined using weights which depend on the alignment of the transformed image with the reference image to thereby form the reduced noise image. By weighting the images according to their alignment with the reference image the effects of misalignment between the images in the combined image are reduced. Furthermore, motion correction may be applied to the reduced noise image.

Abstract: A computing system may include a metamaterial representation engine configured to represent a metamaterial of a three-dimensional (3D) object as program code. The metamaterial may define an internal geometry of the 3D object and may be configured to be physically constructed via additive manufacturing. Representation of the metamaterial as program code may include assigning a value of a code parameter of the metamaterial as a probability distribution. The computing system may also include a metamaterial analysis engine configured to analyze the metamaterial through the probability distribution assigned for the value of the code parameter of the program code.

Abstract: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image

Abstract: System and method for reconstructing a three-dimensional (3D) face model from an input 2D image of the face, including: feeding the input 2D image into at least one preparatory network to generate 3D landmarks (L?), facial features (F?) and segmentation maps (S?); feeding the 3D landmarks (L?), the facial features (F?), and the segmentation maps (S?) to a parameter regressor network (M1) to predict parameters of a 3D face parametric model (P?), camera parameters (C?), hair parameters (H?) and wrinkle parameters (W?); generating an initial UV texture map (UV_0?) using the input 2D image and (P?, C?, H?, W?); feeding the initial UV texture map (UV_0?) into a UV completion network (M2) to generate a full UV texture map (UV?) and illumination parameters (LI?); and generating the 3D face model using (P?, C?, H?, W?, UV?, LI?).

Abstract: At least one embodiment relates to the transfer, between two processing units or memories, of a three-channels texture image and at least two image-structured data used for reconstructing the geometry of the point cloud. Such transfer comprises copying the three channels of the three-channels texture image into the three channels of a four-channels image, and storing, in the fourth channel of the four-channels image, a combined information obtained by combining altogether the at least two image-structured data. The four-channel image is then transferred.

Abstract: A face image processing method and apparatus, a face image display method and apparatus, and a device are provided, belonging to the technical field of image processing. The method includes: acquiring a first face image of a person; invoking an age change model to predict a texture difference map of the first face image at a specified age, the texture difference map being used for reflecting a texture difference between a face texture in the first face image and a face texture of a second face image of the person at the specified age; and performing image processing on the first face image based on the texture difference map to obtain the second face image.

Abstract: A method includes obtaining one or more images associated with a user. The method further includes generating, using a body-assessment classifier, one or more body-assessment vectors. Each of the one or more body-assessment vectors is a function of a particular one of the one or more images. The one or more body-assessment vectors include quantitative physique and biometric assessments associated with the user. The method further includes displaying, on the display, a body-assessment indicator that is based on the one or more body-assessment vectors.

Abstract: A system and method of creating a shape-conforming lattice structure for a part formed via additive manufacturing. The method includes receiving a computer model of the part and generating a finite element mesh. A lattice structure including a number of lattice cellular components may also be generated. Some of the mesh elements of the finite element mesh may be deformed so that the finite element mesh conforms to the overall shape of the part. The lattice structure may then be deformed so that the lattice structure has a cellular periodicity corresponding to the finite elements of the finite element mesh. In this way, the part retains the benefits of its overall shape and the benefits of lattice features without introducing structural weak points, directional stresses, and other structural deficiencies.

Abstract: Embodiments of the present disclosure assist pilots of aerial vehicles in performing particular operations utilizing improved user interface(s). In some contexts, pilots performing vertical takeoffs or vertical landings cannot visually inspect the environment around the vehicle. Embodiments of the present disclosure utilize virtual elements, including a virtual corridor and virtual vehicle corresponding to an aerial vehicle, to enable improved visualization and control of an aerial vehicle within a particular environment. Utilizing representation(s) of the virtual elements, including a virtual corridor and/or virtual vehicle, embodiments of the present disclosure provide improved user interfaces that assist a pilot in safely controlling an aerial vehicle (even without visual inspection of a real-world environment) during vertical takeoff and/or vertical landing.

Abstract: Disclosed herein are a method and system for producing a digital model of a customised device, comprising the steps of: importing a first digital file of a base part; importing a second digital file of a target shape; determining a warping interpolation function based on source point positions associated with the base part and target point positions associated with the target shape; and applying the warping interpolation function to the points of said base part to generate a model of said customised device.

Abstract: A computer device obtains a first face image (IMA) and a second face image (IFA). The device obtains M first image blocks corresponding to facial features from the first face image (IMA), and obtains N second image blocks corresponding to facial features from the second face image (IFA). The device transforms the M first image blocks and the N second image blocks to a feature space to generate M first feature blocks and N second feature blocks. The device selects a subset of the first feature blocks and a subset of the second feature blocks according to a specified control vector. The device generates a first composite feature map based the selected subset of the first feature blocks and the selected subset of the second feature blocks. The device inversely transforms the first composite feature map back to an image space to generate a third face image.

Abstract: Systems and methods relate to the determination of accurate motion vectors, for rendering situations such as a noisy Monte Carlo integration where image object surfaces are at least partially translucent. To optimize the search for “real world” positions, this invention defines the background as first path vertices visible through multiple layers of refractive interfaces. To find matching world positions, the background is treated as a single layer morphing in a chaotic way, permitting the optimized algorithm to be executed only once. Further improving performance over the prior linear gradient descent, the present techniques can apply a cross function and numerical optimization, such as Newton's quadratic target or other convergence function, to locate pixels via a vector angle minimization. Determined motion vectors can then serve as input for services including image denoising.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.

Abstract: A system comprises one or more processors. The system further comprises memory having computer readable instructions stored thereon that, when executed by the one or more processors, cause the system to: obtain a reference tree of nodes and linkages for a reference three dimensional volumetric representation of a branched anatomical formation in a reference state; based on the reference tree, generate a reference three dimensional geometric model; based on measurements from a sensor system, detect deformation of the branched anatomical formation; based on the detected deformation, obtain a deformed tree of nodes and linkages; and generate a three dimensional deformation field that represents the detected deformation of the branched anatomical formation.

Abstract: A conferencing system terminal device includes an image capture device capturing images of a subject during a videoconference occurring across a network. A communication device transmits the images to at least one remote electronic device engaged in the videoconference. The conferencing system terminal device includes one or more processors and one or more sensors. The one or more processors automatically apply virtual background indicia in the images behind the subject as a function of contextual information detected by the one or more sensors during the videoconference.

Abstract: A display method and apparatus, and an electronic device are provided, the method includes: displaying a browsing object in a first region, wherein the first region displays on a online documentation; determining, in response to an instruction to display a comment for the browsing object, a display structure of a comment layer based on a predefined display parameter of the comment for the browsing object, wherein the predefined display parameter is configured to indicate a size of a second region in which the comment layer is located; and generating the comment layer based on the determined display structure, and displaying the comment in the generated comment layer, wherein a range of the second region is smaller than a range of the first region in a first direction or a second direction.

Abstract: An imaging and display system for guiding medical interventions includes a wearable display, such as a goggle display, for viewing by a user. The display presents a composite, or combined image that includes pre-operative surgical navigation images, intraoperative images, and in-vivo microscopy images or sensing data. The pre-operative images are acquired from scanners, such as MRI and CT scanners, while the intra-operative images are acquired in real-time from a camera system carried by the goggle display for imaging the patient being treated so as to acquire intraoperative images, such as fluorescence images. A probe, such as a microscopy probe or a sensing probe, is used to acquire in-vivo imaging/sensing data from the patient. Additionally, the intra-operative and in-vivo images are acquired using tracking and registration techniques to align them with the pre-operative image and the patient to form a composite image for display by the goggle display.

Abstract: Systems, methods, and new file formats are provided for printing 3D microstructures. In some implementations, a new file format is provided that defines 3D objects by a wireframe model expressed as a collection of wires. Because wires and their parameters are defined within the new file format, objects may be processed more efficiently and quickly to support 3D rendering operations. Such methods may be used to print new articles, such as eyelashes, bushes, swabs and other novel items.

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

Abstract: Provided is a decoding device including a decoding unit configured to decode encoded data in which a differential signal that includes a differential between a tactile signal and a reference signal has been encoded, and a signal addition unit configured to add the reference signal and the differential signal. In addition, provided is a decoding method by a processor, the decoding method including decoding encoded data in which a differential signal that includes a differential between a tactile signal and a reference signal has been encoded, and adding the reference signal and the differential signal that has been decoded.

Abstract: A computer-readable medium storing contents configured to cause a computing device to obtain image data describing a subject, measure the subject based on the obtained image data to obtain one or more spatial dimensions, and access data describing a wearable item based on the spatial dimensions of the subject.

Abstract: In accordance with one embodiment of the invention, a method coordinates experiences of a realm for a group of users, including at least an administrative user and at least one participating user. The method includes transmitting, from the server to an administrative user, a session identifier associated with the realm. The method also includes receiving, by the server, a user acceptance to join a session using the session identifier so that the at least one participating user can experience the realm. In response to receiving the acceptance, the method also includes transmitting to a computing device of the participating user, by the server, executable code including data describing a series of locations in the realm. The series of locations comprises at least a first location and a second location, and the first location is associated with a first panoramic image and the second location is associated with a second panoramic image.

Abstract: A method and an apparatus for generating a virtual viewpoint image by obtaining at least one input viewpoint image and warping pixels of the at least one input viewpoint image to a virtual viewpoint image coordinate system; mapping a patch to a first pixel of a plurality of pixels warped to the virtual viewpoint image coordinate system when a difference between a first depth value of the first pixel and a second depth value of a second pixel adjacent to the first pixel is less than or equal to a predetermined threshold and mapping no patch to the first pixel when the difference is greater than the predetermined threshold; and generating the virtual viewpoint image by blending the plurality of pixels and/or the patch are provided.

Abstract: A method and apparatus for method for image processing, and a computer storage medium are provided. The method includes: obtaining a first image, identifying a target object in the first image, and obtaining leg detection information of the target object; respectively determining a contour line and a target line of a leg region of the target object based on the leg detection information; and performing image deformation processing on the leg region based on the contour line and the target line of the leg region to generate a second image.

Abstract: A user interface may present multiple presentation slides for user selection. Each slide may include one or more shapes, and a shape thread may be associated with each shape on the slide. For a selected slide, the user interface may present one or more shape threads associated with the selected slide. Each shape displayed on the selected slide may be associated with a particular shape thread, and a user may independently adjust one or more slide transition attributes of a shape via the associated shape thread.

Abstract: A bounce light map for a scene is determined for use in rendering the scene in a graphics processing system. Initial lighting indications representing lighting within the scene are determined. For a texel position of the bounce light map, the initial lighting indications are sampled using an importance sampling technique to identify positions within the scene. Sampling rays are traced between a position in the scene corresponding to the texel position of the bounce light map and the respective identified positions with the scene. A lighting value is determined for the texel position of the bounce light map using results of the tracing of the sampling rays. By using the importance sampling method described herein, the rays which are traced are more likely to be directed towards more important regions of the scene which contribute more to the lighting of a texel.

Abstract: This disclosure includes technologies for deformation of 3D shapes using meta-handles. The disclosed 3D conditional generative system takes control points with biharmonic coordinates as deformation handles for a shape to train a network to learn a set of meta-handles for the shape. Further, each deformation axis of the latent space of deformation is explicitly associated with a meta-handle from a set of disentangled meta-handles, and the disentangled meta-handles factorize plausible deformations of the shape. Advantageously, an intuitive deformation of the shape may be generated by manipulating coefficients of the meta-handles, e.g., via a user interface.

Abstract: Implementations of the present disclosure provide a solution for cross-domain image translation. In this solution, a first learning network for geometric deformation from a first to a second image domain is determined based on first and second images in the first and second domains, images in the two domains having different styles and objects in the images having geometric deformation with respect to each other. Geometric deformation from the second to the first domains is performed on the second image or geometric deformation from the first to the second domains is performed on the first image, to generate an intermediate image. A second learning network for style transfer from the first to the second domains is determined based on the first and intermediate images or based on the second and intermediate images generated. Accordingly, processing accuracy of leaning networks for cross-domain image translation can be improved and complexity is lowered.

Abstract: A computer-implemented method and system for modeling an outer surface, such as skin. The method includes, under the control of one or more computer systems configured with executable instructions, defining a plurality of microstructures such as microstructures to be displayed in microstructure locations on a geometric model of a character or inanimate object, and generating a volumetric mesh including the plurality of microstructures. The volumetric mesh is configured to be applied to the geometric model as an outer surface (e.g., skin) covering the geometric model.

Abstract: Embodiments of this application relate to the field of terminal technologies, and describe a method for displaying a dynamic image and a terminal, which resolve a problem that power consumption of a terminal caused by an existing method in which three-dimensional real-time rendering is used is relatively high. The method may be applied to a terminal, and can includes obtaining, from a video file based on a preset factor, a plurality of pieces of image frame data in a one-to-one correspondence to a plurality of image frames. The method may also include decoding the plurality of pieces of image frame data, to obtain the plurality of image frames. Furthermore, the method can include successively displaying the plurality of image frames obtained through the decoding, to present the dynamic image. The dynamic image includes the plurality of image frames, and the preset factor includes at least one of the following factors: a time point and orientation data.

Abstract: Embodiments of the systems and methods described herein provide a virtual object aging system. The virtual object aging system can utilize artificial intelligence to modify virtual objects within a video game to age and/or deteriorate for a certain time period. The virtual object aging system can be used to determine erosion, melting ice, and/or other environmental effects on virtual objects within the game. The virtual object aging system can apply aging, rust, weathering, and/or other effects that cause persistent change to object meshes and textures.

Abstract: An example of a computer-readable medium is provided to store machine-readable instructions. The instructions may cause a processor to receive three-dimensional (3D) object representations of an object. The distance between points of a grid applied to 3D object representation and random points on the 3D object representation may provide a sampling error used in calculating a modeling accuracy between the 3D object representations.

Abstract: A video may be captured by an image capture device in motion. A horizon-leveled view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The placement of the punchout of the video may be changed based on different rotational positions of to provide a view in which a horizon depicted within the video is leveled.

Abstract: Moving images of a space, which includes objects 34 and 35 of a display target, as viewed from reference points are created in advance as reference images, and they are combined in response to actual positions of the points of view to draw a moving image. When the object 35 is displaced as indicated by an arrow mark in the space, reference points of view 30a to 30e are fixed as depicted in (a). Alternatively, the reference points of view are displaced in response to the displacement like reference points of view 36a to 36e in (b). Then, the moving images from the reference points of view are generated as the reference images.

Abstract: Automating the shifting of pixels within a digital image comprises a processor receiving an indication of a starting point through a user interface. The starting point is received through a user selection of a particular portion of the digital image. Additionally, the processor receives, through the user interface, a direction associated with the starting point. The processor also selects a set of pixels extending in the direction away from the starting point. Further, the processor shifts the set of pixels in the first direction. Shifting the set of pixels comprises rendering and re-rendering in a loop the set of pixels being shifted.

Abstract: Various examples pertaining to camera view synthesis on head-mounted display (HMD) for virtual reality (VR) and augmented reality (AR) are described. A method involves receiving, from a plurality of tracking cameras disposed around a HMD, image data of a scene which is on a first side of the HMD. The method also involves performing, using the image data and depth information pertaining to the scene, view synthesis to generate a see-through effect of viewing the scene from a viewing position on a second side of the HMD opposite the first side thereof.

Abstract: A method and a device for classifying facial images includes retrieving a first plurality of facial landmarks of a provided facial image associated with a subject, determining a corresponding second plurality of facial landmarks of a captured facial image of the subject, and extracting at least one feature vector based on differences between at least some of the first plurality of facial landmarks and corresponding facial landmarks of the second plurality of facial landmarks, wherein at least some values of the at least one feature vector represent angular values of facial landmarks, and supplying the at least one feature vector to a classifier to classify the provided facial image as a real facial image of the subject or as an artificial facial image.

Abstract: A time slice video providing server includes a video transmission unit configured to transmit, to a user device, any video requested to be played from among multiple videos recorded by multiple cameras; a request unit configured to receive, from the user device, a request to generate a time slice video of a subject shown in the transmitted video; a coordinate extraction unit configured to extract center coordinates of the selected subject based on coordinate information of the subject and positional relationship information of the multiple cameras; a field of view selection unit configured to select a field of views for the multiple videos based on the extracted center coordinates; a field of view correction unit configured to correct each of the selected field of views based on a positional relationship between each of the selected field of views and a video region shown in a corresponding one of the multiple videos; and a time slice video providing unit configured to extract images from the respective multi

Abstract: The present disclosure is directed to a coherent signal generator comprising an amplifier configured to receive a plurality of optical signals that are respectively associated with a plurality of phases, and generate a plurality of amplified optical signals using the plurality of optical signals; and a splitter network that is coupled to the amplifier. The splitter network is configured to receive the plurality of amplified optical signals, and generate a combined optical signal at an output of a plurality of outputs using the plurality of amplified optical signals.

Abstract: A method and a system for generating an augmented 3D digital model of an intraoral anatomical structure a subject. The method comprises: obtaining a 3D digital model of the intraoral anatomical structure including a plurality of mesh elements representative of a surface of the intraoral anatomical structure; generating, based on the 3D digital model, a 2D grid comprising an unfolded surface of the 3D digital model; the 2D grid including a plurality of 2D cells; assigning, to each one of the plurality of 2D cells, a respective value of at least one textural parameter, thereby generating a texture reference map; and based on the texture reference map, causing application of the at least one textural parameter to the 3D digital model to generate the augmented 3D digital model of the intraoral anatomical structure.

Abstract: Various embodiments described herein relate to techniques for computing dimensions of an object using multiple range images. In this aspect, the multiple range images are captured from selective locations and satisfy a pre-defined criterion. In accordance with various embodiments, at least a pair of 3D points are identified from the multiple range images, which correspond to at least one geometric feature on a surface of the object. In this regard, a correspondence score is estimated for the identified at least one pair of 3D points. The correspondence score is then utilized for registering the at least one pair of 3D points. Based in part on the registration of the 3D points and 3D point clouds retrieved from the captured images, the dimensions of the object are computed.

Abstract: A computer-implemented method for managing data objects stored in a data repository and displaying elements associated with data objects on a graphical user interface is presented. The method includes using reusable logic to provide at least one displayed input element associated with a first data object stored in the data repository. In response to user input associated with the displayed input element, the method includes generating a second data object stored in the data repository, and linking the second data object with one or more related data objects in the data repository automatically based on the data object associated with the displayed element.

Abstract: The object of the present invention relates to a method for the production of an orthodontic functional device for the treatment of facial asymmetries. The present invention refers to the field of the technique comprising the manufacturing methods and the technique used to make orthodontic appliances, Specifically, it refers to a methodology that allows the artwork to be performed without making the operator dependent based on a cephalometric frontal path created by a computer so without ever contacting the patient with a functional orthodontic device for the treatment of facial asymmetries. Facial asymmetry is an alteration in skeletal growth that can be determined by several congenital or acquired factors that in patients with skeletal development in place. They exemplify the pathogenetic action by altering the functional harmonics of the entire stomatognathic apparatus.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for displaying a video. A video stream including a plurality of image frames, wherein at least some image frames include an overlay, is received by a video management system. The video management system determines a position of the overlay within an image frame. The video management system applies an image adjustment function to the image frame to create an adjusted image frame. The image adjustment function uses the determined position of the overlay to adjust the image while keeping the appearance of the overlay essentially unchanged, and the video stream including the adjusted image frame is displayed.

Abstract: An approach is provided that captures a digital image of an object that has a number of facets. The approach further determines the actual sizes of various facets found on the object. The actual sizes of the facets are used to identify compatible objects based, with the compatible objects being objects that can work with the object.

Abstract: A method for transmitting virtual reality (VR) content by a device is provided. The method includes obtaining at least two images captured from a target, arranging the at least two images and projecting the at least two images onto a planar surface to configure a 360-degree image corresponding to the VR content, detecting an overlapped region of the at least two images projected and generating rearrangement information about the overlapped region, and transmitting the rearrangement information and the at least two images.

Abstract: An electronic device is provided and includes a touch screen and a processor that is configured to display a first object among a plurality of sequentially arranged objects on the touch screen, display, when a first user input that satisfies a designated condition is detected via the touch screen while the first object is displayed, a second object arranged subsequent to the first object according to an arrangement order among the plurality of objects on the touch screen, and display, when a second user input that does not satisfy the designated condition is detected via the touch screen while the first object is displayed, a third object designated regardless of the arrangement order among the plurality of objects on the touch screen.

Abstract: Automating the shifting of pixels within a digital image comprises a processor receiving an indication of a starting point through a user interface. The starting point is received through a user selection of a particular portion of the digital image. Additionally, the processor receives, through the user interface, a direction associated with the starting point. The processor also selects a set of pixels extending in the direction away from the starting point. Further, the processor shifts the set of pixels in the first direction. Shifting the set of pixels comprises rendering and re-rendering in a loop the set of pixels being shifted.

Abstract: An editing apparatus of three-dimensional shape data, includes: a range setting unit that sets at least one of a protection target range and an editable range of a three-dimensional shape represented by three-dimensional shape data including three-dimensional position information, as an edit control range; and a control condition setting unit that sets a control condition for controlling edit in the editable range so as not to edit the protection target range when the editable range is edited.