Abstract: Methods and systems for estimation of a 3D hand pose are disclosed. A 2D image containing a detected hand is processed using a U-net network to obtain a global feature vector and a heatmap for the keypoints of the hand. Information from the global feature vector and the heatmap are concatenated to obtain a set of input tokens that are processed using a transformer encoder to obtain a first set of 2D keypoints representing estimated 2D locations of the keypoints in a first view. The first set of 2D keypoints are inputted as a query to a transformer decoder, to obtain a second set of 2D keypoints representing estimated 2D locations of the keypoints in a second view. The first and second sets of 2D keypoints are aggregated to output the set of estimated 3D keypoints.

Abstract: Aspects of the subject disclosure may include, for example, capturing a first depiction of an exhibit environment, wherein the first depiction of the exhibit environment comprises an image of at least one artifact and an image of at least one interface element, and wherein the at least one interface element is located in the exhibit environment at a first location relative to the at least one artifact; obtaining a first user profile of a first user, wherein the first user profile comprises at least one first preference of the first user, and wherein the first user is located in a first remote environment; and facilitating a presenting of a first modified version of the first depiction of the exhibit environment in the first remote environment, wherein the first modified version moves the image of the at least one interface element to a second location relative to the at least one artifact, wherein the second location is different than the first location, and wherein the second location is selected based upon

Abstract: The present invention relates to a method and an apparatus for composing a background and a face by using a deep learning network, comprising: receiving an input of an original face image and a converted face image, and extracting data preprocessing and feature vectors for each image; generating a face feature vector mask from the extracted feature vectors; and generating a composite image by performing adaptive object normalization on the basis of the generated face feature vector mask.

Abstract: Systems, methods, and computer readable media for messaging system with augmented reality (AR) makeup are presented. Methods include processing a first image to extract a makeup portion of the first image, the makeup portion representing the makeup from the first image and training a neural network to process images of people to add AR makeup representing the makeup from the first image. The methods may further include receiving, via a messaging application implemented by one or more processors of a user device, input that indicates a selection to add the AR makeup to a second image of a second person. The methods may further include processing the second image with the neural network to add the AR makeup to the second image and causing the second image with the AR makeup to be displayed on a display device of the user device.

Abstract: Certain aspects of the present disclosure provide techniques for providing a chronologically-based search engine. Example methods includes presenting, on a display of an end-user device, live image data being captured by a camera of the end-user device, determining a pose of the end-user device, and sending the pose of the device to a server. The method also includes receiving location specific data from the server, the location specific data based on the pose of the end-user device, the location specific data including a first topic, and superimposing, on the live image data, based on the location specific data, (i) at least one highlighted area of an object associated with the first topic, and (ii) a query panel associated with the first topic superimposed proximate the object, the at least one highlighted area and the query panel being interactive elements associated with the first topic.

Abstract: This disclosure is directed toward systems and methods of pre-multiplied alpha handling during image processing operations. The image processing circuitry may include hardware that enables removal and insertion of pre-multiplied alpha content into red, green, blue (RGB) pixel values during gamma and scaling operations. The division by alpha and multiplication by alpha hardware may enable removal of pre-multiplied alpha content to RGB pixel values prior to gamma operations and insertion of pre-multiplied alpha content into RGB pixel values prior to scaling operations.

Abstract: An electronic device includes an input module configured to receive, from a user, an input of a plurality of emotion representation contents representing emotions, a display, and a processor electrically connected to the input module and the display. The processor is configured to, in response to at least one emotion representation content among the plurality of emotion representation contents being different from other emotion representation contents among the plurality of emotion representation contents, present a recommended animation representation based on an emotion combination of the plurality of emotion representation contents.

Abstract: A CPU determines whether a first condition related to a current position of a subject is satisfied, determines whether a second condition different from the first condition and related to at least one of the current position of the subject and a motion state of the subject is satisfied, and controls a display mode of a display unit on the basis of a determination result as to whether the first condition is satisfied and a determination result as to whether the second condition is satisfied.

Abstract: Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

Abstract: An image processing method is provided. The method includes generating appearance information corresponding to a canonical space defined by a cube including a plurality of regular grids in a first input image by implementing a first neural network, generating geometric information corresponding to a standard space in a second input image by implementing a second neural network, deforming the plurality of regular grids based on the generated geometric information, generating standardized image information by applying the appearance information to the plurality of deformed regular grids, and generating an output image based on the standardized image information.

Abstract: An information processing device (control device) includes a control unit that performs control, during control of display of a virtual space accompanied by viewpoint change, to display a model of the virtual space in a manner changeable to any appearance desired by a user, and to display the virtual space by moving a virtual user viewpoint to a position on the virtual space at which the same appearance as an appearance of the model is obtained.

Abstract: An apparatus configured to be worn on a head of a user, includes: a screen configured to present graphics to the user; a camera system configured to view an environment in which the user is located; and a processing unit configured to determine a map based at least in part on output(s) from the camera system, wherein the map is configured for use by the processing unit to localize the user with respect to the environment; wherein the processing unit of the apparatus is also configured to obtain a metric indicating a likelihood of success to localize the user using the map, and wherein the processing unit is configured to obtain the metric by computing the metric or by receiving the metric.

Abstract: A vector graphics file includes at least one artwork layer and at least one watermark layer. The watermark layer comprises a pattern of vector graphics primitives, each of which is filled with a color that is a tinted variant of the color of the location in the artwork that the primitive overlies. Such layered arrangement enables the watermark to be added or omitted, and varied in strength, payload and appearance, at will. Yet the artwork is left unchanged through such manipulations. In some embodiments the watermark conveys a multi-symbol Global Trade Item Number (GTIN), and the file is used to generate a label or packaging for a food or general merchandise retail item. A great number of other arrangements, features and advantages are also detailed.

Abstract: In one embodiment, a computing system determines one or more depth measurements associated with a first physical object. The system captures an image including image data associated with the first physical object. The system identifies and associates a plurality of first pixels with a first representative depth value based on the one or more depth measurements. The system determines, for an output pixel of an output image, that (1) a portion of a virtual object is visible from a viewpoint and (2) the output pixel overlaps with a portion of the first physical object. The system determines that the portion of the first physical object is associated with the plurality of first pixels and renders the output image from the viewpoint. Occlusion at the output pixel is determined based on a comparison between the first representative depth value and a depth value associated with the portion of the virtual object.

Abstract: Systems and methods are disclosed for generating a scaled reconstruction for a consumer product. One method includes receiving digital input comprising a calibration target and an object; defining a three-dimensional coordinate system; positioning the calibration target in the three-dimensional coordinate system; based on the digital input, aligning the object to the calibration target in the three-dimensional coordinate system; and generating a scaled reconstruction of the object based on the alignment of the object to the calibration target in the three-dimensional coordinate system.

Abstract: A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.

Abstract: Apparatuses, components, devices, methods, and systems for generating dentures are provided. An example system includes a motion capture system that captures patient jaw motion and generates patient jaw motion data; and a denture design system that generates a denture design based on the patient jaw motion data. An example method includes acquiring a digital reference denture model of a reference denture; selecting a denture tooth library based on the digital reference denture model; selecting and aligning denture library teeth from the selected denture tooth library to the digital reference denture model; generating a denture base digital model based on the digital reference denture model and the aligned denture library teeth; and fabricating a physical denture based from the denture base digital model.

Abstract: A display apparatus includes an optical see-through display apparatus, and includes a light source that emits lights a combiner including a diffraction member that diffracts light incident from the light source and outputs the light, and a controller that controls light emission of the light source. The controller controls a light output of the light source on the basis of a wavelength of light outputted from the light source and diffraction efficiency of the combiner that is changed resulting from change in a wavelength of incident light.

Abstract: An image coloring method includes: acquiring first color a priori information about an image-to-be-colored; transforming the first color a priori information to obtain second color a priori information aligned with the image-to-be-colored; downsampling the image-to-be-colored to obtain a first image feature; performing modulation coloring processing on the first image feature based on the second color a priori information to obtain a second image feature; and upsampling the second image feature based on the second color a priori information to obtain a first colored image, where the first colored image is aligned with the image-to-be-colored.

Abstract: A system automatically identifies objects in an environment based on a walkthrough video and an annotated floorplan of the environment. The annotated floorplan indicates locations and types of objects that are expected to be in the environment. The system receives the walkthrough video and generates a 3D model of the environment. The system applies a machine learning model to the walkthrough video to identify regions within frames where objects are captured. After identifying the regions within frames of the walkthrough video that include objects, the system modifies corresponding regions of the 3D model to include the identified objects. For each of the identified objects, the system determines a likelihood of the identified object being present at a location in the environment based on a comparison of the modified 3D model and the annotated floorplan.