Abstract: A liquid crystal display apparatus includes: a liquid crystal panel; an input interface for inputting data of a first image; a backlight module; and at least one memory and at least one processor which function as: an estimating unit configured to estimate brightness of light to be irradiated from the backlight module to the liquid crystal panel; a correcting unit configured to correct the first image to a second image based on the brightness estimated by the estimating unit, a contrast of the liquid crystal panel, and a target contrast so that a brightness error with respect to a display brightness in a case where the first image is displayed with the target contrast is suppressed; and a control unit configured to control transmittance of the liquid crystal panel based on data of the second image.

Abstract: An orthodontic appliance for movably disposed inside dental patient's mouth. The dental patient's mouth has a maxillary dental arch, a mandibular dental arch, and defines a lingual side, a labial side, and a buccal side. The orthodontic appliance has a hard maxillary retainer corresponding to patient's upper jaw, a hard mandibular retainer corresponding to patient's lower jaw, and a soft retainer rigidly attached to the hard maxillary retainer and hard mandibular retainer. The hard maxillary retainer and hard mandibular retainer can be prefabricated according to expected Cusp-to-Fossa Relationship of dental patient, and then be manufactured in an injection mold. The orthodontic appliance can have function to treat teeth deviation, dislocation, malocclusion, or teeth unmatch.

Abstract: Systems and methods of generating, selecting and rendering level of detail (LOD) visual assets are described. In an offline process for auto-generating the LOD visual assets, a LOD management module receives data representative of a LOD visual asset of an object model and its associated switch distance and iteratively reduces a polygon mesh complexity of the LOD visual asset to generate a lower complexity LOD visual asset along with its associated offline authored switch distance. Data representative of the LOD visual assets is presented in one or more GUIs to enable a user to optimize the data. Subsequently, a rendering module selects a LOD visual asset based on its associated switch distance or a modulated switch distance. The modulated switch distance is determined by applying one or more corrective factors to the associated switch distance.

Abstract: Described are systems and methods directed to generation of a personalized three-dimensional (“3D”) body model of a body, such as a human body, based on two-dimensional (“2D”) images of that body and the generation and presentation of predicted personalized 3D body models of the body when one or more body measurements (e.g., body fat, body weight, muscle mass) are changed. For example, a user may provide a target body measurement value and the implementations will generate one or more predicted personalized 3D body models representative of a predicted appearance of the body with the target body measurement value.

Abstract: A computing system includes one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to perform operations. The operations include determining that a portion of an existing map is to be updated; obtaining a point cloud acquired by one or more Lidar sensors corresponding to a location of the portion; converting the portion into an equivalent point cloud; performing a point cloud registration based on the equivalent point cloud and the point cloud; and updating the existing map based on the point cloud registration.

Abstract: An image processing method includes: acquiring a fixation point position on a respective screen viewed by each of dominant eye(s); determining a fixation area of a left-eye screen and a fixation area of a right-eye screen according to fixation point position(s) corresponding to the dominant eye(s); rendering a first part of a left-eye image to be displayed on the left-eye screen at a first resolution, and rendering a second part of the left-eye image at a second resolution; rendering a first part of a right-eye image to be displayed on the right-eye screen at a third resolution, and rendering a second part of the right-eye image at a fourth resolution. A resolution of an image to be displayed in a fixation area of the respective screen is greater than resolutions of images to be displayed in other areas of the left-eye screen and the right-eye screen.

Abstract: An illustrator system accesses a multi-element document, the multi-element document including a plurality of elements. The illustrator system determines, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics. The illustrator system creates a first aggregated topic distribution from the determined element-specific topic distributions. The illustrator system determines a global intent for the multi-element document, the global intent including one or more terms from the first aggregated topic distribution. The illustrator system queries a database using the global intent to retrieve a substitute element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of an element in the multi-element document The at least one substitute element is different from the element in the displayed multi-element document.

Abstract: Techniques are described for using computing devices to perform automated operations for determining matching buildings and using corresponding information in further automated manners, such as by determining buildings having similarities to other indicated buildings based at least in part on building floor plans and/or other attributes, and by automatically generating descriptions of the similarities. In some situations, such matching building determinations are based on generating and using adjacency graphs for floor plans that represent inter-connections between rooms and other attributes of the buildings, and further generating and comparing vector-based embeddings that concisely represent the information of the adjacency graphs for use in performing inter-building comparisons and generating the descriptions. Information about such determined buildings may be used in various automated manners, including for controlling device navigation (e.g.

Abstract: A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.

Abstract: The information processing apparatus includes: one or more processors functioning by executing instructions stored in one or more memories as the following units: an obtaining unit configured to obtain information for specifying a display device that displays a virtual viewpoint image whose virtual viewpoint can be changed; and a determining unit configured to determine a virtual viewpoint position in accordance with a display device specified based on information obtained by the obtaining unit.

Abstract: Embodiments include systems and methods for remotely measuring distances in an environment captured by a device. A device captures a video stream of a device along with AR data that may include camera pose information and/or depth information, and transmits the video stream and AR data to a remote device. The remote device receives a selection of a first point and a second point within the video stream and, using the AR data, calculates a distance between the first and second points. The first and second points may be at different locations not simultaneously in view of the device. Other embodiments may capture additional points to compute areas and/or volumes.

Abstract: A method and device for generating points of a 3D scene from a depth image. To reach that aim, depth information associated with a current pixel is compared with depth information associated with pixels spatially adjacent to the current pixel in the depth image. When the difference of depth between the current pixel and an adjacent pixel is greater than a first value and less than a second value, at least an additional point of said 3D scene is generated, in addition to a current point associated with the current pixel of the depth image, the number of additional points depending on the depth difference.

Abstract: A method and device for modifying virtual content according to various simulation characteristics includes obtaining first virtual content; obtaining one or more simulation characteristics; and generating second virtual content by modifying the first virtual content according to the one or more simulation characteristics; and presenting the second virtual content.

Abstract: An object of the present disclosure is to provide a technique for creating a three-dimensional model of a line-like structure from a point cloud obtained using three-dimensional laser measuring equipment and detecting a three-dimensional model of a cable.

Abstract: Systems and methods for utilizing a device as a marker for virtual content viewed in an augmented reality environment are discussed herein. The device (or sign post) may comprise a wirelessly connectable device linked to a power source and associated with multiple linkage points. The device may provide information to a user (or a device of a user) defining virtual content and a correlation between the linkage points and a reference frame of the virtual content. When rendered by a display device, the virtual content may be presented based on the reference frame of the virtual content correlated to the real world by virtue of the position of the linkage points in the real world.

Abstract: A system includes a biometric sensor configured to detect physiological data associated with anxiety of a user, a memory, and at least one hardware processor executing operations. The operations include selecting a plurality of stimuli from a pool of stimuli, the selected plurality of stimuli including at least one target stimuli associated with a subject matter and at least one generic stimuli not directly associated with the subject matter. The operations also include presenting each stimulus to the user, collecting sensor readings from the biometric sensor, and generating anxiety results. The operations also include determining an anxiety score based on the anxiety results, identifying a plurality of risk tolerance ranges, each risk tolerance range being associated with a category of risk tolerance, and determining a risk tolerance result of the user based on comparing the anxiety score to the plurality of risk tolerance ranges.

Abstract: The present disclosure provides computing device implemented methods, computing device readable media, and systems for motion compensation in a three dimensional scan. Motion compensation can include receiving three-dimensional (3D) scans of a dentition, estimating a motion trajectory from one scan to another, and calculating a corrected scan by compensating for the motion trajectory. Estimating the motion trajectory can include one or more of: registering a scan to another scan and determining whether an amount of movement between the scans is within a registration threshold; determining an optical flow based on local motion between consecutive two-dimensional (2D) images taken during the scan, estimating and improving a motion trajectory of a point in the scan using the optical flow; and estimating an amount of motion of a 3D scanner during the scan as a rigid body transformation based on input from a position tracking device.

Abstract: A method includes: obtaining a plurality of view images; identifying a representative value from among difference values between values of a plurality of sub-pixels corresponding to a first position in the plurality of view images and an intermediate value of a bit range of a display; determining filtering strength corresponding to the representative value, based on a correspondence map indicating a correspondence relationship between filtering strength and a difference value between a value of a sub-pixel and the intermediate value; and applying a filter having the determined filtering strength to the plurality of sub-pixels corresponding to the first position, wherein a value resulting from applying the filter having the determined filtering strength to the plurality of sub-pixels corresponding to the first position is included in a range of sub-pixel values according to the bit range of the display.

Abstract: An image identification device can be trained to identify classes with high accuracy even in cases with a small number of learning images.

Abstract: A system may have one or more processors and a memory storing instructions, that when executed by the processors, cause the processors to perform operations that include receiving data associated with a user, and determining that the received data corresponds to a direction of movement by the user through a virtual reality (VR) environment, augmented reality (AR) environment, or mixed reality (MR) environment. The operations may also include transmitting a tile of high quality image data to a display device based on the direction of movement by the user, transmitting a command to the display device to display one or more aspects of a region of the VR environment, the AR environment, or the MR environment based on the tile of high quality image data, and preloading one or more additional tiles of high quality image data into a preloader based on the tile of high quality image data.

Abstract: Aspects described herein relate to three-dimensional (3D) characters and rapidly generating 3D characters from a plurality of 3D source models. In generating the 3D characters, one or more 3D source models may be standardized, applied to a base mesh with material ID assignments, and decomposed to isolate particular polygonal mesh pieces and/or texture map feature selections denoted by the material IDs of the base mesh. The disparate isolated polygonal mesh pieces and/or texture map feature selections may be assembled in a modular fashion to compose unique 3D characters unlike any of those of the one or more 3D models. The 3D characters may be further refined through the addition of features and/or accessories, and may also be processed through machine learning algorithms to further ascertain uniqueness.

Abstract: Aspects of the present disclosure relate to in-air control regions. Communication between an electronic pen and a device can be established. Two or more in-air control regions above the device can be defined, each in-air control region specifying a set of functions that can be performed by the electronic pen. A determination can be made that the electronic pen is within a first in-air control region of the two or more in-air control regions, the first in-air control region specifying a first set of functions that can be performed by the electronic pen. In response to input received from the electronic pen within the first in-air control region, at least one function of the first set of functions can be executed.

Abstract: System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.

Abstract: A method includes: recording gameplay metadata generated from execution of a first session of a video game, wherein the execution of the first session renders a first view of a virtual environment of the video game for presentation through the first HMD, the first view being from a first location in the virtual environment determined by the interactive gameplay; after completion of the first session, storing the gameplay metadata to a cloud storage; receiving a request from a client device to spectate gameplay from the first session; responsive to the request, then retrieving the gameplay metadata from the cloud storage, and initiating execution of a second session of the video game using the gameplay metadata to recreate gameplay events from the first session in the second session, wherein the execution of the second session renders a second view of the virtual environment for presentation through a second HMD.

Abstract: Techniques associated with improving performance and realism of simulation instances associated with simulation testing of autonomous vehicles. In some cases, a simulation system may be configured to run a pre-simulation test to identify and store occlusion data to improve the performance of subsequent simulations associated with a shared scene or route.

Abstract: Systems and methods including one or more processors and one or more non-transitory storage devices storing computing instructions configured to run on the one or more processors and perform: generating a mask of an object using one or more images; generating a 3D model of the object using the mask of the object; facilitating displaying a 3D display of the object on an electronic device of a user using the 3D model; receiving, from the electronic device of the user, a zoom selection on the 3D display of the object; in response to receiving the zoom selection, facilitating displaying a zoomed 3D display of the object on the electronic device of the user; receiving, from the electronic device of the user, a zoom rotation selection of the object in the zoomed 3D display; and in response to receiving the zoom rotation selection, facilitating rotating the 3D display of the object in the zoomed 3D display on the electronic device of the user. Other embodiments are disclosed herein.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program retrieves an assembly and inspection plan for a product. The assembly and inspection plan includes a three-dimensional (3D) model of the product to be assembled. The program further creates an inspection task for an inspection operation in the assembly and inspection plan for the product. The program also associates the 3D model with the inspection task for the inspection operation.

Abstract: Systems, methods, and devices are disclosed for training a model. Media data is separated into one or more clusters, each cluster based on a feature from a first model. The media data of each cluster is sampled and, based on an analysis of the sampled media data, an accuracy of the media data of each cluster is determined. The accuracy is associated with the feature from the first model. Based on a subset dataset of the media data being outside a threshold accuracy, the subset dataset is automatically forwarded to a crowd source service. Verification of the subset dataset is received from the crowd source service, and the verified subset dataset is added to the first model.

Abstract: Global fluence estimators may be calculated on accelerators and processors for neutron and photon Monte Carlo transport. Monte Carlo random walk simulation may be performed on the processors and the calculation of a Volumetric-Ray-Casting (VRC) estimator may be offloaded to the accelerators. The VRC estimator may modify an expected-value estimator to extend a pseudo-particle ray along the direction of the emitted particle from source and collision event through not only the event volume, but also through all volumes that describe the problem geometry. Additionally, many pseudo-particle rays may be sampled per event, rather than just a single pseudo-particle ray per event, in order to provide more complete angular coverage.

Abstract: A system and method for planning a pathway through an anatomical luminal network of a patient including a computing device having at least one processor; a display device in communication with the computing device; and a user interface configured for display on the display device and configured to guide a user through a pathway planning procedure. The user interface includes a patient selection window configured to receive a user input to select a patient having CT image data on which to perform pathway planning; a target selection window configured to receive a user input to select at least one target from the CT image data; and an airway finder window configured to generate at least one pathway from the at least one target to an entry point of the anatomical luminal network in response to a user input.

Abstract: Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group task. During a shared group task session, each eyewear displays the same image. An eye tracker in each eyewear detects a portion of the image the respective user is gazing at. Each eyewear generates an indication of the portion of the respective image each eyewear user is gazing at. The indication is shared with the other eyewear, and the eyewear display indicates the portion of the image the other eyewear user is gazing at. This allows each eyewear user to see what the other user is gazing at when collaborating and visually observing the same image.

Abstract: In one implementation, a method of generating an affordance linked to an SR representation of an item is performed in a device including one or more processors, a non-transitory memory, and one or more displays. The method includes identifying an item; generating an affordance-item pair that corresponds to the item; detecting an input selecting the affordance-item pair; and displaying, on the one or more displays, a simulated reality (SR) environment that includes an SR representation of the item in response to detecting the user input selecting the affordance-item pair. In some implementations, the method includes obtaining an image data frame that includes the item.

Abstract: A system may perform head pose neutralization on an input mesh to produce a neutral mesh and/or determine blend shapes for the neutral mesh. The system may generate a neutral mesh based on an input mesh and a reference mesh and then generate a blend shape associated with the neutral mesh based at least in part on one or more reference neutral meshes and one or more corresponding reference blend shapes.

Abstract: In some implementations, a method of navigation mesh exploration is performed at a virtual agent operating system. The method includes: determining one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent; generating a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes candidate subsequent locations different from the first location; and in response to detecting movement of the virtual agent to a respective candidate subsequent location among candidate subsequent locations, generating a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location.

Abstract: Systems, apparatuses and methods may provide for technology to improve an appearance of objects that enter a viewable area of a 360-degree video. The technology may include a head mounted display (HMD), a viewport comprising a viewable area within the HMD, and a memory to store objects of interest not currently in the viewable area.

Abstract: A method includes: detecting an object in a first image; receiving a selection of the object depicted in the image; associating the object with a second device based on the selection; and, in response to the selection: recording a series of odometry data; estimating a location of the first device based on the odometry data; recording a series of images; estimating a location of the second device based on the images; calculating a first reference vector in the reference frame of the first device defining the location of the second device relative to the location of the first device; receiving, from the second device, a second reference vector; calculating a rotation and an offset between the reference vectors; and transforming the reference frame of the first device to a common reference based on the rotation and the offset.

Abstract: In an embodiment, a method includes: collecting usage and maintenance data for a rotorcraft at a computer of the rotorcraft; sending the usage and maintenance data to a fleet management server; generating individualized equipment data for the rotorcraft according to the usage and maintenance data at the fleet management server, the individualized equipment data including a lightweight digital representation of the rotorcraft and technical publications for the rotorcraft, the lightweight digital representation including mesh-based 3D visualizations of each component of the rotorcraft, the technical publications having views referencing the mesh-based 3D visualizations; sending the individualized equipment data to the computer of the rotorcraft; and persisting the individualized equipment data at the computer of the rotorcraft.

Abstract: A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

Abstract: Systems, methods, and devices for managing media storage and delivery, including obtaining, by a media access function (MAF), a glTF file corresponding to a scene; determining that the glTF file has a CBOR format; converting the glTF file into a converted glTF file having a JSON format using a first CBOR parser function implemented by the MAF; and obtaining media content corresponding to the scene based on the converted glTF file.

Abstract: There is provided a computerized system and method of generating a unique identification associated with a gemstone, usable for unique identification of the gemstone. The method comprises: obtaining one or more images of the gemstone, the one or more images captured at one or more viewing angles relative to the gemstone and to a light pattern, thus giving rise to a representative group of images; processing the representative group of images to generate a set of rotation-invariant values informative of rotational cross-correlation relationship characterizing the images in the representative group; and using the generated set of rotation-invariant values to generate a unique identification associated with the gemstone. The unique identification associated with the gemstone can be further compared with an independently generated unique identification associated with the gemstone in question, or with a class-indicative unique identification.

Abstract: In example embodiments, techniques are provided for calculating camera rotation using translations between sensor-derived camera positions (e.g., from GPS) and pairwise information, producing a sensor-derived camera pose that may be integrated in an early stage of SfM reconstruction. A software process of a photogrammetry application may obtain metadata including sensor-derived camera positions for a plurality of cameras for a set of images and determine optical centers based thereupon. The software process may estimate unit vectors along epipoles from a given camera of the plurality of cameras to two or more other cameras. The software process then may determine a camera rotation that best maps unit vectors defined based on differences in the optical centers to the unit vectors along the epipoles. The determined camera rotation and the sensor-derived camera position form a sensor-derived camera pose that may be returned and used.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.

Abstract: A method is provided for processing a video to be displayed on a head mounted display device mounted on a worker performing virtual work. A position, posture, and line of sight of the worker are acquired, and a three-dimensional model of a work object on which the worker performs virtual work and a three-dimensional model of the worker are displayed on a display screen according to the acquired position, posture, and line of sight. A distance visualization portion is displayed which linearly extends from a predetermined section of the three-dimensional model of the worker and connects the predetermined section and the three-dimensional model of the work object, to visualize a distance between the predetermined section and the work object.

Abstract: Implementations of the subject technology provides analyzing a recording of content. The subject technology generates metadata information based at least in part on the analyzing. The subject technology identifies, based at least in part on at least one of a user preference or a detected event, a region of interest or an object of interest in the recording of content. Based at least in part on the identified region of interest or object of interest, the subject technology generates a modified version of the recording of content. Further, the subject technology stores the modified version of the recording of content for subsequent playback on an electronic device.

Abstract: An apparatus can improve the accuracy of calculation of a defocus amount by determining, as a processing frequency, a frequency at which a difference between contrast values corresponding to respective defocus amounts is greater than a predetermined threshold.

Abstract: A system is comprised of one or more processors coupled to memory. The one or more processors are configured to receive image data based on an image captured using a camera of a vehicle and to utilize the image data as a basis of an input to a trained machine learning model to at least in part identify a distance of an object from the vehicle. The trained machine learning model has been trained using a training image and a correlated output of an emitting distance sensor.

Abstract: When generating a graphics processing output, a sequence of one or more of primitives to be processed when generating the output is assembled from a set of vertex indices provided for the output based on primitive configuration information provided for the output, each assembled primitive of the sequence of assembled primitives comprising an identifier for the primitive and a set of one or more vertex indices for the primitive. One or more attributes for vertices of the assembled primitives are then shaded and fetched based on the vertex indices of the assembled primitives. The assembled primitives including their shaded fetched vertex attribute(s) are then provided to later stages of the graphics processing pipeline for processing.

Abstract: A multi-dimensional fabric user interface is described herein. A remote server executes an operating system that provides a multi-dimensional fabric user interface for storing content for a particular user. The user can access content by manipulating the multi-dimensional fabric user interface through a graphical user interface displayed on a personal mobile computing device. The remote server also enables the user to enter a portal and travel to a virtual representation a second actual physical location from a virtual representation of a first actual physical location, and transfer an object or content from the virtual representation of the first actual physical location to the virtual representation of the second actual physical location. This initiates an operation relating to the one or more of objects and content, in response to the user picking up, transferring, and placing the one or more of objects and content.

Abstract: A lenticular display may be formed with convex curvature. The lenticular display may have a lenticular lens film with lenticular lenses that extend across the length of the display. The lenticular lenses may be configured to enable stereoscopic viewing of the display. To enable more curvature in the display while ensuring satisfactory stereoscopic display performance, the display may have stereoscopic zones and non-stereoscopic zones. A central stereoscopic zone may be interposed between first and second non-stereoscopic zones. The non-stereoscopic zones may have more curvature than the stereoscopic zone. To prevent crosstalk within the lenticular display, a louver film may be incorporated into the display. The louver film may have a plurality of transparent portions separated by opaque walls. The opaque walls may control the emission angle of light from the display, reducing crosstalk. The louver film may be interposed between the lenticular lens film and the display panel.

Abstract: Provided are a virtual livestreaming method, apparatus, and system, and a storage medium, relating to the technical field of livestreaming. The method is acquiring real feature data of a real subject, where the real feature data include motion data and face data of the real subject during a performance; determining target feature data of a virtual character according to the real feature data, where the virtual character is a preset animation model, and the target feature data include motion data and face data of the virtual character; determining video stream pushing data corresponding to the virtual character according to the target feature data; and sending the video stream pushing data corresponding to the virtual character to a target livestreaming platform, where the video stream pushing data is used for instructing the target livestreaming platform to display virtual livestreaming of the virtual character.