Abstract: A method for use in colourising a three-dimensional (3D) point cloud of an environment, the method including determining timing information indicative of a time of capture of a frame; identifying at least some 3D points of the point cloud in the frame based on the position of the camera and determining a local point cloud that captures a scene in the immediate vicinity of the camera, wherein a visibility check is performed on the local point cloud to determine points in the local point cloud that are visible from the perspective of the camera for a given frame; and determining a candidate colour for the at least some of the 3D points using a colour of a corresponding pixel in the frame extracted from the video data; and, assigning a colour to one or more points of the 3D point cloud using candidate colours obtained from multiple frames.

Abstract: In an aspect, an update unit can evaluate condition(s) in an update request and update one or more memory locations based on the condition evaluation. The update unit can operate atomically to determine whether to effect the update and to make the update. Updates can include one or more of incrementing and swapping values. An update request may specify one of a pre-determined set of update types. Some update types may be conditional and others unconditional. The update unit can be coupled to receive update requests from a plurality of computation units. The computation units may not have privileges to directly generate write requests to be effected on at least some of the locations in memory. The computation units can be fixed function circuitry operating on inputs received from programmable computation elements. The update unit may include a buffer to hold received update requests.

Abstract: a device and a method are disclosed to detect obstructed objects, usually behind a wall or other similar surface. The device may be used by dragging it across the surface of the wall to scan, detect and display the objects behind the wall. The types of hidden objects and materials they are made of vary and may include wooden or metal studs used in building construction, electrical AC or DC wires and conduits, metal rebar and the like. Each type of material may need a different type of sensor to be detected. In some examples, the device may include memory to record the objects detected and display them on the screen in a persistent manner. The objects may be displayed via graphics that are similar to the real objects that were detected. In effect, the device may display a picture of what is hidden behind the wall.

Abstract: Aspects of the subject disclosure may include, for example, presenting a first virtual object in accordance with a first context associated with a first user engaged in a communication session via a first application, presenting a second virtual object in accordance with a second context associated with a second user engaged in the communication session via a second application, identifying a conflict between the presenting of the first virtual object and the presenting of the second virtual object, a presenting of a physical object, or a combination thereof, and responsive to the identifying of the conflict, modifying the first virtual object, the second virtual object, or a combination thereof. Other embodiments are disclosed.

Abstract: Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.

Abstract: Systems and methods are disclosed for recommending products or services by receiving a three-dimensional (3D) model of one or more products; performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment; and projecting the product in the environment.

Abstract: Disclosed herein are a learning-based three-dimensional (3D) model creation apparatus and method. A method for operating a learning-based 3D model creation apparatus includes generating multi-view feature images using supervised learning, creating a three-dimensional (3D) mesh model using a point cloud corresponding to the multi-view feature images and a feature image representing internal shape information, generating a texture map by projecting the 3D mesh model into three viewpoint images that are input, and creating a 3D model using the texture map.

Abstract: A system includes a processing system and memory system configured to apply a building detection model to identify a footprint of a building based on a first dataset. The building characterization model is applied to identify one or more derived characteristics of the building based on the footprint. A building area is determined based on the footprint and at least one of the one or more derived characteristics of the building. A record is created including an indicator of a geographic area, the building area, and the one or more derived characteristics of the building. A processing request is generated based on the record. One or more derived characteristics of the building are compared with one or more corresponding values of property data from a third-party data source to identify a mismatch. A data accuracy verification request is output based on the mismatch.

Abstract: The disclosure describes artificial reality systems and techniques for providing artificial reality content to a user. For example, an artificial reality system includes a head-mounted display (HMD) configured to output artificial reality content, the HMD including a set of second image capture devices configured to capture image data indicative of a focal point of a gaze of the user and a varifocal display having a focal length that is modifiable based on the focal point of the user. Additionally, the system includes a depth engine configured to generate, based on the real-world image data and depth data associated with the real-world image data, a three-dimensional (3D) scene of the physical environment of the user and generate artificial reality content as an overlay to the 3D scene of the physical environment for display on the varifocal display of the HMD based on the focal point of the user.

Abstract: Several embodiments of scalable image processing systems and methods are disclosed herein whereby color management processing of source image data to be displayed on a target display is changed according to varying levels of metadata.

Abstract: A method for detection of deviations in packaging containers is disclosed, comprising creating a virtual model of a packaging container in a virtual coordinate system (x, y, z), defining a deformation zone on a surface of the virtual model, creating a defined deviation in the deformation zone having a defined geometry and coordinates in the virtual coordinate system (x, y, z) to create a controlled deformation of the virtual model, producing an image rendering of the virtual model with said controlled deformation to generate image features representing a deviation in the packaging container, associating the image features with different categories of deviations, and inputting the image features to a machine learning-based model for subsequent detection of categories of deviations in packaging containers in a packaging machine based on the image features. A system for detection of deviations is also disclosed.

Abstract: A graphics processing unit (GPU) includes a packet management component that automatically aggregates data from input packets. In response to determining that a received first input packet does not indicate a send condition, and in response to determining that a generated output packet would be smaller than an output size threshold, the packet management component aggregates data corresponding to the first input packet with data corresponding to a second input packet stored at a packet buffer. In response to determining that a received third input packet indicates a send condition, the packet management component sends the aggregated data to a compute unit in an output packet and performs an operation indicated by the send condition.

Abstract: First and second skeleton model data is determined based on first and second surface data of a patient. Each of the skeleton model data describes geometries of rigid anatomic structures of a patient at a different point in time. Skeleton difference data is determined describing differences between the geometries of the rigid anatomic structures. In a next step, movement instruction data is determined which describes movement to be performed by the rigid anatomic structures to minimize the differences, i.e. to correct the posture of the patient. The movement instruction data is for example determined based on anatomy constraint data which describes anatomical movement constraints for the rigid anatomic structures (e.g. range of motion of a joint). An instruction is displayed (e.g. using augmented reality), guiding the user how to move the rigid anatomic structures so as to correct the patient's posture.

Abstract: The disclosure notably relates to a computer-implemented method for forming a dataset configured for learning a neural network. The neural network is configured for inference, from a discrete geometrical representation of a 3D shape, of an editable feature tree representing the 3D shape. The editable feature tree comprises a tree arrangement of geometrical operations applied to leaf geometrical shapes. The method includes obtaining respective data pieces, and inserting a part of the data pieces in the dataset each as a respective training sample. The respective 3D shape of each of one or more first data pieces inserted in the dataset is identical to the respective 3D shape of respective one or more second data pieces not inserted in the dataset. The method forms an improved solution for digitization.

Abstract: A texture filtering unit includes a datapath block and a control block. The datapath block includes one or more parallel computation pipelines, each containing at least one hardware logic component configured to receive a plurality of inputs and generate an output value as part of a texture filtering operation. The control block includes a plurality of sequencers and an arbiter. Each sequencer executes a micro-program that defines a sequence of operations to be performed by the one or more pipelines in the datapath block as part of a texture filtering operation and the arbiter controls access, by the sequencers, to the one or more pipelines in the datapath based on predefined prioritization rules.

Abstract: Disclosed is a method to derive the absorption coefficient, transparency, and/or the scattering coefficient from the user-specified parameters including roughness, phase function, index of refraction (IOR), and color by performing the simulation once, and storing the results of the simulation in an easy to retrieve representation, such as a lookup table, or an analytic function. To create the analytic function, one or more analytic functions can be fitted to the results of the simulation for the multiple parameters including roughness, phase function, IOR, and color. The lookup table can be combined with the analytic representation. For example, the lookup table can be used to represent the color, roughness, and phase function, while the IOR can be represented by an analytic function. For example, when the IOR is above 2, the lookup table becomes three-dimensional and the IOR is calculated using the analytic function.

Abstract: Disclosed is a method to derive the absorption coefficient, transparency, and/or the scattering coefficient from the user-specified parameters including roughness, phase function, index of refraction (IOR), and color by performing the simulation once, and storing the results of the simulation in an easy to retrieve representation, such as a lookup table, or an analytic function. To create the analytic function, one or more analytic functions can be fitted to the results of the simulation for the multiple parameters including roughness, phase function, IOR, and color. The lookup table can be combined with the analytic representation. For example, the lookup table can be used to represent the color, roughness, and phase function, while the IOR can be represented by an analytic function. For example, when the IOR is above 2, the lookup table becomes three-dimensional and the IOR is calculated using the analytic function.

Abstract: An information processing apparatus includes a generation unit and an instruction unit. The generation unit generates a display image including information on speech or action of a target person, based on history information that the target person has made speech or action. The instruction unit instructs a display device, which displays an image of a virtual space so as to be superimposed in a real space, to display the generated display image as the image of the virtual space.

Abstract: An electronic device is configured to performing a three-dimensional (3D) scan of an interior space. In some cases, the electronic device acquires information and depth measurements relative to the electronic device. The electronic device acquires voxels in a 3D grid that is generated from the 3D scan. The voxels represent portions of the volume of the interior space. The electronic device determines a trajectory and poses of the electronic device concurrently with performing the 3D scan of the interior space. The electronic device labels voxels representing objects in the interior space based on the trajectory and the poses. In some cases, the electronic device uses queries to perform spatial reasoning at an object level of granularity, positions, overlays, or blends virtual objects into an augmented reality representation of the interior space or modifies positions or orientations of the objects by applying a transformation to corresponding connected components.

Abstract: The present disclosure provides a method for displaying a three-dimensional space view. The three-dimensional space view includes a first three-dimensional space view and a second three-dimensional space view. The method includes presenting the first three-dimensional space view on a first user interface; presenting the second three-dimensional space view on a second user interface; changing the first three-dimensional space view according to a user input; and changing the second three-dimensional space view according to a change in the first three-dimensional space view.