Abstract: One example provides a computing device configured to capture, via the camera, first image data imaging a first physical world location, create a first spatial representation of the first physical world location based on the first image data, receive a user input defining a pose of a first virtual spatial anchor point relative to a feature imaged in the first image data, track user movement to a second physical world location, capture second image data imaging the second physical world location, receive a user input defining a pose of a second virtual spatial anchor point relative to a feature imaged in the second image data, and send, to a remote computing device, data representing the first spatial representation, the pose of first spatial anchor point, the second spatial representation, the pose of second spatial anchor point, and a positional relationship between first and second spatial anchor points.

Abstract: Computerized systems, methods, apparatuses, and computer-readable storage media are provided for generating a 3D map of an environment and/or for utilizing the 3D map to enable a user to control smart devices in the environment and/or to interact with a person in the environment. To generate the 3D map, perform the control, and/or interact with the person, a plurality of neuromuscular sensors may be worn by the user. The sensors may be arranged on a carrier worn by the user, and may be configured to sense neuromuscular signals from the user. A camera configured to capture information about the environment may be arranged on the carrier worn by the user. The sensors and the camera provide data to a computer processor coupled to a memory.

Abstract: A personalized scene image processing method is provided for a terminal device. The method includes acquiring, according to a touch event triggered in a screen region of the terminal device, a trajectory of the touch event in the screen region; generating a virtual model, according to a projection of the trajectory of the touch event in a space coordinate system; reconstructing a model view of the virtual model mapped within a field of view of the terminal device, according to a position and posture of the terminal device in the space coordinate system; and overlaying a scene image acquired by the terminal device in the position and posture with the model view to obtain a personalized scene image.

Abstract: Systems and methods of generating landing solutions for containers onto landing surfaces using multiple measurement points generated by a measuring device or multiple measuring devices are described. In particular, methods of analyzing the plurality of measurement and from the analysis of the data, determining the location and orientation, in the container handling equipment's frame of reference, of where to place a shipping container onto a landing surface present within the equipment's workspace are described. This location can then be used by the equipment's automation system to automatically place the shipping container onto the landing surface without the need for human input, or relatively little human interaction or input. The systems and methods are applicable to operating in a landside transfer zone as well as outside such zone, and as such would be applicable to install on any container handling equipment which can land containers on equipment from above.

Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: An information processing apparatus for correcting a shift between a first three-dimensional position in an image capturing region that is identified based on a position of a first feature point on a first image and a second three-dimensional position in an image capturing region that is identified based on a position of a second feature point corresponding to the first feature point on a second image.

Abstract: Certain embodiments involve visually augmenting images of three-dimensional containers with virtual elements that fill one or more empty regions of the three-dimensional containers. For instance, a computing system receives a first image that depicts a storage container and identify sub-containers within the storage container. The computing system selects, from a virtual object library, a plurality of virtual objects that are semantically related to the sub-container. The computing system determines an arrangement of the virtual objects within the sub-container based on semantics associated with the sub-container and the plurality of virtual objects. The computing system generates a second image that depicts the arrangement of the plurality of virtual objects within the storage container and sub-containers. The computing system generates, for display, the second image depicting the storage container and the arrangement of the virtual objects.

Abstract: Embodiments include systems and methods for remotely measuring distances in an environment captured by a device. A device captures a video stream of a device along with AR data that may include camera pose information and/or depth information, and transmits the video stream and AR data to a remote device. The remote device receives a selection of a first point and a second point within the video stream and, using the AR data, calculates a distance between the first and second points. The first and second points may be at different locations not simultaneously in view of the device. Other embodiments may capture additional points to compute areas and/or volumes.

Abstract: In an embodiment, a 3D facial modeling system includes a plurality of cameras configured to capture images from different viewpoints, a processor, and a memory containing a 3D facial modeling application and parameters defining a face detector, wherein the 3D facial modeling application directs the processor to obtain a plurality of images of a face captured from different viewpoints using the plurality of cameras, locate a face within each of the plurality of images using the face detector, wherein the face detector labels key feature points on the located face within each of the plurality of images, determine disparity between corresponding key feature points of located faces within the plurality of images, and generate a 3D model of the face using the depth of the key feature points.

Abstract: Provided are a control device, a control method, and a mobile object that enable distinction among positions and accurate estimation of a self-position even in an environment where different positions include many similar feature amounts in surroundings and are thus likely to be erroneously detected as being the same position. In accordance with a place corresponding to the self-position, an image feature amount is extracted from an image of surroundings to which a mask has been added on the basis of a place-related non-feature portion representing an area, in the image of the surroundings, that is not useful for identifying the self-position, and the image feature amount and positional information regarding the self-position are associated with each other and registered in a position/image feature amount database (DB).

Abstract: Some implementations of this application are directed to a server system including one or more CPUs, a plurality of GPUs, main dynamic memory storing programs and data for use by the CPUs and/or GPUs during program execution, a static memory pool stored in a non-volatile memory, and a memory controller configured to manage the static memory pool. Each of the GPUs includes a local cache and is configured to access the static memory pool via the memory controller. The server system executes a plurality of gaming sessions for a gaming title in parallel on the one or more CPUs. Each of the plurality of gaming sessions is associated with a static data item stored in the static memory pool, and requires a graphics operation executable by a respective GPU using the static data item.

Abstract: Provided are a method, a storage medium and an apparatus for converting a 2D picture set to a 3D model. The method includes: identifying the category of each object contained in each picture in the 2D picture set and outline information of each object by using a deep learning algorithm; extracting detail characteristic information of each object in each picture in the 2D picture set by using a computer vision algorithm, wherein the detail feature information at least includes texture information, color feature information and shape feature information of each object; matching the 3D model based on the category, the shape feature information and the outline information of each object, wherein the 3D model matched successfully is the 3D model of the object; and mapping the texture information and the color feature information of each object onto the 3D model of each object.

Abstract: Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and a first sensor is used to detect that a gaze has shifted from a first portion of the extended reality environment to a second portion of the extended reality environment, where the object is excluded from the first portion of the extended reality environment and included in the second portion of the extended reality environment. An indicator of the shift in the gaze is generated for display within the extended reality environment in response to detecting the gaze shift, and a voice command is detected by a second sensor while the indicator is in a vicinity of the object. In response to detecting the voice command, an action corresponding to the voice command may be executed.

Abstract: Vector format based computer graphics tools have become very powerful tools allowing artists, designers etc. to mimic many artistic styles, exploit automated techniques, etc. and across different simulated physical media and digital media. However, hand-drawing and sketching in vector format graphics is unnatural and a user's strokes rendered by software are generally unnatural and appear artificial. In contrast to today's hand-drawing and sketching which requires significant training of and understanding by the user of complex vector graphics methods embodiments of the invention lower the barrier to accessing computer graphics applications for users in respect of making hand-drawing or sketching easier to perform. Accordingly, the inventors have established a direct vector-based hand-drawing/sketching entry format supporting any input methodology.

Abstract: An apparatus comprises a store (209) storing a set of anchor poses for a scene, as well as typically 3D image data for the scene. A receiver (201) receives viewer poses for a viewer and a render pose processor (203) determines a render pose in the scene for a current viewer pose of the viewer pose where the render pose is determined relative to a reference anchor pose. A retriever (207) retrieves 3D image data for the reference anchor pose and a synthesizer (205) synthesizes images for the render pose in response to the 3D image data. A selector selects the reference anchor pose from the set of anchor poses and is arranged to switch the reference anchor pose from a first anchor pose of the set of anchor poses to a second anchor pose of the set of anchor poses in response to the viewer poses.

Abstract: A method, a computer program product, and a computer system guide a user through dimensional relationships. The method includes receiving a plurality of images of a unit of a perspective of a user. When a number of corresponding three-dimensional points between a current image and a previous image is less than a registration threshold to perform a three-dimensional registration operation, the method includes performing a three-dimensional data augmentation operation based on two-dimensional data from the current image and the previous image to generate extended corresponding three-dimensional points. The method includes determining a three-dimensional transform function between the current image and the previous image based on the extended corresponding three-dimensional points.

Abstract: A method for updating camera poses includes receiving a set of captured depth maps associated with a scene and detecting a first shape and a second shape present in the scene. The method also includes, for each of the first shape and the second shape, creating a 3D mesh, creating a virtual camera associated with the 3D mesh, and rendering a depth map associated with the virtual camera. The method further includes identifying a subset of the captured depth maps such that each captured depth map in the subset contains at least a portion of either the first shape or the second shape. The method additionally includes updating the physical camera poses by jointly solving for the physical camera poses by optimizing an alignment between the first depth map, the second depth map, and the subset of the set of captured depth maps.

Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.

Abstract: An information processing apparatus includes a first display screen, a second display screen, a detection unit, and a display controller. The detection unit detects switching between the first mode and the second mode. The first mode is a mode in which information is displayed on the first display screen. The second mode is a mode in which information is displayed on the first display screen and the second display screen. The display controller controls whether enlarged display or additional display is performed in accordance with a change in the orientation of the first display screen or an operation of specifying the information displayed on the first display screen. The change or the operation is performed in a certain time including a time point at which the detection unit detects switching from the first mode to the second mode.

Abstract: A user-guidance system that utilizes augmented-reality (AR) components and human-posture-detection techniques is presented. The user-guidance system can help users to use smart devices to conduct 3D body scans more efficiently and accurately. AR components are computer generated for the on-screen guidance to guide a camera operator to position the camera in a particular location in relation to a target object with a particular tilt orientation in relation to the target object to capture an image that includes a region of the target object for 3D reconstruction of the target object. Human-posture-detection techniques are used to detect a human user's real-time posture and provide real-time on-screen guidance feedback and instructions to the human user to adopt an intended best posture for 3D reconstruction of the human user.