Abstract: A computer-implemented method in conjunction with mixed reality gear (e.g., a headset) includes imaging a real scene encompassing a user wearing a mixed reality output apparatus. The method includes determining data describing a real context of the real scene, based on the imaging; for example, identifying or classifying objects, lighting, sound or persons in the scene. The method includes selecting a set of content including content enabling rendering of at least one virtual object from a content library, based on the data describing a real context, using various selection algorithms. The method includes rendering the virtual object in the mixed reality session by the mixed reality output apparatus, optionally based on the data describing a real context (“context parameters”). An apparatus is configured to perform the method using hardware, firmware, and/or software.

Abstract: Provided is a display device for an industrial machine capable of automatically switching between augmented reality display and 3D computer graphics display. A robot display device 2 comprises: a camera 2b; a display unit 20 capable of switching between a first display by means of 3D computer graphics for a robot 3 or for the robot 3 and peripherals 4 thereof, and a second display using augmented reality for the robot 3 and the peripherals 4 thereof captured by the camera 2b; and a selection unit 21 that activates the first display and displays the first display on the display unit when the camera 2b does not face the robot and the peripherals 4 thereof, and activates the second display and displays the second display on the display unit 20 when the camera 2b faces the robot 3 and the peripherals 4 thereof.

Abstract: An information processing device includes: a foldable one display; a memory which stores at least a program; and a processor. By executing the program stored in the memory, the processor performs display mode switching processing to switch among a first display mode to control display in such a manner that a screen area of the display is set as one display area, a second display mode to control display in such a manner that the screen area of the display is split into two display areas of a first display area and a second display area with the first display area set as a primary screen and the second display area set as a secondary screen, and a third display mode to control display in such a manner that the second display area is set as the primary screen and the first display area is set as the secondary screen.

Abstract: Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object. upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.

Abstract: The disclosure relates to a soil distribution planning system. The soil distribution planning system according to an embodiment includes a grid-model generation module configured to receive information about three-dimensional (3D) topography, ground and a target model and generate a 3D grid model by dividing a target area; an earthwork-volume calculation module configured to calculate an earthwork volume of each grid model generated by the grid-model generation module and store the calculated earthwork volume in a database; and an earthwork-volume distribution module configured to distribute the earthwork volume of a cutting area to a banking area based on the earthwork volume stored in the database.

Abstract: A method for virtually representing human body poses includes receiving positioning data detailing parameters of one or more body parts of a human user based at least in part on input from one or more sensors. One or more mapping constraints are maintained that relate a model articulated representation to a target articulated representation. A model pose of the model articulated representation and a target pose of the target articulated representation are concurrently estimated based at least in part on the positioning data and the one or more mapping constraints. The previously-trained pose optimization machine is trained with training positioning data having ground truth labels for the model articulated representation. The target articulated representation is output for display with the target pose as a virtual representation of the human user.

Abstract: A method, system, and non-transitory computer readable storage medium for rasterizing primitives are disclosed. The method, system, and non-transitory computer readable storage medium includes: generating a primitive batch from a sequence of one or more primitives, wherein the primitive batch includes primitives sorted into one or more row groups based on which row of a plurality of rows each primitive intersects; and processing each row group, the processing for each row group including: identifying one or more primitive column intercepts for each of the one or more primitives in the row group, wherein each combination of primitive column intercept and row identifies a bin; and rasterizing the one or more primitives that intersect the bin.

Abstract: A control device for a working machine includes a position designation receiving unit configured to identify a designated position in a state image which is displayed on a display panel and a screen control unit configured to perform screen control based on an image displayed at the identified position out of part images constituting parts of the state image.

Abstract: Disclosed are apparatuses, systems, and techniques to render images with global illumination using efficient ray tracing, light source identification, and reservoir resampling that deploys temporal and spatial reservoirs.

Abstract: A vehicle data display system includes an electronic display installed within a vehicle, a 3-D sensor and an electronic controller. The 3-D sensor configured to scan areas forward of and along lateral sides of the vehicle producing point cloud. Each data point of the cloud data corresponding to a surface portion of a physical feature. Each data point includes distance, direction and vertical location of each surface point. The electronic controller is connected to the electronic display and the 3-D sensor. The electronic controller receives and evaluates the point cloud from the 3-D sensor generating a 3-D model of detected ones of the physical features around the vehicle including ground surfaces, non-drivable features and driving limiting features relative to the vehicle. The non-drivable features are features that have predetermined geometric relationships with adjacent ground surfaces such that caution is to be taken when driving over or on driving limiting features.

Abstract: An apparatus for generating an emoji includes an analyzer that is configured to, in response to an utterance of a user being input, acquire at least one of context information or information about a sentiment of the user. AN emoji generator generates a new emoji based on emoji generation information including information related to at least two among the context information, the information about the sentiment of the user, and information about an intent of the user corresponding to the utterance. The emoji generator is configured to select a plurality of emojis that match the emoji generation information from among a plurality of stored emojis and combine at least some of the plurality of emojis to generate the new emoji.

Abstract: Simulation sighting binoculars include a camera, a screen, a pair of lenses which are arranged to face the screen, and electronic circuitry which is configured to: obtain a video frame from the camera; transmit, to a simulation platform, geolocation information and orientation information for the camera; receive simulation graphical elements and spatial positioning information for corresponding virtual objects; carry out a two-dimensional rendering of the virtual objects, in order to display them in a projection window E2; superimpose the two-dimensional rendering of the virtual objects in the projection window E2 and the video frame in a projection window E3; obtain a mixed-reality stereoscopic image using a pair of virtual cameras reproducing binocular vision which is adapted to the pair of lenses; and carry out, on the screen, a right-eye and left-eye display of the obtained mixed-reality stereoscopic image.

Abstract: Methods and systems are described that enable three-dimensional (3D) imaging of objects. One example system includes a light source that produces multiple light beams having specific spectral content and polarization states. The system also includes phase masks that modify the intensity or phase of the light, and projection optics that allow simultaneously projection of at least three fringe patterns onto an object having particular phase, polarization and spectral characteristics. The detection system includes a camera that simultaneously receives light associated with the at the fringe patterns upon reflection from the object, and a processing unit coupled to the camera unit that determines one or both of a phase or a depth information associated with the object. The system and associated methods can efficiency produce 2D images of the object and allow determination of characteristics such as surface profile. The disclosed systems and methods can be effectively implemented with moving objects.

Abstract: A three dimensional (3D) backshell component is flattened to a two dimensional (2D) representation while maintaining a connected wiring component in 3D. Sketch segments for a curved 3D backshell connected first route segment within the backshell housing are stored. A first tangent is computed for a first entry point at a first end point of the connected first route segment, and a flattened route is calculated for route segments unconnected to the backshell. A flattened route position and a second tangent are calculated for a second route segment connected with the first route segment at a second entry point corresponding to the first entry point. The first entry point and the second entry point are aligned, and the first tangent and the second tangent are aligned, and the flattened unconnected route segment aligned with the 3D backshell component is displayed.

Abstract: An extended reality (XR) system receives capture information from a first camera with a first image sensor that faces a first direction, for instance facing an environment. The capture information is associated with capture of first image data by the first image sensor, for instance including the first image data and/or first image capture settings used to capture the first image data. The XR system determines an image capture setting, such as an exposure setting, for a second image sensor based on the capture information. The second image sensor faces second direction, for instance facing a user of the XR system. In some examples, the XR system determines the image capture setting also based on information from a display buffer for a display that faces the second direction. The XR system causes a second image sensor to capture second image data according to the image capture setting.

Abstract: A method, computer system, and a non-transitory computer-readable storage medium for performing primitive batch binning are disclosed. The method, computer system, and non-transitory computer-readable storage medium include techniques for generating a primitive batch from a plurality of primitives, computing respective bin intercepts for each of the plurality of primitives in the primitive batch, and shading the primitive batch by iteratively processing each of the respective bin intercepts computed until all of the respective bin intercepts are processed.

Abstract: Provided are a method for training a font generation model, a method for establishing a font library, and a device. The method for training a font generation model includes the following steps. A source-domain sample character is input into the font generation model to obtain a first target-domain generated character. The first target-domain generated character is input into a font recognition model to obtain the target adversarial loss of the font generation model. The model parameter of the font generation model is updated according to the target adversarial loss.

Abstract: In an image generation apparatus, an image acquisition unit is configured to acquire, from at least one camera operable to capture an image of surroundings of a vehicle, a captured image. A bird's-eye view image generation unit is configured to generate a bird's-eye view image from the captured image. A three-dimensional object recognition unit is configured to recognize a three-dimensional object in the captured image. A superimposition-image acquisition unit is configured to acquire a superimposition image that represents the three-dimensional object recognized by the three-dimensional object recognition unit, by performing a process depending on a type of the three-dimensional object recognized by the three-dimensional object recognition unit. A superimposition unit is configured to superimpose, onto the bird's-eye view image, the superimposition image acquired by the superimposition-image acquisition unit, at a position where the three-dimensional object is present in the bird's-eye view image.

Abstract: Apparati, methods, and computer readable media for inserting identity information from a source image (static image or video) (301) into a destination video (302), while mimicking motion of the destination video (302). In an apparatus embodiment, an identity encoder (304) is configured to encode identity information of the source image (301). When source image (301) is a multi-frame static image or a video, an identity code aggregator (307) is positioned at an output of the identity encoder (304), and produces an identity vector (314). A driver encoder (313) is coupled to the destination (driver) video (302), and has two components: a pose encoder (305) configured to encode pose information of the destination video (302), and a motion encoder (315) configured to separately encode motion information of the destination video (302). The driver encoder (313) produces two vectors: a pose vector (308) and a motion vector (316).

Abstract: Embodiments of the present disclosure provide methods and systems for broadcasting virtual performance. Motion data related to a performer is received from one or more sensors during a physical performance of the performer. The motion data is processed to animate movements of at least one virtual character. A virtual performance corresponding to the physical performance is generated based, at least in part, on the animated movements of the virtual character. The virtual performance is broadcasted to a viewer device for performing a playback of the virtual performance. The virtual performance simulates an experience of viewing the physical performance for the viewer.