Abstract: The present invention relates to a device, method, and smart glasses for color vision deficiency correction. The method includes: adjusting a color of an image according to an environmental color temperature to obtain an adjusted image, and then adjusting a pixel level of the adjusted image to a preset pixel level according to image content, to obtain a to-be-processed image; determining an adjustment matrix based on an RGB value of the to-be-processed image and a preset RGB target value; comparing a color displayed on a display with a color of a standard colorimetric card for correction, to determine an adjustment mapping table; and generating a target image based on the to-be-processed image, the adjustment matrix, and the adjustment mapping table. The present invention increases the degree of color recognition and improves imaging effects, and can implement good color vision deficiency correction.

Abstract: A method and system are provided for enabling a shared augmented reality experience. The system may include one or more onsite devices for generating AR representations of a real-world location, and one or more offsite devices for generating virtual AR representations of the real-world location. The AR representations may include data and/or content incorporated into live views of a real-world location. The virtual AR representations of the AR scene may incorporate images and data from a real-world location and include additional AR content. The onsite devices may synchronize content used to create the AR experience with the offsite devices in real time, such that the onsite AR representations and the offsite virtual AR representations are consistent with each other.

Abstract: In one embodiment, a method includes adjusting parameters of a three-dimensional geometry corresponding to a first person to make the three-dimensional geometry represent a desired pose for the first person, accessing a neural texture encoding an appearance of the first person, generating a first rendered neural texture based on a mapping between (1) a portion of the three-dimensional geometry that is visible from a viewing direction and (2) the neural texture, generating a second rendered neural texture by processing the first rendered neural texture using a first neural network, determining normal information associated with the portion of the three-dimensional geometry that is visible from the viewing direction, and generating a rendered image for the first person in the desired pose by processing the second rendered neural texture and the normal information using a second neural network.

Abstract: In one embodiment, one or more computing systems may receive an image of a portion of a face of a first user. The one or more computing systems may access a three-dimensional (3D) facial model representative of the face of the first user. The one or more computing systems may identify one or more facial features captured in the image and determine a camera pose relative to the 3D facial model based on the identified one or more facial features in the image and predetermined feature locations on the 3D facial model. The one or more computing systems may determine a mapping relationship between the image and the 3D facial model by projecting the image of the portion of the face of the first user onto the 3D facial model from the camera pose and cause an output image of a facial representation of the first user to be rendered.

Abstract: Methods and apparatus to generate photo-realistic three-dimensional models of a photographed environment are disclosed. An apparatus includes an object position calculator to determine a three-dimensional (3D) position of an object detected within a first image of an environment and within a second image of the environment. The apparatus further includes a 3D model generator to generate a 3D model of the environment based on the first image and the second image. The apparatus also includes a model integrity analyzer to detect a difference between the 3D position of the object and the 3D model. The 3D model generator automatically modifies the 3D model based on the difference in response to the difference satisfying a confidence threshold.

Abstract: According to one embodiment, a display and a sensor signal acceptor which accepts detection signals from a sensor are provided. A first display controller displays a first instruction for instructing a first work on the display, based on the detection signal which indicates an end of preparation for the first work. And, a second display controller displays a second instruction for instructing a next second work on the display, based on the detection signal which indicates an end of the first work.

Abstract: A method (300) includes receiving a first facial framework (144a) and a first captured image (130a) of a face (20). The first facial framework corresponds to the face at a first frame and includes a first facial mesh (142a) of facial information (140). The method also includes projecting the first captured image onto the first facial framework and determining a facial texture (212) corresponding to the face based on the projected first captured image. The method also includes receiving a second facial framework (144b) at a second frame that includes a second facial mesh (142b) of facial information and updating the facial texture based on the received second facial framework. The method also includes displaying the updated facial texture as a three-dimensional avatar (160). The three-dimensional avatar corresponds to a virtual representation of the face.

Abstract: A control system for controlling an operation of an elevator arranged to service different floors of a building, is disclosed. The control system comprises an input interface configured to receive a measurement of a distance metric to an object located at a service floor in a line-of-sight of a sensor; an output interface configured to cause a display device to display a floor value indicating a destination floor; and a processor configured to compare the received distance metric with a referenced distance metric to estimate a sign of the comparison and a value of the comparison; repeatedly update, until a termination condition is met, the floor value displayed on the display device in a direction of the elevator service indicated by the sign and with a frequency of the update indicated by the value; and cause the elevator to perform the service operation from the service floor to the destination floor.

Abstract: In a general aspect, a method can include receiving data defining an augmented reality (AR) environment including a representation of a physical environment, and changing tracking of an AR object within the AR environment between region-tracking mode and plane-tracking mode.

Abstract: The present method and system provides for interacting with a display device including accessing an external content database having images stored therein, and storing a plurality of the images to a local memory device associated with the display device. The method and system includes displaying a user interface screen on the output display of the display device and detecting, via at least one of a plurality environmental sensors, a user gesture external to the display device, the user gesture engaging in a commercial transaction relating to the display of at least one of the plurality of images on the output display. The method and system includes accessing a financial services processing system, verifying user acknowledgement of the commercial transaction, and updating the output display based on the interface command.

Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.

Abstract: Methods and apparatus to facilitate 3D object visualization and manipulation across multiple devices are disclosed. Example apparatus disclosed herein include a viewpoint determiner, a visible shard determiner, and a laminate assembler. The viewpoint determiner determines a viewpoint location of a viewpoint corresponding to a viewing device, the viewpoint location being in a reference frame of a three-dimensional (3D) model. The visible shard determiner determines a visible shard set of the 3D model based on the viewpoint location. The laminate assembler generates a two-dimensional (2D) image of the visible shard set.

Abstract: A head-mounted display (HMD) 1, which is operated by a gesture operation performed by a user 3, is provided with a distance image acquisition unit 106 that detects a gesture operation, a position information acquisition unit 103 that acquires position information of the HMD 1, and a communication unit 2 that performs communication with another HMD 1?. A control unit 205 sets and displays an operating space 600 where a gesture operation performed by the user 3 is valid, exchanges position information and operating space information of the host HMD 1 and the other HMD 1 therebetween by the communication unit 2, and adjusts the operating space of the host HMD so that the operating space 600 and an operating space 600? of the other HMD 1 do not overlap each other.

Abstract: A method and an apparatus for compressing the three-dimensional data of a point cloud are disclosed. The present invention comprises, identifying a plurality of points constituting a point cloud, and projecting the plurality of identified points onto a projection plane so as to generate a projection image, wherein the bit number of projection points corresponding to the plurality of points projected in the projection image is determined on the basis of the distance between a first point closest to the projection plane and a second point farthest therefrom, on a normal with respect to the projection plane, among the plurality of points and/or on the basis of the number of intermediate points located between the first point and the second point.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing one or more neural networks to recursively subdivide a three-dimensional mesh according to local geometries of vertices in the three-dimensional mesh. For example, the disclosed system can determine a local geometry (e.g., a one-ring neighborhood of half-flaps) for each vertex in a three-dimensional mesh. For each subdivision iteration, the disclosed system can then utilize a neural network to determine displacement coordinates for existing vertices in the three-dimensional mesh and coordinates for new vertices added to edges between the existing vertices in the three-dimensional mesh in accordance with the local geometries of the existing vertices. Furthermore, the disclosed system can generate a subdivided three-dimensional mesh based on the determined displacement coordinates for the existing vertices and the determined coordinates for the new vertices.

Abstract: A computer simulation technology that processes 2D clothing patterns and thus creates digital clothing. The purpose of the present disclosure is to easily adjust a length of another segment to be sewn the same as a length of a selected segment on a pattern when free-sewing.

Abstract: The present disclosure provides a method for generating a 3D digital model used in hairpiece manufacturing is provided, which comprises: obtaining an initial 3D model of a head; identifying an outline of a target area to be covered by a hairpiece on the initial 3D model; and cutting the initial 3D model based at least partially on the target area to obtain a refined 3D model. A physical mold used in hairpiece manufacturing and a method for generating the same are also provided according to other aspects of the present disclosure.

Abstract: A three-dimensional (3D) object reconstruction neural network system learns to predict a 3D shape representation of an object from a video that includes the object. The 3D reconstruction technique may be used for content creation, such as generation of 3D characters for games, movies, and 3D printing. When 3D characters are generated from video, the content may also include motion of the character, as predicted based on the video. The 3D object construction technique exploits temporal consistency to reconstruct a dynamic 3D representation of the object from an unlabeled video. Specifically, an object in a video has a consistent shape and consistent texture across multiple frames. Texture, base shape, and part correspondence invariance constraints may be applied to fine-tune the neural network system. The reconstruction technique generalizes well—particularly for non-rigid objects.

Abstract: A portable electronic device comprises a double-sided display including a first display side and a second display side formed on a side opposite the first display side; a direct memory access (DMA) controller configured to read first image data from a memory; at least one sensor configured to detect at least one of a position change of the double-sided display and a movement of a user's pupil and to output a detection signal; a status signal generator configured to interpret the detection signal output and to output a status signal; a transmission order determiner configured to receive the first image data from the DMA controller, to determine a transmission order of the first image data based on the status signal, and to output second image data corresponding to the determined transmission order; and a display driver integrated circuit (IC) configured to transmit the second image data to the display.

Abstract: The described technology regards an augmented reality system and method for estimating a position of a location of interest relative to the position and orientation of a display, including receiving and selectively filtering a plurality of measurement vectors from a rate-gyroscope. Systems of the described technology include including a plurality of sensors, a processing module or other computation means, and a database. Methods of the described technology use data from the sensor package useful to accurately render graphical user interface information on a display.