Abstract: A virtual model placement system can generate virtual floors and virtual walls to correspond to a real-world environment. Virtual items such as doors, windows, lamps, can be placed on the generated virtual walls and the system can generate dynamic updates of the placed items in response to movement by a user's device (e.g., a smartphone moving from right to left). The virtual items can be initially placed as primitives and then rendered to new positions upon the user selecting a render or lock instruction.

Abstract: A viewing system provides a viewing user with an experience of viewing a content that presents a character whose behaviors are controlled based on physical motions of a performer, the content being a binocular stereopsis content that presents staging in a 3D space in which a first character associated with a first performer and a second character associated with a second performer are arranged. The first character is arranged in a first region in the space, a viewpoint associated with the viewing user and the second character are arranged in a second region in the space. The system controls behaviors of the first character based on first motion information of the first performer, and controls behaviors of the second character based on at least one of second motion information of the second performer and information of an operational input performed by the viewing user.

Abstract: A driving guidance system is provided for a motor vehicle having a windshield. The system includes an input device for generating an input signal associated with the movement of the motor vehicle, a road detection module for generating a road signal associated with a road geometry, and an ARHUD for generating a plurality of images upon the windshield. The system further includes a computer having a processor and a non-transitory computer readable medium storing instructions, such that the processor is programmed to receive the input signal and the road signal. The processor is further programmed to determine a predicted trajectory and a recommended trajectory of the motor vehicle along the road geometry based on the input signal and the road signal. The ARHUD is configured to generate the images upon the windshield and overlaid onto the road geometry to notify the driver of the predicted trajectory and the recommended trajectory.

Abstract: In some embodiments, techniques for using machine learning to enable visible light pupilometry are provided. In some embodiments, a smartphone may be used to create a visible light video recording of a pupillary light reflex (PLR). A machine learning model may be used to detect a size of a pupil in the video recording over time, and the size over time may be presented to a clinician. In some embodiments, a system that includes a smartphone and a box that holds the smartphone in a predetermined relationship to a subject's face is provided. In some embodiments, a sequential convolutional neural network architecture is used. In some embodiments, a fully convolutional neural network architecture is used.

Abstract: Enabling colorization and color adjustments on 3D point clouds, which are projected onto a 2D view with an equirectangular projection. A user may color regions on the 2D view and preview the changes immediately in a 3D view of the point cloud. Embodiments render the color of each point in the point cloud by testing whether the 2D projection of the point is inside the colored region. Applications may include generation of a color 3D virtual reality environment using point clouds and color-adjusted imagery.

Abstract: A visual partition system is provided. The system comprises a number of dry mist dispensers that generate a particle curtain comprising liquid micro-droplets. A gutter system collects liquid from the particle curtain, and at least one vacuum extractor is operably coupled to the gutter system. A liquid recirculation system collects liquid from the gutter system via the at least one vacuum extractor and returns it to the dry mist dispensers for reuse of the liquid.

Abstract: A method for interacting with an autostereoscopic display is disclosed. The method includes initiating displaying by the autostereoscopic display a left eye view and a right eye view that contain a virtual manipulated object, determining a real-world coordinate of the virtual manipulated object perceived by a user located at a predetermined viewing position of the auto stereoscopic display, receiving an interactive action of the user's manipulating body acquired by a motion tracker, where the interaction action includes a real-world coordinate of the manipulating body, determining whether an interaction condition is triggered based at least in part on the real-world coordinate of the virtual manipulated object and the real-world coordinate of the manipulating body, and refreshing the left eye view and the right eye view based on the interactive action of the manipulating body acquired by the motion tracker, in response to determining that the interaction condition is triggered.

Abstract: A system includes a computing system configured to communicatively couple to a database configured to store a virtual coordinate system and a plurality of features associated with a representative environment associated with the virtual coordinate system. The computing system is configured to receive a first input indicative of a physical positioning of a user in a physical environment, determine a virtual positioning of the user in the virtual coordinate system based on the first input, receive a second input indicative of an updated physical positioning of the user in the physical environment, determine an updated virtual positioning of the user in the virtual coordinate system based on the second input, and output a first signal to a computing device in response to determining the updated virtual positioning of the user in the virtual coordinate system.

Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.

Abstract: A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

Abstract: An orthogonal or multi-dimensional fabric user interface is described herein. A remote server executes an operating system that provides a multi-dimensional fabric user interface for storing content for a particular user. The user can access select content by manipulating the multi-dimensional fabric user interface through a graphical user interface displayed on a personal mobile computing device. In this way, the user experiences and manipulates various data dimensions around the specific content they are accessing, rather than selecting a particular file structure location. The remote server also enables the user to enter a first location side of a portal and travel to a virtual representation a second actual physical location in the multi-dimensional fabric user interface from a virtual representation of a first actual physical location in the multi-dimensional fabric user interface.

Abstract: A digital media system is configured to support any one or more of multiple features with respect to virtual-reality content. Examples of such features include directional picture-in-picture (PIP) windows based on viewing direction, directional audio based on viewing direction, user recommendations based on anomalous viewing times of certain visual features in video content, dynamic adjustment of time-to-live (TTL) durations prior to requesting deletion of video files uploaded to a content distribution network, dynamic adjustment of durations of video files to upload based on network capacity, dynamic adjustment of quantities of video files per set to upload based on network capacity, dynamic resizing of top-depicting or bottom-depicting regions within the picture areas of sets of video files, dynamic resizing of the picture areas themselves within sets of video files, or any suitable combination thereof.

Abstract: A method for augmented reality content production based on attribute information application according to an embodiment of the present disclosure, as a method for augmented reality content production based on attribute information application by a production application executed by at least one or more processors of a computing device, comprises providing a virtual object authoring space which is a virtual space for authoring a virtual object and includes at least one or more reference objects; providing a virtual object authoring interface for the virtual object authoring space; generating augmentation relationship attribute information based on a virtual object generated based on the provided virtual object authoring interface and at least one reference object of the virtual object authoring space; storing the virtual object by including the generated augmentation relationship attribute information; and displaying the stored virtual object on a reference object in a different space other than the virtual ob

Abstract: Techniques for manufacturing a light field print using a printing press. The techniques include: identifying at least one characteristic of the printing press at least in part by printing at least one calibration pattern; obtaining content to be rendered using the light field print, the content comprising multiple scene views; generating, based at least in part on the content and the at least one characteristic of the printing press, a front target pattern and a back target pattern; and using the printing press to: print the front target pattern on a first side of a substrate; and print the back target pattern on a second side of the substrate.

Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

Abstract: Aspects of the present invention relate to methods and systems for the see-through computer display systems with adjustable-zoom cameras positioned such that their respective capture fields-of-view at least partially overlap at a target distance.

Abstract: A system for dense depth computation aided by sparse feature matching generates a first image using a first camera, a second image using a second camera, and a third image using a third camera. The system generates a sparse disparity map using the first image and the third image by (1) identifying a set of feature points within the first image and a set of corresponding feature points within the third image, and (2) identifying feature disparity values based on the set of feature points and the set of corresponding feature points. The system also applies the first image, the second image, and the sparse disparity map as inputs for generating a dense disparity map.

Abstract: A computer simulation controller includes a camera that can be used to image a display on which a computer simulation, controlled by the controller, can be presented. The camera images information on the display, such as display identification (ID), and sends the information to a server streaming the simulation. Based on the information, the server knows to which display to stream the simulation.

Abstract: A method for rendering light field images of a 3D scene in an HMD using an integral-imaging-based light field display. The method includes providing integral imaging (InI) optics including a microdisplay, the InI optics having a central depth plane (CDP) associated therewith; providing an eyepiece in optical communication with the InI optics, the eyepiece and the InI optics together providing InI-HMD optics; sampling the 3D scene using a simulated virtual array of cameras so that each camera captures a respective portion of the 3D scene to create a plurality of elemental images; and displaying the image data on the microdisplay.

Abstract: A 3D display system and a 3D display method are provided. The 3D display system includes a 3D display, a memory and one or more processors. The memory records a plurality of modules, and the processor accesses and executes the modules recorded by the memory. The modules include a bridge interface module and a 3D display service module. When an application is executed by the processor, the bridge interface module creates a virtual extend screen, and moves the application to the virtual extend screen. The bridge interface module obtains a 2D content frame of the application from the virtual extend screen by a screenshot function. The 3D display service module converts the 2D content frame into a 3D format frame by communicating with a third-party software development kit, and provides the 3D format frame to the 3D display for displaying.

Abstract: An endoscope includes a housing with a distal end insertable into a cavity; an image capture device at the distal end to obtain 3D images, and process them to form a video signal; and a folded substrate folded into a U-shape having first and second legs. The image capture device includes a detector and a lens system with right and left multi-band pass filters having right pass bands that are complements of left pass bands. The lens system receives the 3D images including right and left images. The detector faces the lens system to obtain the right and left images. A processing circuit faces the proximal end behind the detector to process signals from the detector. The folded substrate includes the detector at an outer side of the first leg facing the lens system and the processing circuit at an outer side of the second leg facing the proximal end.

Abstract: An apparatus and method for displaying an image are disclosed. The apparatus includes independently-controllable microLED unit cells including sets of microLEDs each emitting light and at least one lens to control an emission angle and emission profile of the light emitted by the microLED unit cells. A display controller controls an intensity distribution of the microLED unit cells in accordance with a video data signal such that a first portion of the emitted light is emitted at a first emission angle with a first emission profile and a second portion of the emitted light is emitted at a second emission angle with a second emission profile. The first and second light portions form three-dimensional stereoscopic images.

Abstract: Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (smart phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event.

Abstract: Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

Abstract: Systems, methods, and non-transitory computer readable media for transferring virtual content to a physical display device are disclosed. An extended reality environment may be presented in a room via a wearable extended reality appliance configured to be paired with multiple display devices located in the room. Each display device may be associated with a unique network identifier. Input to cause presentation of a specific virtual object in the extended reality environment on a target display device and image data depicting the target display device may be received. The image data may be analyzed to identify the target display device. A network identifier of the target display device may be determined. A communications link with the target display device may be established. Data representing the specific virtual object may be transmitted to the target display device, to enable the target display device to present the specific virtual object.

Abstract: This application discloses a display panel and a display device. The display panel includes: a first substrate; a plurality of pixels arranged on the first substrate and including a first pixel and a second pixel; a plurality of data lines and a plurality of scanning lines arranged on the first substrate; a spacer standing portion arranged between two adjacent data lines and at an intersection of four adjacent pixels; and a spacer arranged corresponding to the spacer standing portion. The first pixel and the second pixel are connected to the nth row of data lines and the nth row of scanning lines. The first pixel includes a first main pixel and a first auxiliary pixel arranged adjacent to each other. The second pixel includes a second main pixel and a second auxiliary pixel arranged adjacent to each other.

Abstract: A method includes a computing system tracking motions performed by a hand of a user, determining one or more anchor locations in a three-dimensional space, and generating a virtual surface anchored in the three-dimensional space. An image of a real environment is captured using a camera worn by the user, and a pose of the camera when the image is captured is determined. The computing system determines a first viewpoint of a first eye of the user and a region in the image that, as viewed from the camera, corresponds to the virtual surface. The computing system renders an output image based on (1) the first viewpoint relative to the virtual surface and (2) the image region corresponding to the virtual surface, and displays the output image on a first display of the device, the first display being configured to be viewed by the first eye of the user.

Abstract: An apparatus and a method for image display include a projection screen, a projection device, a control unit, and an imaging element. The projection screen is movable back and forth along an axis perpendicular to the projection face under control from the control unit. The control unit is configured to divide an image to be projected into a set of sub-images depending on distances, of one or more objects in the image, to be perceived by a user along the axis, and to control the projection screen and the projection device such that the projection device projects the set of sub-images onto the projection face when the projection face is moving to different positions respectively. The imaging optical element is configured to form a virtual image of the respective sub-image when the projection face is moving to the corresponding position.

Abstract: An electronic device and a method of controlling the same are provided. The electronic device may include a display; a communication circuit; a camera; and at least one processor configured to: based on an execution of a compensation application for performing compensation on an image of a display device, control the display to output guide information including an interface indicating the electronic device to move to meet an image capturing condition for capturing an image of a partial area of a display device connected through the communication circuit; and based on the compensation of the image of the display device being completed, output a first image of the display device before the compensation and a second image of the display device after the compensation.

Abstract: Disclosed herein are various embodiments for meeting space collaboration in augmented reality computing environments. An embodiment operates by receiving a request from a first user to join a virtual meeting space from a first location, wherein the virtual meeting space includes a plurality of virtual objects accessible to the user through the virtual meeting space. A size of the virtual meeting space and a size of a viewing space in the first location are determined. The size of the virtual meeting space for the first user is reduced to fit into the size of the viewing space in the first location. The reduced size virtual meeting space is provided for display in the viewing space of the first location for the first user.

Abstract: A method, system, apparatus, and/or device for displaying a portion of data so as to not obstruct a portion of a central visual field. The method, system, apparatus, and/or device may include a display configured to display data and a processing device coupled to the display. The processing device may be configured to determine a position of an eye of a viewer with respect to the display, define a first region of the display substantially corresponding with a peripheral vision field of the eye, define a second region of the display substantially corresponding with a central visual field of the eye, send a first portion of the data to be displayed at the first region, and send a second portion of the data to be displayed at the second output region such that a portion of the central visual field is unobstructed by the second portion of the data.

Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

Abstract: A three-dimensional (3D) image rendering method for a heads-up display (HUD) system including a 3D display apparatus and a catadioptric system is provided. The 3D image rendering method includes determining optical images corresponding to both eyes of a user by applying, to each of the positions of the eyes, an optical transformation that is based on an optical characteristic of the catadioptric system, and rendering an image to be displayed on a display panel included in the 3D display apparatus, based on a position relationship between the optical images and the display panel.

Abstract: Disclosed are a method and a device by which individual images can be displayed simultaneously to a plurality of observers. In this process, projectors can be used that project the colors from which the images are assembled following one another periodically in time.

Abstract: A display control apparatus configured to perform display control so as to display information on a plurality of image capturing apparatuses configured to capture images for generating a virtual viewpoint image includes acquisition means configured to acquire information on the plurality of image capturing apparatuses, and display control means configured to cause a display unit to display information on a communication connection of the plurality of image capturing apparatuses for transmitting an image captured by each of the plurality of image capturing apparatuses based on the information acquired by the acquisition means.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: An entertainment apparatus, a display controlling method and a display controlling program are provided which are capable of presenting a compatibility situation of a program or content with VR display to a user without relying upon representation by a selection target itself from which the program or the content can be identified. A compatibility situation data acquisition unit acquires compatibility situation data indicative of a compatibility situation with virtual reality display of the programs or the content upon selection by the user, the compatibility situation data being different from the selection targets. A screen image generation unit generates, on the basis of the compatibility situation data, the screen image including information indicative of a compatibility situation with virtual reality display of the program to be executed or the content to be reproduced in response to selection from the selection targets. A display controlling unit causes the screen image to be displayed.

Abstract: A method comprising: switching between a first mode for controlling a relative position of a virtual sound object from a notional listener in a virtual space in dependence upon a point of view of the notional listener and a second mode for controlling the relative position of the virtual sound object from the notional listener in the virtual space in dependence upon the point of view of the notional listener, wherein during the first mode there is a higher dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measured location of a user in a real space and during the second mode there is a lower dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measure

Abstract: A content processing system for modifying the brightness of one or more image frames of content, the system comprising a content analysis unit operable to identify brightness information for each of two or more image frames within the content, a variation detection unit operable to detect a variation in the brightness of at least two image frames within the content, and a brightness modification unit operable to modify the brightness of one or more image frames in dependence upon the detected brightness variation so as to reduce the variation in brightness between frames of the content.

Abstract: An augmented reality viewing system that aids a patron in visualizing a prepared food dish. The restaurant prepares ahead of time three-dimensional images of available food dishes. The patron, using their portable electronic device, images the table at which they plan on having their meal. Any selected dish can then be superimposed onto the image of the actual table so the patron can view, through augmented reality, what they can anticipate when the dish is delivered to the table.

Abstract: Systems, apparatuses and methods may provide for technology to improve user experience when viewing simulated 3D objects on a display. Head and upper-body movements may be tracked and recognized as gestures to alter the displayed viewing angle. The technology provides for a very natural way to look around, under, or over objects.

Abstract: System and method for improving the shaving experience by providing improved visibility of the skin shaving area. A digital camera is integrated with the electric shaver for close image capturing of shaving area, and displaying it on a display unit. The display unit can be integral part of the electric shaver casing, or housed in a separated device which receives the image via a communication channel. The communication channel can be wireless (using radio, audio or light) or wired, such as dedicated cabling or using powerline communication. A light source is used to better illuminate the shaving area. Video compression and digital image processing techniques are used for providing for improved shaving results. The wired communication medium can simultaneously be used also for carrying power from the electric shaver assembly to the display unit, or from the display unit to the electric shaver.

Abstract: A first augmented reality device shares, with a second augmented reality device, a visualization of an object viewed by the respective devices in an augmented reality scene. The first augmented reality device receives property information, according to which the second augmented reality device is displaying the visualization. The first augmented reality device displays the visualization according to the property information, adjusted to account for differences in perspective between the first and second augmented reality devices.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include at least one microphone configured to capture sounds from an environment of a user; a wearable camera configured to capture a plurality of images from the environment of the user; and at least one processor. The processor may be configured to receive at least one image of the plurality of images; receive at least one audio signal representative of the sounds captured by the at least one microphone; identify an item of information based on at least one of the at least one image or the at least one audio signal; determine at least a beginning of an informational time period for providing the item of information to the user; and transmit an informational audio signal representative of the item of information to a hearing interface device during the informational time period.

Abstract: A display device includes a display panel which displays an image, a touch sensor which senses a touch, a display controller which drives the display panel, and a touch controller which drives the touch sensor. The display controller transfers a timing signal representing a timing of a display operation to the touch controller, and provides display driving information to the touch controller by modulating the timing signal in a blank period of a frame period.

Abstract: A method includes the steps: a) capturing image of an environment surrounding a vehicle by a camera; b) determining an area of increased brightness in the image based on pixels having a brightness exceeding a predefined threshold; c) estimating position coordinates of a light source in the environment from the area of increased brightness; d) detecting a shadow of the vehicle in the image; and e) determining a type of the light source as a spot light source or a direction light source from the shadow, environment.

Abstract: Provided is a display device. The display device comprises: a display module including a display panel, wherein the display panel includes a display area having a plurality of pixels and an alignment mark area surrounded by the display area, and a display driver driving at least one of the plurality of pixels in the alignment mark area to form an alignment mark; and a stereoscopic lens including a base disposed on the display module, a plurality of lenses disposed on the base at an angle offset from a side of the display module, and a marking portion formed on one or more of the plurality of lenses to overlap the alignment mark area.

Abstract: According to the technology of the present disclosure, in a case where multiple documents are placed on a document positioning plate, it is possible to display document images on a UI screen in such a manner that the user can easily check the correspondence relationship between the document images being displayed on the UI screen and the corresponding documents placed on the document positioning plate. An image processing apparatus according to the present disclosure includes a processor causing the image processing apparatus to perform: acquiring position information of each of a plurality of document image areas, and information of an analyzing result obtained by analysis of document image data corresponding to each of the plurality of document image areas; and controlling the information of the analyzing result corresponding to one of the plurality of document image areas to be displayed together with the scanned image data on a display apparatus.

Abstract: A light transmitting display system, an image output method thereof and a processing device thereof are provided. The light transmitting display device is located between a background object and a user. The image output method includes the following steps. The locations of the user, the light transmitting display device and the background object are detected. A coordinate conversion relationship between the user, the light transmitting display device and the background object is established. An eyes midpoint and an eyes offset of the user are detected. A left eye viewpoint and a right eye viewpoint of the user on the light transmitting display device are calculated according to the coordinate conversion relationship, the eyes midpoint and the eyes offset of the user. As a head-mounted device is switched, an image is alternately displayed at the left eye viewpoint and the right eye viewpoint.

Abstract: A system creating an autostereoscopic augmented reality (AR), virtual reality (VR), or other visual display experience involving 3D images, presented to a viewer without glasses or other head-gear. The system includes a projection screen, which includes a reflective surface formed using retroreflective material. The system includes a projection assembly and a beamsplitter, which is disposed between an outlet of the projection assembly and the projection screen. The system includes a physical scenic space facing a lower side of the beamsplitter and a viewing space facing an upper side of the beamsplitter. A controller operates the projector assembly to project left and right eye images toward the projection screen. The left and right eye images are then directed to left and right eye positions so a viewer with eyes positioned at the left and right eye positions perceives a virtual object concurrently with light from the physical scenic space.