Abstract: The present disclosure provides a display apparatus and a driving method thereof. The display apparatus includes a display panel including a plurality of pixel islands arranged at intervals in a row direction and a column direction, each pixel island being provided with a plurality of sub-pixels arranged at intervals in the row direction; and a light splitting component, disposed on a display side of the display panel and including a plurality of light splitting structures extending in the column direction and continuously arranged in the row direction. In the row direction, every at least two adjacent light splitting structures are one light splitting repeating unit. Each light splitting repeating unit covers one column of the pixel islands correspondingly. In one of the pixel islands, relative positions of all sub-pixels to the corresponding light splitting structures are complementary.

Abstract: A three-dimensional data storage method includes: acquiring one or more units in which an encoded stream generated by encoding point cloud data is stored; and storing the one or more units into a file. The storing includes storing, in control information for the file, information indicating that data stored in the file is data generated by encoding the point cloud data.

Abstract: An information playback method and device, a computer readable storage medium, and an electronic device, relating to the technical field of computers. Said method comprises: performing identification on a spatial image in a 3D model and obtaining an information display device and a display area in the spatial image (201); determining the display position information corresponding to the display area (202); overlaying an information playback layer in the display area according to the display position information so as to play back display information in the information playback layer (203). By overlaying an information playback layer on the information display device in a 3D model, further information exchange can be implemented in the 3D model, so that user can experience a more reality-like scenario in the 3D model, thereby enhancing user experience.

Abstract: A focusing method of a camera for obtaining an image of a surveillance area by performing a pan-tilt-zoom (PTZ) operation is included. The focusing method includes: determining whether a region of interest set in the surveillance area is included in a first image obtained by the camera; converting a mode according to a result of the determination by selecting a first mode in which focusing is performed using a first focusing algorithm or a second mode in which focusing is performed using a second focusing algorithm that is different from the first focusing algorithm; and focusing the camera with respect to the first image according to the first mode or the second mode.

Abstract: Disclosed is a stereopsis image display device comprising a display panel including a plurality of pixels and a black matrix having a plurality of openings respectively overlapped with the plurality of pixels, and a plurality of lenses disposed over the display panel and extending in a vertical direction, wherein the plurality of pixels includes K pixel groups composed of M pixels disposed in each of N horizontal lines, the N horizontal lines include a first horizontal line and a second horizontal line adjacent to the first horizontal line in the vertical direction, wherein K, M, and N are integers greater than or equal to 2, and the pixels arranged in the second horizontal line are shifted by a first distance in a horizontal direction with respect to the pixels arranged in the first horizontal line.

Abstract: This application includes an interactive control method and apparatus, a storage medium, and an electronic device. In this method, apparatus, storage medium, and device, a touch operation performed on a touch panel is recognized. A holographic projection device is configured to display a holographic projection-based virtual character. The touch panel is disposed on the holographic projection device. An interaction request is generated according to the recognized touch operation. The interaction request corresponds to an interaction with the holographic projection-based virtual character. Further the holographic projection-based virtual character is controlled to perform an interactive action associated with the interaction request.

Abstract: Autonomous vehicle methods and systems are described herein for communicating with an autonomous or semi-autonomous vehicle to remotely control operation of the vehicle, to detect and remove unauthorized passengers, to deliver loads, to receive registration information for the vehicle, to provide accessibility information to the vehicle, and/or to receive sensor or other environmental data to integrate with an electronic game or other extended reality experience.

Abstract: In various embodiments, a quality inference application estimates perceived video quality for reconstructed video. The quality inference application computes a set of feature values corresponding to a set of visual quality metrics based on a reconstructed frame, a source frame, a display resolution, and a normalized viewing distance. The quality inference application executes a trained perceptual quality model on the set of feature values to generate a perceptual quality score that indicates a perceived visual quality level for the reconstructed frame. The quality inference application performs one or more operations associated with an encoding process based on the perceptual quality score.

Abstract: A time of flight sensor includes at least one demodulation pixel. Each demodulation pixel includes a semiconductor substrate; a charge generation region in the semiconductor substrate, the charge generation region having a lateral extent, the charge generation region being configured to convert light into charge carriers; a light directing element in the charge generation region of the semiconductor substrate, the light directing element being configured to direct light through at least a portion of the lateral extent of the charge generation region; a collection region in the semiconductor substrate, the collection region being configured to collect the charge carriers generated in at least a portion of the lateral extent of the charge generation region, and a readout component in electrical communication with the collection region, the readout component being operable to control an electrical coupling between the charge generation region and the collection region.

Abstract: The present invention provides an optical device for augmented reality having a ghost image blocking function. The optical device includes: an optical means configured to transmit at least part of real object image light, which is image light output from a real object, therethrough toward the pupil of an eye of a user; a first reflective unit disposed inside the optical means, and configured to transfer augmented reality image light, which is image light corresponding to an image for augmented reality output from an image output unit, to a second reflective unit; and the second reflective unit disposed inside the optical means, and configured to transfer the augmented reality image light to the pupil of the eye of the user by reflecting the augmented reality image light to the pupil of the eye of the user, thereby providing the image for augmented reality to the user.

Abstract: A side by side image detection method and an electronic apparatus using the same are provided. The side by side image detection method includes the following steps. A first image with a first image size is obtained. A second image with a second image size that conforms to a side-by-side image format is detected within the first image by using a convolutional neural network model.

Abstract: Systems and methods for encoding/decoding a 3D image are provided. The system decomposes depth map into a plurality of component depth maps (CDMs) for a plurality of depth ranges, wherein each component depth map corresponds to a focal plane of a multiple focal plane (MFP) decomposition of the image data. The system generates a plurality of component depth map focal planes (CDMFPs) by combining each respective CDM with the depth map. The system scales data in each CDMFP by a respective scaling factor. The system generates for transmission a plurality of encoded scaled CDMFP data streams for the plurality of depth ranges, wherein each respective scaled CDMFP data stream is based at least in part on a respective scaled CDMFP.

Abstract: Techniques are disclosed for generating a representation of a motion of an object through a physical topography. In one example, a system receives from a camera a sequence of images that shows the motion of the object within a first field of view of the camera that shows a portion of the physical topography, the portion being mapped to a three-dimensional coordinate space. The object is detected using a computer vision model, and a motion profile of the object is determined that maps the motion of the object to the three-dimensional space. The motion profile is provided to a computing service for being combined with audiovisual data (e.g., including a three-dimensional model of the physical topography), and whereby the combined data is then provided to a user device for subsequent presentation.

Abstract: The disclosure describes a distributed, pluggable architecture for an artificial reality (AR) system that enables concurrent execution and collaborative scene rendering for multiple artificial reality applications. For example, an AR system includes an image capture device configured to capture image data representative of a physical environment. The AR system also includes a head-mounted display (HMD) configured to output artificial reality content. The AR system further includes a plurality of concurrently executing artificial reality client applications. The AR system also includes a concurrent application engine configured to control rendering the artificial reality content as a common scene that include one or more objects from each of the plurality of artificial reality applications.

Abstract: Systems and methods are provided to mitigate potential collisions between a person and robotic system. In various embodiments, a robotic surgical system includes a robotic linkage including joints, an endoscope coupled to a distal portion of the robotic linkage and configured to capture stereoscopic images, and a controller in communication with the endoscope. The controller executes instructions to analyze the stereoscopic images from the endoscope to identify a human-held tool in the stereoscopic images and to estimate a type and/or pose of the human-held tool, infer a position of a person holding the human-held tool based on the type and/or pose of the human-held tool, determine a spatial relationship between the person and the robotic linkage based on the inferred position of the person, and generate a warning of potential collision between the person and the robotic linkage based on the determined spatial relationship.

Abstract: Systems and methods for implementing one or more autonomous features for autonomous and semi-autonomous control of one or more vehicles are provided. More specifically, image data may be obtained from an image acquisition device and processed utilizing one or more machine learning models to identify, track, and extract one or more features of the image utilized in decision making processes for providing steering angle and/or acceleration/deceleration input to one or more vehicle controllers. In some instances, techniques may be employed such that the autonomous and semi-autonomous control of a vehicle may change between vehicle follow and lane follow modes. In some instances, at least a portion of the machine learning model may be updated based on one or more conditions.

Abstract: An electronic device includes a memory; a communication interface; and a processor. The processor is configured to, based on a source device connected through the communication interface being identified to support a first version of transmission standard, convert first Extended Display Identification Data (EDID) information, which is stored in the memory and corresponds to a second version of transmission standard, to second EDID information corresponding to the first version of transmission standard, and change a state of a hot plug detect signal related to the communication interface so that the source device reads EDID information.

Abstract: Aspects of the present disclosure relate to distributed virtual reality. In examples, a depth buffer and a color buffer are generated at a presenter device as part of rendering a virtual environment. The virtual environment may be perceived by a user in three dimensions (3D), for example via a virtual reality (VR) headset. Virtual environment information comprising the depth buffer and the color buffer may be transmitted to a viewer device, where it is used to render the virtual environment for display to a viewer. For example, the viewer may similarly view the virtual environment in 3D via a VR headset. A viewer perspective (e.g., from which the virtual environment is generated for the viewer) may differ from a presenter perspective and may be manipulated by the viewer, thereby decoupling the viewer's perception of the virtual environment from that of the presenter.

Abstract: Disclosed herein are system, method, and computer program product embodiments for camera surveillance planning and tracking using, for example, infrared technologies. An embodiment operates by receiving a camera specification input and placement input, calculating a surveillance coverage based on the camera specification and the placement input, displaying the surveillance coverage on a map, and identifying at least one stereo pair.

Abstract: The present disclosure provides a an image processing device for providing a plurality of enhanced partial images which together represent an enhanced three-dimensional, 3D, image, wherein each enhanced partial image is a two-dimensional, 2D, image associated with one of a plurality of focal planes. The image processing device includes processing circuitry configured to receive or generate a plurality of initial partial images, which together form an initial 3D image, wherein each initial partial image is a 2D image associated with one of the plurality of focal planes; and to generate, from each of the initial partial images, an enhanced partial image by generating a blurred version of the initial partial image; and blending the initial partial image with the blurred version of the initial partial image.

Abstract: An image obtaining means including: a processor; a memory module communicatively coupled to the processor; a camera communicatively coupled to the processor; and the processor being configured to: receive, from the camera, image data; determine whether a predetermined object is present based on the image data; if a predetermined object is detected as present, determine if the predetermined object is moving or stationary; and if the predetermined object is stationary for at least a predetermined time period, record the duration that the predetermined object is stationary in the memory module.

Abstract: The present disclosure causes live content to be drawn on the basis of specification data on a virtual object, operation data on the virtual object, and the like, and causes the drawn content to be provided for viewing reproduction on a terminal for viewing.

Abstract: A method of image retargeting is provided. The method includes obtaining a source image, obtaining a target size for a retargeted image based on the source image, generating a two-dimensional importance map for the source image, generating, based on the two-dimensional importance map and the target size, a warping mesh having a distortion metric below a threshold value, determining whether a size of the warping mesh corresponds to the target size, and based on the size of the warping mesh being determined to correspond to the target size, rendering the retargeted image by applying the warping mesh to the source image.

Abstract: The invention relates to a method for operating a visualization system in a surgical application, wherein at least one image representation of a region to be operated on and/or operated on is captured by means of a capturing device, wherein the at least one image representation is displayed on a main display device, wherein a pose of a visualization device that can be worn on the head relative to a display surface of the main display device is captured by means of a pose sensor system, and wherein at least one three-dimensional augmentation information item corresponding to the at least one image representation displayed is generated and/or provided and is displayed on a display device of the visualization device, wherein the augmentation information item is generated and/or provided in consideration of the captured pose in such a way that the at least one image representation displayed on the main display device is extended into a three-dimensional region by the at least one three-dimensional augmentation in

Abstract: It is presented a method for controlling display of content, the method being performed in a wearable device, the wearable device comprising a head mounted display allowing a user to see both real-world objects and computer-rendered content. The method comprises the steps of: selecting an external display device in a vicinity of the wearable device; determining first visual content to be suitable for being displayed on the external display device; and sending a request for the external display device to display the first visual content and refraining from displaying the first visual content using the head mounted display.

Abstract: According to one embodiment, a display apparatus includes a display device and an image display control circuit. The display device includes a display panel and a light controller. The light controller controls a direction of a light ray emitted from the display panel. The image display control circuit controls the display panel to display an image in which two or more parallax images having different parallax numbers are mixed, on a display surface of the display device. The image display control circuit displays a parallax image having a first parallax number in at least a first area and displays a parallax image having a second parallax number in a second area. The second parallax number is smaller than the first parallax number.

Abstract: A system for capturing and presenting views of a vehicle. In an example embodiment, the system captures video data rearward and along a side of the vehicle and/or behind the vehicle. The system includes video cameras for capturing video data at one or more resolutions and in one or more fields-of-view. The displays present the video data to the driver for use during operation of the vehicle. The displays present the video data at one or more resolutions. The resolution of capture and/or display may be in accordance with an operating mode of the vehicle, such as turning, direction of travel and/or driver selection.

Abstract: This application includes an interactive control method and apparatus, a storage medium, and an electronic device. In these method, apparatus, storage medium, and device, a touch operation performed on a touch panel is recognized. A holographic projection device is configured to display a holographic projection-based virtual character. The touch panel is disposed on the holographic projection device. An interaction request is generated according to the recognized touch operation. The interaction request corresponds to an interaction with the holographic projection-based virtual character. Further the holographic projection-based virtual character is controlled to perform an interactive action associated with the interaction request.

Abstract: Embodiments are disclosed for adding lens blur effects to input images. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a request to apply a lens blur effect to an image an accumulation region of the input image corresponding to a first pixel of an output image, determining a weight for each of the one or more source pixels based at least in part on an iris map for the one or more source pixels and a depth distance value between each of the one or more source pixels and the focal plane, and generating an output pixel value for the first pixel by calculating a weighted sum of the one or more source pixels from the accumulation region.

Abstract: A method executed by at least one processor, the method comprising: segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; representing each segment of the plurality of segments of multidimensional media using a respective sequence vector, the respective sequence vector comprising one or more predefined multidimensional metadata, wherein the predefined multidimensional metadata includes one of a starting vector, a length vector, and a scaling vector, and a startcode; and deriving a network based media processing (NBMP) workflow based on the respective sequence vectors of each segment of the plurality of segments.

Abstract: An object of the present invention is to provide an image processing device, an endoscope system, and an image processing method capable of observing an accurate structure of a subject while preventing a substantial decrease in a frame rate in a case where an image is acquired using a plurality of observation lights.

Abstract: A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also, a method and a device for processing images configured to read the at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video.

Abstract: There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.

Abstract: A focusing method of a camera for obtaining an image of a surveillance area by performing a pan-tilt-zoom (PTZ) operation is included. The focusing method includes: determining whether a region of interest set in the surveillance area is included in a first image obtained by the camera; converting a mode according to a result of the determination by selecting a first mode in which focusing is performed using a first focusing algorithm or a second mode in which focusing is performed using a second focusing algorithm that is different from the first focusing algorithm; and focusing the camera with respect to the first image according to the first mode or the second mode.

Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.

Abstract: System and method for providing a warning to a motorist of the presence of a mobile target in an area, when at least one projected path of the motor vehicle intersects at least one projected target path. A sensor obtains an image of the area and passes the image to a data processing unit. The data processing unit comprises an image analysis module that is used to analyze the image to detect the presence of a target, such as a bicycle, in the area. The image analysis module uses artificial intelligence methods to analyze the image. When a mobile target is detected in the area, a signal is generated and passed to a display unit. The display unit then displays a visible warning of the presence of the target to the motorist. In one embodiment, the area includes a blind spot of a motor vehicle operated by the motorist.

Abstract: According to an embodiment of the present invention, disclosed is a camera module comprising: an optical output unit for outputting an optical signal to an object; an optical unit for transmitting the optical signal reflected from the object; a sensor for receiving the optical signal transmitted through the optical unit; and a control unit for acquiring the depth map of the object by using the optical signal received by the sensor, wherein the sensor includes an effective area in which a light receiving element is arranged and a non-effective area excluding the effective area, and includes a first row area in which the effective area and the non-effective area are alternately arranged in a row direction, and a second row area in which the effective area and the non-effective area are alternately arranged in the row direction, and in which the effective area is arranged in a column direction at a position not overlapping with the effective area of the first row area, light reaching the effective area of the fi

Abstract: A method of operating a head mounted augmented reality display system includes producing an electromagnetic field using an electromagnetic emitter, positioned in a handheld controller and reflecting the electromagnetic field using a first electromagnetic reflector, positioned adjacent to the electromagnetic emitter, to form a modified electromagnetic field. The method also includes reflecting a portion of the modified electromagnetic field using a second electromagnetic reflector positioned in a headset and detecting the reflected portion of the modified electromagnetic field by an electromagnetic sensor positioned adjacent to the second electromagnetic reflector.

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Abstract: A method of activating an object-specific action comprises obtaining, based on image analysis of acquired images, a plurality of values of a movement characteristic, each value representing a moving object detected in the acquired images; receiving an input signal from a user input device, wherein the input signal represents a value of the movement characteristic for the user input device; comparing the value of the movement characteristic for the user input device with each value of the movement characteristics for the moving objects, and determining the moving object corresponding to the closest value of movement characteristic as a selected moving object; and activating the object-specific action for the selected moving object.

Abstract: A photodetector device includes an avalanche photodiode array substrate. A circuit substrate includes time measurement circuits and a clock driver. Each of the time measurement circuit includes a delay line unit, and is arranged to acquire, from an operation result of a delay line, time information indicating timing at which a pulse signal is input from a corresponding avalanche photodiode. The delay line unit is arranged to initiate an operation of the delay line in response to input of the pulse signal to the time measurement circuit, and to stop the operation of the delay line in response to input of a clock signal from a clock driver to the time measurement circuit, and is arranged to detect a time interval shorter than a cycle of the clock signal by the operation of the delay line.

Abstract: Provided are a method of displaying a digital holographic image and a digital hologram display apparatus, the method including generating and converting a digital hologram, recording the digital hologram in a spatial light modulator, radiating coherent parallel light to the spatial light modulator, removing an aliasing noise image, and implementing a reconstructed image reconstructed by the spatial light modulator.

Abstract: A device is provided. The device includes a polarization hologram polymer layer having a wavy surface, an optic axis of the polarization hologram polymer layer being configured with a spatially varying orientation in a first predetermined in-plane direction. The device also includes a compensation layer disposed at the wavy surface of the polarization hologram polymer layer and configured to compensate for the wavy surface in shape.

Abstract: A system for mapping a stage includes a lighting fixture, a scanner, and a controller. The lighting fixture includes a visible light source and an infrared light source. The lighting fixture at least partially illuminates the stage with structured infrared light. The scanner detects the structured infrared light on the stage. The controller is connected to the lighting fixture and the scanner. The controller turns on the visible light source in a visible light mode and turns on the infrared light source in an infrared light mode. The infrared light source illuminates at least a portion of the stage with the structured infrared light. The controller also directs the scanner to scan the structured infrared light on the portion of the stage, receives signals from the scanner as scan data, and translates the scan data into three-dimensional location data.

Abstract: A method, computer program, and computer system is provided for streaming immersive media. The method includes ingesting content in a two-dimensional format, the 2D format referencing at least one neural network; converting the ingested content to a three-dimensional format based on the referenced at least one neural network; and streaming the converted content to a client end-point.

Abstract: An active interaction method, an electronic device and a readable storage medium, relating to the field of deep learning and image processing technologies, are disclosed. According to an embodiment, the active interaction method includes: acquiring a video shot in real time; extracting a visual target from each image frame of the video, and generating a first feature vector of each visual target; for each image frame of the video, fusing the first feature vector of each visual target and identification information of the image frame to which the visual target belongs to generate a second feature vector of each visual target; aggregating the second feature vectors with the same identification information respectively to generate a third feature vector corresponding to each image frame; and initiating active interaction in response to determining that the active interaction is to be performed according to the third feature vector of a preset image frame.

Abstract: An information processing method is disclosed. The method includes: obtaining initial feature information of to-be-queried information; performing feature processing on the initial feature information of the to-be-queried information, to obtain target feature information of the to-be-queried information, where the feature processing includes at least feature dimension processing used to process a data dimension of the initial feature information of the to-be-queried information to be a preset dimension; performing a first retrieval operation on m pieces of candidate information based on the target feature information of the to-be-queried information, to obtain a first retrieval result; and performing a second retrieval operation on the first retrieval result based on the initial feature information of the to-be-queried information, to obtain result information corresponding to the to-be-queried information. The method can quickly and efficiently implement information retrieval.

Abstract: A display device for vehicle capable of reducing visual recognition burden on a driver and shortening watching time is provided. The display device for vehicle includes a liquid crystal display including a first area, a second area and a third area as display areas, and a CPU configured to switch the liquid crystal display between a normal display mode and a simple display mode. The CPU is configured to, in the normal display mode, make the first area, the second area and the third area to display vehicle information, and in the simple display mode, put the first area and the second area in a non-displayed state and make only the third area to display in digital indication at least speed information among the vehicle information.

Abstract: A light field (LF) display system for displaying holographic content (e.g., a holographic sporting event or holographic content to augment a holographic sporting event) to viewers in an arena. The LF display system in the arena includes LF display modules tiled together to form an array of LF modules. The array of LF modules create a holographic object volume for displaying the holographic content in the arena. The array of LF modules displays the holographic content to viewers in the viewing volumes. The LF display system can be included in a LF sporting event network. The LF sporting event network allows holographic content to be created at one location and presented at another location. The LF sporting event network includes a network system to manage the digital rights of the holographic sporting event content.

Abstract: A method is described for generating a video stream by starting from a plurality of sequences of 2D and/or 3D video frames, wherein a video stream generator composes into a container video frame video frames coming from N different sources (S1, S2, S3, SN) and generates a single output video stream of container video frames which is coded by an encoder, wherein said encoder enters into the output video stream a signalling adapted to indicate the structure of the container video frames. A corresponding method for regenerating the video stream is also described.