Abstract: According to one embodiment, a display apparatus includes a display device and an image display control circuit. The display device includes a display panel and a light controller. The light controller controls a direction of a light ray emitted from the display panel. The image display control circuit controls the display panel to display an image in which two or more parallax images having different parallax numbers are mixed, on a display surface of the display device. The image display control circuit displays a parallax image having a first parallax number in at least a first area and displays a parallax image having a second parallax number in a second area. The second parallax number is smaller than the first parallax number.

Abstract: A system for capturing and presenting views of a vehicle. In an example embodiment, the system captures video data rearward and along a side of the vehicle and/or behind the vehicle. The system includes video cameras for capturing video data at one or more resolutions and in one or more fields-of-view. The displays present the video data to the driver for use during operation of the vehicle. The displays present the video data at one or more resolutions. The resolution of capture and/or display may be in accordance with an operating mode of the vehicle, such as turning, direction of travel and/or driver selection.

Abstract: This application includes an interactive control method and apparatus, a storage medium, and an electronic device. In these method, apparatus, storage medium, and device, a touch operation performed on a touch panel is recognized. A holographic projection device is configured to display a holographic projection-based virtual character. The touch panel is disposed on the holographic projection device. An interaction request is generated according to the recognized touch operation. The interaction request corresponds to an interaction with the holographic projection-based virtual character. Further the holographic projection-based virtual character is controlled to perform an interactive action associated with the interaction request.

Abstract: Embodiments are disclosed for adding lens blur effects to input images. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a request to apply a lens blur effect to an image an accumulation region of the input image corresponding to a first pixel of an output image, determining a weight for each of the one or more source pixels based at least in part on an iris map for the one or more source pixels and a depth distance value between each of the one or more source pixels and the focal plane, and generating an output pixel value for the first pixel by calculating a weighted sum of the one or more source pixels from the accumulation region.

Abstract: An object of the present invention is to provide an image processing device, an endoscope system, and an image processing method capable of observing an accurate structure of a subject while preventing a substantial decrease in a frame rate in a case where an image is acquired using a plurality of observation lights.

Abstract: A method executed by at least one processor, the method comprising: segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; representing each segment of the plurality of segments of multidimensional media using a respective sequence vector, the respective sequence vector comprising one or more predefined multidimensional metadata, wherein the predefined multidimensional metadata includes one of a starting vector, a length vector, and a scaling vector, and a startcode; and deriving a network based media processing (NBMP) workflow based on the respective sequence vectors of each segment of the plurality of segments.

Abstract: A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also, a method and a device for processing images configured to read the at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video.

Abstract: There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.

Abstract: A focusing method of a camera for obtaining an image of a surveillance area by performing a pan-tilt-zoom (PTZ) operation is included. The focusing method includes: determining whether a region of interest set in the surveillance area is included in a first image obtained by the camera; converting a mode according to a result of the determination by selecting a first mode in which focusing is performed using a first focusing algorithm or a second mode in which focusing is performed using a second focusing algorithm that is different from the first focusing algorithm; and focusing the camera with respect to the first image according to the first mode or the second mode.

Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.

Abstract: System and method for providing a warning to a motorist of the presence of a mobile target in an area, when at least one projected path of the motor vehicle intersects at least one projected target path. A sensor obtains an image of the area and passes the image to a data processing unit. The data processing unit comprises an image analysis module that is used to analyze the image to detect the presence of a target, such as a bicycle, in the area. The image analysis module uses artificial intelligence methods to analyze the image. When a mobile target is detected in the area, a signal is generated and passed to a display unit. The display unit then displays a visible warning of the presence of the target to the motorist. In one embodiment, the area includes a blind spot of a motor vehicle operated by the motorist.

Abstract: According to an embodiment of the present invention, disclosed is a camera module comprising: an optical output unit for outputting an optical signal to an object; an optical unit for transmitting the optical signal reflected from the object; a sensor for receiving the optical signal transmitted through the optical unit; and a control unit for acquiring the depth map of the object by using the optical signal received by the sensor, wherein the sensor includes an effective area in which a light receiving element is arranged and a non-effective area excluding the effective area, and includes a first row area in which the effective area and the non-effective area are alternately arranged in a row direction, and a second row area in which the effective area and the non-effective area are alternately arranged in the row direction, and in which the effective area is arranged in a column direction at a position not overlapping with the effective area of the first row area, light reaching the effective area of the fi

Abstract: A method of operating a head mounted augmented reality display system includes producing an electromagnetic field using an electromagnetic emitter, positioned in a handheld controller and reflecting the electromagnetic field using a first electromagnetic reflector, positioned adjacent to the electromagnetic emitter, to form a modified electromagnetic field. The method also includes reflecting a portion of the modified electromagnetic field using a second electromagnetic reflector positioned in a headset and detecting the reflected portion of the modified electromagnetic field by an electromagnetic sensor positioned adjacent to the second electromagnetic reflector.

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Abstract: A method of activating an object-specific action comprises obtaining, based on image analysis of acquired images, a plurality of values of a movement characteristic, each value representing a moving object detected in the acquired images; receiving an input signal from a user input device, wherein the input signal represents a value of the movement characteristic for the user input device; comparing the value of the movement characteristic for the user input device with each value of the movement characteristics for the moving objects, and determining the moving object corresponding to the closest value of movement characteristic as a selected moving object; and activating the object-specific action for the selected moving object.

Abstract: A photodetector device includes an avalanche photodiode array substrate. A circuit substrate includes time measurement circuits and a clock driver. Each of the time measurement circuit includes a delay line unit, and is arranged to acquire, from an operation result of a delay line, time information indicating timing at which a pulse signal is input from a corresponding avalanche photodiode. The delay line unit is arranged to initiate an operation of the delay line in response to input of the pulse signal to the time measurement circuit, and to stop the operation of the delay line in response to input of a clock signal from a clock driver to the time measurement circuit, and is arranged to detect a time interval shorter than a cycle of the clock signal by the operation of the delay line.

Abstract: Provided are a method of displaying a digital holographic image and a digital hologram display apparatus, the method including generating and converting a digital hologram, recording the digital hologram in a spatial light modulator, radiating coherent parallel light to the spatial light modulator, removing an aliasing noise image, and implementing a reconstructed image reconstructed by the spatial light modulator.

Abstract: A device is provided. The device includes a polarization hologram polymer layer having a wavy surface, an optic axis of the polarization hologram polymer layer being configured with a spatially varying orientation in a first predetermined in-plane direction. The device also includes a compensation layer disposed at the wavy surface of the polarization hologram polymer layer and configured to compensate for the wavy surface in shape.

Abstract: A system for mapping a stage includes a lighting fixture, a scanner, and a controller. The lighting fixture includes a visible light source and an infrared light source. The lighting fixture at least partially illuminates the stage with structured infrared light. The scanner detects the structured infrared light on the stage. The controller is connected to the lighting fixture and the scanner. The controller turns on the visible light source in a visible light mode and turns on the infrared light source in an infrared light mode. The infrared light source illuminates at least a portion of the stage with the structured infrared light. The controller also directs the scanner to scan the structured infrared light on the portion of the stage, receives signals from the scanner as scan data, and translates the scan data into three-dimensional location data.

Abstract: An information processing method is disclosed. The method includes: obtaining initial feature information of to-be-queried information; performing feature processing on the initial feature information of the to-be-queried information, to obtain target feature information of the to-be-queried information, where the feature processing includes at least feature dimension processing used to process a data dimension of the initial feature information of the to-be-queried information to be a preset dimension; performing a first retrieval operation on m pieces of candidate information based on the target feature information of the to-be-queried information, to obtain a first retrieval result; and performing a second retrieval operation on the first retrieval result based on the initial feature information of the to-be-queried information, to obtain result information corresponding to the to-be-queried information. The method can quickly and efficiently implement information retrieval.

Abstract: A method, computer program, and computer system is provided for streaming immersive media. The method includes ingesting content in a two-dimensional format, the 2D format referencing at least one neural network; converting the ingested content to a three-dimensional format based on the referenced at least one neural network; and streaming the converted content to a client end-point.

Abstract: An active interaction method, an electronic device and a readable storage medium, relating to the field of deep learning and image processing technologies, are disclosed. According to an embodiment, the active interaction method includes: acquiring a video shot in real time; extracting a visual target from each image frame of the video, and generating a first feature vector of each visual target; for each image frame of the video, fusing the first feature vector of each visual target and identification information of the image frame to which the visual target belongs to generate a second feature vector of each visual target; aggregating the second feature vectors with the same identification information respectively to generate a third feature vector corresponding to each image frame; and initiating active interaction in response to determining that the active interaction is to be performed according to the third feature vector of a preset image frame.

Abstract: A display device for vehicle capable of reducing visual recognition burden on a driver and shortening watching time is provided. The display device for vehicle includes a liquid crystal display including a first area, a second area and a third area as display areas, and a CPU configured to switch the liquid crystal display between a normal display mode and a simple display mode. The CPU is configured to, in the normal display mode, make the first area, the second area and the third area to display vehicle information, and in the simple display mode, put the first area and the second area in a non-displayed state and make only the third area to display in digital indication at least speed information among the vehicle information.

Abstract: A light field (LF) display system for displaying holographic content (e.g., a holographic sporting event or holographic content to augment a holographic sporting event) to viewers in an arena. The LF display system in the arena includes LF display modules tiled together to form an array of LF modules. The array of LF modules create a holographic object volume for displaying the holographic content in the arena. The array of LF modules displays the holographic content to viewers in the viewing volumes. The LF display system can be included in a LF sporting event network. The LF sporting event network allows holographic content to be created at one location and presented at another location. The LF sporting event network includes a network system to manage the digital rights of the holographic sporting event content.

Abstract: A method system an apparatus to convert an image to a pseudo-stereoscopic image comprising receiving an image through a video source, duplicating the captured image, cropping the captured image and the duplicated image by applying an offset to the images, outputting the images to a display be displayed to a user in a manner such that user perceives depth in the images due to the applied offset and displaying the images on a stereoscopic display.

Abstract: Systems, methods, and devices for laser mapping and color imaging with increased dynamic range are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises a plurality of pixels each configurable as a short exposure pixel or a long exposure pixel. The system includes a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises a laser mapping pattern.

Abstract: An inductor includes an element containing a magnetic metal powder and a resin, a coil that includes a winding portion and paired extended portions extended from both ends of the winding portion and that is embedded in the element, a pair of an external terminal electrically connected to one of the extended portions and an external terminal electrically connected to the other of the extended portions, and a conductive layer disposed on a surface of the element that crosses the winding axis of the coil. The conductive layer includes a first metal layer formed by fusing together the magnetic metal powder near the surface of the element and a second metal layer formed by plating on the first metal layer. The electrical resistivity of the second metal layer is lower than the electrical resistivity of the first metal layer.

Abstract: The present disclosure provides a communication method, and an electronic device. The method includes: obtaining, by an electronic device, a plurality of 2D images and/or a plurality of depth maps for a current scene, the plurality of 2D images and/or the plurality of depth maps being aligned in time; and transmitting, by the electronic device, the plurality of 2D images and/or the plurality of depth maps to the server by means of wireless communication.

Abstract: A 3D imaging system includes a camera to capture visible images, and a MEMS device with a scanning mirror that sweeps a beam in two dimensions. Actuating circuits receive angular extents and offset information and provide signal stimulus to the MEMS device to control the amount and direction of mirror deflection on two axes. The scan angle and offset information may be modified in response to camera properties.

Abstract: Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and/or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.

Abstract: A label assigning device of an embodiment includes one or more hardware processors configured to function as a label candidate generation unit, a feature amount pair detection unit, and a label assigning unit. The label candidate generation unit generates a label candidate from association data associated with a content. The feature amount pair detection unit detects a feature amount pair that is a combination of feature amounts having a highest similarity among combinations of a feature amount extracted from a first content and a feature amount extracted from a second content. The label assigning unit assigns, as a label, a common label candidate generated from both first association data associated with the first content and second association data associated with the second content to each feature amount constituting the feature amount pair.

Abstract: A processor system and computer-implemented method are provided for generating a composite video stream which may include a non-volumetric video and a volumetric video, at least part of which is to be displayed in front of the non-volumetric video. The volumetric video may be included in the composite video stream in the form of a non-volumetric representation of the volumetric video, for example inserted into a spatial subregion of the non-volumetric video which may be occluded by the volumetric video during display. The encoding, transmission and decoding may thus not have to be modified to support volumetric video. Signaling data may be provided which may be indicative of the composite video stream containing the non-volumetric representation of the volumetric video. A processor system and computer-implemented method may be provided for rendering the composite video stream using the signaling data.

Abstract: A panum's area measurement method includes: projecting a first parallax image of a spatial object to the left eye of a user under test, and projecting a second parallax image of the spatial object to the right eye of the user under test, the first parallax image comprising a first homologous point and the second parallax image comprising a second homologous point; adjusting a horizontal parallax amount between the first homologous point and the second homologous point until the user under test observes the spatial object producing a ghost; acquiring a parallax amount parameter ?ne; calculating a horizontal physical spacing ?x between the first homologous point and the second homologous point based on the parallax amount parameter ?ne; and calculating a panum's area range (?in, ?out) of the user under test based on the horizontal physical spacing ?x.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing. A media processing entity includes at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and metadata associated with a second track at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the metadata associated with the second track to generate second media data for the second track.

Abstract: A method for streaming content that includes loading the content on a streaming server wherein the streaming server is designed to generate models of the content and model updates. Generating the model updates is based on the models, acquired client metrics containing viewing device specific information and a client state containing information about previously transmitted model updates. Transmitting the model updates to a viewing device. Providing the content for visualization according to the model updates.

Abstract: Systems and methods for a multi-primary color system for display. A multi-primary color system increases the number of primary colors available in a color system and color system equipment. Increasing the number of primary colors reduces metameric errors from viewer to viewer. One embodiment of the multi-primary color system includes Red, Green, Blue, Cyan, Yellow, and Magenta primaries. The systems of the present invention maintain compatibility with existing color systems and equipment and provide systems for backwards compatibility with older color systems.

Abstract: A broadcast transmitter/receiver and a 3D video data processing method of the same are disclosed. A 3D video data processing method of a broadcast transmitter includes encoding 3D video data, using an encoder, generating system information included in 3D video metadata, using a system information processor, outputting a transport stream by inserting frame sync information in the 3D vide data and multiplexing the 3D video data and system information, using a TP encoder, and modulating and transmitting the transport stream, using a transmitting unit.

Abstract: A minimally invasive surgical system includes a scene anti-bloom process that allows switching between imaging modes on a stereoscopic display without causing a surgeon to look-away or being momentarily distracted by sudden changes in overall scene luminance. The process receives a switch from a first imaging mode to a second imaging mode. An overall scene luminance of a scene in the first imaging mode is less than an overall scene luminance of a scene in the second imaging mode. The process delays the switch to the second imaging mode until after an illumination output level of a visible illumination source has changed to a higher output level, and then switches to the second imaging mode.

Abstract: Disclosed herein is an information processing apparatus, including: an acquisition section adapted to acquire stereoscopic image information for displaying a stereoscopic image; and a production section adapted to compare a first image and a second image, which configure the acquired stereoscopic image information, with each other to produce a parameter indicative of a position of a body included in the stereoscopic image in the depthwise direction when the stereoscopic image is displayed.

Abstract: Disclosed is a segmented liquid crystal modulator panel apparatus and method for driving the same that overcomes electrical cross-talk associated with capacitive coupling to a common electrode. Each modulator segment may be divided into subsegments and driven substantially synchronously and out-of-phase. The field-polarity insensitive LC materials yield a substantially identical optical response for each subsegment, while allowing current on the common electrode to flow between the subsegments, thereby reducing power consumption and decreasing response times.

Abstract: An image processing apparatus includes an image input unit that inputs a two-dimensional image signal, a depth information output unit that inputs or generates depth information of image areas constituting the two-dimensional image signal, an image conversion unit that receives the image signal and the depth information from the image input unit and the depth information output unit, and generates and outputs a left eye image and a right eye image for realizing binocular stereoscopic vision, and an image output unit that outputs the left and right eye images. The image conversion unit extracts a spatial feature value of the input image signal, and performs an image conversion process including an emphasis process applying the feature value and the depth information with respect to the input image signal, thereby generating at least one of the left eye image and the right eye image.

Abstract: A device for processing data includes a first input port for receiving color image data from a first image sensor and a second input port for receiving depth-related image data from a second image sensor. Processing circuitry generates a depth map using the depth-related image data. At least one output port conveys the depth map and the color image data to a host computer.

Abstract: A control apparatus for controlling a three-dimensional (3D) display apparatus includes: an image processing unit to receive an image source signal and convert the image source signal to an interval signal. The interval signal is defined as a first timing interval and a second timing interval. A backlight control device, coupled to the image processing unit, receives the interval signal and generates a plurality of backlight control signals according to the interval signal. A backlight device, coupled to the backlight control device, receives the plurality of backlight control signals and provides a lighting source to a display device during the first timing interval and/or the second timing interval according to the plurality of backlight control signals.

Abstract: A system and method are provided for improving video encoding using content information. A three-dimensional (3D) modeling system produces an encoded video stream. The system includes a content engine, a renderer, and a video encoder. The renderer receives 3D model information from the content engine relating and to produces corresponding two-dimensional (2D) images. The video encoder receives the 2D images and produce a corresponding encoded video stream. The video encoder receives content information from the content engine, transforms the content information into encoder control information, and controls the video encoder using the encoder control information.

Abstract: A method that incorporates teachings of the subject disclosure may include, for example, receiving, by a system comprising a processor, holographic video data and a descriptor file associated with the holographic video data, where the holographic video data comprises encoded holographic wave front images that are generated by reconstructing holographic interference patterns associated with a target object, determining, by the system, presentation characteristics from the received descriptor file, and presenting, by the system, holographic video content decoded from the holographic video data, at a portion of a display device. Other embodiments are disclosed.

Abstract: Techniques for setting depth values for invalid measurement regions of depth images are described herein. A computing device may set the depth values based on evaluations of depth values of neighboring pixels and of corresponding pixels from time-adjacent depth images. Alternately or additionally, the computing device may utilize a texture image corresponding to the depth image to identify objects and may set depth values for pixels based on depth values of other pixels belonging to the same object. After setting the depth values, the computing device may normalize the depth values of the pixels. Further, the computing device may generate reduced representations of the depth images based on a depth reference model or a depth error model and may provide the reduced representations to an encoder.

Abstract: There is provided a display device including a display unit which periodically arranges and displays a plurality of images and a parallax barrier which is disposed in front of a pixel plane of the display unit and separates light from the display unit. The display device includes a disparity extraction unit which extracts information on a distribution of disparities between the view images, a parameter calculation unit which calculates a shift amount based on the disparity distribution information, a shift processing unit which performs shift processing on at least one of the view images based on the calculated shift amount, and a mapping processing unit which rearranges the at least one shift-processed view image on the display unit.

Abstract: A single progressive 1080P60 side-by-side 3D video or a single progressive 1080P60 2D video is captured for transmission to interlaced receivers such as a legacy 1080i capable video receiver. A video transmitter splits the captured 1080P60 video into a plurality of even-indexed line pictures and odd-indexed line pictures. Lines of the plurality of even-indexed line pictures and odd-indexed line pictures are reassembled to generate two interlaced video sequences such as two 1080i video sequences. The video transmitter compresses the generated two 1080i video sequences, respectively, utilizing different compression algorithms, for example. Pictures that originate from the same one of the plurality of pictures in the captured 1080P60 video may be synchronized for a progressive display at the legacy 1080i capable video receiver. The legacy 1080i capable video receiver may decode the synchronized pictures from the video transmitter so as to restore the captured 1080P60 video for display in progressive format.

Abstract: In one example, a method includes identifying a first set of pixels in co-located pairs in a corresponding pair of multiview image frames for which the co-located pairs have a disparity between the pixels that is greater than a selected disparity threshold. The method further includes identifying a second set of pixels in at least one of the image frames that are within a selected distance of an intensity transition greater than a selected intensity transition threshold. The method further includes applying crosstalk correction to pixels that are identified as being in at least one of the first set and the second set.

Abstract: A method is described for generating a video stream by starting from a plurality of sequences of 2D and/or 3D video frames, wherein a video stream generator composes into a container video frame video frames coming from N different sources (S1, S2, S3, SN) and generates a single output video stream of container video frames which is coded by an encoder, wherein said encoder enters into the output video stream a signalling adapted to indicate the structure of the container video frames. A corresponding method for regenerating the video stream is also described.