Abstract: An image processing apparatus includes a first processing task configured to acquire surface normal information of an object, a second processing task configured to acquire a plurality of first images acquired by capturing the object while changing a polarization angle of light from the object, a third processing task configured to acquire polarization information of the object, and a fourth processing task configured to generate a second image in which an illumination state of the object is different from that of each first image. The third processing task acquires light intensity information that changes according to the polarization angle, using the first images. The fourth processing task extracts a partial area of the first images using the surface normal information, and generates the second image using the partial area and the light intensity information.

Abstract: A microlens array-based ultrathin microscope is provided. The microlens array-based ultrathin microscope includes a filter unit configured to selectively transmit fluorescence manifested in a measurement sample, and an image unit configured to acquire an image from light transmitted by the filter unit. The filter unit is formed to be in contact with or spaced apart from one surface of a transparent substrate, and the image unit includes a microlens array formed on an opposite surface to the transparent substrate in which the filter unit is formed, and an image sensor configured to collect image information of the microlens array.

Abstract: A barrier panel includes a first substrate and a second substrate having block region and transmission region; a liquid crystal layer between the first and second substrates, the liquid crystal layer including a plurality of liquid crystal molecules aligned in a predetermined direction; a plurality of barrier electrodes in the block region and the transmission region of the first substrate; a common electrode on the second substrate to apply an electric field to the liquid crystal layer with the plurality of barrier electrodes; a diffraction unit in the plurality of barrier electrodes to diffract the light transmitting therethrough; and a polarization plate over the second substrate, wherein an optical axis direction of the polarization plate is parallel to the alignment direction of the liquid crystal molecule to transmit an image through an area where the electric field is not applied.

Abstract: During operation of a machine, an understanding of terrain features is critical. Accordingly, disclosed embodiments augment a video stream, captured by a camera mounted on the machine, with terrain information. In particular, an overlay is generated on at least one image frame. The overlay, which may comprise one or more semi-transparent bands, may cyclically recede from a foreground to a background of the image frame(s), cyclically advance from a background to a foreground of the image frame(s), or cyclically move horizontally across the image frame(s). The overlay may be colorized to illustrate the height of the terrain underneath the overlay.

Abstract: In some embodiments, a computer-implemented method includes capturing an image for each flash unit of an electronic device, each image being illuminated during the capturing of the image; obtaining a normalized image from one or more of the illuminated images; and using an illumination-based optimization framework to generate an enhanced three-dimensional (3D) depth image, the illumination-based optimization framework being based on the illuminated image. In some embodiments of the computer-implemented method, the illumination-based optimization framework incorporates the normalized image and 3D depth data associated with the captured image into the generation of the enhanced 3D depth image.

Abstract: The present invention relates to a decoding method for a bit stream that supports a plurality of layers. The decoding method may include receiving information on a set of video parameters that includes information on the plurality of layers, and parsing the set of video parameters to grasp information on the layers in the bit stream.

Abstract: A method of compressing a frame in an image compression and storage system includes mapping an original sample to a mapped sample based on a bit depth of the original sample and a maximum allowed error, determining a residue of the mapped sample based on a mapped previous reconstructed sample, applying a modulo addition to the residue to generate a biased residue, quantizing the biased residue based on the maximum allowed error to generate a quantized biased residue, and encoding a value corresponding to the quantized biased residue to generate an encoded value.

Abstract: According to one embodiment, a processing device performs at least determination processing of determining a state of a weld by using a first image of at least a portion of a weld pool. The state includes a first state, and a second state that is more unstable than the first state. The determination processing determines the weld to be in the second state when ripples exist in the weld pool. The processing device corrects a condition of the weld when the weld is determined to be in the second state. The processing device does not correct the condition of the weld when the weld is determined to be in the first state.

Abstract: The disclosure provides a method for mitigating 3D crosstalk and a 3D display. The method includes: detecting first and second eye positions of a user, and determining a viewing angle of the user and a rotation angle of a head of the user accordingly; estimating a first reference position and a first midpoint position between first and second eyes of the user based on the first and second eye positions of the user; obtaining a second reference position, and estimating a difference between the first and second reference positions; correcting the first midpoint position to a second midpoint position based on the rotation angle of the user and the difference; and determining a first pixel for projecting to the first eye and a second pixel for projecting to the second eye among the pixels of the 3D display based on the second midpoint position.

Abstract: The present invention relates to an image information decoding method. The decoding method includes receiving a bit stream including a Network Abstraction Layer (NAL) unit that includes information related to encoded image, and parsing a NAL unit header of the NAL unit. The NAL unit header may not include 1 bit flag information that represents whether a picture is a non-reference picture or a reference picture in the entire bit stream during encoding.

Abstract: A method for encoding video data is provided that includes determining whether or not a parent coding unit of a coding unit of the video data was predicted in intra-prediction block copy (IntraBC) mode and, when it is determined that the parent coding unit was not predicted in IntraBC mode: computing activity of the coding unit, determining an IntraBC coding cost of the coding unit by computing the IntraBC coding cost of the coding unit using a two dimensional (2D) search when the activity of the coding unit is not than an activity threshold, and computing the IntraBC coding cost of the coding unit using a one dimensional (1D) search when the activity of the coding unit is less than the activity threshold, using the IntraBC coding cost to select an encoding mode from one of a plurality of encoding modes, encoding the coding unit using the selected encoding mode.

Abstract: A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method may include based on a reference line index signaling a first reference line nearest to a coding unit, among a plurality of reference lines adjacent to the coding unit, applying intra smoothing on one or more first reference lines comprising the first reference line, among the plurality of reference lines, and based on the intra smoothing being applied on the one or more first reference lines, applying a position-dependent intra prediction combination (PDPC) on one or more third reference lines comprising the first reference line, among the plurality of reference lines, while preventing application of the PDPC on one or more fourth reference lines other than the one or more third reference lines, among the plurality of reference lines.

Abstract: Embodiments of the present disclosure relate to a method, a device, and a computer program product for video compression. The method includes: segmenting, in response to one or more features of an object in a video having a periodic change, the video into a plurality of segments based on a cycle of the periodic change; and identifying focal regions in frames of the video that are associated with the object. The method further includes: compressing the video based on the plurality of segments and the focal regions. This solution provides a content-aware lightweight video compression solution that supports content-based video deduplication at multiple scales and breaks the spatio-temporal continuity constraint of video frames during compression, thus enabling more effective video compression.

Abstract: Techniques related to reduction of artifacts in parallel block coding mode selection for video are discussed. Such techniques include, for blocks along a parallel processing split boundary of a video frame, coding mode selection that divides a block into sub-blocks, performs motion estimation for the sub-blocks with skip check disabled and using distortion and coefficient coding cost but exclusive of motion vector coding cost, and evaluates a skip check for the block using the sub-block motion vectors.

Abstract: An apparatus comprising an interface, a light projector and a processor. The interface may be configured to receive pixel data. The light projector may be configured to generate a structured light pattern. The processor may be configured to process the pixel data arranged as video frames comprising the structured light pattern, perform computer vision operations to detect a size of a face area of the video frames, determine a scale ratio in response to the size of the face area, extract the structured light pattern from the video frames, generate a downscaled structured light image and generate a depth map in response to the downscaled structured light image and a downscaled reference image. A downscale operation may be performed in response to the scale ratio to generate the downscaled structured light image. The scale ratio may enable the generation of the downscaled structured light image with sufficient depth pixels.

Abstract: Cost-effective, spatially representative image data is recording in a stereoscopic or photogrammetric image of an environment by a camera apparatus having three holographic-optical elements arranged as coupling regions at different positions on a carrier medium to capture the environment from different perspectives. Light from the environment is coupled by the coupling regions into the carrier medium which provides a light guide that transfers the light to an additional holographic-optical element which provides a decoupling region to decouple the light from the carrier medium. An image capture device captures the decoupled light and produces image data therefrom. A separating device produces the spatially representative image data from the image data by capturing the light incident on the coupling regions in a manner separated temporally or by color.

Abstract: An electronic device for encoding a picture is described. The electronic device includes a processor and instructions stored in memory that are in electronic communication with the processor. The instructions are executable to encode a step-wise temporal sub-layer access (STSA) sample grouping. The instructions are further executable to send and/or store the STSA sample grouping.

Abstract: An imaging apparatus includes a first camera, a second camera, a first imaging condition setting portion, and a second imaging condition setting portion. The first camera includes a color filter portion and a first light receiving portion receiving light transmitted through the color filter portion, and which captures a color imaged. The second camera includes a spectroscopic element to disperse light having a predetermined spectral wavelength from incident light and to change the spectral wavelength to four or more wavelengths, and a second light receiving portion to receive the light dispersed by the spectroscopic element and capture a spectroscopic image of each wavelength dispersed by the spectroscopic element; The first imaging condition setting portion sets a first imaging condition for the first camera. The second imaging condition setting portion sets a second imaging condition for the second camera based on the first imaging condition.

Abstract: Systems and methods are disclosed for tracking objects in a physical environment using visual sensors onboard an autonomous unmanned aerial vehicle (UAV). In certain embodiments, images of the physical environment captured by the onboard visual sensors are processed to extract semantic information about detected objects. Processing of the captured images may involve applying machine learning techniques such as a deep convolutional neural network to extract semantic cues regarding objects detected in the images. The object tracking can be utilized, for example, to facilitate autonomous navigation by the UAV or to generate and display augmentative information regarding tracked objects to users.

Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.