Abstract: Embodiments are directed to perceiving scene features using event sensors and image sensors. Paths may be scanned across objects in a scene with one or more beams. Images of the scene may be captured with frame cameras. Events may be generated based on detection of beam reflections that correspond to the objects. Trajectories may be based on the paths and the events. A distribution of intensity associated with the trajectories may be determined based on the energy associated with the traces in the images. Centroids for the trajectories may be determined based on the distribution of the intensity of energy, a resolution of the frame cameras, or timestamps associated with the events. Enhanced trajectories may be generated based on the centroids such that the enhanced trajectories may be provided to a modeling engine that executes actions based on the enhanced trajectories and the objects.

Abstract: A video decoding method performed by a decoding apparatus includes deriving one of a plurality of cross-component linear model (CCLM) prediction mode as a CCLM prediction mode of the current chroma block, deriving a sample number of neighboring chroma samples of the current chroma block based on the CCLM prediction mode of the current chroma block, a size of the current chroma block, and a specific value derived as 2. The method includes deriving the neighboring chroma samples of the sample number, calculating CCLM parameters based on the neighboring chroma samples and the down sampled neighboring luma samples, deriving prediction samples for the current chroma block based on the CCLM parameters and the down sampled luma samples and generating reconstructed samples for the current chroma block based on the prediction samples.

Abstract: An encoder encodes a video, and includes: circuitry; and memory coupled to the circuitry. Using the memory, the circuitry: obtains at least two items of prediction information for a first partition included in the video; derives at least one template from neighboring samples which neighbor the first partition; calculates at least two costs, using the at least one template and the at least two items of prediction information; using the at least two costs, (i) determines at least one splitting direction for the first partition or (ii) assigns one of the at least two items of prediction information to a second partition split from the first partition according to the splitting direction, and another thereof to a third partition split from the first partition according to the splitting direction; and encodes the first partition according to the splitting direction and the at least two items of prediction information.

Abstract: A method includes transcoding a first block from a spatial region. The first block is associated with a first block tree pattern defining a structure of splitting a block into smaller blocks. A bit string of bits for the first block tree pattern is included in an encoded bitstream. The method determines a location of the first block in the spatial region when the first block tree pattern of the first block can be reused for a second block tree pattern of a second block. The spatial region includes blocks and the location is based on the first block being in the spatial region. Information for the second block is included in the encoded bitstream that indicates the location of the first block in the spatial region. The location allows the bit string for the first block tree pattern to be retrieved for use to decode the second block.

Abstract: The applicant proposes a method and an apparatus to realize a faster, easier and more precise multispectral digitalization of films. The proposed method and apparatus ensure quality control of the multispectral film digitization using sensors and can correct the digital images for film shrinkage and deformation. This can allow for efficient digitization of films which can enable an effective automatization of the mass safeguarding of archived films. The proposed film digitizer apparatus can comprise a novel and improved light source module, which comprise a light assembly that can allow for better illumination of the film and shorter required exposure time that can lead to lower acquisition time for each of the various wavelength image acquisitions for each film image. Monitoring of the spectral distribution and/or the temperature of the light sources can ensure quality control of the digitalization.

Abstract: The disclosed depth camera assembly may include a projector device to project light into an imaging environment. The projector device may include a light source and may also include a diffractive optical element that separates light emitted by the light source into a plurality of light regions including a plurality of separate wavelength ranges, such that each of the plurality of light regions contain light from only one of the plurality of separate wavelength ranges. The projector device may also include an interference filter. A head-mounted display system and related methods are also disclosed.

Abstract: Disclosed are an electronic device generating a multi-plane image of an arbitrary viewpoint and an operating method thereof. The electronic device includes a memory that stores a plurality of images, and at least one processor that executes a machine learning-based multi-plane image generating module generating an image of an arbitrary viewpoint from the plurality of images stored in the memory. When the multi-plane image generating module is executed, the processor selects at least two images from the plurality of images, by performing geometric calibration on the plurality of images, calculates a plane sweep volume including at least two layer images, performs an operation of a deep neural network to generate a plurality of multi-plane images having probability values, and generates the image of the arbitrary viewpoint by composing the plurality of multi-plane images and stores the image of the arbitrary viewpoint in the memory.

Abstract: An imaging device assembly includes a light source, an imaging device formed with a plurality of imaging elements, and a control device. Each imaging element (10) includes a light receiving portion (21), a first charge storage portion (22) and a second charge storage portion (24), and a first charge transfer control means (23) and a second charge transfer control means (24). Under the control of the control device, the imaging element (10) captures an image of an object on the basis of high-intensity light and stores first image signal charge into the first charge storage portion (22) during a first period, and captures an image of the object on the basis of low-intensity light and stores second image signal charge into the second charge storage portion (24) during a second period. The control device obtains an image signal on the basis of the difference between the first image signal charge and the second image signal charge.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: A system and a method for measuring the profile of a part. The measurement system includes a sensor with a probe having at least one degree of freedom, and a first reference element fastened to the probe. The sensor is arranged so that the probe is able to follow the internal or external contour of the part while the first reference element is outside the part. An imaging device is adapted to capture an image representing at least a portion of the outside of the part and the first reference element. Thus, the first reference element serves as a reference element for the position of the probe relative to the reference system that is the part.

Abstract: In various examples, systems and methods are disclosed that detect hazards on a roadway by identifying discontinuities between pixels on a depth map. For example, two synchronized stereo cameras mounted on an ego-machine may generate images that may be used extract depth or disparity information. Because a hazard's height may cause an occlusion of the driving surface behind the hazard from a perspective of a camera(s), a discontinuity in disparity values may indicate the presence of a hazard. For example, the system may analyze pairs of pixels on the depth map and, when the system determines that a disparity between a pair of pixels satisfies a disparity threshold, the system may identify the pixel nearest the ego-machine as a hazard pixel.

Abstract: The present invention provides a system and a method for automatically generating an output video of a presentation given by at least one presenter, comprising a displayed content, and performed in an environment, the system comprising a plurality of zones defined within the environment, at least one camera, wherein the camera is configured to capture image frames of the presentation given by the presenter in the environment, means to detect when the at least one presenter changes zone, a configuration associating to each zone, a set of filming parameters for controlling the at least one camera when the at least one presenter is in said zone, wherein the system if further configured to change the filming parameters when the at least one presenter changes zone based on the configuration associated to the zone in which the at least one presenter is so as to provide an output video to the user with different filming parameters.

Abstract: Systems, methods, and computer program products for recursive modifications are provided. An example imaging system includes a first infrared (IR) imaging device that generates first IR image data of a first field of view of the first IR imaging device at a first time and a computing device operably connected with the first IR imaging device. The computing device receives the first IR image data from the first IR imaging device and determines a first set of pixels and a second set of pixels from amongst a plurality of pixels associated with the first IR image data. The computing device further determines a first modification protocol for the first set of pixels and determines a second modification protocol for the second set of pixels. In response, the computing device generates a recursive modification input based upon the first and second modification protocols.

Abstract: A circular knitting machine, a method for controlling textile fabric defects, and a method for retrofitting a circular knitting machine are provided. The circular knitting machine includes a fixed support structure, a rotational support structure, and a system for controlling textile fabric defects. The system includes a digital camera for capturing digital images of knitted textile fabric, a data processor for processing the captured digital images, a camera support structure for holding the camera, and a lighting system to illuminate the knitted textile fabric from the camera side for capture by the digital camera. The camera support structure is fixed to the rotational structure.

Abstract: Embodiments are directed providing a stage studio for immersive 3-D video capture. A two-dimensional video of a scene may be captured with frame cameras oriented towards a center of the scene. Paths may be scanned across objects in the scene with signal beams oriented towards the center of the scene. Events may be generated based on signal beams that are reflected by the objects and detected by event cameras oriented towards the center of the scene. Trajectories may be generated based on the paths and the events. A scene that includes a representation of the objects based on the captured two-dimensional video and the trajectories may be generated such that a position and an orientation of the represented objects in the scene are based on the trajectories.

Abstract: The disclosure provides a surface inspection apparatus for inspecting a surface of an object, a non-transitory computer readable medium thereof, and a surface inspection method thereof. According to an aspect of the disclosure, the surface inspection apparatus includes an imaging device configured to image a surface of an object to be inspected, and a processor configured to calculate a numerical value representing a quality of the surface by processing an image captured by the imaging device, and display, on a display device, the image including an index for specifying a position of a portion that has contributed to the calculation of the numerical value and the numerical value.

Abstract: An integrated system for automatic forming, picking, and inspection of a grinding wheel mesh piece and a method thereof, including a visual inspection system (1), a conveying system (2), a cutting system (3), and a picking system (4); the conveying system (2) is used to precisely control a conveying action of a cutting section conveying platform (51) and a picking section conveying platform (52), and the visual inspection system (1) is used to acquire an image of a grinding wheel mesh cloth, establish virtual origin coordinates of a cutting layout and center coordinates of the grinding wheel mesh piece after cutting, recognize defects of the grinding wheel mesh cloth, and calibrate qualified center coordinates and unqualified center coordinates; the cutting system (3) is used to cut the grinding wheel mesh cloth moved to the cutting section conveying platform (51) to obtain a circular grinding wheel mesh piece.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. Actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: A video decoding method performed by a decoding apparatus includes deriving one of a plurality of cross-component linear model (CCLM) prediction mode as a CCLM prediction mode of the current chroma block, deriving a sample number of neighboring chroma samples of the current chroma block based on the CCLM prediction mode of the current chroma block, a size of the current chroma block, and a specific value derived as 2. The method includes deriving the neighboring chroma samples of the sample number, calculating CCLM parameters based on the neighboring chroma samples and the down sampled neighboring luma samples, deriving prediction samples for the current chroma block based on the CCLM parameters and the down sampled luma samples and generating reconstructed samples for the current chroma block based on the prediction samples.

Abstract: A LIDAR device is positioned on a crane and is moved along a track to collect 3D image data of the area below the crane. The resulting image data is sent to a computing device that applies or more filtering algorithms to the image data and searches for known image shapes therein through a comparison of the image data and one or more 3D object models based on known shapes or geometric primitives. If an object is identified in the image data and is determined to be accessible, position information for that object may be sent to a device configured to control movement of the crane to grab/pick up the object.