Abstract: Systems and methods are disclosed for automated color selection for focus peaking highlighting. For example, methods may include accessing a color image including a first component image, a second component image, and a third component image that each encode a dimension of a color space used to encode the color image; selecting pixels of the color image for focus peaking highlighting based on pixel values of the first component image; and determining a color for focus peaking highlighting based on the second component image and on the third component image.

Abstract: A method for registering pixels provided in a pixel event stream comprising: acquiring image frames from a frame-based camera, each image frame being generated using an exposure period; generating a first point matrix from one or more of the image frames, the first point matrix being associated with an acquisition period of the image frames; acquiring a pixel event stream generated during the acquisition period; generating a second point matrix from pixel events of the pixel event stream, occurring during the acquisition period of the first point matrix; computing a correlation scoring function applied to at least a part of the points of the first and second point matrices, and estimating respective positions of points of the second point matrix in the first point matrix, due to depths of the points of the first point matrix related to the second point matrix, by maximizing the correlation scoring function.

Abstract: Multiple images that include a first image, a second image, and a third image are received. The multiple images are such that the second image is temporally between the first image and the third image. The first image, the second image, and the third image are combined to obtain a long-exposure image. High dynamic range processing is applied to the second image and the long-exposure image to obtain an output image with a larger dynamic range than a dynamic range of the second image. The high dynamic range processing uses the second image as a short-exposure image. An image based on the output image is transmitted, stored, or displayed.

Abstract: Multiple images that include a first image, a second image, and a third image are received. The multiple images are such that the second image is temporally between the first image and the third image. The first image, the second image, and the third image are combined to obtain a long-exposure image. High dynamic range processing is applied to the second image and the long-exposure image to obtain an output image with a larger dynamic range than a dynamic range of the second image. The high dynamic range processing uses the second image as a short-exposure image. An image based on the output image is transmitted, stored, or displayed.

Abstract: The present disclosure generally relates to systems and methods for imaging and sensing vibrations of an object. In one implementation, a system is provided for detecting vibrations that comprises a sensor with a plurality of pixels, each pixel including at least one photosensitive element. The sensor is configured to output signals related to illumination on each pixel. The system also includes at least one processor configured to receive the output signals from the sensor and detect, based on the output signals, one or more polarities. The at least one processor is also configured to determine timestamps associated with the output signals, analyze the timestamps and the polarities to detect vibrations of an object in the field of view of the sensor, and determine one or more frequencies of the detected vibrations.

Abstract: A method for registering pixels provided in a pixel event stream comprising: acquiring image frames from a frame-based camera, each image frame being generated using an exposure period; generating a first point matrix from one or more of the image frames, the first point matrix being associated with an acquisition period of the image frames; acquiring a pixel event stream generated during the acquisition period; generating a second point matrix from pixel events of the pixel event stream, occurring during the acquisition period of the first point matrix; computing a correlation scoring function applied to at least a part of the points of the first and second point matrices, and estimating respective positions of points of the second point matrix in the first point matrix, due to depths of the points of the first point matrix related to the second point matrix, by maximizing the correlation scoring function.

Abstract: The present disclosure generally relates to systems and methods for imaging and sensing vibrations of an object. In one implementation, a system is provided for detecting vibrations that comprises a sensor with a plurality of pixels, each pixel including at least one photosensitive element. The sensor is configured to output signals related to illumination on each pixel. The system also includes at least one processor configured to receive the output signals from the sensor and detect, based on the output signals, one or more polarities. The at least one processor is also configured to determine timestamps associated with the output signals, analyze the timestamps and the polarities to detect vibrations of an object in the field of view of the sensor, and determine one or more frequencies of the detected vibrations.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: A system comprising a camera and a computing device. The camera may comprise (a) a plurality of capture devices configured to capture images of an environment surrounding the camera to provide a spherical field of view and (b) a first interface. The computing device may comprise (a) a processor and (b) a second interface. The camera may be configured to encode a plurality of video streams based on the captured images. The first interface may be configured to transfer the plurality of video streams to the second interface. The processor may perform a stitching operation on the plurality of video streams to generate a single video signal. The stitching operation may be performed on the plurality of video streams in real time as the plurality of video streams are transferred. The single video signal may be configured to represent an omnidirectional view based on the environment surrounding the camera.

Abstract: An apparatus comprising a plurality of image modules and a plurality of processors. The image modules may each comprise (i) a sensor configured to generate images and (ii) a lens mounted to the sensor. The processors may each be configured to (A) receive the images from a subset of the plurality of image modules and (B) generate a plurality of video streams. Each one of the video streams may be generated by one of the processors in response to the images received from one of the image modules. The subset of the plurality of image modules may comprise at least two distinct image modules of the plurality of image modules. The lenses may be arranged to allow the images to provide coverage for a spherical field of view of a scene surrounding the apparatus.

Abstract: According to an exemplary embodiment of the present invention, a cardiac roadmapping technique is provided, that does not rely on the prerequisite of a phase-centric pairing of the angiogram and life images. Instead, both the pairing and accurate registration of the images are combined within a single operation, for example by using a multi-device map. This may provide for robust and precise cardiac roadmapping.

Abstract: Bit rate regulation module (3) comprising: a selection block (31) configured to select a frame type to be used to encode a current frame of a video, a determination block (32) configured to determine a target number of bits to be used to encode the current frame, and a computation block (33) configured to compute a quantization step to be used to encode the current frame by using a rate model taking into account a quantization step of a previously encoded reference frame and by modelling rate variations due to a quantization step change between the previously encoded reference frame and the current frame.

Abstract: The present invention relates to a video decoder (DEC) for decoding a bit stream (BS) corresponding to pictures (P) of a video signal, the coded pictures being likely to include macroblocks coded in a progressive and in an interlaced way. The decoder includes a decoding unit (DEU) for decoding macroblocks coded in a progressive way, and a hybrid reference construction unit (HRCU) for constructing, for each reference picture, a hybrid reference texture (HRT) which has the property of representing said reference picture in a frame-based and in a field-based manner. Said hybrid reference texture is used by said decoding unit for decoding interlaced macroblocks.

Abstract: The present invention relates to a video decoder (DEC) for decoding a bit stream (BS) corresponding to pictures (P) of a video signal, coded pictures being likely to include macroblocks coded in a progressive and in an interlaced way, said decoder including a decoding unit (DEU) for decoding macroblocks coded in a progressive way. A video decoder according to the invention includes a decoding configuration unit (DCU) for activating said decoding unit several times for decoding a single picture and for configuring the read and/or write stride at each pass of said picture in said decoding unit.

Abstract: According to an exemplary embodiment of the present invention, a cardiac roadmapping technique is provided, in which a static roadmap is built onto which a view of the intervention device is projected at the correct location. This new viewing mode combines the advantages of both roadmapping, i.e. accurate localization, and the advantages of a motion-free view, i.e. maximum readability.