Abstract: An infrared camera includes a housing containing a pixel array. The pixel array includes: image pixels forming an image sensor arranged to receive infrared light from an image scene; and a plurality of parasitic heat sensing pixels arranged to receive infrared light from different portions of an interior surface of the housing.

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Abstract: A medical control device includes a focus controller configured to move a focus lens included in an imaging device configured to capture an object image taken in by an endoscope and generate a captured image, and control a focus position, wherein the focus controller is configured to executes remote shooting control for moving the focus lens and setting the focus position in a position of a hyperfocal distance corresponding to the endoscope in a case where an object distance from the endoscope to an object is included in a range of an object distance from the endoscope to the object at which remote shooting is performed.

Abstract: A foot switch (1, 26) for use with a medical device (16, 27, 28) comprises an interface (10) for a communications link between the foot switch (1, 26) and a control unit (12) of the device (16, 27, 28) and comprises at least one pedal (2, 3) for operating the foot switch (1, 26) using a foot. An operation sensor (17) captures an operation of the foot switch (1, 26) for switching a function of the medical device (16, 27, 28). The control unit (12) assigns the function to the pedal (2, 3) via the interface (10) and the assigned function is displayed on the foot switch (1, 26) by a multicolor LED (4, 5).

Abstract: A method of providing adaptive augmented reality (AR) streaming and an apparatus performing the method are disclosed. An AR streaming method includes identifying an AR content to be displayed, obtaining a metafile corresponding to the AR content, extracting information of chunks to render the AR content from the metafile, requesting the chunks based on the information, receiving the requested chunks, and rendering the AR content based on the received chunks.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a current block within a current picture from a coded video bitstream. The prediction information is indicative of usage information of an inter prediction mode that is not compatible with using the current picture as a reference picture for the current block. Then, the processing circuitry determines whether the coded video bitstream is valid based on a conformance check of the usage information to the reference picture for the current block.

Abstract: An image encoding/decoding method and apparatus for performing intra prediction using a plurality of reference sample lines are provided. An image decoding method may comprise configuring a plurality of reference sample lines, reconstructing an intra prediction mode of a current block, and performing intra prediction for the current block based on the intra prediction mode and the plurality of reference sample lines.

Abstract: In a method of video decoding in a decoder, a merge candidate list of a current coding block is constructed for processing the current coding block with a triangular prediction mode (TPM). The merge candidate list can include merge candidates each having one or two motion vectors. Each motion vector can be associated with a first reference picture list or a second reference picture list. A first motion vector and a second motion vector are determined from the motion vectors of the merge candidates on the merge candidate list. The current block is processed with the TPM with the first and second motion vectors as two motion vector predictors (MVPs) of two triangular partitions of the current coding block.

Abstract: A method includes capturing, by a camera disposed behind a display panel of an electronic device, an original image through a semi-transparent pixel region of the display panel, and determining a depth position with respect to at least one object identified within the original image. The method further includes accessing, based on the depth position, a plurality of point spread functions (PSFs) corresponding to a plurality of lateral positions at the depth position, and generating a set of image patches based on the plurality of PSFs. Each image patch of the set of image patches is generated based on a different one of the plurality of PSFs. The method concludes with generating a reconstructed image corresponding to the original image based on the set of image patches.

Abstract: Devices, systems and methods for operating a rear-facing perception system for vehicles are described. An exemplary rear-facing perception system contains two corner units and a center unit, with each of the two corner units and the center unit including a camera module and a dual-band transceiver. A method for operating the rear-facing perception system includes pairing with a control unit by communicating, using the dual-band transceiver, over at least a first frequency band, transmitting a first trigger signal to the two corner units over a second frequency band non-overlapping with the first frequency band, and switching to an active mode. In an example, the first trigger signal causes the two corner units to switch to the active mode, which includes orienting the camera modules on the center unit and the two corner units to provide an unobstructed view of an area around a rear of the vehicle.

Abstract: There are provided systems and methods for synchronized media capturing for an interactive scene. A user at a venue may watch an event unfold at the venue. The venue may include wireless beacons established throughout the venue. The wireless beacons may be configured to establish short range wireless communications with the user's device. Once a connection is established, the wireless beacons may instruct the user's device to capture media of an instance during the event. The wireless beacons may similar instruct other user's devices to capture media of the instance at the same time, thereby synchronizing media capturing of a particular instance during the event. The user may review the media and select to delete the media or upload the media to a media sharing service. The server may further process the media into an interactive scene.

Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.

Abstract: Methods and systems for generating free viewpoint videos (FVVs) based on images captured in a sports arena. A method includes projecting, onto objects within a filming area within the sports arena, a predefined pattern including a large set of features; generating, based on signals captured by each of a plurality of depth cameras, a point cloud for each depth camera, wherein the plurality of depth cameras is deployed in proximity to the filming area, wherein the captured signals are reflected off of the objects within the filming area; creating, based on the plurality of point clouds, a unified point cloud; meshing points in the unified point cloud to generate a three-dimensional (3D) model of the objects; texturing the 3D model based on images captured by the plurality of depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to a viewpoint.

Abstract: Methods, systems, and apparatus, including a media player and computer-readable mediums, are described for rendering media content at a frame rate that is safe to a user. A system, or its media player, obtains media content that includes video content having multiple frames. The system determines a frame rate representing a rate for sequentially displaying the frames to the user when the media player plays the media content. Image content of each frame is scanned and data describing different photosensitivity thresholds is obtained. Based on a photosensitivity of the user, the system determines that one or more frames in a portion of the media content include image content that is unsafe to the user when the media player plays the media content. The system selectively decreases a frame playback rate for the portion of the media content as a function of an input value that is selectable by the user.

Abstract: Systems and methods for foreground/background separation and for studio production of a FVV. A method includes projecting, onto objects in a filming area within a studio, a predefined pattern including a large set of features; generating, based on signals reflected off of the objects and captured by a plurality of depth cameras deployed in proximity to the filming area, a local point cloud for each depth camera; separating, based on the local point clouds, between a background and a foreground of the filming area; creating, based on the local point clouds, a unified point cloud; meshing points in the unified point cloud to generate a 3D model of the objects; texturing the 3D model based on the separation and images captured by the depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to at least one viewpoint.

Abstract: A method for encoding an input signal comprising signal frames into quantized bits is disclosed, the method comprises generating, for each frame of the input signal, a signal matrix comprising matrix coefficients obtained from that frame, grouping the matrix coefficients of each signal matrix into a plurality of partition vectors, and for each partition vector, selecting one vector quantization scheme from among a plurality of vector quantization schemes and quantizing that partition vector according to the selected vector quantization scheme to obtain the quantized bits. In an adaptive mode, the method comprises grouping differently the matrix coefficients obtained from different frames, and/or selecting different vector quantization schemes for partition vectors obtained from different frames.

Abstract: Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for data indexing. The method for data indexing includes obtaining a plurality of data blocks for storage. The method further includes generating a plurality of vectorized representations of the plurality of data blocks so that a difference between vectorized representations of data blocks with a higher similarity among the plurality of data blocks is smaller. The method further includes storing the plurality of vectorized representations for indexing the plurality of data blocks respectively. The vectorized representations serve as indexes of the data blocks, and the vectorized representations may be used to effectively measure similarities between the data blocks, thereby providing the possibility of performing a fuzzy search of the data blocks based on the similarities.

Abstract: Point cloud data relating to a matching target is efficiently eliminated after completion of a process of matching between sets of point cloud data obtained at different viewpoints. The surveying data processing device includes a target detecting unit, a location acquiring unit, a point cloud data eliminating region setting unit, and a point cloud data eliminating unit. The target detecting unit detects a target in point cloud data. The point cloud data is obtained by emitting laser light on an object having the target and by detecting the light reflected back from the object. The target location acquiring unit acquires a location of the detected target. The point cloud data eliminating region setting unit sets a point cloud data eliminating region containing the target, based on the location of the target. The point cloud data eliminating unit eliminates point cloud data contained in the point cloud data eliminating region.

Abstract: A method for determining a rotational speed of a rotatably mounted component of a machine is disclosed, wherein image data of a marked region of the machine component are obtained in the form of a plurality of frames via a video camera, and the image data are evaluated, in order to determine the periodicity of the rotation of the machine component from the change over time of the image data in the frames of the machine component. The video camera is configured by selecting an active region for obtaining the image data from the total number of pixels of the video camera, in which an observation area is imaged, which is passed through by the marked region during the rotation of the machine component, wherein the active region comprises only a portion of the total number of pixels of the video camera, to increase the frame rate correspondingly.

Abstract: An imaging device includes a light source operating in response to an optical control signal having a predetermined frequency, a sensor including a plurality of pixels, configured to generate an electrical signal in response to a light reception signal output by the light source and reflected from a subject, and a logic circuit configured to generate first raw data of a spatial domain based on the electrical signal, and an image signal processor configured to convert the first raw data into second raw data of a frequency domain, to select low-frequency data of the second raw data within a frequency band lower than a predetermined reference frequency, to apply a predetermined weighting to the low-frequency data to generate weighted data, and to generate a resultant image based on the first raw data and the weighted data.