Abstract: A system, method, and/or instrumentality may be provided for coding a 360-degree video. A picture of the 360-degree video may be received. The picture may include one or more faces associated with one or more projection formats. A first projection format indication may be received that indicates a first projection format may be associated with a first face. A second projection format indication may be received that indicates a second projection format may be associated with a second face. Based on the first projection format, a first transform function associated with the first face may be determined. Based on the second projection format, a second transform function associated with the second face may be determined. At least one decoding process may be performed on the first face using the first transform function and/or at least one decoding process may be performed on the second face using the second transform function.

Abstract: The present disclosure relates to a vision assistive device for use by blind or low vision users. The device includes an imaging unit for viewing objects positioned beneath the device. The device further includes a forwardly facing screen for displaying an enlarged view of the imaged object to the user. The imaging unit is configured to take multiple views of the object, each with a different area of focus. This can be accomplished by digitally changing the imaging sensor's area of focus or by pivoting the sensor via a focus motor. In either event, the resulting images are combined into a single, integrated, focused, and composite image. Combining images with differing areas of focus helps eliminate any blurry regions in the composite image. The device further includes a rearwardly positioned fin that facilitates positioning the device in multiple different orientations. In a first orientation, the device is vertically positioned upon a desktop.

Abstract: A block of video data is split using one or more of several possible partition operations by using the partitioning choices obtained through use of a texture-based image partitioning. In at least one embodiment, the block is split in one or more splitting operations using a convolutional neural network. In another embodiment, inputs to the convolutional neural network come from pixels along the block's causal borders. In another embodiment, boundary information, such as the location of partitions in spatially neighboring blocks, is used by the texture analysis. Methods, apparatus, and signal embodiments are provided for encoding.

Abstract: A media items to be shared with users of a content sharing service are identified. Each of the media items corresponds to a video recording generated by a client device that depicts one or more objects corresponding to a real-world event and/or a geographic location. A location of the client device that generated the video recording corresponding to a respective media item of the media items is determined based on image features depicted in a set of frames of the video recording. A request for content associated with at least one of the real-world event and/or the geographic location is received from another client device connected to the content sharing service. The media items and, for each of the media items, an indication of the location of the client device that generated the corresponding video recording are provided in accordance with the request for content.

Abstract: Exemplary embodiments include systems and methods for coding a video comprising a plurality of pictures including a current picture, a first reference picture, and a second reference picture, where each picture includes a plurality of blocks. In one method, for at least a current block in the current picture, a number of available bi-prediction weights is determined based at least in part on a temporal layer and/or a quantization parameter of the current picture. From among available bi-prediction weights a pair of weights are identified. Using the identified weights, the current block is then predicted as a weighted sum of a first reference block in the first reference picture and a second reference block in the second reference picture. Encoding techniques are also described for efficient searching and selection of a pair of bi-prediction weights to use for prediction of a block.

Abstract: Example embodiments relate to enhanced depth of focus cameras using variable apertures and pixel binning. An example embodiment includes a device. The device includes an image sensor. The image sensor includes an array of light-sensitive pixels and a readout circuit. The device also includes a variable aperture. Additionally, the device includes a controller that is configured to cause: the variable aperture to adjust to a first aperture size when a high-light condition is present, the variable aperture to adjust to a second aperture size when a low-light condition is present, the readout circuit to perform a first level of pixel binning when the high-light condition is present, and the readout circuit to perform a second level of pixel binning when the low-light condition is present. The second aperture size is larger than the first aperture size. The second level of pixel binning is greater than the first level of pixel binning.

Abstract: Provided is a video decoding method including obtaining split information indicating whether a current block is to be split from a bitstream; splitting the current block into two or more sub-blocks when the split information indicates that the current block is to be split; determining lower horizontal coding order information of the sub-blocks of the current block according to higher horizontal coding order information applied to the current block, based on at least one of split information, size information, and neighboring block information of the current block; and decoding the sub-blocks according to the lower horizontal coding order information.

Abstract: An encoder includes: circuitry; and memory coupled to the circuitry. The circuitry, in operation, stores a first parameter into a bitstream, the first parameter indicating, as a prediction mode, one of (i) a multiple prediction mode in which a prediction image is generated by overlapping an inter prediction image of a current block and an intra prediction image of the current block and (ii) one of a plurality of prediction modes including a non-rectangular mode in which a prediction image is generated for each non-rectangular partition in the current block, and encodes the current block according to the prediction mode.

Abstract: An image encoding apparatus comprises a selector configured to select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples; an intra-image predictor configured to derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples; in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region; a detector configured to detect whether samples corresponding to any of the two or more par

Abstract: One example system comprises a LIDAR sensor that rotates about an axis to scan an environment of the LIDAR sensor. The system also comprises one or more cameras that detect external light originating from one or more external light sources. The one or more cameras together provide a plurality of rows of sensing elements. The rows of sensing elements are aligned with the axis of rotation of the LIDAR sensor. The system also comprises a controller that operates the one or more cameras to obtain a sequence of image pixel rows. A first image pixel row in the sequence is indicative of external light detected by a first row of sensing elements during a first exposure time period. A second image pixel row in the sequence is indicative of external light detected by a second row of sensing elements during a second exposure time period.

Abstract: Provided is an image decoding method of decoding an image, the image decoding method including: obtaining at least one of block shape information and split shape information about a first coding unit included in the image, from a bitstream; determining at least one second coding unit included in the first coding unit based on at least one of the block shape information and the split shape information; and decoding the image based on the at least one second coding unit, wherein the block shape information indicates a shape of the first coding unit and the split shape information indicates whether the first coding unit is split into the at least one second coding unit. Also, provided is an image encoding method corresponding to the image decoding method. Also, provided is an image encoding apparatus and image decoding apparatus for respectively performing the image encoding method and image decoding method.

Abstract: An encoder includes: circuitry; and memory coupled to the circuitry. The circuitry, in operation, stores a first parameter into a bitstream, the first parameter indicating, as a prediction mode, one of (i) a multiple prediction mode in which a prediction image is generated by overlapping an inter prediction image of a current block and an intra prediction image of the current block and (ii) one of a plurality of prediction modes including a non-rectangular mode in which a prediction image is generated for each non-rectangular partition in the current block, and encodes the current block according to the prediction mode.

Abstract: An encoder includes: circuitry; and memory coupled to the circuitry. The circuitry, in operation, stores a first parameter into a bitstream, the first parameter indicating, as a prediction mode, one of (i) a multiple prediction mode in which a prediction image is generated by overlapping an inter prediction image of a current block and an intra prediction image of the current block and (ii) one of a plurality of prediction modes including a non-rectangular mode in which a prediction image is generated for each non-rectangular partition in the current block, and encodes the current block according to the prediction mode.

Abstract: A video data processing method includes receiving a bitstream; decoding an index associated with a coding unit based on the bitstream, the index indicating a selection mode among at least four selection modes; determining whether a plurality of top neighboring samples and a plurality of left neighboring samples are available; determining four samples based on the index; determining two parameters based on the four samples; determining predicted samples of the coding unit based on the two parameters; and decoding the coding unit based on the predicted samples; wherein determining the four samples based on the index further comprises: determining the four samples based on an availability of the plurality of the top neighboring samples and the plurality of the left neighboring samples.

Abstract: There is provided a method and apparatus of encoding/decoding an image. The method comprises decoding information on block partitioning of a current block included in a current picture from a bitstream; determining a partitioning method of the current block on the basis of the information; and partitioning the current block by using the determined partitioning method, wherein the partitioning method is determined on the basis of whether or not the current block includes a predetermined boundary.

Abstract: A surveillance monitoring system may use a camera to detect any viewing faces visible within viewing sight of a monitor and determine whether the detected viewing faces belong to authorized individuals who are authorized to view video surveillance footage on the monitor or if any of the detected viewing faces belong to individuals who are not authorized to view video surveillance footage on the monitor. When the detected viewing faces belong only to authorized individuals, the surveillance monitoring system continues to display the video surveillance footage that includes identifiable faces without anonymizing the identifiable faces. When the detected viewing faces also include unauthorized individuals, the surveillance monitoring system may continue to display the video surveillance footage, but the surveillance monitoring system may automatically anonymize one or more of the identifiable faces seen in the video surveillance footage.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure may include determining whether a prediction mode of a current block is an intra prediction mode based on information on the prediction mode of the current block, determining whether intra sub-partitions (ISP) is available for the current block, when the prediction mode of the current block is an intra prediction mode, decoding an ISP application indicator indicating whether to apply ISP to the current block, when ISP is available for the current block, and generating a prediction block for the current block by applying ISP to the current block, upon determining that ISP applies to the current block based on the ISP application indicator.

Abstract: Video encoding and decoding techniques for bi-prediction with weighted averaging are disclosed. According to certain embodiments, a computer-implemented video signaling method includes signaling, by a processor to a video decoder, a bitstream including weight information used for prediction of a coding unit (CU). The weight information indicates: if weighted prediction is enabled for a bi-prediction mode of the CU, disabling weighted averaging for the bi-prediction mode.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video encoding includes receiving circuitry and processing circuitry. The processing circuitry determines whether a block is under a local dual tree structure, and disallows a palette based coding mode for encoding the block in response to the block being under the local dual tree structure.

Abstract: A decoder may receive, in a bit stream for a current block of samples, a first residual block of samples, an indication of a displacement vector, and an indication of a downscaling. The decoder may, based on the indication of the downscaling, upscale the first residual block of samples to a second residual block of samples. The decoder may generate a decoded block of samples based on: the displacement vector; and the second residual block of samples.