Abstract: A temporal domain rate distortion optimization based on video content characteristic and QP-? correction provides the temporal domain rate distortion optimization based on the video content characteristic and the QP-? correction for a new generation encoder AV1, wherein according to a previous temporal domain dependency relationship under an HEVC-RA coding structure, a feature of the new generation encoder AV1 and a video sequence feature, an aggregation distortion of a current coding unit and an affected future coding unit is estimated and ta propagation factor of the current coding unit in a temporal domain distortion propagation model is calculated by constructing a temporal domain distortion propagation chain, wherein a Lagrange multiplier is adjusted through a more accurate propagation factor to realize a temporal domain dependency rate distortion optimization, and a relationship of QP-? is re-corrected and an I frame is adjusted to achieve a better coding effect.

Abstract: Security devices and associated methods have a housing, a camera with a field of view of a monitored area outside the housing, a microphone to sense audio from the monitored area, a speaker to generate sound audible to the monitored area, an illumination source to illuminate the monitored area, a communication module to communicate with a communication network, a motion sensor to detect motion within the monitored area, at least two removable battery casings, each configured via a release button to hold at least one battery within the housing, and a control circuit that, when the motion sensor detects motion, is operable to (a) activate the illumination source, (b) capture video and audio from the camera and the microphone, and (c) send the captured video and audio to a remote server via the communication module and the communication network.

Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information using inter-connected images of a defined area, and for using the generated mapping information in further automated manners. In at least some situations, the defined area includes an interior of a multi-room building, and the generated information includes a floor map of the building, such as from an automated analysis of multiple panorama images or other images acquired at various viewing locations within the building—in at least some such situations, the generating is further performed without having detailed information about distances from the images' viewing locations to walls or other objects in the surrounding building. The generated floor map and other mapping-related information may be used in various manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on one or more client devices in corresponding graphical user interfaces, etc.

Abstract: Hyperspectral, fluorescence, and laser mapping imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp circuit providing offset control for data generated by the pixel array. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm; electromagnetic radiation having a wavelength from about 565 nm to about 585 nm; electromagnetic radiation having a wavelength from about 900 nm to about 1000 nm; an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce; or a laser mapping pattern.

Abstract: A proxy device may organize a set of local devices as members of a union. The proxy device may create a set of virtual peripheral devices. The set of virtual peripheral devices may represent a set of physical peripheral devices connected to the set of local devices. The proxy device may communicate the set of virtual peripheral devices to a remote device.

Abstract: A computer-implemented method, system and computer program product for compressing video. A set of video frames is partitioned into two subsets of different types of frames, a first type and a second type. The first type of frames of videos is compressed to generate a first representation by a first stage encoder. The first representation is then decoded to reconstruct the first type of frames using a first stage decoder. The second type of frames of video is compressed to generate a second representation that only contains soft edge information by a second stage encoder. A generative model corresponding to a second stage decoder is then trained using the first representation and the reconstructed first type of frames by using a discriminator employed by a machine learning system. After training the generative model, it generates reconstructed first and second types of frames using the soft edge information.

Abstract: A method of video encoding at a video encoder can include receiving a picture, and determining a substitutional representation of the picture by performing an optimization process to tune elements of the substitutional representation of the picture to optimize a rate-distortion performance of coding the substitutional representation of the picture based on an end-to-end (E2E) optimized framework. The E2E optimized framework can be an artificial neural network (ANN) based video coding framework that is pretrained. The substitutional representation of the picture can be encoded to generate a bitstream.

Abstract: The disclosed computer-implemented method may include downsampling and encoding one or more video segments into a plurality of encoded segments with a first encoder using a plurality of encoding parameter value sets and decoding and upsampling the plurality of encoded segments to a plurality of decoded segments at an original resolution of the one or more video segments. The method may also include determining, based on analyzing the plurality of decoded segments, an optimal encoding parameter value set for the one or more video segments. The method may further include encoding the one or more video segments with a second encoder using the optimal encoding parameter value set. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An encoder includes circuitry and memory. The circuitry, using the memory: derives a one-dimensional array of a plurality of reference samples for intra prediction; performs smoothing on the one-dimensional array of the plurality of reference samples which has been derived; and generates a prediction image using the plurality of reference samples. In deriving the one-dimensional array, the circuitry projects a value of at least one decoded pixel located on a first line onto a second line perpendicular to the first line, to derive at least one of the plurality of reference samples, and the smoothing is performed on the at least one decoded pixel projected onto the second line.

Abstract: An embodiment of the method receives input data associated with a current block in a current picture at a video encoder or receiving a video bitstream corresponding to compressed data including the current block in the current picture at a video decoder, wherein the current block is coded or to be coded in an affine mode according to an affine motion model; calculates and storing affine parameters for a plurality of coded blocks in the current picture; retrieves the affine parameters of one or more coded blocks from the temporal buffer; derives an affine candidate including affine motion vectors using the retrieved affine parameters of the neighboring block; and encodes or decodes the current block by predicting the current block using one or more motion compensated blocks by the derived affine candidate.

Abstract: A method for decoding a compressed video bit stream in a video decoder to recover a video sequence, the video decoder including a plurality of decoder processing cores is provided. The method includes determining that a picture is encoded in the compressed bit stream as a pre-determined number of independently encoded sub-pictures, and dispatching a first encoded sub-picture of the pre-determined number of sub-pictures to a first decoder processing core of the plurality of decoder processing cores and a second encoded sub-picture of the pre-determined number of sub-pictures to a second decoder processing core of the plurality of decoder processing cores, wherein the first encoded sub-picture and the second encoded sub-picture are independently decoded in parallel on the respective first and second decoder processing cores.

Abstract: A system and method of planar motion vector derivation which, in some embodiments can employ an unequal weighted combination of adjacent motion vectors. In some embodiments, motion vector information associated with a bottom right pixel or block adjacent to a current coding unit can be derived from motion information associated with a top row or top neighboring row of a current coding unit and motion information associated with a left column or left neighboring column of a current coding unit. Weighted or non-weighted combinations of such values can be combined in a planar mode prediction model to derive associated motion information for bottom and/or right adjacent pixels or blocks.

Abstract: The present disclosure relates to an image processing apparatus and an image processing method for enabling suppression of an increase in a memory capacity required for orthogonal transform and inverse orthogonal transform. A transformation matrix is derived using a submatrix configuring a part of the transformation matrix, a prediction residual of an image is orthogonally transformed using the derived transformation matrix, and coefficient data obtained by orthogonally transforming the prediction residual is encoded to generate a bit stream. The present disclosure can be applied to, for example, an image processing apparatus, an image encoding device, an image decoding device, or the like.

Abstract: The present invention provides a new and useful paradigm in wide area imaging, in which wide area imaging is provided by a step/dwell/image capture process and system to capture images and produce from the captured images a wide area image. The image capture is by a sensor that has a predetermined image field and provides image capture at a predetermined frame capture rate, and by a motorized step and dwell sequence of the sensor, where image capture is during a dwell, and the step and dwell sequence of the sensor is synchronized with the image capture rate of the sensor.

Abstract: A temporal domain rate distortion optimization considering a coding-mode adaptive distortion propagation is provided. A problem of dependency rate distortion optimization based on a temporal domain distortion propagation is induced again according to a temporal domain dependency relationship under an LD structure and a distortion propagation analysis under a skip mode and an inter mode; and an aggregation distortion of a current coding unit and an affected future coding unit are estimated and a propagation factor of a coding unit in a temporal domain distortion propagation model is calculated by constructing a time propagation chain, wherein a Lagrange multiplier is adjusted through an accurate propagation factor to realize a temporal domain dependency rate distortion optimization, and an I frame is subjected to a secondary coding technology to realize the temporal domain dependency rate distortion optimization of the I frame.

Abstract: Methods, systems, and techniques for tagless tracking of an object-of-interest are disclosed. Image and non-image data are generated across a plurality of camera-specific regions, and the object-of-interest is tracked over a global map formed as a composite of these regions.

Abstract: An image data processing method includes obtaining flight state information of an unmanned aerial vehicle (UAV), selecting a target image processing strategy from a plurality of image processing strategies based on the flight state information, and processing image data obtained by an imaging device carried by the UAV based on the target image processing strategy to obtain processed image data. The plurality of image processing strategies include an image stabilization strategy.

Abstract: This application discloses an image coding method comprising: obtaining a plurality of groups of human skeleton data associated with performing an action by a human body, wherein each group of the human skeleton data comprises joint data associated with a joint for performing the action; extracting, based on joint data in the plurality of groups of human skeleton data, a motion feature matrix corresponding to the plurality of groups of human skeleton data; and encoding the motion feature matrix to obtain a motion feature image.

Abstract: A wearable accessory device is disclosed. The wearable accessory device includes a flexible display coupled to a bi-stable spring. Coupling the display to the bi-stable spring allows the accessory device to be easily worn in a number of convenient locations.

Abstract: In some embodiments, a method generates a representation for a video that represents a relationship of a bitrate to a quality measurement for the video and selects candidate transcoding points on the representation. A plurality of candidate profile ladders are generated based on the candidate transcoding points. Each of the plurality of candidate profile ladders includes a different combination of profiles and a profile is associated with at least one of a bitrate and a quality measurement. The method selects a profile ladder from the plurality of candidate profile ladders based on analyzing the bitrate or the quality of the profile ladder and uses the profile ladder for the video.