Abstract: In one embodiment, a method includes accessing a first image corresponding to a first frame of a video stream, where the first image has complete pixel information, rendering a provisional image corresponding to a second frame of the video stream subsequent to the first frame, where the provisional image has a first area with complete pixel information and a second area with incomplete pixel information, generating a predicted image corresponding to the second frame by re-projecting at least an area of the first image according to one or more warping parameters, and generating a second image corresponding to the second frame by compositing the rendered provisional image and the predicted image.

Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

Abstract: Disclosed are an electronic apparatus and a method of controlling the same. The electronic apparatus includes: an interface circuitry; and a processor configured to receive a low resolution image for each of a plurality of frames of content and characteristic data from an external apparatus through the interface circuitry, generate, based on the low resolution image and the characteristic data, a high resolution image that has a larger amount of data than the low resolution image and has characteristics corresponding to the characteristic data, and control to display the generated high resolution image on a display.

Abstract: An endoscopic imaging system for use in a light deficient environment includes an imaging device having a tube, one or more image sensors, and a lens assembly including at least one optical elements that corresponds to the one or more image sensors. The endoscopic system includes a display for a user to visualize a scene and an image signal processing controller. The endoscopic system includes a light engine having an illumination source generating one or more pulses of electromagnetic radiation and a lumen transmitting one or more pulses of electromagnetic radiation to a distal tip of an endoscope.

Abstract: An image encoding/decoding method and apparatus for performing intra prediction using a plurality of reference sample lines are provided. An image decoding method may comprise configuring a plurality of reference sample lines, reconstructing an intra prediction mode of a current block, and performing intra prediction for the current block based on the intra prediction mode and the plurality of reference sample lines.

Abstract: In an on-screen display (OSD) image processing method for generating an interpolated frame with interpolated blocks, motion compensation is performed to generate motion compensation (MC) data according to a first motion vector referring to a previous frame and a second motion vector referring to a current frame. Zero-motion data are generated according to a zero-motion vector referring to the previous frame and the current frame. The MC data of a first weight and the zero-motion data of a second weight are blended to generate each interpolated block as a processed block. When the number of pixels having OSD data in the processed block is less than a first positive threshold and larger than a second positive threshold, the processed block is determined as an extended OSD block and the second weight of the extended OSD block is less than that of an OSD block.

Abstract: In an on-screen display (OSD) image processing method for generating an interpolated frame with interpolated blocks, motion compensation is performed to generate motion compensation (MC) data according to a first motion vector referring to a previous frame and a second motion vector referring to a current frame. Zero-motion data are generated according to a zero-motion vector referring to the previous frame and the current frame. The MC data of a first weight and the zero-motion data of a second weight are blended to generate each interpolated block as a processed block. When the number of pixels having OSD data in the processed block is less than a first positive threshold and larger than a second positive threshold, the processed block is determined as an extended OSD block and the second weight of the extended OSD block is less than that of an OSD block.

Abstract: A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes mapping a spherical video signal, stitched from multiple directional video signals, into a plurality of sub-picture video signals each containing a sequence of sub-pictures. The plurality of sub-picture video signals are encoded as a plurality of sub-picture bitstreams. The plurality of sub-picture bitstreams are composed into a plurality of sub-picture tracks to be compatible with a multi-bitstream merge function for reconstruction of the spherical video signal. A track level mergable indication is encoded within a track level box for the sub-picture tracks, which indicates the sub-picture tracks are compatible with the multi-bitstream merge function for reconstruction of the spherical video signal.

Abstract: A method for decoding video includes receiving quantized coefficients representative of a block of video representative of a plurality of pixels. The quantized coefficients are dequantized based upon a function of a remainder. The dequantized coefficients are inverse transformed to determine a decoded residue.

Abstract: This application discloses a video decoding method, a video encoding method, and related apparatuses. The method includes: determining a current video frame; obtaining, from video frames that have been decoded, an energy parameter of an MV in a reference frame associated with the current video frame, the energy parameter including at least one of the following: an average value of the MV and a variance of the MV; determining, according to the energy parameter, a target resolution used for decoding the current video frame; and decoding the current video frame by using the target resolution. In this application, the technical problem of relatively low video encoding and decoding efficiency caused by complex processing operations in the related art is resolved.

Abstract: Embodiments of the invention describe apparatuses, systems, and methods related to data capture of objects and/or an environment. In one embodiment, a user can capture time-indexed three-dimensional (3D) depth data using one or more portable data capture devices that can capture time indexed color images of a scene with depth information and location and orientation data. In addition, the data capture devices may be configured to captured a spherical view of the environment around the data capture device.

Abstract: A stereoscopic imaging platform includes a stereoscopic camera configured to record left and right images of a target site. A robotic arm is operatively connected to the stereoscopic camera, the robotic arm being adapted to selectively move the stereoscopic camera relative to the target. The stereoscopic camera includes a lens assembly having at least one lens and defining a working distance. The lens assembly has at least one focus motor adapted to move the at least one lens to selectively vary the working distance. A controller is adapted to selectively execute one or more automatic focusing modes for the stereoscopic camera. The automatic focusing modes include a continuous autofocus mode adapted to maintain a focus of the at least one stereoscopic image while the robotic arm is moving the stereoscopic camera and the target site is moving along at least an axial direction.

Abstract: The usual coding order according to which the reference view is coded prior to the dependent view, and within each view, a depth map is coded subsequent to the respective picture, may be maintained and does lead to a sacrifice of efficiency in performing inter-view redundancy removal by, for example, predicting motion data of the current picture of the dependent view from motion data of the current picture of the reference view. Rather, a depth map estimate of the current picture of the dependent view is obtained by warping the depth map of the current picture of the reference view into the dependent view, thereby enabling various methods of inter-view redundancy reduction more efficiently by bridging the gap between the views.

Abstract: This application relates to a video coding method and apparatus, a computer device, and a storage medium. The method includes: obtaining a current coding unit; obtaining target pixel gradient data through calculation according to a pixel value of a pixel in the current coding unit, the target pixel gradient data being obtained according to a difference between the pixel value of the pixel and a reference pixel value; determining a target division decision result corresponding to the current coding unit according to the target pixel gradient data; and performing video coding on the current coding unit according to the target division decision result.

Abstract: A method, decoder, and apparatus are provided. Responsive to a current block being a MIP predicted block, it is determined whether it has one or multiple transform blocks. A MIP weight matrix to be used to decode the current block is determined based on a MIP prediction mode. Responsive to the MIP predicted block having one transform block, the MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream. Responsive to the MIP predicted block having multiple transform blocks: deriving a first MIP predicted block is derived based on the MIP weight matrix and previously decoded elements in the bitstream and remaining MIP predicted blocks are derived based further on decoded elements in at least one decoded transform block of the current block. The MIP predicted block(s) are output for subsequent processing.

Abstract: Methods for management of encoding complexity for image and video encoding, for example for algorithms belonging to the JPEG 2000 family of standards, where the encoding process targets a given compressed size (i.e. a total coded length) for the image or for each frame of a video sequence. Described are a set of methods for complexity constrained encoding of HTJ2K code-streams, involving collection of local or global statistics for each sub-band (not for each code-block), generation of forecasts for the statistics of sub-band samples that have not yet been produced by spatial transformation and quantization processes, and the use of this information to generate a global quantization parameter, from which the coarsest bit-plane to generate in each code-block can be deduced. Coded length estimates can be generated in a manner that enables latency and memory to be separately optimized against encoded image quality, while maintaining low computational complexity.

Abstract: A method of video decoding in a decoder is provided. A first template magnitude of a first transform coefficient in a specific frequency region of the transform block is determined. The first template magnitude is a first single value representing magnitudes of a first local template of the first transform coefficient. A first context model is identified for coding the syntax element of the first transform coefficient, the first context model being shared with at least a second transform coefficient in the specific frequency region of the transform block, a second template magnitude of the second transform coefficient having a second single value that belongs to a first subinterval. A first bin of the syntax element of the first transform coefficient and a second bin of the syntax element of the second transform coefficient is determined, from the coded bits, based on the first context model.

Abstract: A system to perform processing operations of input (video) streams, including is disclosed. The system consists of an input module, a stream type detection engine, a plurality of processing resources a resource monitoring engine, an attribution module, a dispatching module, and various other optional interface modules.

Abstract: Disclosed herein are technological solutions that are configured to limit sub-optimal visualization of the surgical field during robotic and manual laparoscopic surgery. Such technological solutions are configured to systematically assess cleanliness of an imaging element of a laparoscope (or other type of similar imaging apparatus) and take action for enabling or causing the imaging element to be cleaned. In preferred embodiments, assessment of the cleanliness of the imaging element provides information that can be used for enabling or causing cleaning of the imaging element to be performed in-vivo in either a manual, semi-autonomous or autonomous manner. In this manner such technological solutions advantageously enable the surgical field during surgery to be more efficiently and consistently maintained in an optimal condition.

Abstract: Devices and methods of intra prediction of a block of a picture are provided. The method includes obtaining reference samples of a block, and determining a value of a predicted sample based on the reference samples and an intra prediction mode. The method further includes obtaining a value of a multiplier based on at least one dimension of the block, and normalizing the value of the predicted sample based on the value of the multiplier and a value of a shift. The intra prediction mode is INTRA_DC, or INTRA_BI, or horizontal intra prediction mode. By normalizing the value of the predicted sample based on the value of the multiplier and a value of a shift without division operation, the method could increase intra prediction efficiency.