Abstract: A method for jockey and horse recognition and tracking. The method includes receiving input images or a sequence of images obtained from horse racing videos or video streams; extracting features from the images by computational methods; locating jockey and horse positions of a target horse in the images by the computational methods; deciding to accept or reject the computed jockey and horse positions according to an acceptance function; and producing the final jockey and horse positions and their associated information by an error correction algorithm.

Abstract: A method for jockey and horse recognition and tracking. The method includes receiving input images or a sequence of images obtained from horse racing videos or video streams; extracting features from the images by computational methods; locating jockey and horse positions of a target horse in the images by the computational methods; deciding to accept or reject the computed jockey and horse positions according to an acceptance function; and producing the final jockey and horse positions and their associated information by an error correction algorithm.

Abstract: A method for video coding with coding parameter reuse is provided as follows. A first video encoding process is executed with respect to a first video source for generating a first video stream by a first video encoder. First coding parameters are exported during the first video encoding process by the first video encoder. The first coding parameters are processed to generate second coding parameters by a parameter processor. A second video encoding process is executed with respect to a second video source for generating a second video stream by a second video encoder. The first and second video sources have different dynamic ranges from each other, and the second coding parameters are introduced into the second video encoding process.

Abstract: A method for video coding with global rate-distortion optimization-based rate control (RC) is provided. By using this video coding method, an RC scheme for High dynamic range (HDR) in High Efficiency Video Coding (HEVC) is provided. Briefly, considering the characteristics of HDR image content, a rate-distortion (R-D) model based on HDR-Visual Difference Predictor (VDP)-2 for performance optimization is provided. In the optimization process, the ? is directly utilized rather than the bit rate to obtain the globally optimal solution. Finally, the model parameter estimation method is used to reduce errors. The video coding method of the present invention is verified that bit rate reduction on average can be achieved.

Abstract: The present disclosure relates to a method for image patch selection for training a neural network for image quality assessment. The method includes receiving an input image and extracting one or more image patches from the input image. The moment of the extracted image patches is measured. There is a decision to accept or decline the extracted image patches according to the measured moment. Additional image patches are extracted until a minimum number, Nmin, of extracted image patches are accepted. Alternatively, selection criteria are adjusted until the minimum number of extracted image patches are accepted. The selected image patches are input into a neural network with a corresponding image quality value of the input image, and the neural network is trained with the image patches and image quality value. Also provided is a method for image quality assessment using a neural network trained as set forth above.

Abstract: A method based on CTU level rate-distortion optimization for rate control in video coding which can effectively improve the perceptual rate-distortion performance and coding efficiency is provided. Firstly, a perceptual rate-distortion model is established using a divisive normalization framework, which characterizes the relationship between local visual quality and coding bits. Subsequently, the established perceptual rate-distortion model is applied to overall distortion optimization which is transformed into a global optimization problem and solved with convex optimization algorithms to obtain optimal CTU level coding bit allocation.

Abstract: A machine learning based initial quantization parameter (QP) prediction method, which can effectively optimize RC performance A machine learning framework for initial QP prediction is proposed, where learning labels are built with the criterion of maximizing rate-distortion (RC) performance, which is proved to be much more effective than the QP determination method with the only consideration on sum of the absolute transformed difference (SATD) complexity. Instead of target bits per pixel for intra frame, target bits per pixel for remaining frames is used as sample data to avoid empirically setting intra frame bit allocation, thus improve the prediction accuracy as the real-time updated remaining bits can better reflect the real-time requirements on the level of QPs. In addition, a clipping and decision approach based on the previous initial QP and the target bits per pixel for all remaining frames is proposed, which can help fast QP adaption and quality smoothness.

Abstract: A method based on CTU level rate-distortion optimization for rate control in video coding which can effectively improve the perceptual rate-distortion performance and coding efficiency is provided. Firstly, a perceptual rate-distortion model is established using a divisive normalization framework, which characterizes the relationship between local visual quality and coding bits. Subsequently, the established perceptual rate-distortion model is applied to overall distortion optimization which is transformed into a global optimization problem and solved with convex optimization algorithms to obtain optimal CTU level coding bit allocation.

Abstract: A machine learning based initial quantization parameter (QP) prediction method, which can effectively optimize RC performance. A machine learning framework for initial QP prediction is proposed, where learning labels are built with the criterion of maximizing rate-distortion (RC) performance, which is proved to be much more effective than the QP determination method with the only consideration on sum of the absolute transformed difference (SATD) complexity. Instead of target bits per pixel for intra frame, target bits per pixel for remaining frames is used as sample data to avoid empirically setting intra frame bit allocation, thus improve the prediction accuracy as the real-time updated remaining bits can better reflect the real-time requirements on the level of QPs. In addition, a clipping and decision approach based on the previous initial QP and the target bits per pixel for all remaining frames is proposed, which can help fast QP adaption and quality smoothness.

Abstract: The present disclosure relates to a method for image patch selection for training a neural network for image quality assessment. The method includes receiving an input image and extracting one or more image patches from the input image. The moment of the extracted image patches is measured. There is a decision to accept or decline the extracted image patches according to the measured moment. Additional image patches are extracted until a minimum number, Nmin, of extracted image patches are accepted. Alternatively, selection criteria are adjusted until the minimum number of extracted image patches are accepted. The selected image patches are input into a neural network with a corresponding image quality value of the input image, and the neural network is trained with the image patches and image quality value. Also provided is a method for image quality assessment using a neural network trained as set forth above.

Abstract: An intelligent method and system for expanding and enhancing the color content of video or image to a wider color gamut to make the displayed video or image more pleasing while certain important and sensitive colors such as skin colors are preserved to avoid the perception of visually unnatural image or video artifacts. With the implementation of such method and system, the merits of the wide color gamut display can be fully utilized to provide videos and images of high visual quality.

Abstract: A method and apparatus for converting a standard dynamic range (SDR) video to a high dynamic range (HDR) video. The conversion is adaptive and takes both spatial and temporal information of a current frame and previous frames into consideration such that the majority of pixels falls into the most sensitive regions of human eyes in the target dynamic range, while at the same time, the continuity of luminance is maintained in temporal domain to prevent flickering.

Abstract: An intelligent method and system for expanding and enhancing the color content of video or image to a wider color gamut to make the displayed video or image more pleasing while certain important and sensitive colors such as skin colors are preserved to avoid the perception of visually unnatural image or video artifacts. With the implementation of such method and system, the merits of the wide color gamut display can be fully utilized to provide videos and images of high visual quality.

Abstract: A method and apparatus for converting a standard dynamic range (SDR) video to a high dynamic range (HDR) video. The conversion is adaptive and takes both spatial and temporal information of a current frame and previous frames into consideration such that the majority of pixels falls into the most sensitive regions of human eyes in the target dynamic range, while at the same time, the continuity of luminance is maintained in temporal domain to prevent flickering.

Abstract: An image device includes a plurality of first sub-pixels, a plurality of second sub-pixels, a plurality of third sub-pixels, a plurality of fourth sub-pixels, and a plurality of fifth sub-pixels. The image device further comprises a plurality of basic repeating units. Each of the basic repeating units comprises the first sub-pixels, the second sub-pixels, the third sub-pixels, the fourth sub-pixels, and the fifth sub-pixel. A ratio of the first sub-pixels to the second sub-pixels to the third sub-pixels to the fourth sub-pixels and to the fifth sub-pixel in the basic repeating unit is 3:3:4:1:1.

Abstract: An image device includes a plurality of red sub-pixels, a plurality of green sub-pixels, a plurality of blue sub-pixels, a plurality of white sub-pixels, and a plurality of yellow sub-pixels. A ratio of the total number of red sub-pixels to the total number of green sub-pixels to the total number of blue sub-pixels to the total number of white sub-pixels and to the total number of yellow sub-pixels is about 3:3:3:1:2.

Abstract: An image device includes a plurality of first sub-pixels, a plurality of second sub-pixels, a plurality of third sub-pixels, a plurality of fourth sub-pixels, and a plurality of fifth sub-pixels. The image device further comprises a plurality of basic repeating units. Each of the basic repeating units comprises the first sub-pixels, the second sub-pixels, the third sub-pixels, the fourth sub-pixels, and the fifth sub-pixel. A ratio of the first sub-pixels to the second sub-pixels to the third sub-pixels to the fourth sub-pixels and to the fifth sub-pixel in the basic repeating unit is 3:3:4:1:1.

Abstract: An image device includes a plurality of first sub-pixels, a plurality of second sub-pixels, a plurality of third sub-pixels, a plurality of fourth sub-pixels, and a plurality of fifth sub-pixels. The image device further is consisted by a plurality of basic repeating units in a 2×8 matrix. Each of the basic repeating units comprises the first sub-pixels, the second sub-pixels, the third sub-pixels, the fourth sub-pixels, and the fifth sub-pixel. A ratio of the first sub-pixels to the second sub-pixels to the third sub-pixels to the fourth sub-pixels and to the fifth sub-pixel in the basic repeating unit is 4:4:4:3:1.