Patents by Inventor Wenhui Jia
Wenhui Jia has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11849104Abstract: A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering.Type: GrantFiled: June 27, 2022Date of Patent: December 19, 2023Assignee: Dolby Laboratories Licensing CorporationInventors: Haricharan Lakshman, Wenhui Jia, Jasper Chao, Shwetha Ram, Domagoj Baricevic, Ajit Ninan
-
Patent number: 11670039Abstract: Bordering pixels delineating a texture hole region are identified in a target image. Depth values of the bordering pixels are automatically clustered into two depth value clusters. A specific estimation direction is selected from multiple candidate estimation directions for a texture hole pixel in a texture hole region. A depth value of the texture hole pixel is estimated by interpolating depth values of two bordering background pixels in the specific estimation direction. The estimated depth value is used to warp the texture hole pixel into a reference view represented by a temporal reference image. A pixel value of the texture hole pixel is predicted based on a reference pixel value of a reference pixel from the reference image to which the texture hole pixel is warped using the estimated depth value.Type: GrantFiled: March 4, 2020Date of Patent: June 6, 2023Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Wenhui Jia, Haricharan Lakshman, Ajit Ninan
-
Publication number: 20220329775Abstract: A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering.Type: ApplicationFiled: June 27, 2022Publication date: October 13, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Haricharan LAKSHMAN, Wenhui JIA, Jasper CHAO, Shwetha RAM, Domagoj BARICEVIC, Ajit NINAN
-
Patent number: 11393113Abstract: Bordering pixels delineating a texture hole region in an image are identified. Depth values of the bordering pixels are recorded. The depth values are automatically clustered into two depth value clusters with a depth value threshold separating the two depth value clusters. A subset of bordering background pixels is identified in the bordering pixels as those with depth values in one of the two depth value clusters that is declared as a background depth value cluster. The subset of bordering background pixels is used to predict texture hole pixel values in the texture hole region based on multiple candidate prediction directions. Quality indicator values are computed for the multiple candidate prediction directions and used to select a specific candidate prediction direction for filling in final texture hole pixel values in the texture hole region of the image.Type: GrantFiled: February 25, 2020Date of Patent: July 19, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Haricharan Lakshman, Ajit Ninan
-
Patent number: 11375178Abstract: A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering.Type: GrantFiled: March 4, 2020Date of Patent: June 28, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Haricharan Lakshman, Wenhui Jia, Jasper Chao, Shwetha Ram, Domagoj Baricevic, Ajit Ninan
-
Patent number: 11181977Abstract: Methods for using a head mounted display (HMD) can detect slippage of the HMD through the use of a comparison between, for example, a calibrated glint reference point and a glint reference point calculated during monitoring of glints during usage of the HMD.Type: GrantFiled: November 16, 2018Date of Patent: November 23, 2021Assignee: Dolby Laboratories Licensing CorporationInventor: Wenhui Jia
-
Patent number: 10992936Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: GrantFiled: November 11, 2019Date of Patent: April 27, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward
-
Publication number: 20200288114Abstract: A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering.Type: ApplicationFiled: March 4, 2020Publication date: September 10, 2020Applicant: Dolby Laboratories Licensing CorporationInventors: Haricharan LAKSHMAN, Wenhui JIA, Jasper CHAO, Shwetha RAM, Domagoj BARICEVIC, Ajit NINAN
-
Publication number: 20200286293Abstract: Bordering pixels delineating a texture hole region are identified in a target image. Depth values of the bordering pixels are automatically clustered into two depth value clusters. A specific estimation direction is selected from multiple candidate estimation directions for a texture hole pixel in a texture hole region. A depth value of the texture hole pixel is estimated by interpolating depth values of two bordering background pixels in the specific estimation direction. The estimated depth value is used to warp the texture hole pixel into a reference view represented by a temporal reference image. A pixel value of the texture hole pixel is predicted based on a reference pixel value of a reference pixel from the reference image to which the texture hole pixel is warped using the estimated depth value.Type: ApplicationFiled: March 4, 2020Publication date: September 10, 2020Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Haricharan LAKSHMAN, Ajit NINAN
-
Publication number: 20200279384Abstract: Bordering pixels delineating a texture hole region in an image are identified. Depth values of the bordering pixels are recorded. The depth values are automatically clustered into two depth value clusters with a depth value threshold separating the two depth value clusters. A subset of bordering background pixels is identified in the bordering pixels as those with depth values in one of the two depth value clusters that is declared as a background depth value cluster. The subset of bordering background pixels is used to predict texture hole pixel values in the texture hole region based on multiple candidate prediction directions. Quality indicator values are computed for the multiple candidate prediction directions and used to select a specific candidate prediction direction for filling in final texture hole pixel values in the texture hole region of the image.Type: ApplicationFiled: February 25, 2020Publication date: September 3, 2020Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Haricharan LAKSHMAN, Ajit NINAN
-
Publication number: 20200084448Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: ApplicationFiled: November 11, 2019Publication date: March 12, 2020Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Ajit NINAN, Arkady TEN, Gregory John WARD
-
Patent number: 10511837Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: GrantFiled: March 25, 2019Date of Patent: December 17, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward
-
Publication number: 20190222844Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: ApplicationFiled: March 25, 2019Publication date: July 18, 2019Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Ajit NINAN, Arkady TEN, Gregory John WARD
-
Publication number: 20190155380Abstract: Methods for using a head mounted display (HMD) can detect slippage of the HMD through the use of a comparison between, for example, a calibrated glint reference point and a glint reference point calculated during monitoring of glints during usage of the HMD.Type: ApplicationFiled: November 16, 2018Publication date: May 23, 2019Applicant: Dolby Laboratories Licensing CorporationInventor: Wenhui JIA
-
Patent number: 10264259Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: GrantFiled: June 18, 2018Date of Patent: April 16, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward
-
Patent number: 10121454Abstract: Displays, display components, image and video processing apparatus and related methods are described. A method for driving local-dimming displays comprises generating control values for driving pixels of a spatial light modulator from one image data component and generating control values for driving backlight elements from a second image data component. The first and second image data components may respectively comprise a tone map and a ratio image. Control values for the spatial light modulator and/or backlight may be obtained using cost effective hardware.Type: GrantFiled: February 17, 2017Date of Patent: November 6, 2018Assignee: Dolby Laboratories Licensing CorporationInventors: Ajit Ninan, Wenhui Jia
-
Publication number: 20180302623Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: ApplicationFiled: June 18, 2018Publication date: October 18, 2018Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Ajit NINAN, Arkady TEN, Gregory John WARD
-
Patent number: 10027961Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: GrantFiled: September 25, 2017Date of Patent: July 17, 2018Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward
-
Publication number: 20180014015Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: ApplicationFiled: September 25, 2017Publication date: January 11, 2018Applicant: Dolby Laboratories Licensing CorporationInventors: Wenhui JIA, Ajit NINAN, Arkady TEN, Gregory John WARD
-
Patent number: 9819938Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.Type: GrantFiled: April 7, 2017Date of Patent: November 14, 2017Assignee: Dolby Laboratories Licensing CorporationInventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward