Patents by Inventor Frederic Cao
Frederic Cao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11935285Abstract: This disclosure relates to techniques for synthesizing out of focus highlighting effects in images in real-time. Digital single-lens reflex (DSLR) cameras and other cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). So-called SDOF photography may be particularly fit for portrait photography, since it nicely emphasizes the subject, while essentially deemphasizing the background via blurring. Simulating this kind of blurring, particularly around background light sources, using a comparatively larger depth of field (LDOF) camera, may require a high dynamic range (HDR) image capture system, to accurately determine the color of background light sources, which are prone to saturation. However, small form-factor cameras having smaller lens apertures may not have the bandwidth or processing power to process full HDR images in real time.Type: GrantFiled: June 1, 2018Date of Patent: March 19, 2024Assignee: Apple Inc.Inventors: Frederic Cao, Philip G. Lee
-
Publication number: 20230229297Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.Type: ApplicationFiled: March 20, 2023Publication date: July 20, 2023Inventors: Behkish J. MANZARI, Marek BAREZA, Jeffrey A. BRASKET, Frederic CAO, Alan C. DYE, Elliott HARRIS, Cyrus Daniel IRANI, Jonathan P. IVE, Garrett JOHNSON, Emilie KIM, Joseph A. MALIA, Grant PAUL, Pavel PIVONKA, Billy SORRENTINO, III, Andre SOUZA DOS SANTOS
-
Patent number: 11620738Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.Type: GrantFiled: July 12, 2021Date of Patent: April 4, 2023Assignee: Apple Inc.Inventors: Touraj Tajbakhsh, Chihsin Wu, Frederic Cao
-
Publication number: 20230098699Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: ApplicationFiled: September 22, 2022Publication date: March 30, 2023Applicant: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Kathrin Berkner Cieslicki, Paul M Hubel, Frederic Cao, Bryan Dang
-
Patent number: 11204692Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.Type: GrantFiled: January 3, 2020Date of Patent: December 21, 2021Assignee: Apple Inc.Inventors: Behkish J. Manzari, Marek Bereza, Jeffrey A. Brasket, Frederic Cao, Alan C. Dye, Elliott Harris, Cyrus Daniel Irani, Jonathan P. Ive, Garrett Johnson, Emilie Kim, Joseph A. Malia, Grant Paul, Pavel Pivonka, Billy Sorrentino, III, Andre Souza Dos Santos
-
Publication number: 20210342989Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.Type: ApplicationFiled: July 12, 2021Publication date: November 4, 2021Inventors: Touraj Tajbakhsh, Chihsin Wu, Frederic Cao
-
Patent number: 11100620Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.Type: GrantFiled: September 4, 2018Date of Patent: August 24, 2021Assignee: Apple Inc.Inventors: Touraj Tajbakhsh, Chihsin Wu, Frederic Cao
-
Patent number: 10897558Abstract: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.Type: GrantFiled: September 10, 2019Date of Patent: January 19, 2021Assignee: Apple Inc.Inventors: Wei Sun, Philip G. Lee, Gregory Guyomarc'h, Frederic Cao
-
Patent number: 10855964Abstract: Embodiments relate to generation of hue maps for highlight recovery of an input image. An image having a plurality of color channels is obtained at a first resolution lower than a resolution of the input image. A hue for each color channel for each pixel is determined, using a pixel value for that color channel and pixel values for the plurality of color channels in the first image. Weights are determined for each pixel for each color channel, based on hues for the pixel and pixel values for the pixel in the first image. A plurality of candidate hue maps are generated, based on the weights and pixel values in the first image in a patch surrounding the pixel for the plurality of color channels.Type: GrantFiled: August 29, 2018Date of Patent: December 1, 2020Assignee: Apple Inc.Inventors: Frederic Cao, Touraj Tajbakhsh, Muge Wang
-
Patent number: 10762692Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: GrantFiled: September 6, 2019Date of Patent: September 1, 2020Assignee: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Patent number: 10740959Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.Type: GrantFiled: July 11, 2018Date of Patent: August 11, 2020Assignee: Apple Inc.Inventors: Garrett Johnson, Chong Chen, Frederic Cao
-
Publication number: 20200142577Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.Type: ApplicationFiled: January 3, 2020Publication date: May 7, 2020Inventors: Behkish J. MANZARI, Marek BEREZA, Jeffrey A. BRASKET, Frederic CAO, Alan C. DYE, Elliott HARRIS, Cyrus Daniel IRANI, Jonathan P. IVE, Garrett JOHNSON, Emilie KIM, Joseph A. MALIA, Grant PAUL, Pavel PIVONKA, Billy SORRENTINO, III, Andre SOUZA DOS SANTOS
-
Publication number: 20200082607Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: ApplicationFiled: September 6, 2019Publication date: March 12, 2020Applicant: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Publication number: 20200074601Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.Type: ApplicationFiled: September 4, 2018Publication date: March 5, 2020Inventors: Touraj Tajbakhsh, Chihsin Wu, Frederic Cao
-
Publication number: 20200077066Abstract: Embodiments relate to generation of hue maps for highlight recovery of an input image. An image having a plurality of color channels is obtained at a first resolution lower than a resolution of the input image. A hue for each color channel for each pixel is determined, using a pixel value for that color channel and pixel values for the plurality of color channels in the first image. Weights are determined for each pixel for each color channel, based on hues for the pixel and pixel values for the pixel in the first image. A plurality of candidate hue maps are generated, based on the weights and pixel values in the first image in a patch surrounding the pixel for the plurality of color channels.Type: ApplicationFiled: August 29, 2018Publication date: March 5, 2020Inventors: Frederic Cao, Touraj Tajbakhsh, Muge Wang
-
Patent number: 10528243Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.Type: GrantFiled: October 9, 2017Date of Patent: January 7, 2020Assignee: Apple Inc.Inventors: Behkish J. Manzari, Marek Bereza, Jeffrey A. Brasket, Frederic Cao, Alan C. Dye, Elliott Harris, Cyrus Daniel Irani, Jonathan P. Ive, Garrett Johnson, Emilie Kim, Joseph A. Malia, Grant Paul, Pavel Pivonka, Billy Sorrentino, III, Andre Souza Dos Santos
-
Patent number: 10467803Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: GrantFiled: September 11, 2018Date of Patent: November 5, 2019Assignee: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Publication number: 20190080508Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.Type: ApplicationFiled: July 11, 2018Publication date: March 14, 2019Applicant: Apple Inc.Inventors: Garrett Johnson, Chong Chen, Frederic Cao
-
Publication number: 20180349008Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.Type: ApplicationFiled: October 9, 2017Publication date: December 6, 2018Inventors: Behkish J. MANZARI, Marek BAREZA, Jeffrey A. BRASKET, Frederic CAO, Alan C. DYE, Elliott HARRIS, Cyrus Daniel IRANI, Jonathan P. IVE, Garrett JOHNSON, Emilie KIM, Joseph A. MALIA, Grant PAUL, Pavel PIVONKA, Billy SORRENTINO, Andre SOUZA DOS SANTOS
-
Patent number: 10070109Abstract: Embodiments of the present disclosure relate to highlight recovery of a high-resolution image using a single low-resolution image captured at a lower exposure. An example apparatus includes a hue target circuit that receives an input image at a high-resolution including at least one pixel with a clipped color channel. For example, the input image is a Blue sky image with a pixel having clipped Blue channel. The hue target circuit also receives a set of candidate hue maps having a pixel resolution lower than the high-resolution of the input image. The hue target circuit generates a target hue value for the at least one pixel using the pixel information of the set of candidate hue maps. The apparatus also includes a hue recovery circuit that generates a recovered version of the input image by adjusting hue information of the clipped color channel based on the generated target hue.Type: GrantFiled: June 30, 2016Date of Patent: September 4, 2018Assignee: Apple Inc.Inventors: Suk Hwan Lim, Frederic Cao, Touraj Tajbakhsh