Patents by Inventor Bosheng Zhang

Bosheng Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12356083
    Abstract: Embodiments disclosed herein are directed to devices and methods for performing spatially-varying brightness correction of a flash image. The spatially-varying brightness correction utilizes a set of images that includes one or more images captured under flash illumination and one or more images captured without flash illumination, which are used to decompose one of the flash images or an image generated therefrom into a flash contribution image and an ambient contribution image. The flash contribution image and the ambient contribution image are recombined to generate a corrected flash image, and information about the flash module and/or scene is used to adjust the relative contributions of these images during recombination.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: July 8, 2025
    Assignee: Apple Inc.
    Inventors: Bosheng Zhang, Tobias Baldauf, Ilya Romanenko, Nicolas P. Bonnier, Noah D. Bedard, Alexandra S. Ludlow, Graham D. Finlayson, Jason P. de Villiers, Claus Moelgaard, Hau Ling Hung, Paul M. Hubel
  • Patent number: 12348875
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: July 1, 2025
    Assignee: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M Alaimo, Noah D Bedard, Kathrin Berkner Cieslicki, Tongbo Chen, Paul M Hubel, Farhan A Baqai, Nicolas Pierre Bonnier, Bryan Dang
  • Publication number: 20250199606
    Abstract: A technique for providing user selection includes obtaining first sensor data from a first device worn on a head, and obtaining second sensor data from a second device worn on the head. The first and second sensor data are collected in a same time frame. A head position is determined for the head based on the first sensor data and the second sensor data. User input is received based on an input gesture. In response to the user input, an object in the local environment is identified based on the head position and selection input.
    Type: Application
    Filed: December 18, 2024
    Publication date: June 19, 2025
    Inventors: Bosheng Zhang, Noah D. Bedard, Jonathan A. Topf, Joseph A. Malia, Ethan T. Daniels, Brett D. Miller, Kathrin Berkner Cieslicki
  • Publication number: 20250113107
    Abstract: Techniques are described that utilize continuous flash lighting, e.g., with automatic activation/deactivation and brightness control of a flash lighting element in an electronic image capturing device. Depth sensing, in combination with front and/or rear lux sensing, is performed at the device and used to evaluate the lighting on the object of interest being captured and/or the overall scene light levels. A lighting element (e.g., a single- or multi-channel flash element) may be controlled automatically based on the depth, front and rear lux sensing, or a combination thereof. The lighting element's intensity may be automatically adjusted in a smooth and gradual manner, e.g., utilizing ranges of acceptable lux values and/or non-linear lighting element activation functions.
    Type: Application
    Filed: September 27, 2024
    Publication date: April 3, 2025
    Inventors: Bosheng Zhang, Kurt S. Clark
  • Publication number: 20250106506
    Abstract: Methods and apparatus for camera focusing for video passthrough devices. Gaze information from a gaze tracking subsystem, either alone or along with depth information from a depth tracking system, may be leveraged to determine depths at which to focus. Gaze information, or a combination of depth and gaze information, may be used. As an alternative, the user can manually control the focus distance. For example, a manual bifocal method may provide two focus distances (near focus and far focus.
    Type: Application
    Filed: September 17, 2024
    Publication date: March 27, 2025
    Applicant: Apple Inc.
    Inventors: Brett D Miller, Bosheng Zhang, Kathrin Berkner Cieslicki, Stephane P Bersot, Noah D Bedard
  • Patent number: 12219267
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: February 4, 2025
    Assignee: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M Alaimo, Bryan Dang
  • Publication number: 20250016292
    Abstract: A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.
    Type: Application
    Filed: September 20, 2024
    Publication date: January 9, 2025
    Applicant: Apple Inc.
    Inventors: Felipe Bacim de Araujo e Silva, Stuart J. Wood, Noah D. Bedard, Bosheng Zhang, Dana F. Segler, JR., Blake M. Coughenour, Rong Liu, Yung-Yu Hsu
  • Patent number: 12132996
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: October 29, 2024
    Assignee: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M Alaimo, Kathrin Berkner Cieslicki, Paul M Hubel, Frederic Cao, Bryan Dang
  • Patent number: 12126943
    Abstract: A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.
    Type: Grant
    Filed: February 4, 2022
    Date of Patent: October 22, 2024
    Assignee: Apple Inc.
    Inventors: Felipe Bacim de Araujo e Silva, Stuart J. Wood, Noah D. Bedard, Bosheng Zhang, Dana F. Segler, Jr., Blake M. Coughenour, Rong Liu, Yung-Yu Hsu
  • Patent number: 12105897
    Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.
    Type: Grant
    Filed: November 11, 2022
    Date of Patent: October 1, 2024
    Assignee: Apple Inc.
    Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
  • Publication number: 20240201512
    Abstract: Methods and apparatus for generating images to be displayed on lenticular displays. In these methods, a fixed mesh is generated offline, and in real-time texture information is mapped to the fixed mesh. In an offline process, texture and 3D mesh information for an object is used to render UV map views for multiple viewpoints of the object, view maps are generated from display calibration data, and a lenticular to UV map is generated from the UV map views and view maps. In real-time, texture information is captured, and a composite process is performed that generates a lenticular image for multiple viewpoints by sampling pixels from the texture based on the lenticular to UV map. The lenticular image is then displayed on the lenticular display. Detected positions of persons in the environment may be used to limit the number of viewpoints that are generated during the real-time composite process.
    Type: Application
    Filed: December 16, 2022
    Publication date: June 20, 2024
    Applicant: Apple Inc.
    Inventors: Felipe Bacim De Araujo E Silva, Noah D. Bedard, Bosheng Zhang, Brett D. Miller, Seung Wook Kim
  • Publication number: 20240107177
    Abstract: Embodiments disclosed herein are directed to devices and methods for performing spatially-varying brightness correction of a flash image. The spatially-varying brightness correction utilizes a set of images that includes one or more images captured under flash illumination and one or more images captured without flash illumination, which are used to decompose one of the flash images or an image generated therefrom into a flash contribution image and an ambient contribution image. The flash contribution image and the ambient contribution image are recombined to generate a corrected flash image, and information about the flash module and/or scene is used to adjust the relative contributions of these images during recombination.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 28, 2024
    Inventors: Bosheng Zhang, Tobias Baldauf, llya Romanenko, Nicolas P. Bonnier, Noah D. Bedard, Alexandra S. Ludlow, Graham D. Finlayson, Jason P. de Villiers, Claus Moelgaard, Hau Ling Hung, Paul M. Hubel
  • Publication number: 20230101548
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 30, 2023
    Applicant: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M. Alaimo, Noah D. Bedard, Kathrin Berkner Cieslicki, Tongbo Chen, Paul M. Hubel, Farhan A. Baqai, Nicolas Pierre Bonnier, Bryan Dang
  • Publication number: 20230098699
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 30, 2023
    Applicant: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M Alaimo, Kathrin Berkner Cieslicki, Paul M Hubel, Frederic Cao, Bryan Dang
  • Publication number: 20230095000
    Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 30, 2023
    Applicant: Apple Inc.
    Inventors: Bosheng Zhang, Angelo M Alaimo, Bryan Dang
  • Publication number: 20230078597
    Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.
    Type: Application
    Filed: November 11, 2022
    Publication date: March 16, 2023
    Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
  • Patent number: 11550408
    Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: January 10, 2023
    Assignee: Apple Inc.
    Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
  • Publication number: 20220413636
    Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.
    Type: Application
    Filed: June 28, 2021
    Publication date: December 29, 2022
    Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
  • Publication number: 20220383470
    Abstract: A system includes a processing unit communicatively coupled to a detector array of an optical wafer characterization system. The processing unit is configured to perform one or more steps of a method or process including the steps of acquiring one or more target images of a target location on a wafer from the detector array, applying a de-noising filter to at least the one or more target images, determining one or more difference images from one or more reference images and the one or more target images, and up-sampling the one or more difference images to generate one or more up-sampled images. One or more wafer defects are detectable in the one or more difference images or the up-sampled images.
    Type: Application
    Filed: October 1, 2021
    Publication date: December 1, 2022
    Inventors: Abdurrahman Sezginer, Wei Zhao, Richard Wallingford, Grace Hsiu-Ling Chen, Xuzhao Liu, Ge Cong, Leon Yu, Kuljit Virk, Bosheng Zhang, Amrish Patel, Patrick McBride
  • Patent number: 11281884
    Abstract: An apparatus for touch-sensing includes a light-emitting layer covered by a transparent layer and configured to illuminate a surface touching the transparent layer and to allow transmission of reflected light rays from the surface to underlying layers. The underlying layers include an optical coupling layer, a collimator layer and a pixelated image sensor. The optical coupling layer bends the reflected light rays to create oblique light rays. The collimator layer includes a number of apertures to collimate the received light rays. The pixelated image sensor senses the collimated oblique light rays.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: March 22, 2022
    Assignee: Apple Inc.
    Inventors: Ting Sun, Mohammad Yeke Yazdandoost, Bosheng Zhang, Marduke Yousefpor, Kathrin Berkner Cieslicki