Patents by Inventor Bosheng Zhang
Bosheng Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12356083Abstract: Embodiments disclosed herein are directed to devices and methods for performing spatially-varying brightness correction of a flash image. The spatially-varying brightness correction utilizes a set of images that includes one or more images captured under flash illumination and one or more images captured without flash illumination, which are used to decompose one of the flash images or an image generated therefrom into a flash contribution image and an ambient contribution image. The flash contribution image and the ambient contribution image are recombined to generate a corrected flash image, and information about the flash module and/or scene is used to adjust the relative contributions of these images during recombination.Type: GrantFiled: September 22, 2022Date of Patent: July 8, 2025Assignee: Apple Inc.Inventors: Bosheng Zhang, Tobias Baldauf, Ilya Romanenko, Nicolas P. Bonnier, Noah D. Bedard, Alexandra S. Ludlow, Graham D. Finlayson, Jason P. de Villiers, Claus Moelgaard, Hau Ling Hung, Paul M. Hubel
-
Patent number: 12348875Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: GrantFiled: September 22, 2022Date of Patent: July 1, 2025Assignee: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Noah D Bedard, Kathrin Berkner Cieslicki, Tongbo Chen, Paul M Hubel, Farhan A Baqai, Nicolas Pierre Bonnier, Bryan Dang
-
Publication number: 20250199606Abstract: A technique for providing user selection includes obtaining first sensor data from a first device worn on a head, and obtaining second sensor data from a second device worn on the head. The first and second sensor data are collected in a same time frame. A head position is determined for the head based on the first sensor data and the second sensor data. User input is received based on an input gesture. In response to the user input, an object in the local environment is identified based on the head position and selection input.Type: ApplicationFiled: December 18, 2024Publication date: June 19, 2025Inventors: Bosheng Zhang, Noah D. Bedard, Jonathan A. Topf, Joseph A. Malia, Ethan T. Daniels, Brett D. Miller, Kathrin Berkner Cieslicki
-
Publication number: 20250113107Abstract: Techniques are described that utilize continuous flash lighting, e.g., with automatic activation/deactivation and brightness control of a flash lighting element in an electronic image capturing device. Depth sensing, in combination with front and/or rear lux sensing, is performed at the device and used to evaluate the lighting on the object of interest being captured and/or the overall scene light levels. A lighting element (e.g., a single- or multi-channel flash element) may be controlled automatically based on the depth, front and rear lux sensing, or a combination thereof. The lighting element's intensity may be automatically adjusted in a smooth and gradual manner, e.g., utilizing ranges of acceptable lux values and/or non-linear lighting element activation functions.Type: ApplicationFiled: September 27, 2024Publication date: April 3, 2025Inventors: Bosheng Zhang, Kurt S. Clark
-
Publication number: 20250106506Abstract: Methods and apparatus for camera focusing for video passthrough devices. Gaze information from a gaze tracking subsystem, either alone or along with depth information from a depth tracking system, may be leveraged to determine depths at which to focus. Gaze information, or a combination of depth and gaze information, may be used. As an alternative, the user can manually control the focus distance. For example, a manual bifocal method may provide two focus distances (near focus and far focus.Type: ApplicationFiled: September 17, 2024Publication date: March 27, 2025Applicant: Apple Inc.Inventors: Brett D Miller, Bosheng Zhang, Kathrin Berkner Cieslicki, Stephane P Bersot, Noah D Bedard
-
Patent number: 12219267Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: GrantFiled: September 22, 2022Date of Patent: February 4, 2025Assignee: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Bryan Dang
-
Publication number: 20250016292Abstract: A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.Type: ApplicationFiled: September 20, 2024Publication date: January 9, 2025Applicant: Apple Inc.Inventors: Felipe Bacim de Araujo e Silva, Stuart J. Wood, Noah D. Bedard, Bosheng Zhang, Dana F. Segler, JR., Blake M. Coughenour, Rong Liu, Yung-Yu Hsu
-
Patent number: 12132996Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: GrantFiled: September 22, 2022Date of Patent: October 29, 2024Assignee: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Kathrin Berkner Cieslicki, Paul M Hubel, Frederic Cao, Bryan Dang
-
Patent number: 12126943Abstract: A spatial light system that may, for example, be used to project image content onto surfaces of a room. The system may include two or more projection units for emitting light onto surfaces within a room. The system may include a controller and two or more projection units, each module including an LED array, an array of light pipes, and a condenser lens. Two or more projection units may be connected to a flexible strip that provides power and data (e.g., serial data) to the projection units. Two or more flex strips may be connected together. The flex strips provide a serially-connected, flexible modular architecture for spatial light systems that allow the projection units to be conformed to a variety of configurations and shapes.Type: GrantFiled: February 4, 2022Date of Patent: October 22, 2024Assignee: Apple Inc.Inventors: Felipe Bacim de Araujo e Silva, Stuart J. Wood, Noah D. Bedard, Bosheng Zhang, Dana F. Segler, Jr., Blake M. Coughenour, Rong Liu, Yung-Yu Hsu
-
Patent number: 12105897Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.Type: GrantFiled: November 11, 2022Date of Patent: October 1, 2024Assignee: Apple Inc.Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
-
Publication number: 20240201512Abstract: Methods and apparatus for generating images to be displayed on lenticular displays. In these methods, a fixed mesh is generated offline, and in real-time texture information is mapped to the fixed mesh. In an offline process, texture and 3D mesh information for an object is used to render UV map views for multiple viewpoints of the object, view maps are generated from display calibration data, and a lenticular to UV map is generated from the UV map views and view maps. In real-time, texture information is captured, and a composite process is performed that generates a lenticular image for multiple viewpoints by sampling pixels from the texture based on the lenticular to UV map. The lenticular image is then displayed on the lenticular display. Detected positions of persons in the environment may be used to limit the number of viewpoints that are generated during the real-time composite process.Type: ApplicationFiled: December 16, 2022Publication date: June 20, 2024Applicant: Apple Inc.Inventors: Felipe Bacim De Araujo E Silva, Noah D. Bedard, Bosheng Zhang, Brett D. Miller, Seung Wook Kim
-
Publication number: 20240107177Abstract: Embodiments disclosed herein are directed to devices and methods for performing spatially-varying brightness correction of a flash image. The spatially-varying brightness correction utilizes a set of images that includes one or more images captured under flash illumination and one or more images captured without flash illumination, which are used to decompose one of the flash images or an image generated therefrom into a flash contribution image and an ambient contribution image. The flash contribution image and the ambient contribution image are recombined to generate a corrected flash image, and information about the flash module and/or scene is used to adjust the relative contributions of these images during recombination.Type: ApplicationFiled: September 22, 2022Publication date: March 28, 2024Inventors: Bosheng Zhang, Tobias Baldauf, llya Romanenko, Nicolas P. Bonnier, Noah D. Bedard, Alexandra S. Ludlow, Graham D. Finlayson, Jason P. de Villiers, Claus Moelgaard, Hau Ling Hung, Paul M. Hubel
-
Publication number: 20230101548Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: ApplicationFiled: September 22, 2022Publication date: March 30, 2023Applicant: Apple Inc.Inventors: Bosheng Zhang, Angelo M. Alaimo, Noah D. Bedard, Kathrin Berkner Cieslicki, Tongbo Chen, Paul M. Hubel, Farhan A. Baqai, Nicolas Pierre Bonnier, Bryan Dang
-
Publication number: 20230098699Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: ApplicationFiled: September 22, 2022Publication date: March 30, 2023Applicant: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Kathrin Berkner Cieslicki, Paul M Hubel, Frederic Cao, Bryan Dang
-
Publication number: 20230095000Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.Type: ApplicationFiled: September 22, 2022Publication date: March 30, 2023Applicant: Apple Inc.Inventors: Bosheng Zhang, Angelo M Alaimo, Bryan Dang
-
Publication number: 20230078597Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.Type: ApplicationFiled: November 11, 2022Publication date: March 16, 2023Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
-
Patent number: 11550408Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.Type: GrantFiled: June 28, 2021Date of Patent: January 10, 2023Assignee: Apple Inc.Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
-
Publication number: 20220413636Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.Type: ApplicationFiled: June 28, 2021Publication date: December 29, 2022Inventors: Jean Hsiang-Chun Lu, Bosheng Zhang, Kathrin Berkner Cieslicki, Manohar B. Srikanth, Noah D. Bedard, Ting Sun
-
Publication number: 20220383470Abstract: A system includes a processing unit communicatively coupled to a detector array of an optical wafer characterization system. The processing unit is configured to perform one or more steps of a method or process including the steps of acquiring one or more target images of a target location on a wafer from the detector array, applying a de-noising filter to at least the one or more target images, determining one or more difference images from one or more reference images and the one or more target images, and up-sampling the one or more difference images to generate one or more up-sampled images. One or more wafer defects are detectable in the one or more difference images or the up-sampled images.Type: ApplicationFiled: October 1, 2021Publication date: December 1, 2022Inventors: Abdurrahman Sezginer, Wei Zhao, Richard Wallingford, Grace Hsiu-Ling Chen, Xuzhao Liu, Ge Cong, Leon Yu, Kuljit Virk, Bosheng Zhang, Amrish Patel, Patrick McBride
-
Patent number: 11281884Abstract: An apparatus for touch-sensing includes a light-emitting layer covered by a transparent layer and configured to illuminate a surface touching the transparent layer and to allow transmission of reflected light rays from the surface to underlying layers. The underlying layers include an optical coupling layer, a collimator layer and a pixelated image sensor. The optical coupling layer bends the reflected light rays to create oblique light rays. The collimator layer includes a number of apertures to collimate the received light rays. The pixelated image sensor senses the collimated oblique light rays.Type: GrantFiled: August 25, 2020Date of Patent: March 22, 2022Assignee: Apple Inc.Inventors: Ting Sun, Mohammad Yeke Yazdandoost, Bosheng Zhang, Marduke Yousefpor, Kathrin Berkner Cieslicki