Patents by Inventor Nicolas Pierre Marie Frederic Bonnier

Nicolas Pierre Marie Frederic Bonnier has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240127400
    Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
    Type: Application
    Filed: December 13, 2023
    Publication date: April 18, 2024
    Applicant: Apple Inc.
    Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
  • Publication number: 20240045502
    Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.
    Type: Application
    Filed: October 17, 2023
    Publication date: February 8, 2024
    Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
  • Patent number: 11822715
    Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: November 21, 2023
    Assignee: Apple Inc.
    Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
  • Publication number: 20230333649
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Application
    Filed: June 28, 2023
    Publication date: October 19, 2023
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Patent number: 11789529
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: October 17, 2023
    Assignee: Apple Inc.
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Patent number: 11361476
    Abstract: An electronic device may include a display panel with pixels that present an image based on image data and an application processor that generates the image data. The electronic device may include a display pipeline coupled to the electronic display and the application processor. The display pipeline may receive first image data from the application processor corresponding to a first color space used by the application processor. The display pipeline may apply a color mapping relationship to the first image data to generate second image data. The color mapping relationship may define a transform to apply to the first image data to generate the second image data corresponding to a second color space used by the electronic display. The display pipeline may transmit the second image data to a display driver that operates the electronic display to emit light according to the second image data.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: June 14, 2022
    Assignee: Apple Inc.
    Inventors: Vincent Z. Young, Can Jin, Mahesh B. Chappalli, Peter F. Holland, Nicolas Pierre Marie Frederic Bonnier
  • Publication number: 20220130350
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Application
    Filed: January 5, 2022
    Publication date: April 28, 2022
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Patent number: 11295425
    Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: April 5, 2022
    Assignee: Apple Inc.
    Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
  • Patent number: 11244660
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Grant
    Filed: February 11, 2021
    Date of Patent: February 8, 2022
    Assignee: Apple Inc.
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Publication number: 20220011858
    Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.
    Type: Application
    Filed: May 10, 2021
    Publication date: January 13, 2022
    Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
  • Publication number: 20210287633
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Application
    Filed: February 11, 2021
    Publication date: September 16, 2021
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Publication number: 20210090225
    Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
    Type: Application
    Filed: December 4, 2020
    Publication date: March 25, 2021
    Applicant: Apple Inc.
    Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
  • Patent number: 10861142
    Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: December 8, 2020
    Assignee: Apple Inc.
    Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
  • Patent number: 10198794
    Abstract: A system and computer-implemented method of altering perceptibility of depth in an image. The method comprises receiving a desired change in the perceptibility of depth in the image; receiving a depth-map corresponding to the image; and determining at least one characteristic of the image. The method further comprises applying an image process to the image, the image process varying in strength according to the depth map, and in accordance with a non-linear predetermined mapping relating a strength of the applied image process to a change in the perceptibility of depth, the mapping being determined with respect to the identified characteristic.
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: February 5, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Nicolas Pierre Marie Frederic Bonnier, Anna Wong, Clement Fredembach, Peter Jan Pakulski, Steven Richard Irrgang
  • Publication number: 20190026874
    Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.
    Type: Application
    Filed: July 19, 2018
    Publication date: January 24, 2019
    Applicant: Apple Inc.
    Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
  • Patent number: 10120267
    Abstract: A method of re-configuring a lighting arrangement (120-170) used to light a scene (100) which is to be captured by an image capture device (110), the method including the steps of: obtaining an initial image of the scene (100) using an initial configuration (190) of the lighting arrangement; developing an image content map identifying at least one scene characteristic of at least a part of the scene (100) captured in the initial image; determining a desired aesthetic effect for a further image to be captured based on the scene (100); in accordance with the at least one scene characteristic identified in the image content map, selecting from a plurality of aesthetic factors at least one aesthetic factor involving adjustment in order to achieve the determined desired aesthetic effect for the further image; and developing at least one lighting parameter for re-configuring the lighting arrangement (120-170), wherein the at least one lighting parameter corresponds with the at least one selected aesthetic factor.
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: November 6, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Nicolas Pierre Marie Frederic Bonnier, Geoffrey John Woolfe
  • Publication number: 20170178298
    Abstract: A system and computer-implemented method of altering perceptibility of depth in an image. The method comprises receiving a desired change in the perceptibility of depth in the image; receiving a depth-map corresponding to the image; and determining at least one characteristic of the image. The method further comprises applying an image process to the image, the image process varying in strength according to the depth map, and in accordance with a non-linear predetermined mapping relating a strength of the applied image process to a change in the perceptibility of depth, the mapping being determined with respect to the identified characteristic.
    Type: Application
    Filed: December 16, 2016
    Publication date: June 22, 2017
    Inventors: Nicolas Pierre Marie Frederic Bonnier, Anna Wong, Clement Fredembach, Peter Jan Pakulski, Steven Richard Irrgang
  • Publication number: 20150338722
    Abstract: A method of re-configuring a lighting arrangement (120-170) used to light a scene (100) which is to be captured by an image capture device (110), the method including the steps of: obtaining an initial image of the scene (100) using an initial configuration (190) of the lighting arrangement; developing an image content map identifying at least one scene characteristic of at least a part of the scene (100) captured in the initial image; determining a desired aesthetic effect for a further image to be captured based on the scene (100); in accordance with the at least one scene characteristic identified in the image content map, selecting from a plurality of aesthetic factors at least one aesthetic factor involving adjustment in order to achieve the determined desired aesthetic effect for the further image; and developing at least one lighting parameter for re-configuring the lighting arrangement (120-170), wherein the at least one lighting parameter corresponds with the at least one selected aesthetic factor.
    Type: Application
    Filed: May 18, 2015
    Publication date: November 26, 2015
    Inventors: Nicolas Pierre Marie Frederic Bonnier, Geoffrey John Woolfe