Patents by Inventor Nicolas Pierre Marie Frederic Bonnier
Nicolas Pierre Marie Frederic Bonnier has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240127400Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.Type: ApplicationFiled: December 13, 2023Publication date: April 18, 2024Applicant: Apple Inc.Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
-
Publication number: 20240045502Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.Type: ApplicationFiled: October 17, 2023Publication date: February 8, 2024Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
-
Patent number: 11822715Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.Type: GrantFiled: May 10, 2021Date of Patent: November 21, 2023Assignee: Apple Inc.Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
-
Publication number: 20230333649Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.Type: ApplicationFiled: June 28, 2023Publication date: October 19, 2023Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
-
Patent number: 11789529Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.Type: GrantFiled: January 5, 2022Date of Patent: October 17, 2023Assignee: Apple Inc.Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
-
Patent number: 11361476Abstract: An electronic device may include a display panel with pixels that present an image based on image data and an application processor that generates the image data. The electronic device may include a display pipeline coupled to the electronic display and the application processor. The display pipeline may receive first image data from the application processor corresponding to a first color space used by the application processor. The display pipeline may apply a color mapping relationship to the first image data to generate second image data. The color mapping relationship may define a transform to apply to the first image data to generate the second image data corresponding to a second color space used by the electronic display. The display pipeline may transmit the second image data to a display driver that operates the electronic display to emit light according to the second image data.Type: GrantFiled: September 14, 2020Date of Patent: June 14, 2022Assignee: Apple Inc.Inventors: Vincent Z. Young, Can Jin, Mahesh B. Chappalli, Peter F. Holland, Nicolas Pierre Marie Frederic Bonnier
-
Publication number: 20220130350Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.Type: ApplicationFiled: January 5, 2022Publication date: April 28, 2022Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
-
Patent number: 11295425Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.Type: GrantFiled: December 4, 2020Date of Patent: April 5, 2022Assignee: Apple Inc.Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
-
Patent number: 11244660Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.Type: GrantFiled: February 11, 2021Date of Patent: February 8, 2022Assignee: Apple Inc.Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
-
Publication number: 20220011858Abstract: In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.Type: ApplicationFiled: May 10, 2021Publication date: January 13, 2022Inventors: Yang Li, Alexandre Chapiro, Mehmet N. Agaoglu, Nicolas Pierre Marie Frederic Bonnier, Yi-Pai Huang, Chaohao Wang, Andrew B. Watson, Pretesh A. Mascarenhas
-
Publication number: 20210287633Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.Type: ApplicationFiled: February 11, 2021Publication date: September 16, 2021Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
-
Publication number: 20210090225Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.Type: ApplicationFiled: December 4, 2020Publication date: March 25, 2021Applicant: Apple Inc.Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
-
Patent number: 10861142Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.Type: GrantFiled: July 19, 2018Date of Patent: December 8, 2020Assignee: Apple Inc.Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
-
Patent number: 10198794Abstract: A system and computer-implemented method of altering perceptibility of depth in an image. The method comprises receiving a desired change in the perceptibility of depth in the image; receiving a depth-map corresponding to the image; and determining at least one characteristic of the image. The method further comprises applying an image process to the image, the image process varying in strength according to the depth map, and in accordance with a non-linear predetermined mapping relating a strength of the applied image process to a change in the perceptibility of depth, the mapping being determined with respect to the identified characteristic.Type: GrantFiled: December 16, 2016Date of Patent: February 5, 2019Assignee: Canon Kabushiki KaishaInventors: Nicolas Pierre Marie Frederic Bonnier, Anna Wong, Clement Fredembach, Peter Jan Pakulski, Steven Richard Irrgang
-
Publication number: 20190026874Abstract: A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.Type: ApplicationFiled: July 19, 2018Publication date: January 24, 2019Applicant: Apple Inc.Inventors: Can Jin, Nicolas Pierre Marie Frederic Bonnier, Hao Pan
-
Patent number: 10120267Abstract: A method of re-configuring a lighting arrangement (120-170) used to light a scene (100) which is to be captured by an image capture device (110), the method including the steps of: obtaining an initial image of the scene (100) using an initial configuration (190) of the lighting arrangement; developing an image content map identifying at least one scene characteristic of at least a part of the scene (100) captured in the initial image; determining a desired aesthetic effect for a further image to be captured based on the scene (100); in accordance with the at least one scene characteristic identified in the image content map, selecting from a plurality of aesthetic factors at least one aesthetic factor involving adjustment in order to achieve the determined desired aesthetic effect for the further image; and developing at least one lighting parameter for re-configuring the lighting arrangement (120-170), wherein the at least one lighting parameter corresponds with the at least one selected aesthetic factor.Type: GrantFiled: May 18, 2015Date of Patent: November 6, 2018Assignee: CANON KABUSHIKI KAISHAInventors: Nicolas Pierre Marie Frederic Bonnier, Geoffrey John Woolfe
-
Publication number: 20170178298Abstract: A system and computer-implemented method of altering perceptibility of depth in an image. The method comprises receiving a desired change in the perceptibility of depth in the image; receiving a depth-map corresponding to the image; and determining at least one characteristic of the image. The method further comprises applying an image process to the image, the image process varying in strength according to the depth map, and in accordance with a non-linear predetermined mapping relating a strength of the applied image process to a change in the perceptibility of depth, the mapping being determined with respect to the identified characteristic.Type: ApplicationFiled: December 16, 2016Publication date: June 22, 2017Inventors: Nicolas Pierre Marie Frederic Bonnier, Anna Wong, Clement Fredembach, Peter Jan Pakulski, Steven Richard Irrgang
-
Publication number: 20150338722Abstract: A method of re-configuring a lighting arrangement (120-170) used to light a scene (100) which is to be captured by an image capture device (110), the method including the steps of: obtaining an initial image of the scene (100) using an initial configuration (190) of the lighting arrangement; developing an image content map identifying at least one scene characteristic of at least a part of the scene (100) captured in the initial image; determining a desired aesthetic effect for a further image to be captured based on the scene (100); in accordance with the at least one scene characteristic identified in the image content map, selecting from a plurality of aesthetic factors at least one aesthetic factor involving adjustment in order to achieve the determined desired aesthetic effect for the further image; and developing at least one lighting parameter for re-configuring the lighting arrangement (120-170), wherein the at least one lighting parameter corresponds with the at least one selected aesthetic factor.Type: ApplicationFiled: May 18, 2015Publication date: November 26, 2015Inventors: Nicolas Pierre Marie Frederic Bonnier, Geoffrey John Woolfe