Patents by Inventor Yan Côté
Yan Côté has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11880911Abstract: The present disclosure relates to techniques for transitioning between imagery and sounds of two different environments, such as a virtual environment and a real environment. A view of a first environment and audio associated with the first environment are provided. In response to detecting a transition event, a view of the first environment combined with a second environment is provided. The combined view includes imagery of the first environment at a first visibility value and imagery of the second environment at a second visibility value. In addition, in response to detecting a transition event, the first environment audio is mixed with audio associated with the second environment.Type: GrantFiled: September 6, 2019Date of Patent: January 23, 2024Assignee: Apple Inc.Inventors: Bertrand Nepveu, Sandy J. Carter, Vincent Chapdelaine-Couture, Marc-Andre Chenier, Yan Cote, Simon Fortin-Deschênes, Anthony Ghannoum, Tomlinson Holman, Marc-Olivier Lepage, Yves Millette
-
Publication number: 20230386095Abstract: The present disclosure relates to techniques for presenting a combined view of a virtual environment and a real environment in response to detecting a transition event associated with an object in the real environment. While presenting the combined view, if an input of a first type is detected, the combined view is adjusted by increasing the visibility of imagery of the virtual environment and decreasing the visibility of imagery of the real environment. If an input of a second type is detected, the combined view is adjusted by decreasing the visibility of the imagery of the virtual environment and increasing the visibility of the imagery of the real environment.Type: ApplicationFiled: August 14, 2023Publication date: November 30, 2023Inventors: Bertrand NEPVEU, Sandy J. CARTER, Vincent CHAPDELAINE-COUTURE, Marc-Andre CHENIER, Yan COTE, Simon FORTIN-DESCHÊNES, Anthony GHANNOUM, Tomlinson HOLMAN, Marc-Olivier LEPAGE, Yves MILLETTE
-
Patent number: 11790569Abstract: The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.Type: GrantFiled: September 6, 2019Date of Patent: October 17, 2023Assignee: Apple Inc.Inventors: Bertrand Nepveu, Sandy J. Carter, Vincent Chapdelaine-Couture, Marc-Andre Chenier, Yan Cote, Simon Fortin-Deschênes, Anthony Ghannoum, Tomlinson Holman, Marc-Olivier Lepage, Yves Millette
-
Publication number: 20230324684Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: ApplicationFiled: June 14, 2023Publication date: October 12, 2023Inventors: Simon Fortin-Deschenes, Vincent Chapdelaine-Couture, Yan Cote, Anthony Ghannoum
-
Publication number: 20230325965Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.Type: ApplicationFiled: June 14, 2023Publication date: October 12, 2023Inventors: Bertrand Nepveu, Marc-Andre Chenier, Yan Cote, Yves Millette
-
Patent number: 11778154Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.Type: GrantFiled: August 8, 2018Date of Patent: October 3, 2023Assignee: APPLE INC.Inventors: Vincent Chapdelaine-Couture, Anthony Ghannoum, Yan Cote, Irving Lustigman, Marc-Andre Chenier, Simon Fortin-Deschenes, Bertrand Nepveu
-
Patent number: 11736822Abstract: A method includes obtaining a first plurality of image frames that are provided by an image sensor at a first output rate. The method includes determining a GPU temporal processing value characterizing the GPU processing of the first plurality of image frames. The GPU temporal processing value is a function of an amount of information associated with the first plurality of image frames. The method includes determining an operation value associated with the image sensor based on a function of the GPU temporal processing value. The operation value modifies the operation of the image sensor. The method includes changing, using a controller, the operation of the image sensor as a function of the operation value so that the image sensor provides a second plurality of image frames at a second output rate.Type: GrantFiled: February 16, 2021Date of Patent: August 22, 2023Assignee: APPLE INC.Inventors: Bertrand Nepveu, Marc-Andre Chenier, Yan Cote, Yves Millette
-
Patent number: 11704766Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.Type: GrantFiled: November 2, 2022Date of Patent: July 18, 2023Assignee: APPLE INC.Inventors: Bertrand Nepveu, Marc-Andre Chenier, Yan Cote, Yves Millette
-
Patent number: 11693242Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: GrantFiled: October 29, 2021Date of Patent: July 4, 2023Assignee: APPLE INC.Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
-
Publication number: 20230053205Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.Type: ApplicationFiled: November 2, 2022Publication date: February 16, 2023Inventors: Bertrand Nepveu, Marc-Andre Chenier, Yan Cote, Yves Millette
-
Patent number: 11521291Abstract: In some implementations, a method of reducing latency associated with an image read-out operation is performed at a device including one or more processors, non-transitory memory, an image processing architecture, and an image capture device. The method includes: obtaining first image data corresponding to a physical environment; reading a first slice of the first image data into an input buffer; performing processing operations on the first slice of the first image data to obtain a first portion of second image data; reading a second slice of the first image data into the input buffer; performing the image processing operations on the second slice of the first image data to obtain a second portion of the second image data; and generating an image frame of the physical environment based at least in part on the first and second portions of the second image data.Type: GrantFiled: March 29, 2021Date of Patent: December 6, 2022Assignee: APPLE INC.Inventors: Bertrand Nepveu, Marc-Andre Chenier, Yan Cote, Yves Millette
-
Patent number: 11496723Abstract: Generating a representation of a scene includes detecting an indication to capture sensor data to generate a virtual representation of a scene in a physical environment at a first time, in response to the indication obtaining first sensor data from a first capture device at the first time, obtaining second sensor data from a second capture device at the first time, and combining the first sensor data and the second sensor data to generate the virtual representation of the scene.Type: GrantFiled: September 24, 2019Date of Patent: November 8, 2022Assignee: Apple Inc.Inventors: Bertrand Nepveu, Yan Cote
-
Publication number: 20220050290Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: ApplicationFiled: October 29, 2021Publication date: February 17, 2022Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
-
Patent number: 11199706Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: GrantFiled: September 25, 2020Date of Patent: December 14, 2021Assignee: APPLE INC.Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
-
Publication number: 20210352255Abstract: The present disclosure relates to techniques for transitioning between imagery and sounds of two different environments, such as a virtual environment and a real environment. A view of a first environment and audio associated with the first environment are provided. In response to detecting a transition event, a view of the first environment combined with a second environment is provided. The combined view includes imagery of the first environment at a first visibility value and imagery of the second environment at a second visibility value. In addition, in response to detecting a transition event, the first environment audio is mixed with audio associated with the second environment.Type: ApplicationFiled: September 6, 2019Publication date: November 11, 2021Inventors: Bertrand NEPVEU, Sandy J. CARTER, Vincent CHAPDELAINE-COUTURE, Marc-Andre CHENIER, Yan COTE, Simon FORTIN-DESCHÊNES, Anthony GHANNOUM, Tomlinson HOLMAN, Marc-Olivier LEPAGE, Yves MILLETTE
-
Publication number: 20210192802Abstract: The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.Type: ApplicationFiled: September 6, 2019Publication date: June 24, 2021Inventors: Bertrand NEPVEU, Sandy J. CARTER, Vincent CHAPDELAINE-COUTURE, Marc-Andre CHENIER, Yan COTE, Simon FORTIN-DESCHÊNES, Anthony GHANNOUM, Tomlinson HOLMAN, Marc-Olivier LEPAGE, Yves MILLETTE
-
Publication number: 20210011289Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: ApplicationFiled: September 25, 2020Publication date: January 14, 2021Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
-
Patent number: 10838206Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: GrantFiled: February 20, 2017Date of Patent: November 17, 2020Assignee: Apple Inc.Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
-
Publication number: 20200252593Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.Type: ApplicationFiled: August 8, 2018Publication date: August 6, 2020Inventors: Vincent CHAPDELAINE-COUTURE, Anthony GHANNOUM, Yan COTE, Irving LUSTIGMAN, Marc-Andre CHENIER, Simon FORTIN-DESCHENES, Bertrand NEPVEU
-
Publication number: 20190258058Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.Type: ApplicationFiled: February 20, 2017Publication date: August 22, 2019Applicant: Apple Inc.Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum