Search Patents
  • DETERMINING GAZE DIRECTION TO GENERATE AUGMENTED REALITY CONTENT
    Publication number: 20220206572
    Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.
    Type: Application
    Filed: December 28, 2021
    Publication date: June 30, 2022
    Inventor: Kyle Goodrich
  • VOICE NOTES WITH TRANSCRIPTION
    Publication number: 20230206921
    Abstract: A messaging system, which hosts a backend service for an associated messaging client application, includes a voice notes system that addresses the technical problem of serving an audio message to the recipient in a manner that permits the recipient to consume the message in a text format as a transcription. A chat user interface (UI) provided with the voice notes system permits a user to play an audio message or request generation of the transcription of the audio message on-demand to prevent unnecessary cluttering of the UI real estate.
    Type: Application
    Filed: December 28, 2021
    Publication date: June 29, 2023
    Inventors: Alex Edelsburg, Kyle Goodrich, Pedram Javidpour, Andrew James McPhee, Daniel Moreno, Jeremy Baker Voss
  • 3D OBJECT CAMERA CUSTOMIZATION SYSTEM
    Publication number: 20220375178
    Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
    Type: Application
    Filed: August 4, 2022
    Publication date: November 24, 2022
    Inventors: Samuel Edward Hare, Andrew James McPhee, Maxim Maximov Lazarov, Wentao Shang, Kyle Goodrich, Tony Mathew
  • DETERMINING GAZE DIRECTION TO GENERATE AUGMENTED REALITY CONTENT
    Publication number: 20240176417
    Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.
    Type: Application
    Filed: February 8, 2024
    Publication date: May 30, 2024
    Inventor: Kyle Goodrich
  • GENERATING 3D DATA IN A MESSAGING SYSTEM
    Publication number: 20220284682
    Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
    Type: Application
    Filed: November 12, 2021
    Publication date: September 8, 2022
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • Determining gaze direction to generate augmented reality content
    Patent number: 11630511
    Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.
    Type: Grant
    Filed: December 28, 2021
    Date of Patent: April 18, 2023
    Assignee: Snap Inc.
    Inventor: Kyle Goodrich
  • Determining gaze direction to generate augmented reality content
    Patent number: 11934575
    Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.
    Type: Grant
    Filed: March 14, 2023
    Date of Patent: March 19, 2024
    Assignee: Snap Inc.
    Inventor: Kyle Goodrich
  • ACTIVATING HANDS-FREE MODE ON MIRRORING DEVICE
    Publication number: 20220300731
    Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; in response to capturing the video feed, evaluating a set of conditions for activating a hands-free mode of operating the electronic mirroring device; in response to determining that the set of conditions are satisfied, activating the hands-free mode of operating the electronic mirroring device; and performing one or more functions on the electronic mirroring device based on detection of one or more gestures performed by the user in the video feed.
    Type: Application
    Filed: March 16, 2021
    Publication date: September 22, 2022
    Inventors: Dylan Shane Eirinberg, Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • 3D object camera customization system
    Patent number: 11443491
    Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: September 13, 2022
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Andrew James McPhee, Maxim Maximov Lazarov, Wentao Shang, Kyle Goodrich, Tony Mathew
  • Generating 3D data in a messaging system
    Patent number: 11189104
    Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: November 30, 2021
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • 3D object camera customization system
    Patent number: 11823341
    Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
    Type: Grant
    Filed: August 4, 2022
    Date of Patent: November 21, 2023
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Andrew James McPhee, Maxim Maximov Lazarov, Wentao Shang, Kyle Goodrich, Tony Mathew
  • Generating 3D data in a messaging system
    Patent number: 11748957
    Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
    Type: Grant
    Filed: November 12, 2021
    Date of Patent: September 5, 2023
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • 3D object camera customization system
    Patent number: 10964114
    Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: March 30, 2021
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Andrew James McPhee, Maxim Maximov Lazarov, Wentao Shang, Kyle Goodrich, Tony Mathew
  • 3D object camera customization system
    Patent number: 11189098
    Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: November 30, 2021
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Andrew James McPhee, Maxim Maximov Lazarov, Wentao Shang, Kyle Goodrich, Tony Mathew
  • DIY EFFECTS IMAGE MODIFICATION
    Publication number: 20210258511
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.
    Type: Application
    Filed: May 5, 2020
    Publication date: August 19, 2021
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • 3D CAPTIONS WITH SEMANTIC GRAPHICAL ELEMENTS
    Publication number: 20240161425
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
    Type: Application
    Filed: January 22, 2024
    Publication date: May 16, 2024
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maximov Lazarov, Tony Mathew, Andrew Andrew McPhee, Daniel Moreno, Wentao Shang
  • 3D CAPTIONS WITH SEMANTIC GRAPHICAL ELEMENTS
    Publication number: 20220076497
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
    Type: Application
    Filed: November 17, 2021
    Publication date: March 10, 2022
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • MIRRORING DEVICE WITH WHOLE-BODY OUTFITS
    Publication number: 20220301231
    Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; selecting, by the electronic mirroring device, a first whole-body outfit; displaying, by the electronic mirroring device, a representation of the user wearing the first whole-body outfit; detecting, by the electronic mirroring device, a hand gesture performed by the user in the video feed; and in response to detecting the hand gesture, transitioning, by the electronic mirroring device, the representation of the user from wearing the first whole-body outfit to wearing a second whole-body outfit.
    Type: Application
    Filed: March 16, 2021
    Publication date: September 22, 2022
    Inventors: Dylan Shane Eirinberg, Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • Activating hands-free mode on mirroring device
    Patent number: 11734959
    Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; in response to capturing the video feed, evaluating a set of conditions for activating a hands-free mode of operating the electronic mirroring device; in response to determining that the set of conditions are satisfied, activating the hands-free mode of operating the electronic mirroring device; and performing one or more functions on the electronic mirroring device based on detection of one or more gestures performed by the user in the video feed.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: August 22, 2023
    Assignee: Snap Inc.
    Inventors: Dylan Shane Eirinberg, Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • 3D CAPTIONS WITH FACE TRACKING
    Publication number: 20220148270
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
Narrow Results

Filter by US Classification