Search Patents
  • DIY effects image modification
    Patent number: 11758080
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.
    Type: Grant
    Filed: June 1, 2022
    Date of Patent: September 12, 2023
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • 3D captions with face tracking
    Patent number: 11810220
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: November 7, 2023
    Assignee: SNAP INC.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • ANIMATED CUSTOM STICKER CREATION
    Publication number: 20230136013
    Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.
    Type: Application
    Filed: October 29, 2021
    Publication date: May 4, 2023
    Inventors: Kyle Goodrich, Christie Marie Heikkinen, Pedram Javidpour, Andrew James McPhee, Daniel Moreno
  • 3D captions with face tracking
    Patent number: 11263817
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: March 1, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • Virtual surface modification
    Patent number: 11501499
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering virtual modifications to real-world environments depicted in image content. A reference surface is detected in a three-dimensional (3D) space captured within a camera feed produced by a camera of a computing device. An image mask is applied to the reference surface within the 3D space captured within the camera feed. A visual effect is applied to the image mask corresponding to the reference surface in the 3D space. The application of the visual effect to the image mask causes a modified surface to be rendered in presenting the camera feed on a display of the computing device.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: November 15, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Wentao Shang
  • Providing 3D data for messages in a messaging system
    Patent number: 11488359
    Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology captures image data using at least one camera of the client device. The subject technology generates depth data using a machine learning model based at least in part on the captured image data. The subject technology applies, to the image data and the depth data, the 3D effect based at least in part on the augmented reality content generator.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: November 1, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • SPATIAL NAVIGATION AND CREATION INTERFACE
    Publication number: 20230055634
    Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.
    Type: Application
    Filed: August 23, 2022
    Publication date: February 23, 2023
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • CONVERSATION INTERFACE ON AN EYEWEAR DEVICE
    Publication number: 20220197027
    Abstract: Systems and methods are provided for performing operations comprising: receiving a request to access a conversation interface; in response to receiving the request, retrieving a plurality of virtual conversation objects associated with the conversation interface; displaying a first virtual conversation object of the plurality of virtual conversation objects at a first location in three-dimensional space; determining that a second virtual conversation object of the plurality of virtual conversation objects is associated with an earlier timestamp than the first virtual conversation object; and in response to determining that the second virtual conversation object is associated with the earlier timestamp than the first virtual conversation object, displaying the second virtual conversation object at a second location in three-dimensional space that is closer to a user of an eyewear device than the first location.
    Type: Application
    Filed: August 24, 2021
    Publication date: June 23, 2022
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • SPATIAL NAVIGATION AND CREATION INTERFACE
    Publication number: 20240061552
    Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.
    Type: Application
    Filed: November 1, 2023
    Publication date: February 22, 2024
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • Spatial navigation and creation interface
    Patent number: 11847302
    Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.
    Type: Grant
    Filed: August 23, 2022
    Date of Patent: December 19, 2023
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • Spatial navigation and creation interface
    Patent number: 11455078
    Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: September 27, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • GENERATING 3D DATA IN A MESSAGING SYSTEM
    Publication number: 20230386157
    Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.
    Type: Application
    Filed: August 15, 2023
    Publication date: November 30, 2023
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • Mirroring device with a hands-free mode
    Patent number: 11978283
    Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user; identifying a hand of the user in the video feed; determining that a position of the hand in the video feed overlaps a position of a given menu option of the one or more menu options; and performing an operation associated with the given menu option in response to determining that the position of the hand in the video feed overlaps the position of the given menu option.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: May 7, 2024
    Assignee: Snap Inc.
    Inventors: Dylan Shane Eirinberg, Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • AUTO TRIMMING FOR AUGMENTED REALITY CONTENT IN MESSAGING SYSTEMS
    Publication number: 20240087609
    Abstract: The subject technology receives frames of a source media content. The subject technology detects from the frames of the source media content, a first gesture indicating a cut point at a particular frame of the source media content, the cut point associated with a trimming operation to be performed on the source media content. The subject technology selects a starting frame and an ending frame from the frames based at least in part on the cut point at the particular frame. The subject technology performs the trimming operation based on the starting frame and the ending frame. The subject technology generates a second media content using the third set of frames. The subject technology provides for display at least a portion of the third set of frames of the second media content.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • TRIGGER GESTURE FOR SELECTION OF AUGMENTED REALITY CONTENT IN MESSAGING SYSTEMS
    Publication number: 20240087246
    Abstract: The subject technology detects a first gesture corresponding to an open trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the open trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology detects a first collision event. The subject technology detects a second gesture corresponding to a closed trigger finger gesture. The subject technology selects the second virtual object. The subject technology renders the first virtual object as attached to the second virtual object in response to the selecting. The subject technology provides for display the rendered first virtual object as attached to the second virtual object within a first scene.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • VIRTUAL OBJECT MANIPULATION WITH GESTURES IN A MESSAGING SYSTEM
    Publication number: 20240087264
    Abstract: The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • 3D CURSOR FUNCTIONALITY FOR AUGMENTED REALITY CONTENT IN MESSAGING SYSTEMS
    Publication number: 20240087242
    Abstract: The subject technology detects a location and a position of a representation of a finger. The subject technology generates a first virtual object based on the location and the position of the representation of the finger. The subject technology detects a first collision event. The subject technology in response to the first collision event, modifies a set of dimensions of the second virtual object to a second set of dimensions. The subject technology detects a second location and a second position of the representation of the finger. The subject technology detects a second collision event. The subject technology modifies a set of dimensions of the third virtual object to a third set of dimensions. The subject technology renders the third virtual object based on the third set of dimensions within a third scene, the third scene comprising a modified scene from a second scene.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • EFFECTS FOR 3D DATA IN A MESSAGING SYSTEM
    Publication number: 20210067756
    Abstract: The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generator based on metadata associated with each respective augmented reality content generator. The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology captures image data and depth data using at least one camera of the client device.
    Type: Application
    Filed: August 28, 2020
    Publication date: March 4, 2021
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • MEDIA CONTENT PLAYER ON AN EYEWEAR DEVICE
    Publication number: 20230400965
    Abstract: Systems and methods are provided for performing operations comprising: displaying, by one or more processors of an eyewear device, a plurality of media content control options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; based on detecting the first touch input, causing a cursor to track the first touch input to navigate through the plurality of media content control options; based on detecting that the single finger has not been released from touching the touch input interface, displaying a second media content control option related to the first media content control option; and performing a selection associated with the second media content control option based on movement of the single finger along the touch input interface.
    Type: Application
    Filed: August 25, 2023
    Publication date: December 14, 2023
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • MEDIA CONTENT PLAYER ON AN EYEWEAR DEVICE
    Publication number: 20220197446
    Abstract: Systems and methods are provided for performing operations comprising: displaying, by one or more processors of an eyewear device, a plurality of media content control options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; based on detecting the first touch input, causing a cursor to track the first touch input to navigate through the plurality of media content control options; based on detecting that the single finger has not been released from touching the touch input interface, displaying a second media content control option related to the first media content control option; and performing a selection associated with the second media content control option based on movement of the single finger along the touch input interface.
    Type: Application
    Filed: August 24, 2021
    Publication date: June 23, 2022
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
Narrow Results

Filter by US Classification