Search Patents
  • 3D CUTOUT IMAGE MODIFICATION
    Publication number: 20220076500
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated. by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
    Type: Application
    Filed: November 18, 2021
    Publication date: March 10, 2022
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • AUGMENTED REALITY EXPERIENCES WITH DUAL CAMERAS
    Publication number: 20230343004
    Abstract: Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems perform operations including: detecting a real-world object depicted in a first image captured by a first camera of a client device, the client device comprising a second camera; extracting one or more textures from the real-world object depicted in the first image; selecting a target object depicted in a second image captured by the second camera, the second image being captured by the second camera simultaneously with the first image captured by the first camera; generating an augmented reality (AR) element comprising the target object modified based on the one or more textures extracted from the real-world object depicted in the first image; and causing display of the AR element within the second image.
    Type: Application
    Filed: May 10, 2022
    Publication date: October 26, 2023
    Inventors: Kyle Goodrich, Pedram Javidpour, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • TOUCHPAD INPUT FOR AUGMENTED REALITY DISPLAY DEVICE
    Publication number: 20220374132
    Abstract: Disclosed is a method of receiving and processing content-sending inputs received by a head-worn device system including one or more display devices, one or more cameras and a vertically-arranged touchpad. The method includes displaying a content item on the one or more display devices, receiving a touch input on the touchpad corresponding to a send instruction, displaying a carousel of potential recipients, receiving a horizontal touch input on the touchpad, scrolling the carousel left or right on the one or more display devices in response to the horizontal touch input, receiving a tap touch input on the touchpad to select a particular recipient, receiving a further touch input, and in response to the further touch input, transmitting the content item to the selected recipient.
    Type: Application
    Filed: September 20, 2021
    Publication date: November 24, 2022
    Inventors: Karen Stolzenberg, David Meisenholder, Mathieu Emmanuel Vignau, Sana Park, Tianyi Sun, Joseph Timothy Fortier, Kaveh Anvaripour, Daniel Moreno, Kyle Goodrich
  • GESTURES TO ENABLE MENUS USING AUGMENTED REALITY CONTENT IN A MESSAGING SYSTEM
    Publication number: 20240087245
    Abstract: The subject technology detects a first location and a first position of a first representation of a first finger and a second location and a second position of a second representation of a second finger. The subject technology detects a first particular location and a first particular position of a first particular representation of a first particular finger and a second particular location and a second particular position of a second particular representation of a second particular finger. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology detects a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position. The subject technology generates a set of virtual objects.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • 3D CUTOUT IMAGE MODIFICATION
    Publication number: 20210287439
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
    Type: Application
    Filed: April 28, 2020
    Publication date: September 16, 2021
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • SELECTING ITEMS DISPLAYED BY A HEAD-WORN DISPLAY DEVICE
    Publication number: 20240094865
    Abstract: Disclosed is a method of receiving and processing content-sending inputs received by a head-worn device system including one or more display devices, one or more cameras and a vertically-arranged touchpad. The method includes displaying a content item on the one or more display devices, receiving a touch input on the touchpad corresponding to a send instruction, displaying a carousel of potential recipients, receiving a horizontal touch input on the touchpad, scrolling the carousel left or right on the one or more display devices in response to the horizontal touch input, receiving a tap touch input on the touchpad to select a particular recipient, receiving a further touch input, and in response to the further touch input, transmitting the content item to the selected recipient.
    Type: Application
    Filed: November 29, 2023
    Publication date: March 21, 2024
    Inventors: Karen Stolzenberg, David Meisenholder, Mathieu Emmanuel Vignau, Sana Park, Tianyi Sun, Joseph Timothy Fortier, Kaveh Anvaripour, Daniel Moreno, Kyle Goodrich
  • Virtual object manipulation with gestures in a messaging system
    Patent number: 11948266
    Abstract: The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: April 2, 2024
    Assignee: SNAP INC.
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • SCULPTING AUGMENTED REALITY CONTENT USING GESTURES IN A MESSAGING SYSTEM
    Publication number: 20240087239
    Abstract: The subject technology detects from a set of frames, a first gesture, the first gesture corresponding to a pinch gesture. The subject technology detects a first location and a first position of a first representation of a first finger from the first gesture and a second location and a second position of a second representation of a second finger from the first gesture. The subject technology detects a first collision event corresponding to a first collider and a second collider intersecting with a third collider of a first virtual object. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies the first virtual object to include an additional augmented reality content based at least in part on the first change and the second change.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Kurt Kaminski, Andrew James McPhee, Daniel Moreno
  • SHOOTING INTERACTION USING AUGMENTED REALITY CONTENT IN A MESSAGING SYSTEM
    Publication number: 20240087243
    Abstract: The subject technology receives a set of frames. The subject technology detect a first gesture correspond to an open trigger finger gesture. The subject technology receives a second set of frames. The subject technology detects from the second set of frames, a second gesture correspond to a closed trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the closed trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders a movement of the first virtual object along a vector away from the location and the position of the representation of the finger within a first scene. The subject technology provides for display the rendered movement of the first virtual object along the vector within the first scene.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • CURSOR FUNCTIONALITY FOR AUGMENTED REALITY CONTENT IN MESSAGING SYSTEMS
    Publication number: 20240087244
    Abstract: The subject technology detects a location and a position of a representation of a finger in a set of frames captured by a camera of a client device. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders the first virtual object within a first scene. The subject technology detects a first collision event corresponding to a first collider of the first virtual object intersecting with a second collider of a second virtual object. The subject technology modifies a set of dimensions of the second virtual object to a second set of dimensions. The subject technology renders the second virtual object based on the second set of dimensions within a second scene. The subject technology provides for display the rendered second virtual object within the second scene.
    Type: Application
    Filed: September 9, 2022
    Publication date: March 14, 2024
    Inventors: Kyle Goodrich, Maxim Maximov Lazarov, Andrew James McPhee, Daniel Moreno
  • 3D PAINTING ON AN EYEWEAR DEVICE
    Publication number: 20240012549
    Abstract: Systems and methods are provided for performing operations comprising: displaying a plurality of augmented reality painting options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; selecting a first augmented reality painting option of the plurality of augmented reality painting options in response to the first touch input; while continuing to detect continuous touch between the single finger and the touch input interface following selection of the first augmented reality painting option, displaying a second augmented reality painting option related to the first augmented reality painting option; and performing a selection associated with the second augmented reality painting option in response to detecting, by the touch input interface, movement of the single finger along the touch input interface while continuing to detect the continuous touch.
    Type: Application
    Filed: September 20, 2023
    Publication date: January 11, 2024
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • 3D PAINTING ON AN EYEWEAR DEVICE
    Publication number: 20220197485
    Abstract: Systems and methods are provided for performing operations comprising: displaying a plurality of augmented reality painting options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; selecting a first augmented reality painting option of the plurality of augmented reality painting options in response to the first touch input; while continuing to detect continuous touch between the single finger and the touch input interface following selection of the first augmented reality painting option, displaying a second augmented reality painting option related to the first augmented reality painting option; and performing a selection associated with the second augmented reality painting option in response to detecting, by the touch input interface, movement of the single finger along the touch input interface while continuing to detect the continuous touch.
    Type: Application
    Filed: August 24, 2021
    Publication date: June 23, 2022
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • EFFECTS FOR 3D DATA IN A MESSAGING SYSTEM
    Publication number: 20240048678
    Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
    Type: Application
    Filed: October 18, 2023
    Publication date: February 8, 2024
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • EFFECTS FOR 3D DATA IN A MESSAGING SYSTEM
    Publication number: 20230015194
    Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
    Type: Application
    Filed: September 22, 2022
    Publication date: January 19, 2023
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • RECENTERING AR/VR CONTENT ON AN EYEWEAR DEVICE
    Publication number: 20220198603
    Abstract: Systems and methods are provided for performing operations comprising: displaying one or more virtual objects at a first virtual coordinate associated with a first portion of a real-world environment while the eyewear device is directed towards the first portion of the real-world environment; determining that the eyewear device has been moved to be directed towards a second portion of the real-world environment; maintaining the display of the one or more virtual objects at the first virtual coordinate while the eyewear device is directed towards the second portion of the real-world environment; receiving, by the one or more processors, a request to bring the one or more virtual objects into a current view of the eyewear device; and in response to receiving the request, moving the one or more virtual objects from the first virtual coordinate to a second virtual coordinate associated with the second portion of the real-world environment.
    Type: Application
    Filed: August 24, 2021
    Publication date: June 23, 2022
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • 3D cutout image modification
    Patent number: 11217020
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: January 4, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • Effects for 3D data in a messaging system
    Patent number: 11457196
    Abstract: The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generator based on metadata associated with each respective augmented reality content generator. The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology captures image data and depth data using at least one camera of the client device. The subject technology applies, to the image data and the depth data, the 3D effect based at least in part on the augmented reality content generator.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: September 27, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • Media content player on an eyewear device
    Patent number: 11782577
    Abstract: Systems and methods are provided for performing operations comprising: displaying, by one or more processors of an eyewear device, a plurality of media content control options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; based on detecting the first touch input, causing a cursor to track the first touch input to navigate through the plurality of media content control options; based on detecting that the single finger has not been released from touching the touch input interface, displaying a second media content control option related to the first media content control option; and performing a selection associated with the second media content control option based on movement of the single finger along the touch input interface.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: October 10, 2023
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Andrew James McPhee, Daniel Moreno
  • VOICE NOTES WITH CHANGING EFFECTS
    Publication number: 20230135516
    Abstract: Methods and systems are disclosed for generating voice notes. In one embodiment, a messaging application implemented on a first participant computing device, receives a request to send a voice message to a second participant computing device in a communication session. In response to receiving the request, the messaging application selects a voice modification effect. The messaging application receives input to begin recording the voice message. While the voice message is being recorded, the messaging application receives speech input, modifies the speech input based on the voice modification effect in real time, and continuously updates an audio file with the modified speech input. In response to receiving input to terminate recording the voice message, the messaging application provides a first option to playback the audio file and a second option to send the audio file as the voice message to the second participant computing device.
    Type: Application
    Filed: October 29, 2021
    Publication date: May 4, 2023
    Inventors: Alex Edelsburg, Kyle Goodrich, Pedram Javidpour, Andrew James McPhee, Daniel Moreno, Jeremy Baker Voss
  • PASSING AUGMENTED REALITY CONTENT BETWEEN DEVICES
    Publication number: 20210304506
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first device associated with a first user, a first request to submit a media content item for viewing, the media content item corresponding to display of a first image, captured by the first device, with an augmented reality content item, the first request including an identifier of the augmented reality content item; storing the media content item together with the identifier of the augmented reality content item; providing, to a second device associated with a second user, the media content item; receiving, from the second device, a second request to identify the augmented reality content item; and providing, to the second device, the identifier of the augmented reality content item.
    Type: Application
    Filed: March 17, 2021
    Publication date: September 30, 2021
    Inventors: Celia Nicole Mourkogiannis, Kaveh Anvaripour, Andrew James McPhee, Daniel Moreno, Kyle Goodrich, Vincent Sung
Narrow Results

Filter by US Classification