Patents by Inventor Itamar Berger
Itamar Berger has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11676319Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.Type: GrantFiled: July 12, 2022Date of Patent: June 13, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Piers George Cowburn, Avihay Assouline
-
Patent number: 11673054Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.Type: GrantFiled: September 7, 2021Date of Patent: June 13, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Patent number: 11670059Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.Type: GrantFiled: September 1, 2021Date of Patent: June 6, 2023Assignee: SNAP INC.Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Publication number: 20230169739Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.Type: ApplicationFiled: January 26, 2023Publication date: June 1, 2023Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Patent number: 11660022Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.Type: GrantFiled: November 6, 2020Date of Patent: May 30, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230154121Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.Type: ApplicationFiled: January 23, 2023Publication date: May 18, 2023Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230154042Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user, The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.Type: ApplicationFiled: January 19, 2023Publication date: May 18, 2023Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230154129Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.Type: ApplicationFiled: January 19, 2023Publication date: May 18, 2023Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Mishin Shuvi, Matan Zohar
-
Patent number: 11651572Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.Type: GrantFiled: October 11, 2021Date of Patent: May 16, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Publication number: 20230129747Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.Type: ApplicationFiled: December 22, 2022Publication date: April 27, 2023Inventors: Ma'ayan Mishin Shuvi, Avihay Assouline, Itamar Berger
-
Patent number: 11636662Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.Type: GrantFiled: September 30, 2021Date of Patent: April 25, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Patent number: 11636654Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.Type: GrantFiled: May 19, 2021Date of Patent: April 25, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Amar Boghani, Maria Jose Garcia Sopo, Isac Andreas Müller Sandvik, Qi Pan, Matan Zohar
-
Publication number: 20230120037Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.Type: ApplicationFiled: December 19, 2022Publication date: April 20, 2023Inventors: Avihay Assouline, Itamar Berger, Jean Luo, Matan Zohar
-
Publication number: 20230116929Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.Type: ApplicationFiled: October 20, 2021Publication date: April 20, 2023Inventors: Matan Zohar, Yanli Zhao, Brian Fulkerson, Itamar Berger
-
Publication number: 20230111489Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.Type: ApplicationFiled: October 11, 2021Publication date: April 13, 2023Inventors: Matan Zohar, Yanli Zhao, Brian Fulkerson, Itamar Berger
-
Publication number: 20230116652Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.Type: ApplicationFiled: October 11, 2021Publication date: April 13, 2023Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Publication number: 20230100509Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.Type: ApplicationFiled: September 30, 2021Publication date: March 30, 2023Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Publication number: 20230103125Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.Type: ApplicationFiled: September 30, 2021Publication date: March 30, 2023Inventors: Itamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Shuvi, Matan Zohar
-
Patent number: 11615592Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.Type: GrantFiled: October 27, 2020Date of Patent: March 28, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230090086Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.Type: ApplicationFiled: November 30, 2022Publication date: March 23, 2023Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li