Patents by Inventor Avihay Assouline
Avihay Assouline has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230196685Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.Type: ApplicationFiled: December 21, 2021Publication date: June 22, 2023Inventors: Avihay Assouline, Itamar Berger, Nir Malbin, Gal Sasson
-
Publication number: 20230196602Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.Type: ApplicationFiled: December 21, 2021Publication date: June 22, 2023Inventors: Avihay Assouline, Itamar Berger, Nir Malbin, Gal Sasson
-
Patent number: 11676319Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.Type: GrantFiled: July 12, 2022Date of Patent: June 13, 2023Assignee: Snap Inc.Inventors: Itamar Berger, Piers George Cowburn, Avihay Assouline
-
Patent number: 11660022Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.Type: GrantFiled: November 6, 2020Date of Patent: May 30, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230154121Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.Type: ApplicationFiled: January 23, 2023Publication date: May 18, 2023Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230154042Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user, The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.Type: ApplicationFiled: January 19, 2023Publication date: May 18, 2023Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230129747Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.Type: ApplicationFiled: December 22, 2022Publication date: April 27, 2023Inventors: Ma'ayan Mishin Shuvi, Avihay Assouline, Itamar Berger
-
Publication number: 20230120037Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.Type: ApplicationFiled: December 19, 2022Publication date: April 20, 2023Inventors: Avihay Assouline, Itamar Berger, Jean Luo, Matan Zohar
-
Patent number: 11615592Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.Type: GrantFiled: October 27, 2020Date of Patent: March 28, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Publication number: 20230090086Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.Type: ApplicationFiled: November 30, 2022Publication date: March 23, 2023Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li
-
Patent number: 11594025Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.Type: GrantFiled: April 26, 2021Date of Patent: February 28, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Patent number: 11562548Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.Type: GrantFiled: March 22, 2021Date of Patent: January 24, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Jean Luo, Matan Zohar
-
Patent number: 11557075Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.Type: GrantFiled: March 25, 2021Date of Patent: January 17, 2023Assignee: Snap Inc.Inventors: Avihay Assouline, Itamar Berger, Yuncheng Li
-
Patent number: 11544884Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.Type: GrantFiled: December 11, 2020Date of Patent: January 3, 2023Assignee: Snap Inc.Inventors: Ma'ayan Shuvi, Avihay Assouline, Itamar Berger
-
Publication number: 20220383577Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.Type: ApplicationFiled: August 9, 2022Publication date: December 1, 2022Inventors: Avihay Assouline, Itamar Berger, Gal Dudovitch, Matan Zohar
-
Patent number: 11508087Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising: receiving a monocular image that includes a depiction of a body of a user in a given pose; detecting a plurality of skeletal joints of the body depicted in the monocular image; generating an outline of the body of the user based on the plurality of skeletal joints; retrieving a mask that represents a target pose; comparing the outline of the body depicted in the monocular image with the mask that represents the target pose; and determining that the given pose of the body of the user matches the target pose in response to comparing the outline of the body with the mask.Type: GrantFiled: April 27, 2020Date of Patent: November 22, 2022Assignee: Snap Inc.Inventors: Matan Zohar, Avihay Assouline, Gal Dudovitch, Itamar Berger
-
Publication number: 20220343574Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.Type: ApplicationFiled: July 12, 2022Publication date: October 27, 2022Inventors: Itamar Berger, Piers George Cowburn, Avihay Assouline
-
Publication number: 20220327608Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of one or more objects in a room within a home; determining a room classification for the room by processing the one or more objects depicted in the video; selecting one or more augmented reality items available for purchase based on the room classification and the one or more objects depicted in the video; and generating, for display within the video, the one or more augmented reality items that have been selected at a display position within the video corresponding to the one or more objects depicted in the video.Type: ApplicationFiled: April 12, 2021Publication date: October 13, 2022Inventors: Avihay Assouline, Itamar Berger, Nir Malbin, Ma'ayan Shuvi
-
Publication number: 20220301272Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.Type: ApplicationFiled: March 22, 2021Publication date: September 22, 2022Inventors: Avihay Assouline, Itamar Berger, Jean Luo, Matan Zohar
-
Publication number: 20220300728Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.Type: ApplicationFiled: March 22, 2021Publication date: September 22, 2022Inventors: Avihay Assouline, Itamar Berger, Jean Luo, Matan Zohar