Patents by Inventor Aleksandr Mashrabov
Aleksandr Mashrabov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20220319060Abstract: The subject technology receives frames of a source media content, the frames of the source media content including representations of a head and a face of a source actor. The subject technology generates sets of source pose parameters. The subject technology receives at least one target image, the at least one target image including representations of a target head and a target face of a target entity. The subject technology generates, based at least in part on the sets of source pose parameters, an output media content, each frame of the output media content includes an image of the target face in at least one frame of the output media content. The subject technology provides an online advertisement based at least in part on the output media content for display on a computing device.Type: ApplicationFiled: March 24, 2022Publication date: October 6, 2022Inventors: Alexandr Marinenko, Aleksandr Mashrabov, Alexey Pchelnikov
-
Publication number: 20220319230Abstract: The subject technology captures first image data by a computing device, the first image data comprising a target face of a target actor and facial expressions of the target actor, the facial expressions including lip movements. The subject technology generates, based at least in part on frames of a source media content, sets of source pose parameters. The subject technology receives a selection of a particular facial expression from a set of facial expressions. The subject technology generates, based at least in part on sets of source pose parameters and the selection of the particular facial expression, an output media content. The subject technology provides augmented reality content based at least in part on the output media content for display on the computing device.Type: ApplicationFiled: March 29, 2022Publication date: October 6, 2022Inventors: Roman Golobokov, Alexandr Marinenko, Aleksandr Mashrabov
-
Publication number: 20220292794Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.Type: ApplicationFiled: May 25, 2022Publication date: September 15, 2022Inventors: Roman Golobokov, Aleksandr Mashrabov, Dmitry Matov, Jeremy Baker Voss
-
Publication number: 20220284654Abstract: Disclosed are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes at least one input frame and the at least one input frame includes a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face in the target image, where the 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression of the first face, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.Type: ApplicationFiled: May 24, 2022Publication date: September 8, 2022Inventors: Eugene Krokhalev, Aleksandr Mashrabov, Pavel Savchenkov
-
Patent number: 11410365Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing a database of motions; receiving an input image including a body of a person; receiving a user input including a motion selected from the database of motions; segmenting the input image into a body portion and a background portion; fitting the body portion to a hair model; generating, based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; where generating the video includes detecting positions of key points associated with a head of the person in a frame of the video, generating an image of hair of the person based on the positions of the key points and the hair model, and inserting the image of the hair in the frame; and displaying the generated video.Type: GrantFiled: September 14, 2020Date of Patent: August 9, 2022Assignee: Snap Inc.Inventors: Sergei Gorbatyuk, Nikolai Smirnov, Aleksandr Mashrabov, Egor Nemchinov
-
Patent number: 11410364Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.Type: GrantFiled: October 24, 2019Date of Patent: August 9, 2022Assignee: Snap Inc.Inventors: Yurii Volkov, Pavel Savchenkov, Maxim Lukin, Ivan Belonogov, Nikolai Smirnov, Aleksandr Mashrabov
-
Patent number: 11410457Abstract: Provided are systems and a method for photorealistic real-time face reenactment. An example method includes receiving a target video including a target face and a scenario including a series of source facial expressions, determining, based on the target face, one or more target facial expressions, and synthesizing, using the parametric face model, an output face. The output face includes the target face. The one or more target facial expressions are modified to imitate the source facial expressions. The method further includes generating, based on a deep neural network, a mouth region and an eyes region, and combining the output face, the mouth region, and the eyes region to generate a frame of an output video.Type: GrantFiled: September 28, 2020Date of Patent: August 9, 2022Assignee: Snap Inc.Inventors: Pavel Savchenkov, Dmitry Matov, Aleksandr Mashrabov, Alexey Pchelnikov
-
Patent number: 11393152Abstract: Provided are systems and methods for photorealistic real-time portrait animation. An example method includes receiving a scenario video with at least one input frame. The input frame includes a first face of a first person. The method further includes receiving a target image with a second face of a second person. The method further includes determining, based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face and a background in the target image. The 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression and a head orientation of the first face. The method further includes applying the 2D deformations to the target image to obtain at least one output frame of an output video.Type: GrantFiled: May 20, 2021Date of Patent: July 19, 2022Assignee: Snap Inc.Inventors: Eugene Krokhalev, Aleksandr Mashrabov, Pavel Savchenkov
-
Publication number: 20220207810Abstract: Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.Type: ApplicationFiled: March 16, 2022Publication date: June 30, 2022Inventors: Egor Nemchinov, Sergei Gorbatyuk, Aleksandr Mashrabov, Egor Spirin, Iaroslav Sokolov, Andrei Smirdin, Igor Tukh
-
Patent number: 11354872Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.Type: GrantFiled: November 11, 2020Date of Patent: June 7, 2022Assignee: Snap Inc.Inventors: Roman Golobokov, Aleksandr Mashrabov, Dmitry Matov, Jeremy Baker Voss
-
Publication number: 20220148276Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.Type: ApplicationFiled: November 11, 2020Publication date: May 12, 2022Inventors: Roman Golobokov, Aleksandr Mashrabov, Dmitry Matov, Jeremy Baker Voss
-
Publication number: 20220147566Abstract: A system for searching and ranking modifiable videos is provided. In one example embodiment, the system includes a at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to implement the following operations upon executing the processor-executable codes: processing a first set of search requests by a first search rule to obtain a first set of first results; processing a second set of search requests by a second search rule to obtain a second set of second results; determining a first metric based, at least partially, on the first set of first results; determining a second metric based at least partially on the second set of second results; selecting, based on the first metric and the second metric, a search rule from the first search rule and the second search rule; and configuring a search engine to apply the search rule.Type: ApplicationFiled: January 21, 2022Publication date: May 12, 2022Inventors: Jeremy Voss, Victor Shaburov, Aleksandr Mashrabov, Dmitriy Matov, Hanna Rulevska, Dmytro Ishchenko
-
Patent number: 11308676Abstract: Provided are systems and methods for single image-based body animation. An example method includes receiving an input image that includes a body of a person and segmenting the input image into a body portion and a background portion. The method further includes fitting a model to the body portion. The model is configured to receive a set of pose parameters representing a pose of the body and generate an output image including an image of the body adopting the pose. The method further includes receiving a series of further sets of pose parameters, each representing at least one of further poses of the body. The further sets of pose parameters are generated using a generic model. The method also includes generating a series of output images of the body adopting the further poses and generating an output video based on the series of output images.Type: GrantFiled: October 2, 2020Date of Patent: April 19, 2022Assignee: Snap Inc.Inventors: Egor Nemchinov, Sergei Gorbatyuk, Aleksandr Mashrabov, Egor Spirin, Iaroslav Sokolov, Andrei Smirdin, Igor Tukh
-
Publication number: 20220070291Abstract: A system for customizing modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to analyze recent messages of a user to determine a context of the recent messages; determine, based on the context, a customized feature; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with a preset modifiable feature; replace the preset modifiable feature in the relevant modifiable videos with the customized feature; and render a modifiable video from the list of relevant modifiable videos for viewing by the user, the rendering including displaying the customized feature in the relevant modifiable videos.Type: ApplicationFiled: November 10, 2021Publication date: March 3, 2022Inventors: Jeremy Voss, Victor Shaburov, Ivan Babanin, Aleksandr Mashrabov, Roman Golobokov
-
Patent number: 11263260Abstract: A system for searching and ranking modifiable videos in a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a database configured to store modifiable videos, the modifiable videos being associated with text messages and rankings, a processor, and a memory storing processor-executable codes, wherein the processor is configured to implement the following operations upon executing the processor-executable codes: receiving, via the MMA, an input of a user; selecting, based on the input, a list of relevant modifiable videos from the database; rendering, via the MMA, the list of relevant modifiable videos for viewing by the user; determining that the user has shared, via the MMA, a modifiable video from the list; storing an information concerning the list and the shared modifiable video into a statistical log; and updating, based on the information in the statistical log, the rankings of the modifiable videos in the database.Type: GrantFiled: March 31, 2020Date of Patent: March 1, 2022Assignee: Snap Inc.Inventors: Jeremy Voss, Victor Shaburov, Aleksandr Mashrabov, Dmitriy Matov, Hanna Rulevska, Dmytro Ishchenko
-
Publication number: 20210406300Abstract: A personalized preview system to receive a request to access a collection of media items from a user of a user device. Responsive to receiving the request to access the collection of media items, the personalized preview system accesses user profile data associated with the user, wherein the user profile data includes an image. For example, the image may comprise a depiction of a face, wherein the face comprises a set of facial landmarks. Based on the image, the personalized preview system generates one or more media previews based on corresponding media templates and the image, and displays the one or more media previews within a presentation of the collection of media items at a client device of the user.Type: ApplicationFiled: August 11, 2020Publication date: December 30, 2021Inventors: Aleksandr Mashrabov, Victor Shaburov, Grigoriy Tkachenko, Jeremy Baker Voss
-
Patent number: 11212383Abstract: A system for customizing text messages in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to analyze recent messages of a user in the MMA to determine a context of the recent messages; determine, based on the context, a customized text message; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages; replace the preset text messages in the relevant modifiable videos with the customized message; and render the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.Type: GrantFiled: May 20, 2020Date of Patent: December 28, 2021Assignee: Snap Inc.Inventors: Jeremy Voss, Victor Shaburov, Ivan Babanin, Aleksandr Mashrabov, Roman Golobokov
-
Publication number: 20210368039Abstract: A system for customizing text messages in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to analyze recent messages of a user in the MMA to determine a context of the recent messages; determine, based on the context, a customized text message; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages; replace the preset text messages in the relevant modifiable videos with the customized message; and render the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.Type: ApplicationFiled: May 20, 2020Publication date: November 25, 2021Inventors: Jeremy Voss, Victor Shaburov, Ivan Babanin, Aleksandr Mashrabov, Roman Golobokov
-
Publication number: 20210327404Abstract: Provided are systems and methods for text and audio-based real-time face reenactment. An example method includes receiving an input text and a target image, the target image including a target face; generating, based on the input text, a sequence of sets of acoustic features representing the input text; generating, based on the sequence of sets of acoustic features, a sequence of sets of mouth key points; generating, based on the sequence of sets of mouth key points, a sequence of sets of facial key points; generating, by the computing device and based on the sequence of sets of the facial key points and the target image, a sequence of frames; and generating, based on the sequence of frames, an output video. Each of the frames includes the target face modified based on at least one set of mouth key points of the sequence of sets of mouth key points.Type: ApplicationFiled: June 23, 2021Publication date: October 21, 2021Inventors: Pavel Savchenkov, Maxim Lukin, Aleksandr Mashrabov
-
Publication number: 20210327117Abstract: Provided are systems and methods for photorealistic real-time portrait animation. An example method includes receiving a scenario video with at least one input frame. The input frame includes a first face of a first person. The method further includes receiving a target image with a second face of a second person. The method further includes determining, based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face and a background in the target image. The 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression and a head orientation of the first face. The method further includes applying the 2D deformations to the target image to obtain at least one output frame of an output video.Type: ApplicationFiled: May 20, 2021Publication date: October 21, 2021Inventors: Eugene Krokhalev, Aleksandr Mashrabov, Pavel Savchenkov