Patents by Inventor Rahul Bhupendra Sheth
Rahul Bhupendra Sheth has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240098326Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.Type: ApplicationFiled: November 27, 2023Publication date: March 21, 2024Inventors: Bradley Kotsopoulos, Eli Semory, Rahul Bhupendra Sheth
-
Publication number: 20240054687Abstract: An example system includes an encoder configured to receive a bit string and encode the bit string into a visual representation, and a decoder configured to receive an image including the visual representation and decode the bit string from the visual representation. In some examples, the encoder and decoder are trained as a pair by obtaining a training bit string, encoding the training bit string into a training visual representation using the encoder, decoding the training visual representation using the decoder to generate a decoded bit string, determining an error between the training bit string and the decoded bit string, and updating parameters of the encoder and decoder to reduce the error.Type: ApplicationFiled: October 23, 2023Publication date: February 15, 2024Inventors: Drake Austin Rehfeld, Rahul Bhupendra Sheth, Ning Zhang
-
Patent number: 11887344Abstract: Disclosed are methods for encoding information in a graphic image. The information may be encoded so as to have a visual appearance that adopts a particular style, so that the encoded information is visually pleasing in the environment in which it is displayed. An encoder and decoder are trained during an integrated training process, where the encoder is tuned to minimize a loss when its encoded images are decoded. Similarly, the decoder is also trained to minimize loss when decoding the encoded images. Both the encoder and decoder may utilize a convolutional neural network in some aspects to analyze data and/or images. Once data is encoded, a style from a sample image is transferred to the encoded data. When decoding, the decoder may largely ignore the style aspects of the encoded data and decode based on a content portion of the data.Type: GrantFiled: March 29, 2023Date of Patent: January 30, 2024Assignee: Snap Inc.Inventors: Drake Austin Rehfeld, Rahul Bhupendra Sheth, Ning Zhang
-
Patent number: 11831937Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.Type: GrantFiled: March 3, 2022Date of Patent: November 28, 2023Assignee: Snap Inc.Inventors: Bradley Kotsopoulos, Eli Semory, Rahul Bhupendra Sheth
-
Patent number: 11769307Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.Type: GrantFiled: April 25, 2022Date of Patent: September 26, 2023Assignee: Snap Inc.Inventors: Nathan Jurgenson, Linjie Luo, Jonathan M. Rodriguez, II, Rahul Bhupendra Sheth, Jia Li, Xutao Lv
-
Patent number: 11727660Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.Type: GrantFiled: April 18, 2022Date of Patent: August 15, 2023Assignee: Snap Inc.Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
-
Publication number: 20230237706Abstract: Disclosed are methods for encoding information in a graphic image. The information may be encoded so as to have a visual appearance that adopts a particular style, so that the encoded information is visually pleasing in the environment in which it is displayed. An encoder and decoder are trained during an integrated training process, where the encoder is tuned to minimize a loss when its encoded images are decoded. Similarly, the decoder is also trained to minimize loss when decoding the encoded images. Both the encoder and decoder may utilize a convolutional neural network in some aspects to analyze data and/or images. Once data is encoded, a style from a sample image is transferred to the encoded data. When decoding, the decoder may largely ignore the style aspects of the encoded data and decode based on a content portion of the data.Type: ApplicationFiled: March 29, 2023Publication date: July 27, 2023Inventors: Drake Austin Rehfeld, Rahul Bhupendra Sheth, Ning Zhang
-
Patent number: 11670012Abstract: Disclosed are methods for encoding information in a graphic image. The information may be encoded so as to have a visual appearance that adopts a particular style, so that the encoded information is visually pleasing in the environment in which it is displayed. An encoder and decoder are trained during an integrated training process, where the encoder is tuned to minimize a loss when its encoded images are decoded. Similarly, the decoder is also trained to minimize loss when decoding the encoded images. Both the encoder and decoder may utilize a convolutional neural network in some aspects to analyze data and/or images. Once data is encoded, a style from a sample image is transferred to the encoded data. When decoding, the decoder may largely ignore the style aspects of the encoded data and decode based on a content portion of the data.Type: GrantFiled: April 30, 2021Date of Patent: June 6, 2023Assignee: Snap Inc.Inventors: Drake Austin Rehfeld, Rahul Bhupendra Sheth, Ning Zhang
-
Publication number: 20230088471Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.Type: ApplicationFiled: March 3, 2022Publication date: March 23, 2023Inventors: Bradley Kotsopoulos, Eli Semory, Rahul Bhupendra Sheth
-
Patent number: 11557324Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.Type: GrantFiled: June 8, 2021Date of Patent: January 17, 2023Assignee: Snap Inc.Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang
-
Publication number: 20220406008Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.Type: ApplicationFiled: July 1, 2022Publication date: December 22, 2022Inventors: Nathan Jurgenson, Linjie Luo, Jonathan M. Rodriguez, II, Rahul Bhupendra Sheth, Jia Li, Xutao Lv
-
Patent number: 11527267Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.Type: GrantFiled: June 8, 2021Date of Patent: December 13, 2022Assignee: Snap Inc.Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang
-
Publication number: 20220358738Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.Type: ApplicationFiled: April 18, 2022Publication date: November 10, 2022Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
-
Publication number: 20220245907Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.Type: ApplicationFiled: April 25, 2022Publication date: August 4, 2022Inventors: Nathan Jurgenson, Linjie Luo, Jonathan M. Rodriguez, II, Rahul Bhupendra Sheth, Jia Li, Xutao Lv
-
Patent number: 11321896Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering an avatar. A first avatar having a first level of detail is stored in a database, the first avatar including a first plurality of components. A level of detail of each of the first plurality of components is reduced separately from each other. A second plurality of components comprising the reduced level of detail of each of the first plurality of components is stored. A request is received for the first avatar in a second level of detail that comprises a lower level of detail than the first level of detail. In response to receiving the request, the second plurality of components is assembled to generate a second avatar having the second level of detail.Type: GrantFiled: November 18, 2020Date of Patent: May 3, 2022Assignee: Snap Inc.Inventors: Rahul Bhupendra Sheth, Maoning Guo, William Eastcott
-
Patent number: 11308706Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.Type: GrantFiled: July 13, 2020Date of Patent: April 19, 2022Assignee: Snap Inc.Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
-
Patent number: 11284144Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.Type: GrantFiled: January 30, 2020Date of Patent: March 22, 2022Assignee: Snap Inc.Inventors: Bradley Kotsopoulos, Eli Semory, Rahul Bhupendra Sheth
-
Patent number: 11159743Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.Type: GrantFiled: December 20, 2019Date of Patent: October 26, 2021Assignee: Snap Inc.Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang
-
Publication number: 20210295874Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.Type: ApplicationFiled: June 8, 2021Publication date: September 23, 2021Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang
-
Patent number: 11122218Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.Type: GrantFiled: December 20, 2019Date of Patent: September 14, 2021Assignee: Snap Inc.Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang