Patents by Inventor Irfan Essa
Irfan Essa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11663307Abstract: Example systems and methods for defending against powerful, automated attacks on facial authentication systems are disclosed. A first verification is performed based at least in part on determining a response time for a response to a CAPTCHA or other challenge. In response to determining that the response time is within a threshold, a second verification is performed based at least in part on extracting a face feature or a voice feature from a plurality of samples associated with the response.Type: GrantFiled: September 24, 2019Date of Patent: May 30, 2023Assignee: GEORGIA TECH RESEARCH CORPORATIONInventors: Erkam Uzun, Pak Ho Chung, Irfan A. Essa, Wenke Lee
-
Patent number: 10721439Abstract: A method for personalizing a content item using captured footage is disclosed. The method includes receiving a first video feed from a first camera, wherein the first camera is designated as a source camera for capturing an event during a first time duration. The method also includes receiving data from a second camera, and determining, based on the received data from the second camera, that an action was performed using the second camera, the action being indicative of a region of interest (ROI) of the user of the second camera occurring within a second time duration. The method further includes designating the second camera as the source camera for capturing the event during the second time duration.Type: GrantFiled: October 22, 2018Date of Patent: July 21, 2020Assignee: GOOGLE LLCInventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
-
Publication number: 20200097643Abstract: Example systems and methods for defending against powerful, automated attacks on facial authentication systems are disclosed. A first verification is performed based at least in part on determining a response time for a response to a CAPTCHA or other challenge. In response to determining that the response time is within a threshold, a second verification is performed based at least in part on extracting a face feature or a voice feature from a plurality of samples associated with the response.Type: ApplicationFiled: September 24, 2019Publication date: March 26, 2020Inventors: Erkam Uzun, Pak Ho Chung, Irfan A. Essa, Wenke Lee
-
Patent number: 10437882Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.Type: GrantFiled: May 7, 2015Date of Patent: October 8, 2019Assignee: Google LLCInventors: Thad Eugene Starner, Irfan Essa, Hayes Solos Raffle, Daniel Aminzade
-
Publication number: 20180350131Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.Type: ApplicationFiled: December 31, 2014Publication date: December 6, 2018Inventors: Irfan Essa, Vivek Kwatra, Matthias Grundmann
-
Patent number: 10110850Abstract: A method for localizing the attention of a user of a first-person point-of-view (FPPOV) device is disclosed. The method includes receiving data from an FPPOV device, the data being indicative of a first region-of-interest (ROI) of an event for a first time duration and a second ROI of the event for a second time duration. The method further include determining that a first camera from a plurality of cameras best captures the first ROI during the first time duration, and determining that a second camera from the plurality of cameras best captures the second ROI during the second time duration.Type: GrantFiled: July 15, 2014Date of Patent: October 23, 2018Assignee: Google LLCInventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
-
Patent number: 9888180Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.Type: GrantFiled: March 20, 2017Date of Patent: February 6, 2018Assignee: GOOGLE LLCInventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Publication number: 20170195575Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.Type: ApplicationFiled: March 20, 2017Publication date: July 6, 2017Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9635261Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.Type: GrantFiled: May 9, 2016Date of Patent: April 25, 2017Assignee: Google Inc.Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9600723Abstract: A method for localizing the attention of a user of a first-person point-of-view (FPPOV) device is disclosed. The method includes receiving a plurality of images of an event, each image having been captured by one of a plurality of reference cameras during a first time duration. The method further includes receiving a first user-captured image captured by the FPPOV device during the first time duration. A first image of the plurality of images is selected as a best-matched image, based on the first user-captured image, for capturing a region-of-interest.Type: GrantFiled: July 3, 2014Date of Patent: March 21, 2017Assignee: GOOGLE INC.Inventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
-
Patent number: 9554043Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.Type: GrantFiled: July 15, 2014Date of Patent: January 24, 2017Assignee: Google Inc.Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9536354Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving sensor data from a sensor on a wearable computing device and, based on the sensor data, detecting a movement that defines an outline of an area in the sensor data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive sensor data from a sensor on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the sensor data, a movement that defines an outline of an area in the sensor data, identify an object that is located in the area, and initiate a search on the object.Type: GrantFiled: December 4, 2015Date of Patent: January 3, 2017Assignee: Google Inc.Inventors: Thad Eugene Starner, Irfan Essa
-
Publication number: 20160269642Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.Type: ApplicationFiled: May 9, 2016Publication date: September 15, 2016Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9405977Abstract: Methods and devices for initiating a search are disclosed. In one embodiment, a method is disclosed that includes causing a camera on a wearable computing device to record video data, segmenting the video data into a number of layers and, based on the video data, detecting that a pointing object is in proximity to a first layer. The method further includes initiating a first search on the first layer. In another embodiment, a wearable computing device is disclosed that includes a camera configured to record video data, a processor, and data storage comprising instructions executable by the processor to segment the video data into a number of layers and, based on the video data, detect that a pointing object is in proximity to a first layer. The instructions are further executable by the processor to initiate a first search on the first layer.Type: GrantFiled: May 28, 2015Date of Patent: August 2, 2016Assignee: Google Inc.Inventors: Thad Eugene Starner, Irfan Essa
-
Patent number: 9374532Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.Type: GrantFiled: April 1, 2013Date of Patent: June 21, 2016Assignee: Google Inc.Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9357129Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.Type: GrantFiled: September 26, 2014Date of Patent: May 31, 2016Assignee: Google Inc.Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Publication number: 20160150160Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.Type: ApplicationFiled: September 26, 2014Publication date: May 26, 2016Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
-
Patent number: 9298256Abstract: Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.Type: GrantFiled: January 22, 2015Date of Patent: March 29, 2016Assignee: Google Inc.Inventors: Thad Eugene Starner, Irfan Essa
-
Publication number: 20160086383Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving sensor data from a sensor on a wearable computing device and, based on the sensor data, detecting a movement that defines an outline of an area in the sensor data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive sensor data from a sensor on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the sensor data, a movement that defines an outline of an area in the sensor data, identify an object that is located in the area, and initiate a search on the object.Type: ApplicationFiled: December 4, 2015Publication date: March 24, 2016Inventors: Thad Eugene Starner, Irfan Essa
-
Patent number: 9230171Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data from a camera on a wearable computing device and, based on the video data, detecting a movement that defines an outline of an area in the video data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive video data from a camera on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the video data, a movement that defines an outline of an area in the video data, identify an object that is located in the area, and initiate a search on the object.Type: GrantFiled: February 20, 2012Date of Patent: January 5, 2016Assignee: Google Inc.Inventors: Thad Eugene Starner, Irfan Essa