Patents by Inventor Irfan Essa

Irfan Essa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11663307
    Abstract: Example systems and methods for defending against powerful, automated attacks on facial authentication systems are disclosed. A first verification is performed based at least in part on determining a response time for a response to a CAPTCHA or other challenge. In response to determining that the response time is within a threshold, a second verification is performed based at least in part on extracting a face feature or a voice feature from a plurality of samples associated with the response.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: May 30, 2023
    Assignee: GEORGIA TECH RESEARCH CORPORATION
    Inventors: Erkam Uzun, Pak Ho Chung, Irfan A. Essa, Wenke Lee
  • Patent number: 10721439
    Abstract: A method for personalizing a content item using captured footage is disclosed. The method includes receiving a first video feed from a first camera, wherein the first camera is designated as a source camera for capturing an event during a first time duration. The method also includes receiving data from a second camera, and determining, based on the received data from the second camera, that an action was performed using the second camera, the action being indicative of a region of interest (ROI) of the user of the second camera occurring within a second time duration. The method further includes designating the second camera as the source camera for capturing the event during the second time duration.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: July 21, 2020
    Assignee: GOOGLE LLC
    Inventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
  • Publication number: 20200097643
    Abstract: Example systems and methods for defending against powerful, automated attacks on facial authentication systems are disclosed. A first verification is performed based at least in part on determining a response time for a response to a CAPTCHA or other challenge. In response to determining that the response time is within a threshold, a second verification is performed based at least in part on extracting a face feature or a voice feature from a plurality of samples associated with the response.
    Type: Application
    Filed: September 24, 2019
    Publication date: March 26, 2020
    Inventors: Erkam Uzun, Pak Ho Chung, Irfan A. Essa, Wenke Lee
  • Patent number: 10437882
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
    Type: Grant
    Filed: May 7, 2015
    Date of Patent: October 8, 2019
    Assignee: Google LLC
    Inventors: Thad Eugene Starner, Irfan Essa, Hayes Solos Raffle, Daniel Aminzade
  • Publication number: 20180350131
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.
    Type: Application
    Filed: December 31, 2014
    Publication date: December 6, 2018
    Inventors: Irfan Essa, Vivek Kwatra, Matthias Grundmann
  • Patent number: 10110850
    Abstract: A method for localizing the attention of a user of a first-person point-of-view (FPPOV) device is disclosed. The method includes receiving data from an FPPOV device, the data being indicative of a first region-of-interest (ROI) of an event for a first time duration and a second ROI of the event for a second time duration. The method further include determining that a first camera from a plurality of cameras best captures the first ROI during the first time duration, and determining that a second camera from the plurality of cameras best captures the second ROI during the second time duration.
    Type: Grant
    Filed: July 15, 2014
    Date of Patent: October 23, 2018
    Assignee: Google LLC
    Inventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
  • Patent number: 9888180
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: February 6, 2018
    Assignee: GOOGLE LLC
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20170195575
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: March 20, 2017
    Publication date: July 6, 2017
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9635261
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: April 25, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9600723
    Abstract: A method for localizing the attention of a user of a first-person point-of-view (FPPOV) device is disclosed. The method includes receiving a plurality of images of an event, each image having been captured by one of a plurality of reference cameras during a first time duration. The method further includes receiving a first user-captured image captured by the FPPOV device during the first time duration. A first image of the plurality of images is selected as a best-matched image, based on the first user-captured image, for capturing a region-of-interest.
    Type: Grant
    Filed: July 3, 2014
    Date of Patent: March 21, 2017
    Assignee: GOOGLE INC.
    Inventors: Caroline Rebecca Pantofaru, Vinay Bettadapura, Krishna Bharat, Irfan Essa
  • Patent number: 9554043
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.
    Type: Grant
    Filed: July 15, 2014
    Date of Patent: January 24, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9536354
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving sensor data from a sensor on a wearable computing device and, based on the sensor data, detecting a movement that defines an outline of an area in the sensor data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive sensor data from a sensor on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the sensor data, a movement that defines an outline of an area in the sensor data, identify an object that is located in the area, and initiate a search on the object.
    Type: Grant
    Filed: December 4, 2015
    Date of Patent: January 3, 2017
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Publication number: 20160269642
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: May 9, 2016
    Publication date: September 15, 2016
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9405977
    Abstract: Methods and devices for initiating a search are disclosed. In one embodiment, a method is disclosed that includes causing a camera on a wearable computing device to record video data, segmenting the video data into a number of layers and, based on the video data, detecting that a pointing object is in proximity to a first layer. The method further includes initiating a first search on the first layer. In another embodiment, a wearable computing device is disclosed that includes a camera configured to record video data, a processor, and data storage comprising instructions executable by the processor to segment the video data into a number of layers and, based on the video data, detect that a pointing object is in proximity to a first layer. The instructions are further executable by the processor to initiate a first search on the first layer.
    Type: Grant
    Filed: May 28, 2015
    Date of Patent: August 2, 2016
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Patent number: 9374532
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: April 1, 2013
    Date of Patent: June 21, 2016
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9357129
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: May 31, 2016
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20160150160
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Application
    Filed: September 26, 2014
    Publication date: May 26, 2016
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9298256
    Abstract: Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.
    Type: Grant
    Filed: January 22, 2015
    Date of Patent: March 29, 2016
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Publication number: 20160086383
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving sensor data from a sensor on a wearable computing device and, based on the sensor data, detecting a movement that defines an outline of an area in the sensor data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive sensor data from a sensor on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the sensor data, a movement that defines an outline of an area in the sensor data, identify an object that is located in the area, and initiate a search on the object.
    Type: Application
    Filed: December 4, 2015
    Publication date: March 24, 2016
    Inventors: Thad Eugene Starner, Irfan Essa
  • Patent number: 9230171
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data from a camera on a wearable computing device and, based on the video data, detecting a movement that defines an outline of an area in the video data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive video data from a camera on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the video data, a movement that defines an outline of an area in the video data, identify an object that is located in the area, and initiate a search on the object.
    Type: Grant
    Filed: February 20, 2012
    Date of Patent: January 5, 2016
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa