Patents by Inventor Irfan A. Essa

Irfan A. Essa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20150286877
    Abstract: Methods and devices for initiating a search are disclosed. In one embodiment, a method is disclosed that includes causing a camera on a wearable computing device to record video data, segmenting the video data into a number of layers and, based on the video data, detecting that a pointing object is in proximity to a first layer. The method further includes initiating a first search on the first layer. In another embodiment, a wearable computing device is disclosed that includes a camera configured to record video data, a processor, and data storage comprising instructions executable by the processor to segment the video data into a number of layers and, based on the video data, detect that a pointing object is in proximity to a first layer. The instructions are further executable by the processor to initiate a first search on the first layer.
    Type: Application
    Filed: May 28, 2015
    Publication date: October 8, 2015
    Inventors: Thad Eugene Starner, Irfan Essa
  • Publication number: 20150242414
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
    Type: Application
    Filed: May 7, 2015
    Publication date: August 27, 2015
    Inventors: Thad Eugene Starner, Irfan Essa, Hayes Solos Raffle, Daniel Aminzade
  • Publication number: 20150227795
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data from a camera on a wearable computing device and, based on the video data, detecting a movement that defines an outline of an area in the video data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive video data from a camera on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the video data, a movement that defines an outline of an area in the video data, identify an object that is located in the area, and initiate a search on the object.
    Type: Application
    Filed: February 20, 2012
    Publication date: August 13, 2015
    Applicant: GOOGLE INC.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Patent number: 9069382
    Abstract: Methods and devices for initiating a search are disclosed. In one embodiment, a method is disclosed that includes receiving video data captured by an image-capture device on a wearable computing device, segmenting the video data into a number of layers and, based on the video data, detecting that a pointing object is in proximity to a first layer. The method further includes initiating a first search on the first layer. In another embodiment, a wearable computing device is disclosed that includes an interface configured to receive video data captured by an image-capture device, a processor, and data storage comprising instructions executable by the processor to segment the video data into a number of layers and, based on the video data, detect that a pointing object is in proximity to a first layer. The instructions are further executable by the processor to initiate a first search on the first layer.
    Type: Grant
    Filed: March 12, 2012
    Date of Patent: June 30, 2015
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Patent number: 9052804
    Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
    Type: Grant
    Filed: March 12, 2012
    Date of Patent: June 9, 2015
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa, Hayes Solos Raffle, Daniel Aminzade
  • Patent number: 8971571
    Abstract: Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.
    Type: Grant
    Filed: March 15, 2012
    Date of Patent: March 3, 2015
    Assignee: Google Inc.
    Inventors: Thad Eugene Starner, Irfan Essa
  • Publication number: 20140327788
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.
    Type: Application
    Filed: July 15, 2014
    Publication date: November 6, 2014
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 8860825
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Grant
    Filed: September 12, 2012
    Date of Patent: October 14, 2014
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20140267801
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: April 1, 2013
    Publication date: September 18, 2014
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 8810666
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected and a crop window transform may accordingly be determined. The crop window transform may describe a transform of the original camera path to a modified camera path that is smoother than the original camera path. A smoothness metric indicative of a degree of smoothness of the modified path may be determined. Based on a comparison of the smoothness metric to a predetermined threshold, for example, the crop window transform may be applied to the original video to obtain a stabilized modified video.
    Type: Grant
    Filed: January 16, 2012
    Date of Patent: August 19, 2014
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20140071299
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Application
    Filed: September 12, 2012
    Publication date: March 13, 2014
    Applicant: GOOGLE INC.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20130182134
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected and a crop window transform may accordingly be determined. The crop window transform may describe a transform of the original camera path to a modified camera path that is smoother than the original camera path. A smoothness metric indicative of a degree of smoothness of the modified path may be determined. Based on a comparison of the smoothness metric to a predetermined threshold, for example, the crop window transform may be applied to the original video to obtain a stabilized modified video.
    Type: Application
    Filed: January 16, 2012
    Publication date: July 18, 2013
    Applicant: GOOGLE INC.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa