Patents by Inventor Charles Lawrence Zitnick, III

Charles Lawrence Zitnick, III has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9934577
    Abstract: Edges are detected in a digital image including a plurality of pixels. For each of the plurality of pixels, a plurality of different edge assessments are made for that pixel. Each different edge assessment considers that pixel in a different position of a different pixel patch. The different edge assessments for each pixel are aggregated.
    Type: Grant
    Filed: July 10, 2014
    Date of Patent: April 3, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III
  • Patent number: 9928420
    Abstract: The subject disclosure is directed towards a high resolution, high frame rate, robust stereo depth system. The system provides depth data in varying conditions based upon stereo matching of images, including actively illuminated IR images in some implementations. A clean IR or RGB image may be captured and used with any other captured images in some implementations. Clean IR images may be obtained by using a notch filter to filter out the active illumination pattern. IR stereo cameras, a projector, broad spectrum IR LEDs and one or more other cameras may be incorporated into a single device, which may also include image processing components to internally compute depth data in the device for subsequent output.
    Type: Grant
    Filed: June 24, 2013
    Date of Patent: March 27, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Adam G. Kirk, Oliver A. Whyte, Sing Bing Kang, Charles Lawrence Zitnick, III, Richard S. Szeliski, Shahram Izadi, Christoph Rhemann, Andreas Georgiou, Avronil Bhattacharjee
  • Patent number: 9734404
    Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: August 15, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
  • Patent number: 9275680
    Abstract: Described is a user interface that displays a representation of a stereo scene, and includes interactive mechanisms for changing parameter values that determine the perceived appearance of that scene. The scene is modeled as if viewed from above, including a representation of a viewer's eyes, a representation of a viewing screen, and an indication simulating what each of the viewer eyes perceives on the viewing screen. Variable parameters may include a vergence parameter, a dolly parameter, a field-of-view parameter, an interocular parameter and a proscenium arch parameter.
    Type: Grant
    Filed: June 16, 2009
    Date of Patent: March 1, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Charles Lawrence Zitnick, III, Bryan K. Ressler, Sing Bing Kang, Michael F. Cohen, Jagannatha Koppal
  • Patent number: 9111349
    Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.
    Type: Grant
    Filed: December 16, 2011
    Date of Patent: August 18, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Richard Stephan Szeliski, Edward Hsiao, Sudipta Narayan Sinha, Krishnan Ramnath, Charles Lawrence Zitnick, III, Simon John Baker
  • Patent number: 9098908
    Abstract: Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.
    Type: Grant
    Filed: October 21, 2011
    Date of Patent: August 4, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Adam G. Kirk, Yaron Eshet, Kestutis Patiejunas, Sing Bing Kang, Charles Lawrence Zitnick, III, David Eraker, Simon Winder
  • Publication number: 20150206319
    Abstract: Edges are detected in a digital image including a plurality of pixels. For each of the plurality of pixels, a plurality of different edge assessments are made for that pixel. Each different edge assessment considers that pixel in a different position of a different pixel patch. The different edge assessments for each pixel are aggregated.
    Type: Application
    Filed: July 10, 2014
    Publication date: July 23, 2015
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III
  • Publication number: 20150154454
    Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.
    Type: Application
    Filed: February 13, 2015
    Publication date: June 4, 2015
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
  • Patent number: 8977060
    Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.
    Type: Grant
    Filed: May 16, 2013
    Date of Patent: March 10, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
  • Publication number: 20140341474
    Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.
    Type: Application
    Filed: May 16, 2013
    Publication date: November 20, 2014
    Applicant: Microsoft Corporation
    Inventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
  • Publication number: 20140307058
    Abstract: The subject disclosure is directed towards a high resolution, high frame rate, robust stereo depth system. The system provides depth data in varying conditions based upon stereo matching of images, including actively illuminated IR images in some implementations. A clean IR or RGB image may be captured and used with any other captured images in some implementations. Clean IR images may be obtained by using a notch filter to filter out the active illumination pattern. IR stereo cameras, a projector, broad spectrum IR LEDs and one or more other cameras may be incorporated into a single device, which may also include image processing components to internally compute depth data in the device for subsequent output.
    Type: Application
    Filed: June 24, 2013
    Publication date: October 16, 2014
    Inventors: Adam G. Kirk, Oliver A. Whyte, Sing Bing Kang, Charles Lawrence Zitnick, III, Richard S. Szeliski, Shahram Izadi, Christoph Rhemann, Andreas Georgiou, Avronil Bhattacharjee
  • Publication number: 20140270489
    Abstract: Various technologies described herein pertain to constructing mid-level sketch tokens for use in tasks, such as object detection and contour detection. Sketch patches can be extracted from binary images that comprise hand-drawn contours. The hand-drawn contours in the binary images can correspond to contours in training images. The sketch patches can be clustered to form sketch token classes. Moreover, color patches from the training images can be extracted and low-level features of the color patches can be computed. Further, a classifier that labels mid-level sketch tokens can be trained. Such training of the classifier can be through supervised learning of a mapping from the low-level features of the color patches to the sketch token classes.
    Type: Application
    Filed: March 12, 2013
    Publication date: September 18, 2014
    Applicant: Microsoft Corporation
    Inventors: Joseph Jaewhan Lim, Piotr Dollar, Charles Lawrence Zitnick, III
  • Publication number: 20140254926
    Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting non-grid tiles from source bitmaps. A server takes a source image, identifies possibly repetitive features, and tiles the image. For each tile that contains part of a possibly repetitive feature, the server replaces that part with the dominant color of the tile. The system then sends to a client a combination of new tiles and features, and indications to tiles and features that the client has previously received and stored, along with an indication of how to recreate the image based on the tiles and features.
    Type: Application
    Filed: May 23, 2014
    Publication date: September 11, 2014
    Applicant: MICROSOFT CORPORATION
    Inventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III
  • Patent number: 8827710
    Abstract: Architecture that guides the freeform drawing of objects by a user to enable the user to produce improved drawings without significant training. As the user draws, the architecture dynamically updates a relevant shadow image proximate (e.g., underlying) the user's strokes. The strokes overlay an evolving shadow image, which shadow image is suggestive of object contours that guide the user during the drawing process. Relevant edge images selected from a large database are automatically blended to construct the shadow image. As the user draws, the strokes are dynamically analyzed using an encoding of overlapping windows for fast matching with the database of images. A top ranked set of matching database edge images are aligned to the drawing, a set of spatially varying weights blend the edge images into the shadow image, and a scoring technique is employed to select the optimum shadow image for display.
    Type: Grant
    Filed: May 19, 2011
    Date of Patent: September 9, 2014
    Assignee: Microsoft Corporation
    Inventors: Charles Lawrence Zitnick, III, Yong Jae Lee, Michael Cohen
  • Patent number: 8788529
    Abstract: A content-based image retrieval technique for sharing image information between images. In the present image information sharing technique digital photographs containing relevant comments and links to web pages are supplied by a set of authors. A user of the image information sharing technique takes a digital picture of something that interests them, such as, for example, a poster, a product, a painting, and uploads it to an image information sharing server. The image information sharing technique then matches the photo to an image in an image information sharing database. The comments and web links associated with the matched photo are subsequently sent to the user.
    Type: Grant
    Filed: February 26, 2007
    Date of Patent: July 22, 2014
    Assignee: Microsoft Corp.
    Inventors: Charles Lawrence Zitnick, III, Richard Lloyd Hughes
  • Patent number: 8786785
    Abstract: Video signatures are generated when a small change in video information between consecutive frames N?1 and N is followed by a large change in video information between consecutive frames N and N+1. Information from frames N and/or N+1 is used to form a video signature.
    Type: Grant
    Filed: April 5, 2011
    Date of Patent: July 22, 2014
    Assignee: Microsoft Corporation
    Inventors: Seth Hendrickson, George Randell Dong, Saswata Mandal, Charles Lawrence Zitnick, III
  • Patent number: 8774274
    Abstract: A process for compressing and decompressing non-keyframes in sequential sets of contemporaneous video frames making up multiple video streams where the video frames in a set depict substantially the same scene from different viewpoints. Each set of contemporaneous video frames has a plurality frames designated as keyframes with the remaining being non-keyframes. In one embodiment, the non-keyframes are compressed using a multi-directional spatial prediction technique. In another embodiment, the non-keyframes of each set of contemporaneous video frames are compressed using a combined chaining and spatial prediction compression technique. The spatial prediction compression technique employed can be a single direction technique where just one reference frame, and so one chain, is used to predict each non-keyframe, or it can be a multi-directional technique where two or more reference frames, and so chains, are used to predict each non-keyframe.
    Type: Grant
    Filed: January 11, 2012
    Date of Patent: July 8, 2014
    Assignee: Microsoft Corporation
    Inventors: Simon Winder, Matthew T. Uyttendaele, Charles Lawrence Zitnick, III, Richard Szeliski, Sing Bing Kang
  • Patent number: 8768067
    Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting patterns from source bitmaps. A server takes a source image, and performs an edge-detection operation on it. From this edge-detected image, connected segments of the image are determined by executing multiple iterations of a small operation upon the image in parallel—for instance, by assigning each non-white pixel a unique value, then assigning each pixel the minimum value among itself and its neighbors until no pixel is assigned a new value in an iteration. Executing these operations in parallel greatly reduces the time required to identify the connected segments. When the segments are identified, they may be cached by the client so that they do not need to be re-sent to the client when re-encountered by the server.
    Type: Grant
    Filed: April 15, 2010
    Date of Patent: July 1, 2014
    Assignee: Microsoft Corporation
    Inventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III, Max Alan McMullen
  • Patent number: 8761520
    Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting non-grid tiles from source bitmaps. A server takes a source image, identifies possibly repetitive features, and tiles the image. For each tile that contains part of a possibly repetitive feature, the server replaces that part with the dominant color of the tile. The system then sends to a client a combination of new tiles and features, and indications to tiles and features that the client has previously received and stored, along with an indication of how to recreate the image based on the tiles and features.
    Type: Grant
    Filed: December 11, 2009
    Date of Patent: June 24, 2014
    Assignee: Microsoft Corporation
    Inventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III
  • Patent number: 8538077
    Abstract: Technology is described for detecting an interest point in an image using edges. An example method can include the operation of computing locally normalized edge magnitudes and edge orientations for the image using a processor to form a normalized gradient image. The normalized gradient image can be divided into a plurality of image orientation maps having edge orientations. Orientation dependent filtering can be applied to the image orientation maps to form response images. A further operation can be summing the response images to obtain an aggregated filter response image. Maxima can be identified in spatial position and scale in the aggregated filter response image. Maxima in the aggregated filter response image can be defined as interest points.
    Type: Grant
    Filed: May 3, 2011
    Date of Patent: September 17, 2013
    Assignee: Microsoft Corporation
    Inventor: Charles Lawrence Zitnick, III