Patents by Inventor Charles Lawrence Zitnick, III
Charles Lawrence Zitnick, III has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 9934577Abstract: Edges are detected in a digital image including a plurality of pixels. For each of the plurality of pixels, a plurality of different edge assessments are made for that pixel. Each different edge assessment considers that pixel in a different position of a different pixel patch. The different edge assessments for each pixel are aggregated.Type: GrantFiled: July 10, 2014Date of Patent: April 3, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Piotr Dollar, Charles Lawrence Zitnick, III
-
Patent number: 9928420Abstract: The subject disclosure is directed towards a high resolution, high frame rate, robust stereo depth system. The system provides depth data in varying conditions based upon stereo matching of images, including actively illuminated IR images in some implementations. A clean IR or RGB image may be captured and used with any other captured images in some implementations. Clean IR images may be obtained by using a notch filter to filter out the active illumination pattern. IR stereo cameras, a projector, broad spectrum IR LEDs and one or more other cameras may be incorporated into a single device, which may also include image processing components to internally compute depth data in the device for subsequent output.Type: GrantFiled: June 24, 2013Date of Patent: March 27, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Adam G. Kirk, Oliver A. Whyte, Sing Bing Kang, Charles Lawrence Zitnick, III, Richard S. Szeliski, Shahram Izadi, Christoph Rhemann, Andreas Georgiou, Avronil Bhattacharjee
-
Patent number: 9734404Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.Type: GrantFiled: February 13, 2015Date of Patent: August 15, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
-
Patent number: 9275680Abstract: Described is a user interface that displays a representation of a stereo scene, and includes interactive mechanisms for changing parameter values that determine the perceived appearance of that scene. The scene is modeled as if viewed from above, including a representation of a viewer's eyes, a representation of a viewing screen, and an indication simulating what each of the viewer eyes perceives on the viewing screen. Variable parameters may include a vergence parameter, a dolly parameter, a field-of-view parameter, an interocular parameter and a proscenium arch parameter.Type: GrantFiled: June 16, 2009Date of Patent: March 1, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Charles Lawrence Zitnick, III, Bryan K. Ressler, Sing Bing Kang, Michael F. Cohen, Jagannatha Koppal
-
Patent number: 9111349Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.Type: GrantFiled: December 16, 2011Date of Patent: August 18, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Richard Stephan Szeliski, Edward Hsiao, Sudipta Narayan Sinha, Krishnan Ramnath, Charles Lawrence Zitnick, III, Simon John Baker
-
Patent number: 9098908Abstract: Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.Type: GrantFiled: October 21, 2011Date of Patent: August 4, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Adam G. Kirk, Yaron Eshet, Kestutis Patiejunas, Sing Bing Kang, Charles Lawrence Zitnick, III, David Eraker, Simon Winder
-
Publication number: 20150206319Abstract: Edges are detected in a digital image including a plurality of pixels. For each of the plurality of pixels, a plurality of different edge assessments are made for that pixel. Each different edge assessment considers that pixel in a different position of a different pixel patch. The different edge assessments for each pixel are aggregated.Type: ApplicationFiled: July 10, 2014Publication date: July 23, 2015Inventors: Piotr Dollar, Charles Lawrence Zitnick, III
-
Publication number: 20150154454Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.Type: ApplicationFiled: February 13, 2015Publication date: June 4, 2015Inventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
-
Patent number: 8977060Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.Type: GrantFiled: May 16, 2013Date of Patent: March 10, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
-
Publication number: 20140341474Abstract: The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.Type: ApplicationFiled: May 16, 2013Publication date: November 20, 2014Applicant: Microsoft CorporationInventors: Piotr Dollar, Charles Lawrence Zitnick, III, Dennis I. Park
-
Publication number: 20140307058Abstract: The subject disclosure is directed towards a high resolution, high frame rate, robust stereo depth system. The system provides depth data in varying conditions based upon stereo matching of images, including actively illuminated IR images in some implementations. A clean IR or RGB image may be captured and used with any other captured images in some implementations. Clean IR images may be obtained by using a notch filter to filter out the active illumination pattern. IR stereo cameras, a projector, broad spectrum IR LEDs and one or more other cameras may be incorporated into a single device, which may also include image processing components to internally compute depth data in the device for subsequent output.Type: ApplicationFiled: June 24, 2013Publication date: October 16, 2014Inventors: Adam G. Kirk, Oliver A. Whyte, Sing Bing Kang, Charles Lawrence Zitnick, III, Richard S. Szeliski, Shahram Izadi, Christoph Rhemann, Andreas Georgiou, Avronil Bhattacharjee
-
Publication number: 20140270489Abstract: Various technologies described herein pertain to constructing mid-level sketch tokens for use in tasks, such as object detection and contour detection. Sketch patches can be extracted from binary images that comprise hand-drawn contours. The hand-drawn contours in the binary images can correspond to contours in training images. The sketch patches can be clustered to form sketch token classes. Moreover, color patches from the training images can be extracted and low-level features of the color patches can be computed. Further, a classifier that labels mid-level sketch tokens can be trained. Such training of the classifier can be through supervised learning of a mapping from the low-level features of the color patches to the sketch token classes.Type: ApplicationFiled: March 12, 2013Publication date: September 18, 2014Applicant: Microsoft CorporationInventors: Joseph Jaewhan Lim, Piotr Dollar, Charles Lawrence Zitnick, III
-
Publication number: 20140254926Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting non-grid tiles from source bitmaps. A server takes a source image, identifies possibly repetitive features, and tiles the image. For each tile that contains part of a possibly repetitive feature, the server replaces that part with the dominant color of the tile. The system then sends to a client a combination of new tiles and features, and indications to tiles and features that the client has previously received and stored, along with an indication of how to recreate the image based on the tiles and features.Type: ApplicationFiled: May 23, 2014Publication date: September 11, 2014Applicant: MICROSOFT CORPORATIONInventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III
-
Patent number: 8827710Abstract: Architecture that guides the freeform drawing of objects by a user to enable the user to produce improved drawings without significant training. As the user draws, the architecture dynamically updates a relevant shadow image proximate (e.g., underlying) the user's strokes. The strokes overlay an evolving shadow image, which shadow image is suggestive of object contours that guide the user during the drawing process. Relevant edge images selected from a large database are automatically blended to construct the shadow image. As the user draws, the strokes are dynamically analyzed using an encoding of overlapping windows for fast matching with the database of images. A top ranked set of matching database edge images are aligned to the drawing, a set of spatially varying weights blend the edge images into the shadow image, and a scoring technique is employed to select the optimum shadow image for display.Type: GrantFiled: May 19, 2011Date of Patent: September 9, 2014Assignee: Microsoft CorporationInventors: Charles Lawrence Zitnick, III, Yong Jae Lee, Michael Cohen
-
Patent number: 8788529Abstract: A content-based image retrieval technique for sharing image information between images. In the present image information sharing technique digital photographs containing relevant comments and links to web pages are supplied by a set of authors. A user of the image information sharing technique takes a digital picture of something that interests them, such as, for example, a poster, a product, a painting, and uploads it to an image information sharing server. The image information sharing technique then matches the photo to an image in an image information sharing database. The comments and web links associated with the matched photo are subsequently sent to the user.Type: GrantFiled: February 26, 2007Date of Patent: July 22, 2014Assignee: Microsoft Corp.Inventors: Charles Lawrence Zitnick, III, Richard Lloyd Hughes
-
Patent number: 8786785Abstract: Video signatures are generated when a small change in video information between consecutive frames N?1 and N is followed by a large change in video information between consecutive frames N and N+1. Information from frames N and/or N+1 is used to form a video signature.Type: GrantFiled: April 5, 2011Date of Patent: July 22, 2014Assignee: Microsoft CorporationInventors: Seth Hendrickson, George Randell Dong, Saswata Mandal, Charles Lawrence Zitnick, III
-
Patent number: 8774274Abstract: A process for compressing and decompressing non-keyframes in sequential sets of contemporaneous video frames making up multiple video streams where the video frames in a set depict substantially the same scene from different viewpoints. Each set of contemporaneous video frames has a plurality frames designated as keyframes with the remaining being non-keyframes. In one embodiment, the non-keyframes are compressed using a multi-directional spatial prediction technique. In another embodiment, the non-keyframes of each set of contemporaneous video frames are compressed using a combined chaining and spatial prediction compression technique. The spatial prediction compression technique employed can be a single direction technique where just one reference frame, and so one chain, is used to predict each non-keyframe, or it can be a multi-directional technique where two or more reference frames, and so chains, are used to predict each non-keyframe.Type: GrantFiled: January 11, 2012Date of Patent: July 8, 2014Assignee: Microsoft CorporationInventors: Simon Winder, Matthew T. Uyttendaele, Charles Lawrence Zitnick, III, Richard Szeliski, Sing Bing Kang
-
Patent number: 8768067Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting patterns from source bitmaps. A server takes a source image, and performs an edge-detection operation on it. From this edge-detected image, connected segments of the image are determined by executing multiple iterations of a small operation upon the image in parallel—for instance, by assigning each non-white pixel a unique value, then assigning each pixel the minimum value among itself and its neighbors until no pixel is assigned a new value in an iteration. Executing these operations in parallel greatly reduces the time required to identify the connected segments. When the segments are identified, they may be cached by the client so that they do not need to be re-sent to the client when re-encountered by the server.Type: GrantFiled: April 15, 2010Date of Patent: July 1, 2014Assignee: Microsoft CorporationInventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III, Max Alan McMullen
-
Patent number: 8761520Abstract: Systems, methods and computer-readable storage media are disclosed for accelerating bitmap remoting by extracting non-grid tiles from source bitmaps. A server takes a source image, identifies possibly repetitive features, and tiles the image. For each tile that contains part of a possibly repetitive feature, the server replaces that part with the dominant color of the tile. The system then sends to a client a combination of new tiles and features, and indications to tiles and features that the client has previously received and stored, along with an indication of how to recreate the image based on the tiles and features.Type: GrantFiled: December 11, 2009Date of Patent: June 24, 2014Assignee: Microsoft CorporationInventors: Nadim Y. Abdo, Voicu Anton Albu, Charles Lawrence Zitnick, III
-
Patent number: 8538077Abstract: Technology is described for detecting an interest point in an image using edges. An example method can include the operation of computing locally normalized edge magnitudes and edge orientations for the image using a processor to form a normalized gradient image. The normalized gradient image can be divided into a plurality of image orientation maps having edge orientations. Orientation dependent filtering can be applied to the image orientation maps to form response images. A further operation can be summing the response images to obtain an aggregated filter response image. Maxima can be identified in spatial position and scale in the aggregated filter response image. Maxima in the aggregated filter response image can be defined as interest points.Type: GrantFiled: May 3, 2011Date of Patent: September 17, 2013Assignee: Microsoft CorporationInventor: Charles Lawrence Zitnick, III