Patents by Inventor Michael Rubinstein

Michael Rubinstein has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9811901
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images comprises examining pixel values of the at least two images. The temporal variation of the pixel values between the at least two images can be below a particular threshold. The method can further include applying signal processing to the pixel values.
    Type: Grant
    Filed: March 26, 2013
    Date of Patent: November 7, 2017
    Assignees: Massachusetts Institute of Technology, Quanta Computer Inc.
    Inventors: Hao-yu Wu, Michael Rubinstein, Eugene Inghaw Shih, John V. Guttag, Frederic Durand, William T. Freeman
  • Patent number: 9805475
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.
    Type: Grant
    Filed: September 7, 2012
    Date of Patent: October 31, 2017
    Assignees: Massachusetts Institute of Technology, Quanta Computer Inc.
    Inventors: Michael Rubinstein, Neal Wadhwa, Frederic Durand, William T. Freeman, Hao-yu Wu, Eugene Inghaw Shih, John V. Guttag
  • Patent number: 9710917
    Abstract: An imaging method and corresponding apparatus according to an embodiment of the present invention enables measurement and visualization of fluid flow. An embodiment method includes obtaining video captured by a video camera with an imaging plane. Representations of motions in the video are correlated. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Depth and three-dimensional information can be recovered using stereo video, and uncertainty methods can enhance measurement robustness where backgrounds are less textured. Example applications can include avionics and hydrocarbon leak detection.
    Type: Grant
    Filed: May 15, 2014
    Date of Patent: July 18, 2017
    Assignee: Massachusetts Institute of Technology
    Inventors: William T. Freeman, Frederic Durand, Tianfan Xue, Michael Rubinstein, Neal Wadhwa
  • Patent number: 9338331
    Abstract: Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.
    Type: Grant
    Filed: January 8, 2015
    Date of Patent: May 10, 2016
    Assignee: Massachusetts Institute of Technology
    Inventors: Neal Wadhwa, Michael Rubinstein, Frederic Durand, William T. Freeman
  • Patent number: 9324005
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.
    Type: Grant
    Filed: December 6, 2012
    Date of Patent: April 26, 2016
    Assignee: Massachusetts Institute of Technology Quanta Computer Inc.
    Inventors: Neal Wadhwa, Michael Rubinstein, Frederic Durand, William T. Freeman, Hao-Yu Wu, Eugene Inghaw Shih, John V. Guttag
  • Patent number: 9239848
    Abstract: Techniques for semantically annotating images in a plurality of images, each image in the plurality of images comprising at least one image region. The techniques include identifying at least two similar images including a first image and a second image, identifying corresponding image regions in the first image and the second image, and assigning, using at least one processor, annotations to image regions in one or more images in the plurality of images by using a metric of fit indicative of a degree of match between the assigned annotations and the corresponding image regions. The metric of fit may depend on at least one annotation for each image in a subset of the plurality of images and the identified correspondence between image regions in the first image and the second image.
    Type: Grant
    Filed: February 6, 2012
    Date of Patent: January 19, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ce Liu, Michael Rubinstein
  • Publication number: 20150319540
    Abstract: A method of recovering audio signals and corresponding apparatus according to an embodiment of the present invention using video or other sequence of images enables recovery of sound that causes vibrations of a surface. An embodiment method includes combining representations of local motions of a surface to produce a global motion signal of the surface. The local motions are captured in a series of images of features of the surface, and the global motion signal represents a sound within an environment in which the surface is located. Some embodiments compare representations of local motions of a surface to determine which motions are in-phase or out-of-phase with each other, enabling visualization of surface vibrational modes. Embodiments are passive, as compared to other forms of remote audio recovery that employ active sensing, such as laser microphone systems. Example applications for the embodiments include espionage and surveillance.
    Type: Application
    Filed: July 21, 2014
    Publication date: November 5, 2015
    Inventors: Michael Rubinstein, Myers Abraham Davis, Frederic Durand, William T. Freeman, Neal Wadhwa
  • Publication number: 20150195430
    Abstract: Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.
    Type: Application
    Filed: January 8, 2015
    Publication date: July 9, 2015
    Inventors: Neal Wadhwa, Michael Rubinstein, Frederic Durand, William T. Freeman
  • Publication number: 20150016690
    Abstract: An imaging method and corresponding apparatus according to an embodiment of the present invention enables measurement and visualization of fluid flow. An embodiment method includes obtaining video captured by a video camera with an imaging plane. Representations of motions in the video are correlated. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Depth and three-dimensional information can be recovered using stereo video, and uncertainty methods can enhance measurement robustness where backgrounds are less textured. Example applications can include avionics and hydrocarbon leak detection.
    Type: Application
    Filed: May 15, 2014
    Publication date: January 15, 2015
    Applicant: Massachusetts Institute of Technology
    Inventors: William T. Freeman, Frederic Durand, Tianfan Xue, Michael Rubinstein, Neal Wadhwa
  • Publication number: 20140360877
    Abstract: Methods of forming a chip with fluidic channels include forming (e.g., milling) at least one nanofunnel with a wide end and a narrow end into a planar substrate, the nanofunnel having a length, with width and depth dimensions that both vary over its length and forming (e.g., milling) at least one nanochannel into the planar substrate at an interface adjacent the narrow end of the nanofunnel.
    Type: Application
    Filed: February 7, 2013
    Publication date: December 11, 2014
    Inventors: John Michael Ramsey, Laurent Menard, Jinsheng Zhou, Michael Rubinstein, Sergey Panyukov
  • Publication number: 20140340502
    Abstract: An imaging method and corresponding apparatus according to an embodiment of the present invention enables measurement and visualization of fluid flow. An embodiment method includes obtaining video captured by a video camera with an imaging plane. Representations of motions in the video are correlated. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Depth and three-dimensional information can be recovered using stereo video, and uncertainty methods can enhance measurement robustness where backgrounds are less textured. Example applications can include avionics and hydrocarbon leak detection.
    Type: Application
    Filed: May 15, 2014
    Publication date: November 20, 2014
    Applicant: Massachusetts Institute of Technology
    Inventors: William T. Freeman, Frederic Durand, Tianfan Xue, Michael Rubinstein, Neal Wadhwa
  • Publication number: 20140072228
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.
    Type: Application
    Filed: September 7, 2012
    Publication date: March 13, 2014
    Applicant: Massachusetts Institute of Technology
    Inventors: Michael Rubinstein, Neal Wadhwa, Fredo Durand, William T. Freeman
  • Publication number: 20140072190
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images comprises examining pixel values of the at least two images. The temporal variation of the pixel values between the at least two images can be below a particular threshold. The method can further include applying signal processing to the pixel values.
    Type: Application
    Filed: March 26, 2013
    Publication date: March 13, 2014
    Applicant: Massachusetts Institute of Technology
    Inventors: Hao-yu Wu, Michael Rubinstein, Eugene Inghaw Shih, John V. Guttag, Frederic Durand, William T. Freeman
  • Publication number: 20140072229
    Abstract: In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.
    Type: Application
    Filed: December 6, 2012
    Publication date: March 13, 2014
    Applicant: Massachusetts Institute of Technology
    Inventors: Neal Wadhwa, Michael Rubinstein, Frederic Durand, William T. Freeman, Hao-Yu Wu, Eugen Inghaw Shih, John V. Guttag
  • Publication number: 20130202205
    Abstract: Techniques for semantically annotating images in a plurality of images, each image in the plurality of images comprising at least one image region. The techniques include identifying at least two similar images including a first image and a second image, identifying corresponding image regions in the first image and the second image, and assigning, using at least one processor, annotations to image regions in one or more images in the plurality of images by using a metric of fit indicative of a degree of match between the assigned annotations and the corresponding image regions. The metric of fit may depend on at least one annotation for each image in a subset of the plurality of images and the identified correspondence between image regions in the first image and the second image.
    Type: Application
    Filed: February 6, 2012
    Publication date: August 8, 2013
    Applicant: Microsoft Corporation
    Inventors: Ce Liu, Michael Rubinstein
  • Patent number: 8405681
    Abstract: A method for image comparison includes reading from a memory in a computerized image processor a source image and a target image. The source and target images are segmented, using the image processor, into respective pluralities of source and target arrays, respectively including source and target array elements, each array element including a matrix of one or more pixels from a respective image, each of the source arrays having a respective position in the source image, and each of the target arrays corresponding respectively to one of the source arrays based on the respective position. An asymmetric warping process is applied between each of the source arrays and each of the respectively corresponding target arrays so as to compute respective array similarity scores. The respective array similarity scores are combined so as to compute an image similarity score of the target image with respect to the source image.
    Type: Grant
    Filed: June 24, 2009
    Date of Patent: March 26, 2013
    Assignees: Interdisciplinary Center Herzliya
    Inventors: Ariel Shamir, Michael Rubinstein
  • Patent number: 8400473
    Abstract: A method for image processing includes receiving in a computerized image processor a source image having a source size and a definition of a target size that is different from the source size, and defining a plurality of different sequences of two or more different image retargeting operations that when applied to the source image, generates respective target images of the target size. The different sequences are automatically tested, using the image processor, by measuring respective similarities of the respective target images to the source image. One of the sequences is selected responsively to the similarities, and the selected one of the sequences is applied to the source image, using the image processor, in order to generate a target image.
    Type: Grant
    Filed: June 24, 2009
    Date of Patent: March 19, 2013
    Assignees: Interdisciplinary Center Herzliya
    Inventors: Ariel Shamir, Michael Rubinstein
  • Publication number: 20100328352
    Abstract: A method for image processing includes receiving in a computerized image processor a source image having a source size and a definition of a target size that is different from the source size, and defining a plurality of different sequences of two or more different image retargeting operations that when applied to the source image, generates respective target images of the target size. The different sequences are automatically tested, using the image processor, by measuring respective similarities of the respective target images to the source image. One of the sequences is selected responsively to the similarities, and the selected one of the sequences is applied to the source image, using the image processor, in order to generate a target image.
    Type: Application
    Filed: June 24, 2009
    Publication date: December 30, 2010
    Inventors: Ariel Shamir, Michael Rubinstein
  • Publication number: 20100328345
    Abstract: A method for image comparison includes reading from a memory in a computerized image processor a source image and a target image. The source and target images are segmented, using the image processor, into respective pluralities of source and target arrays, respectively including source and target array elements, each array element including a matrix of one or more pixels from a respective image, each of the source arrays having a respective position in the source image, and each of the target arrays corresponding respectively to one of the source arrays based on the respective position. An asymmetric warping process is applied between each of the source arrays and each of the respectively corresponding target arrays so as to compute respective array similarity scores. The respective array similarity scores are combined so as to compute an image similarity score of the target image with respect to the source image.
    Type: Application
    Filed: June 24, 2009
    Publication date: December 30, 2010
    Inventors: Ariel Shamir, Michael Rubinstein
  • Publication number: 20070245369
    Abstract: A lockbox that includes an access device reader configured to obtain a key code from an access device, an access control system, operatively connected to an access administration system, configured to grant access to the lockbox when the key code is verified, and a bidirectional programmable multitap (BPMT) comprising a microprocessor and a tap, wherein the BPMT is controlled by the access control system and wherein the BPMT is configured to send status information about the tap to the access control system.
    Type: Application
    Filed: May 14, 2007
    Publication date: October 18, 2007
    Applicant: REMOTE SECURITY SYSTEMS, LLC
    Inventors: James Thompson, David Strawn, Michael Rubinstein, Stuckey McIntosh