Patents by Inventor Michael Bleyer

Michael Bleyer has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240056696
    Abstract: An image sensor configured to capture imagery with mitigated noise includes a plurality of image sensing pixels arranged to form a sensor array. Each image sensing pixel of the plurality of image sensing pixels comprises an active area configured to receive photons to facilitate image capture. Each active area comprises a length and a width. For at least one image sensing pixel of the plurality of image sensing pixels, the length or the width of the active area is smaller than about 80% of a pixel pitch measurement between the at least one image sensing pixel and an adjacent image sensing pixel. A size of the active area relative to the pixel pitch measurement contributes to mitigating sensor noise for the image sensor.
    Type: Application
    Filed: October 25, 2023
    Publication date: February 15, 2024
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
  • Patent number: 11900621
    Abstract: Techniques for correcting an overlay misalignment between an external camera image and a system camera image are disclosed. A first system camera image and a first external camera image are acquired. A first visual alignment is performed between those two images to produce an overlaid image. Some of the content in the overlaid image is surrounded by a bounding element. A position of the bounding element is modified based on movements of the system camera and/or the external camera. In response to performing a second visual alignment using new images, an update vector is computed. Relative movement between the two cameras is determined. Based on the movement and based on the update vector, the bounding element is progressively transitioned to a corrected position in the overlaid image. A speed by which the bounding element is progressively transitioned is proportional to the amount of movement.
    Type: Grant
    Filed: October 13, 2021
    Date of Patent: February 13, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11899211
    Abstract: A near-eye display device comprises a pupil-expansion optic, a laser, a drive circuit coupled operatively to the first and second lasers, a spatial light modulator (SLM), and a computer. The SLM has a matrix of electronically controllable pixel elements and is configured to receive emission from the laser and to direct the emission in spatially modulated form to the pupil-expansion optic. Coupled operatively to the drive circuit and to the SLM, the computer is configured to parse a digital image, trigger the emission from the laser by causing the drive circuit to drive a periodic current through a gain structure of the laser, and control the matrix of pixel elements such that the spatially modulated form of the emission projects an optical image corresponding to the digital image, wherein the periodic current includes plural cycles of modulation driven through the gain structure while the optical image is projected.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: February 13, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11892624
    Abstract: In one method, device data including an orientation of a targeting device is received in a computing system. Target coordinates of the targeting device as projected onto a field-of-view of a display device are then located based on the device data. Pursuant to locating the target coordinates within a predefined margin, a target graphic indicating the target coordinates is superposed onto the field-of-view. Pursuant to locating the target coordinates outside of the predefined margin, an off-target graphic is superposed onto the field-of-view and aligned to a display perimeter of the display device.
    Type: Grant
    Filed: April 27, 2021
    Date of Patent: February 6, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Publication number: 20240031624
    Abstract: A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.
    Type: Application
    Filed: October 6, 2023
    Publication date: January 25, 2024
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
  • Publication number: 20240029206
    Abstract: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.
    Type: Application
    Filed: October 2, 2023
    Publication date: January 25, 2024
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
  • Patent number: 11881129
    Abstract: A system for adding persistence to SPAD imagery is configurable to capture, using a SPAD array, a plurality of image frames. The system is configurable to capture, using an IMU, pose data associated with the plurality of image frames. The pose data includes at least respective pose data associated with each of the plurality of image frames. The system is configurable to determine a persistence term based on the pose data. The system is also configurable to generate a composite image based on the plurality of image frames, the respective pose data associated with each of the plurality of image frames, and the persistence term. The persistence term defines a contribution of each of the plurality of image frames to the composite image.
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: January 23, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11877088
    Abstract: A method for enhancing digital imagery. The method comprises receiving a linear, intensity-based image of an environment. A histogram of intensity values is generated for a plurality of pixels within the linear, intensity-based image. Based on the histogram of intensity values, local contrast enhancement is applied to the linear, intensity-based image to generate a contrast enhanced version of the linear, intensity-based image, and artificial colorization is applied to the linear, intensity-based image to generate an artificially colorized version of the linear, intensity-based image. A composite image of the environment is then generated based on at least a portion of the contrast enhanced version of the linear, intensity-based image and at least a portion of the artificially colorized version of the linear, intensity-based image.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: January 16, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds, Benjamin Brown, Casey Lee Miller
  • Patent number: 11849220
    Abstract: A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: December 19, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Christopher Douglas Edmonds, Antonios Matakos, Raymond Kirk Price
  • Patent number: 11849227
    Abstract: An image sensor configured to capture imagery with mitigated noise includes a plurality of image sensing pixels arranged to form a sensor array. Each image sensing pixel of the plurality of image sensing pixels comprises an active area configured to receive photons to facilitate image capture. Each active area comprises a length and a width. For at least one image sensing pixel of the plurality of image sensing pixels, the length or the width of the active area is smaller than about 80% of a pixel pitch measurement between the at least one image sensing pixel and an adjacent image sensing pixel. A size of the active area relative to the pixel pitch measurement contributes to mitigating sensor noise for the image sensor.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: December 19, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Publication number: 20230403385
    Abstract: A system for facilitating intensity image capture and time of flight capture. The system includes an image sensor array comprising a plurality of image sensor pixels, one or more processors, and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to facilitate intensity image capture and time of flight capture by configuring the system to perform interleaved intensity image capture and time of flight capture operations using the image sensor array.
    Type: Application
    Filed: August 23, 2023
    Publication date: December 14, 2023
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
  • Patent number: 11841509
    Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.
    Type: Grant
    Filed: November 14, 2022
    Date of Patent: December 12, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Sudipta Narayan Sinha, Christopher Douglas Edmonds, Raymond Kirk Price
  • Patent number: 11831996
    Abstract: A system for generating high dynamic range (HDR) imagery obtains a history frame associated with a first timepoint and with a first set of image capture parameters. The system obtains an image frame associated with a particular set of image capture parameters and captured at a second timepoint that is subsequent to the first timepoint, and the particular set of image capture parameters comprises the first set of image capture parameters or a second set of image capture parameters. The system generates a normalized image frame by applying a normalization operation to the image frame. The normalization operation may be determined based upon the particular set of image capture parameters. The system generates a weight map based upon at least the normalized image frame and generate an HDR image frame based upon the normalized image frame, the history frame, and the weight map.
    Type: Grant
    Filed: February 1, 2022
    Date of Patent: November 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Christian Markus Maekelae, Michael Bleyer
  • Patent number: 11831931
    Abstract: A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: November 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11810278
    Abstract: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: November 7, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Publication number: 20230334636
    Abstract: Techniques to temporally filter images via a filtering weight computation are disclosed. A first image having a first timestamp and a second image having a second timestamp are acquired. These images are generated by a camera, and the first timestamp is before the second timestamp. A motion compensation (MC) operation is performed on the first image to produce an MC image. A difference image is generated using the MC image and the second image. The difference image reflects differences in intensities that exist between the two images. A local weight map is generated based on those differences. A global weight map is generated based on certain IMU data. A final weight map is generated based on a combination of the local weight map and the global weight map. The final weight map is used to generate a filtered image.
    Type: Application
    Filed: June 19, 2023
    Publication date: October 19, 2023
    Inventors: Raymond Kirk PRICE, Christopher Douglas EDMONDS, Michael BLEYER, Christian Markus MAEKELAE
  • Patent number: 11785199
    Abstract: A system for facilitating intensity image capture and time of flight capture. The system includes a single photon avalanche diode (SPAD) array comprising a plurality of SPAD pixels, one or more processors, and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to facilitate intensity image capture and time of flight capture by configuring the system to perform interleaved intensity image capture and time of flight capture operations using the SPAD array.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: October 10, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11776138
    Abstract: Examples are described that relate to correcting line bias in images. One example provides a method comprising receiving, from an imaging device, a plurality of images each comprising a plurality of lines of pixels. The method further comprises, for each image of the plurality of images, for each line of pixels of the plurality of lines of pixels, based at least on one or more pixel values of one or more pixels in the line of pixels, determining a line bias correction for the line, and applying the line bias correction to each pixel in the line, the line bias correction comprising an offset applied to each pixel value in the line of pixels.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: October 3, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Christopher Douglas Edmonds, Raymond Kirk Price
  • Publication number: 20230309207
    Abstract: A computing system includes an illumination light source configured to emit illumination light into an external environment and an orientation sensor configured to estimate an orientation of the illumination light source relative to the external environment. The computing system includes a logic subsystem and a storage subsystem holding instructions executable by the logic subsystem to define a light restriction zone within the external environment. Based at least in part on the orientation of the illumination light source, the illumination light source is dynamically controlled to direct the illumination light toward at least a portion of the external environment outside the light restriction zone, while mitigating emission of the illumination light into the light restriction zone.
    Type: Application
    Filed: March 25, 2022
    Publication date: September 28, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
  • Publication number: 20230308631
    Abstract: Examples are disclosed that relate to providing image data to a user in a defined space of a surrounding environment from a perspective of the user. One example provides a computing system, comprising a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain information regarding a pose of a user within a defined space, based upon the pose of the user, determine a portion of an environment surrounding the defined space toward which the user is looking, obtain image data representing the portion of the environment from a perspective of the user, and provide the image data for display via a display device within the defined space.
    Type: Application
    Filed: March 22, 2022
    Publication date: September 28, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS