Patents by Inventor Michael Bleyer
Michael Bleyer has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12363456Abstract: A system for modifying a dark current image is configurable to receive an input image depicting a dark current state for one or more pixels of the input image, The dark current state for one or more pixels of the input image comprises one of: a faulty state or a non-faulty state. The system is configurable to partition the input image into a plurality of partitions and generate an updated input image by imposing at least one quantity constraint or at least one severity constraint to the plurality of partitions in association with at least one type of dark current state.Type: GrantFiled: April 25, 2023Date of Patent: July 15, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Christian Markus Maekelae, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12360379Abstract: Disclosed herein are techniques for providing an illumination system that emits illumination into an environment while also enabling that system to be undetectable to certain types of external light detection systems. The system includes a single photon avalanche diode (SPAD) low light (LL) detection device and a light emitting device. The light emitting device provides illumination having a wavelength of at least 950 nanometers (nm). An intensity of the illumination is set to a level that causes the illumination to be undetectable from a determined distance away based on the roll off rate of the light. While the light emitting device is providing the illumination, the SPAD LL detection device generates an image of an environment in which the illumination is being provided.Type: GrantFiled: March 13, 2024Date of Patent: July 15, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Christopher Douglas Edmonds, Michael Bleyer
-
Publication number: 20250224616Abstract: A system for power efficient image acquisition is configurable to capture, using an image sensor, a plurality of partial image frames including at least a first partial image frame and a second partial image frame. The first partial image frame is captured at a first timepoint using a first subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second partial image frame is captured at a second timepoint using a second subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second subset of image sensing pixels includes different image sensing pixels than the first subset of image sensing pixels, and the second timepoint is temporally subsequent to the first timepoint. The system is configurable to generate a composite image frame based on the plurality of partial image frames.Type: ApplicationFiled: March 27, 2025Publication date: July 10, 2025Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS, William Chao-Hui HWANG
-
Patent number: 12347122Abstract: A system for updating continuous image alignment of separate cameras identifies a previous alignment matrix associated with a previous frame pair captured at one or more previous timepoints by a reference camera and a match camera. The previous alignment matrix is based on visual correspondences in the previous frame pair. The system also identifies a current matrix associated with a current frame pair captured at one or more current timepoints by the reference camera and the match camera. The current matrix is based on visual correspondences in the current frame pair. The system also identifies a difference value associated with the reference camera or the match camera relative to the one or more previous timepoints and the one or more current timepoints. The system also generates an updated alignment matrix by using the previous alignment matrix, the current matrix, and the difference value as inputs.Type: GrantFiled: April 30, 2024Date of Patent: July 1, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Michael Bleyer, Christopher Douglas Edmonds, Dominik Alexander Konik, Raymond Kirk Price
-
Publication number: 20250191126Abstract: A system for generating foveated imagery is configurable to: (i) access an image; (ii) identify an ROI of the image; (iii) generate a downsampled image by performing downsampling on the image; (iv) generate a transformed downsampled image by performing one or more image processing operations on the downsampled image; (v) generate a transformed image by performing upsampling on the transformed downsampled image; and (vi) generate a foveated image by using the ROI of the image to define a corresponding ROI of the transformed image.Type: ApplicationFiled: December 12, 2023Publication date: June 12, 2025Inventors: Michael BLEYER, Christopher Douglas EDMONDS, Christian Markus MAEKELAE, Pascal PARE
-
Publication number: 20250182247Abstract: Techniques for generating a temporally filtered image designed to compensate for global motions of a camera and to compensate for local motions of an object are disclosed. A history frame and a current frame are acquired. A global motion compensation operation is performed on the history frame to reproject a pose of the history frame to match the pose of the current frame. The history frame is compared against the current frame to identify pixels that represent moving objects. For each of those pixels, an optical flow vector is computed. The optical flow vectors are then applied to those pixels to shift those pixels to new locations. These new positions, which are in the history frame, correspond to positions that were identified in the current frame. Afterwards, the current frame is temporally filtered with the history frame.Type: ApplicationFiled: February 11, 2025Publication date: June 5, 2025Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
-
Publication number: 20250182246Abstract: A system for performing asymmetric multi-modal image fusion is configurable to (i) access a first image associated with a first imaging modality; (ii) decompose the first image into a first base layer and a first detail layer; (iii) determine a weight map based on pixel signals of the first image; and (iv) generate an output image by performing image fusion using the first base layer, the first detail layer, and a second detail layer associated with a second imaging modality that is different from the first imaging modality, where the weight map modifies the first detail layer and the second detail layer in the image fusion.Type: ApplicationFiled: November 30, 2023Publication date: June 5, 2025Inventors: Michael BLEYER, Christian Markus MAEKELAE, Christopher Douglas EDMONDS
-
Patent number: 12322064Abstract: Techniques for generating a high resolution full color output image from lower resolution sparse color input images are disclosed. A camera generates images. The camera's sensor has a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and IMU data are fed into a motion model, which performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, a blue-only image, and a monochrome image. The color images are up-sampled to match the resolution of the monochrome image. A high resolution output color image is generated by combining the up-sampled images and the monochrome image.Type: GrantFiled: March 25, 2024Date of Patent: June 3, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12320981Abstract: A system for power efficient image acquisition is configurable to capture, using an image sensor, a plurality of partial image frames including at least a first partial image frame and a second partial image frame. The first partial image frame is captured at a first timepoint using a first subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second partial image frame is captured at a second timepoint using a second subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second subset of image sensing pixels includes different image sensing pixels than the first subset of image sensing pixels, and the second timepoint is temporally subsequent to the first timepoint. The system is configurable to generate a composite image frame based on the plurality of partial image frames.Type: GrantFiled: April 19, 2024Date of Patent: June 3, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds, William Chao-Hui Hwang
-
Patent number: 12320980Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.Type: GrantFiled: October 27, 2023Date of Patent: June 3, 2025Inventors: Michael Bleyer, Sudipta Narayan Sinha, Christopher Douglas Edmonds, Raymond Kirk Price
-
Patent number: 12302016Abstract: An image sensor configured to capture imagery with mitigated noise includes a plurality of image sensing pixels arranged to form a sensor array. Each image sensing pixel of the plurality of image sensing pixels comprises an active area configured to receive photons to facilitate image capture. Each active area comprises a length and a width. For at least one image sensing pixel of the plurality of image sensing pixels, the length or the width of the active area is smaller than about 80% of a pixel pitch measurement between the at least one image sensing pixel and an adjacent image sensing pixel. A size of the active area relative to the pixel pitch measurement contributes to mitigating sensor noise for the image sensor.Type: GrantFiled: October 25, 2023Date of Patent: May 13, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12277681Abstract: Techniques to temporally filter images via a filtering weight computation are disclosed. A first image having a first timestamp and a second image having a second timestamp are acquired. These images are generated by a camera, and the first timestamp is before the second timestamp. A motion compensation (MC) operation is performed on the first image to produce an MC image. A difference image is generated using the MC image and the second image. The difference image reflects differences in intensities that exist between the two images. A local weight map is generated based on those differences. A global weight map is generated based on certain IMU data. A final weight map is generated based on a combination of the local weight map and the global weight map. The final weight map is used to generate a filtered image.Type: GrantFiled: June 19, 2023Date of Patent: April 15, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Christopher Douglas Edmonds, Michael Bleyer, Christian Markus Maekelae
-
Patent number: 12267606Abstract: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.Type: GrantFiled: March 5, 2024Date of Patent: April 1, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12260522Abstract: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.Type: GrantFiled: October 2, 2023Date of Patent: March 25, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12254595Abstract: Techniques for generating a temporally filtered image designed to compensate for global motions of a camera and to compensate for local motions of an object are disclosed. A history frame and a current frame are acquired. A global motion compensation operation is performed on the history frame to reproject a pose of the history frame to match the pose of the current frame. The history frame is compared against the current frame to identify pixels that represent moving objects. For each of those pixels, an optical flow vector is computed. The optical flow vectors are then applied to those pixels to shift those pixels to new locations. These new positions, which are in the history frame, correspond to positions that were identified in the current frame. Afterwards, the current frame is temporally filtered with the history frame.Type: GrantFiled: February 28, 2022Date of Patent: March 18, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Publication number: 20250086754Abstract: A system for regulating temporal filtering strength is configurable to: (i) obtain a light level indicator indicating light level associated with a real-world environment; (ii) determine a motion compensation confidence indicator using a current image and a previous image; (iii) determine a filter weight by processing the light level indicator and the motion compensation confidence indicator using a filter strength regulation module; and (iv) generate an output image by using at least the filter weight to filter a current frame with a previous frame.Type: ApplicationFiled: September 12, 2023Publication date: March 13, 2025Inventors: Michael BLEYER, Christian Markus MAEKELAE, Christopher Douglas EDMONDS
-
Patent number: 12243450Abstract: A system for adding persistence to SPAD imagery is configurable to capture, using a SPAD array, a plurality of image frames. The system is configurable to capture, using an IMU, pose data associated with the plurality of image frames. The pose data includes at least respective pose data associated with each of the plurality of image frames. The system is configurable to determine a persistence term based on the pose data. The system is also configurable to generate a composite image based on the plurality of image frames, the respective pose data associated with each of the plurality of image frames, and the persistence term. The persistence term defines a contribution of each of the plurality of image frames to the composite image.Type: GrantFiled: December 7, 2023Date of Patent: March 4, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12217383Abstract: Techniques for aligning image content are disclosed. The alignment occurs by concurrently identifying corner and line features and by aligning the images based on those features. As a result, relaxed constraints can be used during the alignment process as compared to constraints that are required when aligning images using only corner features. To achieve these benefits, first and second images are acquired. A first set of pixels that correspond to corner features are detected within the images. In parallel, a second set of pixels that correspond to line features are detected within the images. Image content is then aligned from the two images. The aligning process is performed using at least some of the pixels from the first and second sets.Type: GrantFiled: February 28, 2022Date of Patent: February 4, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Michael Bleyer, Raymond Kirk Price, Christopher Douglas Edmonds
-
Patent number: 12212865Abstract: A system for obtaining color imagery using SPADs includes a SPAD array that has a plurality of SPAD pixels. Each of the plurality of SPAD pixels includes a respective color filter positioned thereover. The system is configurable to capture an image frame using the SPAD array and generate a filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to, after performing the temporal filtering operation, generate a color image by demosaicing the filtered image.Type: GrantFiled: May 26, 2023Date of Patent: January 28, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 12206833Abstract: A system for facilitating intensity image capture and time of flight capture. The system includes an image sensor array comprising a plurality of image sensor pixels, one or more processors, and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to facilitate intensity image capture and time of flight capture by configuring the system to perform interleaved intensity image capture and time of flight capture operations using the image sensor array.Type: GrantFiled: August 23, 2023Date of Patent: January 21, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds