Patents by Inventor Raymond Kirk
Raymond Kirk has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11659296Abstract: A system for structured light depth computation using single photon avalanche diodes (SPADs) is configurable to, over a frame capture time period, selectively activate the illuminator to perform interleaved structured light illumination operations. The interleaved structured light illumination operations comprise alternately emitting at least a first structured light pattern from the illuminator and emitting at least a second structured light pattern from the illuminator. The system is also configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each SPAD pixel of the SPAD array to enable photon detection. The plurality of sequential shutter operations generates, for each SPAD pixel of the SPAD array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations.Type: GrantFiled: May 3, 2021Date of Patent: May 23, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 11656365Abstract: A method of automatically geolocating a visual target. The method comprises operating a flying vehicle in a search region including the visual target. The method further includes affirmatively identifying a visual target in an aerial photograph of the search region captured by the flying vehicle. The method further includes automatically correlating the aerial photograph of the search region to a geo-tagged photograph of the search region, wherein the geo-tagged photograph is labelled with pre-defined geospatial coordinates. Based on such automatic correlation, a geospatial coordinate is determined for the visual target in the search region.Type: GrantFiled: June 8, 2020Date of Patent: May 23, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Evan Gregory Levine
-
Patent number: 11651506Abstract: A system for low compute high-resolution depth map generation using low-resolution cameras is configured to obtain a stereo pair of images and generate a depth map by performing stereo matching on the stereo pair of images. The system is also configured to obtain a first image comprising first texture information for the environment that has a first image resolution that is higher than an image resolution of images of the stereo pair of images. The system is further configured to generate a reprojected first image by reprojecting the first image to correspond to an image capture perspective associated with the depth map. The reprojection of the first image is based on depth information from the depth map and includes reprojected first texture information for the environment. The system is also configured to generate an upsampled depth map based on the depth map.Type: GrantFiled: April 20, 2021Date of Patent: May 16, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 11651502Abstract: A system for updating continuous image alignment of separate cameras identifies a previous alignment matrix associated with a previous frame pair captured at one or more previous timepoints by a reference camera and a match camera. The previous alignment matrix is based on visual correspondences in the previous frame pair. The system also identifies a current matrix associated with a current frame pair captured at one or more current timepoints by the reference camera and the match camera. The current matrix is based on visual correspondences in the current frame pair. The system also identifies a difference value associated with the reference camera or the match camera relative to the one or more previous timepoints and the one or more current timepoints. The system also generates an updated alignment matrix by using the previous alignment matrix, the current matrix, and the difference value as inputs.Type: GrantFiled: July 22, 2020Date of Patent: May 16, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Michael Bleyer, Christopher Douglas Edmonds, Dominik Alexander Konik, Raymond Kirk Price
-
Publication number: 20230145672Abstract: Techniques to temporally filter images via a filtering weight computation are disclosed. A first image having a first timestamp and a second image having a second timestamp are acquired. These images are generated by a camera, and the first timestamp is before the second timestamp. A motion compensation (MC) operation is performed on the first image to produce an MC image. A difference image is generated using the MC image and the second image. The difference image reflects differences in intensities that exist between the two images. A local weight map is generated based on those differences. A global weight map is generated based on certain IMU data. A final weight map is generated based on a combination of the local weight map and the global weight map. The final weight map is used to generate a filtered image.Type: ApplicationFiled: November 11, 2021Publication date: May 11, 2023Inventors: Raymond Kirk PRICE, Christopher Douglas EDMONDS, Michael BLEYER, Christian Markus MAEKELAE
-
Publication number: 20230148231Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera's orientation with the second camera's orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.Type: ApplicationFiled: November 11, 2021Publication date: May 11, 2023Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS, Sudipta Narayan SINHA
-
Patent number: 11642589Abstract: One method comprises receiving a hit signal from a device worn by a first player, receiving a position of the device, receiving an orientation of a launch axis of a virtual-projectile launcher, receiving a position of a second player, and outputting a hit assignment on determining, pursuant to receiving the hit signal, that a recognized object and the second player are coincident at an indicated launch of a virtual projectile. Another method comprises receiving an indication of launch of a virtual projectile by a virtual-projectile launcher of a first player, receiving an image aligned to a launch axis of the virtual-projectile launcher, outputting a hit signal to a server on determining, pursuant to receiving the indication of launch, that a recognized object is imaged in a projectile-delivery area of the image, and outputting a position of the device and an orientation of the launch axis to the server.Type: GrantFiled: July 23, 2020Date of Patent: May 9, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds, Mark Anthony Plagge, Melissa Arde Lobb, Mikael Froejk Figueroa, Jonathan Gustav Paulovich, Evan Gregory Levine
-
Patent number: 11636645Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera's orientation with the second camera's orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.Type: GrantFiled: November 11, 2021Date of Patent: April 25, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds, Sudipta Narayan Sinha
-
Publication number: 20230122185Abstract: Techniques for performing a hardware-based image alignment process are disclosed. A relative position and orientation between a system camera and a detached external camera are determined. This process is performed using 6 degree of freedom (DOF) trackers on the system camera and on the external camera. A depth measurement, which indicates a distance between the external camera and a scene where the external camera is aimed, is obtained. The system camera generates a system camera image, and the external camera generates an image. An overlaid image is generated by using the relative position and orientation and the depth measurement to reproject the second content onto the first content.Type: ApplicationFiled: October 18, 2021Publication date: April 20, 2023Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS, Carlos Andre TAVARES CAMPOS
-
Publication number: 20230117006Abstract: A system for obtaining dark current images includes one or more processors and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to perform various acts. The acts include obtaining a first image frame, generating a first low-pass filtered image by applying a low-pass filter to the first image frame, and generating a first estimated dark current image by subtracting the first low-pass filtered image from the first image frame.Type: ApplicationFiled: October 20, 2021Publication date: April 20, 2023Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS, Casey Lee MILLER
-
Publication number: 20230123494Abstract: A system for selectively modifying gating rate in a single photon avalanche diode (SPAD) is configurable to access first frame metadata associated with a first image frame. The first image frame is captured by performing a first plurality of gate operations to configure the SPAD array to enable photon detection over a frame capture time period. The first plurality of gate operations is performed at a first gating rate such that the first plurality of gate operations comprises a first quantity of gate operations performed over the frame capture time period. The system is further configurable to define a second gating rate based on the first frame metadata and capture a second image frame by performing a second plurality of gate operations to configure the SPAD array to enable photon detection at the second gating rate.Type: ApplicationFiled: October 19, 2021Publication date: April 20, 2023Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
-
Publication number: 20230115537Abstract: Techniques for correcting an overlay misalignment between an external camera image and a system camera image are disclosed. A first system camera image and a first external camera image are acquired. A first visual alignment is performed between those two images to produce an overlaid image. Some of the content in the overlaid image is surrounded by a bounding element. A position of the bounding element is modified based on movements of the system camera and/or the external camera. In response to performing a second visual alignment using new images, an update vector is computed. Relative movement between the two cameras is determined. Based on the movement and based on the update vector, the bounding element is progressively transitioned to a corrected position in the overlaid image. A speed by which the bounding element is progressively transitioned is proportional to the amount of movement.Type: ApplicationFiled: October 13, 2021Publication date: April 13, 2023Inventors: Raymond Kirk PRICE, Michael BLEYER, Christopher Douglas EDMONDS
-
Publication number: 20230112148Abstract: Techniques for evaluating multiple images, which originate from multiple different sources, and for selecting specific images to generate an overlaid image are disclosed. A first set of system camera images (e.g., based on a first FPS rate) and a second set of external camera images (e.g., based on a second FPS rate) are obtained. A set of rules are accessed in order to govern a selection process for selecting a specific system camera image and a specific external camera image. The selected images are designated for use in generating an overlaid image. The selection process is performed using the accessed set of rules. The overlaid image is generated by overlaying and aligning content obtained from the selected images.Type: ApplicationFiled: October 13, 2021Publication date: April 13, 2023Inventors: Michael BLEYER, Raymond Kirk PRICE, Christopher Douglas EDMONDS
-
Patent number: 11624906Abstract: An illumination system having a reduced z-dimensional profile, which is achieved by reflecting light out of plane relative to a light source that generated the light, is disclosed herein. This illumination system includes an IR illumination device, a collimating optic, a turning optic, and a waveguide. The turning optic is specially configured to receive IR light from the IR illumination device and to reflect the IR light out of plane relative to the emission orientation of the IR illumination device. The reflected IR light is reflected towards the collimating optic. The waveguide is positioned in a fixed position relative to the collimating optic and includes an input port or grating to receive the collimated IR light. By reflecting light out of the plane, the size of the illumination system can be beneficially reduced in the z-direction.Type: GrantFiled: March 4, 2019Date of Patent: April 11, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Yarn Chee Poon, Rachel N. Ulanch, Rashelle Kay Yee
-
Patent number: 11620734Abstract: Techniques for de-aliasing depth ambiguities included within infrared phase depth images are described herein. An illuminator emits reference light towards a target object. Some of this light is reflected back and detected. A phase image is generated based on phase differences between the reference light and the reflected light. The phase differences represent changes in depth within overlapping sinusoidal periods of the reference and reflected light. The phase image also includes ambiguities because multiple different depths within the phase image share the same phase difference value, even though these depths actually correspond to different real-world depths. The phase image is fed as input to a machine learning (“ML”) component, which is configured to de-alias the ambiguities by determining, for each pixel in the phase image, a corresponding de-aliasing interval. A depth map is generated based on the phase image and any de-aliasing intervals generated by the ML component.Type: GrantFiled: February 5, 2021Date of Patent: April 4, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Michael Bleyer, Christopher Douglas Edmonds, Raymond Kirk Price
-
Patent number: 11611689Abstract: An image capture module configured for improved heat dissipation includes an image sensor, a first heat spreading element positioned to direct heat from the image sensor along a first heat dissipation path toward a first portion of the image capture module, a processing board in data communication with the image sensor, and a second heat spreading element positioned to dissipate heat from the processing board along a second heat dissipation path toward a second portion of the image capture module. Thermal isolation is used to isolate the different heat paths. The first heat dissipation path does not overlap the second heat dissipation path, the first portion of the image capture module is separate from the second portion of the image capture module.Type: GrantFiled: February 22, 2021Date of Patent: March 21, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 11605153Abstract: Techniques for generating a high resolution full color output image from lower resolution sparse color input images are disclosed. A camera generates images. The camera's sensor has a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and IMU data are fed into a motion model, which performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, a blue-only image, and a monochrome image. The color images are up-sampled to match the resolution of the monochrome image. A high resolution output color image is generated by combining the up-sampled images and the monochrome image.Type: GrantFiled: January 3, 2022Date of Patent: March 14, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
-
Patent number: 11604098Abstract: A method for estimating human body temperature includes receiving, via a thermal camera, a thermal image captured of a real-world environment, the thermal image including thermal intensity values for each of a plurality of pixels of the thermal image. A position of a human face is identified within the thermal image, the human face corresponding to a human subject. An indication of a distance between the human subject and the thermal camera is received. Based on the distance, a distance correction factor is applied to one or more thermal intensity values of one or more pixels corresponding to the human face to give one or more distance-corrected thermal intensity values. Based on the one or more distance-corrected thermal intensity values an indication of a body temperature of the human subject is reported.Type: GrantFiled: June 23, 2020Date of Patent: March 14, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Christopher Douglas Edmonds, Michael Bleyer
-
Publication number: 20230076331Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.Type: ApplicationFiled: November 14, 2022Publication date: March 9, 2023Inventors: Michael BLEYER, Sudipta Narayan SINHA, Christopher Douglas EDMONDS, Raymond Kirk PRICE
-
Patent number: 11598671Abstract: A method for estimating human body temperature includes receiving, via a thermal camera, one or more thermal images captured of a real-world environment, the one or more thermal images including thermal intensity values for each of a plurality of pixels. Positions of a plurality of human faces are identified in the one or more thermal images. A distribution of thermal intensity values of the plurality of human faces is determined. A position of a test human face of a test human subject is identified within a subsequent thermal image. One or more test thermal intensity values of one or more pixels corresponding to the test human face are identified. An indication of a body temperature of the test human subject is reported based on a comparison of the one or more test thermal intensity values and the distribution of thermal intensity values of the plurality of human faces.Type: GrantFiled: June 17, 2020Date of Patent: March 7, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds