Patents by Inventor James Wilson Nash

James Wilson Nash has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210264625
    Abstract: Techniques and systems are provided for generating one or more depth maps. For example, a process can include transmitting a pattern of light using a structured light source, the pattern of light including at least a first sub-pattern group of a primitive pattern and a second sub-pattern group of the primitive pattern. The process can include generating an overlapped pattern of light, the overlapped pattern of light including at least the first sub-pattern group of the primitive pattern overlapped with the second sub-pattern group of the primitive pattern. The process can include receiving one or more return signals based on the overlapped pattern of light. The process can include generating a depth map based on the one or more return signals.
    Type: Application
    Filed: October 23, 2020
    Publication date: August 26, 2021
    Inventors: Kalin Mitkov ATANASSOV, James Wilson NASH, Stephen Michael VERRALL
  • Patent number: 11057608
    Abstract: Techniques are disclosed for depth map generation in a structured light system where an optical transmitter is tilted relative to an optical receiver. The optical transmitter has a transmitter optical axis around which structured light spreads, and the optical receiver has a receiver optical axis around which a reflection of the structured light can be captured. The transmitter optical axis and the receiver optical axis intersect one another. A processing circuit compensates for the angle in the tilt in the reflected pattern to generate the depth map.
    Type: Grant
    Filed: May 5, 2016
    Date of Patent: July 6, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov
  • Publication number: 20210201519
    Abstract: Aspects of the present disclosure relate to systems and methods for active depth sensing. An example apparatus configured to perform active depth sensing includes a projector. The projector is configured to emit a first distribution of light during a first time and emit a second distribution of light different from the first distribution of light during a second time. A set of final depth values of one or more objects in a scene is based on one or more reflections of the first distribution of light and one or more reflections of the second distribution of light. The projector may include a laser array, and the apparatus may be configured to switch between a first plurality of lasers of the laser array to emit light during the first time and a second plurality of laser to emit light during the second time.
    Type: Application
    Filed: June 4, 2020
    Publication date: July 1, 2021
    Inventors: James Wilson NASH, Kalin Mitkov Atanassov, Ioannis Nousias, Mark Ian Roy Muir, Sami Khawam
  • Patent number: 10922829
    Abstract: A device for image processing includes an optical receiver configured to receive a reflection of a coded pattern from an object to generate an image, and processing circuitry. The processing circuitry is configured to determine an estimated position of zero order light in the image, determine a spatial region of the coded pattern that corresponds to a position of the zero order light in the coded pattern, map the spatial region to the estimated position of the zero order light in the image to generate a corrected image, and generate a depth map for the coded pattern based on the corrected image.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: February 16, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Shandon Campbell
  • Patent number: 10914823
    Abstract: Aspects of the present disclosure relate to systems and methods for time-of-flight ranging. An example time-of-flight system includes a transmitter including a plurality of light emitters for transmitting focused light, the plurality of light emitters including a first group of light emitters for transmitting focused light with a first field of transmission and a second group of light emitters for transmitting focused light with a second field of transmission. The first field of transmission at a depth from the transmitter is larger than the second field of transmission at the depth from the transmitter. The time-of-flight system also includes a receiver to receive reflections of the transmitted light.
    Type: Grant
    Filed: May 1, 2018
    Date of Patent: February 9, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Stephen Michael Verrall
  • Patent number: 10620316
    Abstract: Systems, methods, and devices for generating a depth map of a scene are provided. The method comprises projecting, onto the scene, a codeword pattern including a plurality of light points including a first set of light points projected at a first intensity and a second set of light points projected at a second intensity greater than the first intensity. The method further comprises detecting, from the scene, a reflection of the codeword pattern. The method further comprises generating a first depth map layer at a first resolution. The method further comprises generating a second depth map layer at a second resolution lower than the first resolution. The method further comprises generating the depth map of the scene, wherein the depth map includes depth information for the scene according to each of the first depth map layer and the second depth map layer.
    Type: Grant
    Filed: May 5, 2017
    Date of Patent: April 14, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Albrecht Johannes Lindner, Kalin Mitkov Atanassov, James Wilson Nash
  • Patent number: 10565726
    Abstract: A device includes a first camera and a processor configured to detect one or more first keypoints within a first image captured by the first camera at a first time, detect one or more second keypoints within a second image captured by a second camera at the first time, and detect the one or more first keypoints within a third image captured by the first camera at a second time. The processor is configured to determine a pose estimation based on coordinates of the one or more first keypoints of the first image relative to a common coordinate system, coordinates of the one or more second keypoints of the second image relative to the common coordinate system, and coordinates of the one or more first keypoints of the third image relative to the common coordinate system. The first coordinate system is different than the common coordinate system.
    Type: Grant
    Filed: July 3, 2017
    Date of Patent: February 18, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Albrecht Johannes Lindner, Kalin Mitkov Atanassov, James Wilson Nash, Hasib Siddiqui
  • Publication number: 20190378286
    Abstract: A device for image processing includes an optical receiver configured to receive a reflection of a coded pattern from an object to generate an image, and processing circuitry. The processing circuitry is configured to determine an estimated position of zero order light in the image, determine a spatial region of the coded pattern that corresponds to a position of the zero order light in the coded pattern, map the spatial region to the estimated position of the zero order light in the image to generate a corrected image, and generate a depth map for the coded pattern based on the corrected image.
    Type: Application
    Filed: May 9, 2019
    Publication date: December 12, 2019
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Shandon Campbell
  • Publication number: 20190339364
    Abstract: Aspects of the present disclosure relate to systems and methods for time-of-flight ranging. An example time-of-flight system includes a transmitter including a plurality of light emitters for transmitting focused light, the plurality of light emitters including a first group of light emitters for transmitting focused light with a first field of transmission and a second group of light emitters for transmitting focused light with a second field of transmission. The first field of transmission at a depth from the transmitter is larger than the second field of transmission at the depth from the transmitter. The time-of-flight system also includes a receiver to receive reflections of the transmitted light.
    Type: Application
    Filed: May 1, 2018
    Publication date: November 7, 2019
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Stephen Michael Verrall
  • Patent number: 10389948
    Abstract: A method for displaying preview images is disclosed. In one aspect, the method includes: receiving first images captured by a first camera having a first field-of-view (FOV), receiving second images captured by a second camera having a second FOV that is different than the first FOV, and displaying preview images generated based on the first and second images. The method may further include determining a spatial transform based on depth information associated with individual pixels in the first and second images, and upon receiving instructions to zoom in or out beyond a camera switching threshold, modifying the second image using the spatial transform and displaying the first image and the modified second image consecutively.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: August 20, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Adarsh Abhay Golikeri, Narayana Karthik Sadanandam Ravirala
  • Publication number: 20190236794
    Abstract: A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.
    Type: Application
    Filed: April 4, 2019
    Publication date: August 1, 2019
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Sergiu Radu Goma
  • Publication number: 20190180475
    Abstract: Client calibration can include: (a) instructing a host to display a first desired target, (b) imaging the first displayed target, (c) determining a second desired target based on the imaging, (d) instructing the host to display a second desired target, and (e) adjusting a calibration parameter based on one or more images of the second desired target. The second desired target can be determined (e.g., selected, dynamically generated) based on the first desired target.
    Type: Application
    Filed: December 8, 2017
    Publication date: June 13, 2019
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Albrecht Johannes Lindner, Justin Cheng
  • Patent number: 10297034
    Abstract: A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: May 21, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Sergiu Radu Goma
  • Patent number: 10277889
    Abstract: Methods and apparatus for determining a depth of an object within a scene are provided. Image data of a scene can be captured using a lens configured to project an image of the scene onto an image sensor. The lens has a known focal length and is movable between at least a first lens position and a second lens position. A first image of the scene is captured with the lens at a first lens position, and a second image of the scene is captured with the lens at a second, different position. By measuring a first dimension of the object using the first image and a second dimension of the object using the second image, a depth of the object may be determined based upon a ratio of the first and second dimensions, the focal length of the lens, and a distance between the first and second lens positions.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: April 30, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Venkata Ravi Kiran Dayana, Kalin Mitkov Atanassov
  • Patent number: 10223801
    Abstract: Systems and methods for controlling structured light laser systems are disclosed. One aspect is a structured light system. The system includes a memory device configured to store a depth map. The system further includes an image projecting device including a laser system configured to project codewords. The system further includes a receiver device including a sensor, the receiver device configured to sense the projected codewords reflected from an object. The system further includes a processing circuit configured to retrieve a portion of the depth map and calculate expected codewords from the depth map. The system further includes a feedback system configured to control the output power of the laser system based on the sensed codewords and the expected codewords.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: March 5, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Albrecht Johannes Lindner
  • Patent number: 10192345
    Abstract: Methods and systems for surface normal estimation are disclosed. In some aspects, a plurality of images or depth maps representing a three dimensional object from multiple viewpoints is received. Surface normals at surface points within a single image of the plurality of images are estimated based on surface points within the single image. An electronic representation of a three dimensional surface of the object is generated based on the surface normals and a point cloud comprised of surface points derived from the plurality of images.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: January 29, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Albrecht Johannes Lindner, Kalin Mitkov Atanassov, James Wilson Nash
  • Patent number: 10194089
    Abstract: Devices and methods for providing seamless preview images for multi-camera devices having two or more asymmetric cameras. A multi-camera device may include two asymmetric cameras disposed to image a target scene. The multi-camera device further includes a processor coupled to a memory component and a display, the processor configured to retrieve an image generated by a first camera from the memory component, retrieve an image generated by a second camera from the memory component, receive input corresponding to a preview zoom level, retrieve spatial transform information and photometric transform information from memory, modify at least one image received from the first and second cameras by the spatial transform and the photometric transform, and provide on the display a preview image comprising at least a portion of the at least one modified image and a portion of either the first image or the second image based on the preview zoom level.
    Type: Grant
    Filed: February 8, 2016
    Date of Patent: January 29, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Sergiu Radu Goma, Narayana Karthik Sadanandam Ravirala, Venkata Ravi Kiran Dayana, Karthikeyan Shanmugavadivelu
  • Publication number: 20190005678
    Abstract: A device includes a first camera and a processor configured to detect one or more first keypoints within a first image captured by the first camera at a first time, detect one or more second keypoints within a second image captured by a second camera at the first time, and detect the one or more first keypoints within a third image captured by the first camera at a second time. The processor is configured to determine a pose estimation based on coordinates of the one or more first keypoints of the first image relative to a common coordinate system, coordinates of the one or more second keypoints of the second image relative to the common coordinate system, and coordinates of the one or more first keypoints of the third image relative to the common coordinate system. The first coordinate system is different than the common coordinate system.
    Type: Application
    Filed: July 3, 2017
    Publication date: January 3, 2019
    Inventors: Albrecht Johannes Lindner, Kalin Mitkov Atanassov, James Wilson Nash, Hasib Siddiqui
  • Publication number: 20180321384
    Abstract: Systems, methods, and devices for generating a depth map of a scene are provided. The method comprises projecting, onto the scene, a codeword pattern including a plurality of light points including a first set of light points projected at a first intensity and a second set of light points projected at a second intensity greater than the first intensity. The method further comprises detecting, from the scene, a reflection of the codeword pattern. The method further comprises generating a first depth map layer at a first resolution. The method further comprises generating a second depth map layer at a second resolution lower than the first resolution. The method further comprises generating the depth map of the scene, wherein the depth map includes depth information for the scene according to each of the first depth map layer and the second depth map layer.
    Type: Application
    Filed: May 5, 2017
    Publication date: November 8, 2018
    Inventors: Albrecht Johannes Lindner, Kalin Mitkov Atanassov, James Wilson Nash
  • Patent number: 10013764
    Abstract: Certain aspects relate to systems and techniques for performing local intensity equalization on images in a set of images exhibiting local intensity variations. For example, the local intensity equalization can be used to perform accurate region matching and alignment of the images. The images can be partitioned into regions of pixel blocks, for instance based on location, shape, and size of identified keypoints in the images. Regions depicting the same feature in the images can be equalized with respect to intensity. Region matching based on the keypoints in the intensity-equalized regions can be performed with accuracy even in images captured by asymmetric sensors or exhibiting spatially varying intensity.
    Type: Grant
    Filed: June 19, 2014
    Date of Patent: July 3, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Kalin Mitkov Atanassov, James Wilson Nash, Stephen Michael Verrall, Hasib Ahmed Siddiqui