Patents by Inventor Utkarsh Deshmukh

Utkarsh Deshmukh has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11954894
    Abstract: A system for determining blockage of a vehicle camera is configured to apply a partition grid having a plurality of locations to a sequence of images to form a plurality of regions. The system determines at least one spatial feature corresponding to the partition grid and at least one temporal feature corresponding to the partition grid. The system generates a sequence of classifications for each location of the plurality of locations based on the at least one spatial feature, the at least one temporal feature, and reference information. The system applies a smoothing technique to determine a subset of regions that are blocked among the sequence of classifications, and generates an output signal based on the subset of regions. The output may be provided to an output system to wash the camera lens, notify the user or the vehicle of the blockage, or modify image processing.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: April 9, 2024
    Assignee: Rivian IP Holdings, LLC
    Inventors: Utkarsh Deshmukh, Vikram Appia, Vishwas Venkatachalapathy, Martin Mueller
  • Publication number: 20240104682
    Abstract: Features from a style image are adapted to express a machine-readable code. For example, grains of rice depicted in a style image may be positioned to create a pattern mimicking that of a machine-readable code. The resulting output image can then be used as a graphical component in product packaging (e.g., as a background, border, or pattern fill), while also serving to convey a product identifier to a compliant reader device (e.g., a retail point-of-sale terminal). In some embodiments, a neural network is trained to apply a particular style image to machine readable codes. A great variety of other features and arrangements are also detailed.
    Type: Application
    Filed: July 18, 2023
    Publication date: March 28, 2024
    Inventors: Ajith M. Kamath, Christopher A. Ambiel, Utkarsh Deshmukh, Andi R. Castle, Christopher M. Haverkate
  • Publication number: 20230342899
    Abstract: A system for determining image capture degradation of a camera sensor is disclosed. The system is configured to capture a series of image frames by a camera of a vehicle over time. The system is configured to generate a latent image from a series of images captured by the camera. The system generates a plurality of frequency layers based on the latent image by, for example, performing a high frequency multiscale fusion transform. The system generates a plurality of frequency layers, each corresponding a spectral sub-band frequency, and each frequency layer includes the coefficients. The system generates a degradation map based on the processed activation map and generates an output based on the activation map. The output may be provided to an output system to wash the camera lens, notify a user or the vehicle of blockage, or modify image processing.
    Type: Application
    Filed: April 25, 2022
    Publication date: October 26, 2023
    Inventors: Utkarsh Deshmukh, Martin Fritz Mueller, Angelo Anthony Stekardis, JR.
  • Patent number: 11798151
    Abstract: A system for determining image capture degradation of a camera sensor is disclosed. The system is configured to capture a series of image frames by a camera of a vehicle over time. The system is configured to generate a latent image from a series of images captured by the camera. The system generates a plurality of frequency layers based on the latent image by, for example, performing a high frequency multiscale fusion transform. The system generates a plurality of frequency layers, each corresponding a spectral sub-band frequency, and each frequency layer includes the coefficients. The system generates a degradation map based on the processed activation map and generates an output based on the activation map. The output may be provided to an output system to wash the camera lens, notify a user or the vehicle of blockage, or modify image processing.
    Type: Grant
    Filed: April 25, 2022
    Date of Patent: October 24, 2023
    Assignee: Rivian IP Holdings, LLC
    Inventors: Utkarsh Deshmukh, Martin Fritz Mueller, Angelo Anthony Stekardis, Jr.
  • Publication number: 20230316386
    Abstract: Aspects of the detailed technologies concern training and use of neural networks for fine-grained classification of large numbers of items, e.g., as may be encountered in a supermarket. Mitigating false positive errors is an exemplary area of emphasis. Novel network topologies are also detailed—some employing recognition technologies in addition to neural networks. A great number of other features and arrangements are also detailed.
    Type: Application
    Filed: March 1, 2023
    Publication date: October 5, 2023
    Inventors: Ravi K. Sharma, Tomas Filler, Utkarsh Deshmukh, Vahid Sedighianaraki, William Y. Conwell
  • Patent number: 11704765
    Abstract: Features from a style image are adapted to express a machine-readable code. For example, grains of rice depicted in a style image may be positioned to create a pattern mimicking that of a machine-readable code. The resulting output image can then be used as a graphical component in product packaging (e.g., as a background, border, or pattern fill), while also serving to convey a product identifier to a compliant reader device (e.g., a retail point-of-sale terminal). In some embodiments, a neural network is trained to apply a particular style image to machine readable codes. A great variety of other features and arrangements are also detailed.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: July 18, 2023
    Assignee: Digimarc Corporation
    Inventors: Ajith M. Kamath, Christopher A. Ambiel, Utkarsh Deshmukh
  • Patent number: 11636565
    Abstract: Authenticity of a sticker (e.g., a mark-down sticker on a retail item), or integrity of a closure (e.g., on a delivery bag or package), is confirmed by reference to spatial information. In some embodiments a fingerprint is formed from parameters describing spatial placement of a sticker or pattern on a substrate. In some embodiments a digital watermark pattern provides a spatial frame of reference within which one or more other features can be located. A great many other features and arrangements are also detailed.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: April 25, 2023
    Assignee: Digimarc Corporation
    Inventors: Eric D. Evans, Arthur L. Powell, Becky G. Kiichle-Gross, Geoffrey B. Rhoads, Philip J. Stafford, Utkarsh Deshmukh
  • Patent number: 11599744
    Abstract: Aspects of the detailed technologies concern training and use of neural networks for fine-grained classification of large numbers of items, e.g., as may be encountered in a supermarket. Mitigating false positive errors is an exemplary area of emphasis. Novel network topologies are also detailed—some employing recognition technologies in addition to neural networks. A great number of other features and arrangements are also detailed.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: March 7, 2023
    Assignee: Digimarc Corporation
    Inventors: Ravi K. Sharma, Tomas Filler, Utkarsh Deshmukh, William Y. Conwell
  • Publication number: 20220327323
    Abstract: A system for determining blockage of a vehicle camera is configured to apply a partition grid having a plurality of locations to a sequence of images to form a plurality of regions. The system determines at least one spatial feature corresponding to the partition grid and at least one temporal feature corresponding to the partition grid. The system generates a sequence of classifications for each location of the plurality of locations based on the at least one spatial feature, the at least one temporal feature, and reference information. The system applies a smoothing technique to determine a subset of regions that are blocked among the sequence of classifications, and generates an output signal based on the subset of regions. The output may be provided to an output system to wash the camera lens, notify the user or the vehicle of the blockage, or modify image processing.
    Type: Application
    Filed: April 8, 2021
    Publication date: October 13, 2022
    Inventors: Utkarsh Deshmukh, Vikram Appia, Vishwas Venkatachalapathy, Martin Mueller
  • Patent number: 11450025
    Abstract: The geometric pose of a patch of watermark data is estimated based on the position of a similar, but non-identical, patch of information within a data structure. The information in the data structure corresponds to a tiled array of calibration patterns that is sampled along at least three non-parallel paths. In a particular embodiment, the calibration patterns are sampled so that edges are globally-curved, yet locally-flat. Use of such information in the data structure enables enhanced pose estimation, e.g., speeding up operation, enabling pose estimation from smaller patches of watermark signals, and/or enabling pose estimation from weaker watermark signals. A great variety of other features and arrangements are also detailed.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: September 20, 2022
    Assignee: Digimarc Corporation
    Inventors: Geoffrey B. Rhoads, Utkarsh Deshmukh, John D. Lord
  • Publication number: 20210217129
    Abstract: The present disclosure relates to signal decoding and icon (e.g., a logo, shape, icon, etc.) detection. In some implementations, a first response is provided upon signal decoding but no icon detection within first captured image data, and a second response is provided upon signal decoding and icon detection within the first captured image data. Other aspects, combinations and implementations are described as well.
    Type: Application
    Filed: November 30, 2020
    Publication date: July 15, 2021
    Inventors: Utkarsh Deshmukh, Eliot Rogers, Matthew M. Weaver
  • Publication number: 20210142514
    Abstract: The geometric pose of a patch of watermark data is estimated based on the position of a similar, but non-identical, patch of information within a data structure. The information in the data structure corresponds to a tiled array of calibration patterns that is sampled along at least three non-parallel paths. In a particular embodiment, the calibration patterns are sampled so that edges are globally-curved, yet locally-flat. Use of such information in the data structure enables enhanced pose estimation, e.g., speeding up operation, enabling pose estimation from smaller patches of watermark signals, and/or enabling pose estimation from weaker watermark signals. A great variety of other features and arrangements are also detailed.
    Type: Application
    Filed: November 18, 2020
    Publication date: May 13, 2021
    Inventors: Geoffrey B. Rhoads, Utkarsh Deshmukh, John D. Lord
  • Publication number: 20200410312
    Abstract: The present technology relates to image signal processing. One aspect of the present technology involves analyzing reference imagery gathered by a camera system to determine which parts of an image frame offer high probabilities of—relative to other image parts—containing decodable watermark data. Another aspect of the present technology whittles-down such determined image frame parts based on detected content (e.g., a cereal box) vs expected background within such determined image frame parts.
    Type: Application
    Filed: June 9, 2020
    Publication date: December 31, 2020
    Inventors: Vojtech Holub, Utkarsh Deshmukh, Tomas Filler
  • Patent number: 10880451
    Abstract: The present disclosure relates generally to image signal processing, including encoding signals for image data or artwork. An aggregation module predicts likely detection of an encoded signal, including modeling detection in an environment in which an encoded signal is swiped in front of a camera system comprising at least two cameras.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: December 29, 2020
    Assignee: Digimarc Corporation
    Inventors: Utkarsh Deshmukh, Vahid Sedighianaraki, Allison C. Sliter, Jerry A. McMahan, Jr.
  • Patent number: 10853903
    Abstract: The present disclosure relates to signal decoding and icon (e.g., a logo, shape, icon, etc.) detection. In some implementations, a first response is provided upon signal decoding but no icon detection within first captured image data, and a second response is provided upon signal decoding and icon detection within the first captured image data. Other aspects, combinations and implementations are described as well.
    Type: Grant
    Filed: April 23, 2018
    Date of Patent: December 1, 2020
    Assignee: Digimarc Corporation
    Inventors: Utkarsh Deshmukh, Eliot Rogers, Matthew M. Weaver
  • Patent number: 10853968
    Abstract: The geometric pose of a patch of watermark data is estimated based on the position of a similar, but non-identical, patch of information within a data structure. The information in the data structure corresponds to a tiled array of calibration patterns that is sampled along at least three non-parallel paths. In a particular embodiment, the calibration patterns are sampled so that edges are globally-curved, yet locally-flat. Use of such information in the data structure enables enhanced pose estimation, e.g., speeding up operation, enabling pose estimation from smaller patches of watermark signals, and/or enabling pose estimation from weaker watermark signals. A great variety of other features and arrangements are also detailed.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: December 1, 2020
    Assignee: Digimarc Corporation
    Inventors: Geoffrey B. Rhoads, Utkarsh Deshmukh, John D. Lord
  • Publication number: 20200356813
    Abstract: Aspects of the detailed technologies concern training and use of neural networks for fine-grained classification of large numbers of items, e.g., as may be encountered in a supermarket. Mitigating false positive errors is an exemplary area of emphasis. Novel network topologies are also detailed—some employing recognition technologies in addition to neural networks. A great number of other features and arrangements are also detailed.
    Type: Application
    Filed: May 21, 2020
    Publication date: November 12, 2020
    Inventors: Ravi K. Sharma, Tomas Filler, Utkarsh Deshmukh, Vahid Sedighianaraki, William Y. Conwell
  • Patent number: 10803272
    Abstract: The present disclosure relates to signal decoding and icon (e.g., a logo, shape, icon, etc.) detection.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: October 13, 2020
    Assignee: Digimarc Corporation
    Inventors: Utkarsh Deshmukh, Tomas Filler
  • Publication number: 20200320660
    Abstract: Features from a style image are adapted to express a machine-readable code. For example, grains of rice depicted in a style image may be positioned to create a pattern mimicking that of a machine-readable code. The resulting output image can then be used as a graphical component in product packaging (e.g., as a background, border, or pattern fill), while also serving to convey a product identifier to a compliant reader device (e.g., a retail point-of-sale terminal). In some embodiments, a neural network is trained to apply a particular style image to machine readable codes. A great variety of other features and arrangements are also detailed.
    Type: Application
    Filed: April 20, 2020
    Publication date: October 8, 2020
    Inventors: Ajith M. Kamath, Christopher A. Ambiel, Utkarsh Deshmukh, Andi R. Castle, Christopher M. Haverkate
  • Patent number: 10664722
    Abstract: Aspects of the detailed technologies concern training and use of neural networks for fine-grained classification of large numbers of items, e.g., as may be encountered in a supermarket. Mitigating false positive errors is an exemplary area of emphasis. Novel network topologies are also detailed—some employing recognition technologies in addition to neural networks. A great number of other features and arrangements are also detailed.
    Type: Grant
    Filed: October 5, 2017
    Date of Patent: May 26, 2020
    Assignee: Digimarc Corporation
    Inventors: Ravi K. Sharma, Tomas Filler, Utkarsh Deshmukh, Vahid Sedighianaraki