Patents Assigned to RedZone Robotics, Inc.
  • Publication number: 20240121363
    Abstract: An example implementation includes a device that includes a base infrastructure inspection unit and a plurality of modular sensor units attached to the base infrastructure inspection unit. The base infrastructure inspection unit includes a set of one or more processors and a memory device having code executable by the one or more processors. The executable code synchronizes the plurality of sensor units, captures two or more data streams of infrastructure inspection data, combines the data with metadata indicating synchronization between respective ones of the plurality of sensor units, and provides combined metadata and infrastructure inspection data for inclusion in a photorealistic image based on a three-dimensional (3D) model of the infrastructure.
    Type: Application
    Filed: October 9, 2023
    Publication date: April 11, 2024
    Applicant: RedZone Robotics, Inc.
    Inventors: Jianan Lin, Brandon McGannon, Charles Hart, Jason Mizgorski
  • Patent number: 11949989
    Abstract: One embodiment provides a system, including: an inspection platform configured to move through underground infrastructure; an imaging device coupled to the inspection platform; the imaging device comprising a camera housing that arranges an array of four or more cameras in a predetermined configuration; the camera housing comprising a plurality of apertures, wherein each aperture houses a respective camera therein with a viewing axis offset about 30 degrees to about 120 degrees from a viewing axis of an adjacent camera within the array; and circuitry that operates the imaging device to capture a plurality of images using the four or more cameras; where the circuitry captures the plurality of images for a composite image of an interior region of the underground infrastructure, and where the region is larger than a single viewing field of any of the four or more cameras. Other embodiments are described and claimed.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: April 2, 2024
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Todd Kueny, Thorin Tobiassen, Nate Alford, Mark Jordan
  • Patent number: 11908048
    Abstract: Embodiments may be used to evaluate completed inspection jobs using updated pipe segment data obtained by inspecting a rehabilitated pipe after completion of a project. One embodiment provides a method of generating an infrastructure project summary, including: collecting, using one or more sensors of an inspection robot, pipe segment data relating to the one or more pipe segments; the second pipe segment data comprising one or more of laser condition assessment data and sonar condition assessment data; generating infrastructure summary data for at least a part of the network using the pipe segment data, comparing, using a processor, first and second infrastructure summary data; generating, using the processor, a parameter of the infrastructure project summary based on the comparing; and including the parameter of the infrastructure project summary in a project summary report. Other embodiments are disclosed and claimed.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: February 20, 2024
    Assignee: RedZone Robotics, Inc.
    Inventors: Subramanian Vallapuzha, Eric C. Close
  • Patent number: 11867641
    Abstract: An embodiment provides a method, including: obtaining, from a multi-sensor pipe inspection robot that traverses through the interior of a pipe, two or more sets of condition assessment data for the interior of the pipe collected during a single pass through the interior of the pipe; the two or more sets of condition assessment data comprising a first data type obtained using a first sensor type and a second data type obtained using a second sensor type; combining, using a processor, two or more image processing techniques to adjust imaging of a pipe feature; and forming, using the processor, an image of the interior of the pipe using the two or more image processing techniques. Other embodiments are described and claimed.
    Type: Grant
    Filed: May 4, 2021
    Date of Patent: January 9, 2024
    Assignee: RedZone Robotics, Inc.
    Inventors: Todd Kueny, Justin Starr, Foster J. Salotti
  • Patent number: 11719853
    Abstract: One aspect provides a method, including: obtaining sensor data from a ground penetrating radar (GPR) unit; analyzing, using a processor, the sensor data to detect a first object and a second object, the second object being associated with the first object based on location; identifying, with the processor, an underground pipe feature based on the analyzing; associating a position of the underground pipe feature with a location in a pipe network; selecting a subset of the pipe network including a pipe segment associated with the position of the underground pipe feature; and providing the subset of the pipe network as displayable data to a display device. Other aspects are described and claimed.
    Type: Grant
    Filed: September 13, 2021
    Date of Patent: August 8, 2023
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Patent number: 11674943
    Abstract: One embodiment provides a pipe inspection robot, including: a chassis configured to traverse through an interior of a water or sewer pipe; a water quality probe comprising a first end that couples to the chassis and a sensing end distal thereto; an electric motor configured to reposition the sensing end of the water quality probe with respect to the chassis; said electric motor acting to move the sensing end of the water quality probe to reposition the sensing end proximate to fluid containing water located proximate to a bottom part of the chassis; the sensing end configured to contact the fluid containing water for contact sensing of water quality data. Other aspects are described and claimed.
    Type: Grant
    Filed: October 31, 2020
    Date of Patent: June 13, 2023
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, John Lettman, Todd Kueny, Foster J. Salotti, Galin Konakchiev
  • Publication number: 20230123736
    Abstract: In one example, a method includes combining multi-sensor inspection (MIS) data from sensors of inspection platform(s); using respective metadata to select one or more tools for translating the MSI data into a common file format; applying the one or more tools to the first and second MSI data to obtain respective common data formatted files; and providing, via a cloud computing device, access to the common data formatted files. Other implementations may be described and claimed.
    Type: Application
    Filed: October 13, 2022
    Publication date: April 20, 2023
    Applicant: RedZone Robotics, Inc.
    Inventors: Tim Renton, Foster J Salotti, Jason Mizgorski, Anthony van Iersel, Cody Steliga, Bill Derkson, Lynn Palmieri, Dimitrije Balanovic
  • Publication number: 20220028054
    Abstract: One aspect provides a modular inspection robot for inspecting vertical shafts, chambers or tunnels. An embodiment provides related methods and products. One method includes: capturing, using a plurality of video cameras associated with an infrastructure inspection unit, two or more videos of infrastructure; accessing, using one or more processors, image metadata indicating a mesh of connected vertices based on the two or more videos; selecting, using the one or more processors, image data of frames of the two or more videos for inclusion in an output based on the mesh; and outputting, using the one or more processors, a photo-realistic image of the infrastructure comprising the image data selected. Other examples are described and claimed.
    Type: Application
    Filed: July 1, 2021
    Publication date: January 27, 2022
    Applicant: RedZone Robotics, Inc
    Inventors: Andrew Harmen, Gabe Detter, Mohamed Morsy, Andrew Lawniczak, Galin Konalchiev, Matthew Crowell, Jack Buffington, Mohsen Pashna, Richard Rigby, Jason Mizgorski, Foster J. Salotti
  • Publication number: 20210405244
    Abstract: One aspect provides a method, including: obtaining sensor data from a ground penetrating radar (GPR) unit; analyzing, using a processor, the sensor data to detect a first object and a second object, the second object being associated with the first object based on location; identifying, with the processor, an underground pipe feature based on the analyzing; associating a position of the underground pipe feature with a location in a pipe network; selecting a subset of the pipe network including a pipe segment associated with the position of the underground pipe feature; and providing the subset of the pipe network as displayable data to a display device. Other aspects are described and claimed.
    Type: Application
    Filed: September 13, 2021
    Publication date: December 30, 2021
    Applicant: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J. Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Patent number: 11192262
    Abstract: An embodiment provides a method of controlling a pipe inspection robot, including: detecting, from a headset, brain activity of a user wearing the headset; binning the brain activity of the user into one of a plurality of different bins; the binning comprising accumulating brain activity values for a period of time to establish a brain activity value for the period of time; determining, using the brain activity value, if a threshold level of brain activity has accumulated over the period of time; after the threshold level has been accumulated, identifying a control action to be sent to the pipe inspection robot based on the brain activity value; and controlling the movement of the pipe inspection robot using a control signal associated with the control action. Other embodiments are described and claimed.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: December 7, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Todd Kueny, Thorin Tobiassen, Nate Alford, Mark Jordan, Christopher White
  • Patent number: 11125910
    Abstract: One aspect provides a method, including: obtaining sensor data from an unmanned aerial vehicle (UAV); the sensor data comprising data obtained by one or more sensors of the UAV; analyzing, using a processor, the sensor data to detect underground water associated with a pipe; and identifying, with the processor, an underground feature based on the analyzing. Other aspects are described and claimed.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: September 21, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Publication number: 20210255116
    Abstract: An embodiment provides a method, including: obtaining, from a multi-sensor pipe inspection robot that traverses through the interior of a pipe, two or more sets of condition assessment data for the interior of the pipe collected during a single pass through the interior of the pipe; the two or more sets of condition assessment data comprising a first data type obtained using a first sensor type and a second data type obtained using a second sensor type; combining, using a processor, two or more image processing techniques to adjust imaging of a pipe feature; and forming, using the processor, an image of the interior of the pipe using the two or more image processing techniques. Other embodiments are described and claimed.
    Type: Application
    Filed: May 4, 2021
    Publication date: August 19, 2021
    Applicant: RedZone Robotics, Inc.
    Inventors: Todd Kueny, Justin Starr, Foster J. Salotti
  • Publication number: 20210183050
    Abstract: One aspect provides operating a mobile pipe inspection platform to obtain two or more types of sensor data for the interior of a pipe; analyzing, using a processor, the two or more types of sensor data using a trained model, where the trained model is trained using a dataset including training sensor data of pipe interiors; the analyzing including performing: identifying, using a processor, a pipe feature location using a first type of the two or more types of sensor data; and classifying, using a processor, an identified pipe feature using a second type of the two or more types of sensor data; and thereafter producing, using a processor, an output including an indication of the classified pipe feature. Other aspects are described and claimed.
    Type: Application
    Filed: February 26, 2021
    Publication date: June 17, 2021
    Applicant: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J. Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Patent number: 11029257
    Abstract: An embodiment provides a method, including: obtaining, from a multi-sensor pipe inspection robot that traverses through the interior of a pipe, sensor data, such as structured laser light sensor data and Light Detection and Ranging (LIDAR) sensor data, for the interior of the pipe; identifying a pipe feature using one or more of the sensor data types; selecting an image processing technique based on the pipe feature identified using a stored association between the pipe feature and an image processing technique; and forming an image of the interior of the pipe by implementing the selected image processing technique. Other embodiments are described and claimed.
    Type: Grant
    Filed: March 14, 2019
    Date of Patent: June 8, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Todd Kueny, Justin Starr, Foster J Salotti
  • Patent number: 10976734
    Abstract: Described is a method of providing an augmented reality (AR) scene of pipe inspection data, including: obtaining, using a processor, pipe inspection data derived from a pipe inspection robot that traverses through the interior of an underground pipe, the pipe inspection data including one or more sets of condition assessment data relating to an interior of the underground pipe; obtaining, using a processor, real-time visual image data of an above-ground surface; combining, using a processor, the pipe inspection data with the real-time visual image data in an AR scene; and displaying, using a display device, the AR scene. Other examples are described and claimed.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: April 13, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Todd Kueny, Justin Starr, Timothy Renton, Antony van Iersel
  • Patent number: 10970833
    Abstract: One aspect provides a method, including: displaying, at a display screen, an image of an interior of a pipe, the image being obtained using a pipe inspection robot; accessing, using a processor, calibration data associated with the image; receiving, via an input device, user input marking at least a portion of the image; determining, using a processor, quantitative pipe feature data for at least one feature of the pipe using the marking and the calibration data; and providing, based on the determining, data associated with the at least one feature. Other aspects are described and claimed.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: April 6, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Patent number: 10937144
    Abstract: One aspect provides a method, including: operating a mobile pipe inspection platform to obtain sensor data for the interior of a pipe; analyzing, using a processor, the sensor data using a trained model, where the trained model is trained using a dataset including sensor data of pipe interiors and one or more of: metadata identifying pipe feature locations contained within the sensor data of the dataset and metadata classifying pipe features contained within the sensor data of the dataset; performing one or more of: identifying, using a processor, a pipe feature location within the sensor data; and classifying, using a processor, a pipe feature of the sensor data; and thereafter producing, using a processor, an output including one or more of an indication of the identifying and an indication of the classifying. Other aspects are described and claimed.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: March 2, 2021
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, Galin Konakchiev, Foster J Salotti, Mark Jordan, Nate Alford, Thorin Tobiassen, Todd Kueny, Jason Mizgorski
  • Publication number: 20210048423
    Abstract: One embodiment provides a pipe inspection robot, including: a chassis configured to traverse through an interior of a water or sewer pipe; a water quality probe comprising a first end that couples to the chassis and a sensing end distal thereto; an electric motor configured to reposition the sensing end of the water quality probe with respect to the chassis; said electric motor acting to move the sensing end of the water quality probe to reposition the sensing end proximate to fluid containing water located proximate to a bottom part of the chassis; the sensing end configured to contact the fluid containing water for contact sensing of water quality data. Other aspects are described and claimed.
    Type: Application
    Filed: October 31, 2020
    Publication date: February 18, 2021
    Applicant: RedZone Robotics, Inc.
    Inventors: Justin Starr, John Lettman, Todd Kueny, Foster J. Salotti, Galin Konakchiev
  • Publication number: 20200402279
    Abstract: Embodiments may be used to evaluate completed inspection jobs using updated pipe segment data obtained by inspecting a rehabilitated pipe after completion of a project. One embodiment provides a method of generating an infrastructure project summary, including: collecting, using one or more sensors of an inspection robot, pipe segment data relating to the one or more pipe segments; the second pipe segment data comprising one or more of laser condition assessment data and sonar condition assessment data; generating infrastructure summary data for at least a part of the network using the pipe segment data, comparing, using a processor, first and second infrastructure summary data; generating, using the processor, a parameter of the infrastructure project summary based on the comparing; and including the parameter of the infrastructure project summary in a project summary report. Other embodiments are disclosed and claimed.
    Type: Application
    Filed: August 21, 2020
    Publication date: December 24, 2020
    Applicant: RedZone Robotics, Inc.
    Inventors: Subramanian Vallapuzha, Eric C. Close
  • Patent number: 10859554
    Abstract: One embodiment provides a pipe inspection robot, including: a chassis configured to traverse through an interior of a water or sewer pipe; an extension piece coupled to the chassis; a water quality probe comprising a first end that couples to the extension piece and a sensing end distal thereto; an electric motor configured to reposition the sensing end of the water quality probe with respect to the extension piece; said electric motor acting to rotate the sensing end of the water quality probe to reposition the sensing end proximate to fluid containing water located proximate to a bottom part of the chassis; the sensing end configured to contact the fluid containing water for contact sensing of water quality data. Other aspects are described and claimed.
    Type: Grant
    Filed: June 3, 2019
    Date of Patent: December 8, 2020
    Assignee: RedZone Robotics, Inc.
    Inventors: Justin Starr, John Lettman, Todd Kueny, Foster J. Salotti, Galin Konakchiev