Patents by Inventor Vikram VijayanBabu Appia

Vikram VijayanBabu Appia has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11050932
    Abstract: A method for generating a surround view (SV) image for display in a view port of an SV processing system is provided that includes capturing, by at least one processor, corresponding images of video streams from each camera of a plurality of cameras and generating, by the at least one processor, the SV image using ray tracing for lens remapping to identify coordinates of pixels in the images corresponding to pixels in the SV image.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: June 29, 2021
    Assignee: Texas Instruments Incorporated
    Inventors: Hemant Vijay Kumar Hariyani, Martin Fritz Mueller, Vikram VijayanBabu Appia
  • Patent number: 11048957
    Abstract: A method of image processing in a structured light imaging system is provided that includes receiving a captured image of a scene, wherein the captured image is captured by a camera of a projector-camera pair, and wherein the captured image includes a binary pattern projected into the scene by the projector, applying a filter to the rectified captured image to generate a local threshold image, wherein the local threshold image includes a local threshold value for each pixel in the rectified captured image, and extracting a binary image from the rectified captured image wherein a value of each location in the binary image is determined based on a comparison of a value of a pixel in a corresponding location in the rectified captured image to a local threshold value in a corresponding location in the local threshold image.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: June 29, 2021
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Vikram VijayanBabu Appia
  • Publication number: 20210042891
    Abstract: A method for geometrically correcting a distorted input frame and generating an undistorted output frame includes capturing and storing an input frame in an external memory, allocating an output frame with an output frame size and dividing the output frame into output blocks, computing a size of the input blocks in the input image corresponding to each output blocks, checking if the size of the input blocks is less than the size of the internal memory and if not dividing until the required input block size of divided sub blocks is less than the size of the internal memory, programming an apparatus with input parameters, fetching the input blocks into an internal memory, processing each of the divided sub blocks sequentially and processing the next output block in step until all the output blocks are processed; and composing the output frame for each of the blocks in the output frame.
    Type: Application
    Filed: October 27, 2020
    Publication date: February 11, 2021
    Inventors: Rajasekhar Reddy Allu, Niraj Nandan, Mihir Narendra Mody, Gang Hua, Brian Okchon Chae, Shashank Dabral, Hetul Sanghvi, Vikram VijayanBabu Appia, Sujith Shivalingappa
  • Patent number: 10890648
    Abstract: A method of generating an alignment matrix for a camera-radar system includes: receiving radar data originated by a radar subsystem and representative of an area of interest within a field of view for the radar subsystem; receiving image data originated by a camera subsystem and representative of the area of interest within a field of view for the camera subsystem; processing the radar data to detect features within the area of interest and to determine a reflected radar point with three dimensions relating to a camera-radar system; processing the image data to detect features within the area of interest and to determine a centroid with two dimensions relating to the camera-radar system; and computing an alignment matrix for radar and image data from the camera-radar system based on a functional relationship between the three dimensions for the reflected radar point and the two dimensions for the centroid.
    Type: Grant
    Filed: September 17, 2015
    Date of Patent: January 12, 2021
    Assignee: Texas Instruments Incorporated
    Inventors: Vikram VijayanBabu Appia, Dan Wang
  • Patent number: 10853923
    Abstract: A method for geometrically correcting a distorted input frame and generating an undistorted output frame includes capturing and storing an input frame in an external memory, allocating an output frame with an output frame size and dividing the output frame into output blocks, computing a size of the input blocks in the input image corresponding to each output blocks, checking if the size of the input blocks is less than the size of the internal memory and if not dividing until the required input block size of divided sub blocks is less than the size of the internal memory, programming an apparatus with input parameters, fetching the input blocks into an internal memory, processing each of the divided sub blocks sequentially and processing the next output block in step until all the output blocks are processed; and composing the output frame for each of the blocks in the output frame.
    Type: Grant
    Filed: March 21, 2018
    Date of Patent: December 1, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Rajasekhar Reddy Allu, Niraj Nandan, Mihir Narendra Mody, Gang Hua, Brian Okchon Chae, Shashank Dabral, Hetul Sanghvi, Vikram VijayanBabu Appia, Sujith Shivalingappa
  • Publication number: 20200374502
    Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.
    Type: Application
    Filed: August 11, 2020
    Publication date: November 26, 2020
    Inventors: Vikram VijayanBabu Appia, Ibrahim Ethem Pekkucuksen
  • Publication number: 20200349683
    Abstract: An apparatus and method for geometrically correcting a distorted input frame and generating an undistorted output frame. The apparatus includes an external memory block that stores the input frame, a counter block to compute output coordinates of the output frame for a region based on a block size of the region, a back mapping block to generate input coordinates corresponding to each of the output coordinates, a bounding module to compute input blocks corresponding to each of the input coordinates, a buffer module to fetch data corresponding to each of the input blocks, an interpolation module to interpolate data from the buffer module and a display module that receives the interpolated data for each of the regions and stitch an output image. The method includes determining the size of the output block based on a magnification data.
    Type: Application
    Filed: July 16, 2020
    Publication date: November 5, 2020
    Inventors: Rajasekhar Reddy Allu, Niraj Nandan, Mihir Narendra Mody, Gang Hua, Brian Okchon Chae, Shashank Dabral, Hetul Sanghvi, Vikram VijayanBabu Appia, Sujith Shivalingappa
  • Publication number: 20200333467
    Abstract: A method for computing a depth map of a scene in a structured light imaging system including a time-of-flight (TOF) sensor and a projector is provided that includes capturing a plurality of high frequency phase-shifted structured light images of the scene using a camera in the structured light imaging system, generating, concurrently with the capturing of the plurality of high frequency phase-shifted structured light images, a time-of-flight (TOF) depth image of the scene using the TOF sensor, and computing the depth map from the plurality of high frequency phase-shifted structured light images wherein the TOF depth image is used for phase unwrapping.
    Type: Application
    Filed: July 6, 2020
    Publication date: October 22, 2020
    Inventors: Sanjeev Jagannatha Koppal, Vikram VijayanBabu Appia
  • Patent number: 10785463
    Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.
    Type: Grant
    Filed: July 2, 2014
    Date of Patent: September 22, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Vikram VijayanBabu Appia, Ibrahim Ethem Pekkucuksen
  • Publication number: 20200280678
    Abstract: A method for generating a surround view (SV) image for display in a view port of an SV processing system is provided that includes capturing, by at least one processor, corresponding images of video streams from each camera of a plurality of cameras and generating, by the at least one processor, the SV image using ray tracing for lens remapping to identify coordinates of pixels in the images corresponding to pixels in the SV image.
    Type: Application
    Filed: March 1, 2019
    Publication date: September 3, 2020
    Inventors: Hemant Vijay Kumar Hariyani, Martin Fritz Mueller, Vikram VijayanBabu Appia
  • Publication number: 20200260006
    Abstract: A rear-stitched view panorama (RSVP) system is provided that includes at least one processor and a memory storing software instructions that, when executed by the least one processor, cause the RSVP system to compute a disparity map for a left center rear image and a right center rear image captured by a stereo camera mounted on a rear of a vehicle, transform a right rear image, a left rear image, a reference center rear image, and the disparity map to a virtual world view, the right rear image and left rear image captured by respective right and left cameras mounted on the vehicle, compute an optimal left seam and an optimal right seam based on the transformed disparity map, and stitch the transformed images based on respective optimal seams to generate a panorama.
    Type: Application
    Filed: April 27, 2020
    Publication date: August 13, 2020
    Inventors: Janice Shuay-Ann Pan, Vikram VijayanBabu Appia
  • Patent number: 10739463
    Abstract: A method for computing a depth map of a scene in a structured light imaging system including a time-of-flight (TOF) sensor and a projector is provided that includes capturing a plurality of high frequency phase-shifted structured light images of the scene using a camera in the structured light imaging system, generating, concurrently with the capturing of the plurality of high frequency phase-shifted structured light images, a time-of-flight (TOF) depth image of the scene using the TOF sensor, and computing the depth map from the plurality of high frequency phase-shifted structured light images wherein the TOF depth image is used for phase unwrapping.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: August 11, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Sanjeev Jagannatha Koppal, Vikram VijayanBabu Appia
  • Publication number: 20200195846
    Abstract: A method for displaying a surround view on a single display screen is disclosed. A plurality of image frames for a particular time may be received from a corresponding plurality of cameras. A viewpoint warp map corresponding to a predetermined first virtual viewpoint may be selected, wherein the viewpoint warp map defines a source pixel location in the plurality of image frames for each output pixel location in the display screen. The warp map was predetermined offline and stored for later use. An output image is synthesized for the display screen by selecting pixel data for each pixel of the output image from the plurality of image frames in accordance with the viewpoint warp map. The synthesized image is then displayed on a display screen.
    Type: Application
    Filed: December 19, 2019
    Publication date: June 18, 2020
    Inventors: Vikram VijayanBabu Appia, Sujith Shivalingappa, Brijesh Rameshbhai Jadav, Hemant Hariyani, Shashank Dabral, Mayank Mangla
  • Patent number: 10674079
    Abstract: A rear-stitched view panorama (RSVP) system is provided that includes at least one processor and a memory storing software instructions that, when executed by the least one processor, cause the RSVP system to compute a disparity map for a left center rear image and a right center rear image captured by a stereo camera mounted on a rear of a vehicle, transform a right rear image, a left rear image, a reference center rear image, and the disparity map to a virtual world view, the right rear image and left rear image captured by respective right and left cameras mounted on the vehicle, compute an optimal left seam and an optimal right seam based on the transformed disparity map, and stitch the transformed images based on respective optimal seams to generate a panorama.
    Type: Grant
    Filed: April 18, 2019
    Date of Patent: June 2, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Janice Shuay-Ann Pan, Vikram VijayanBabu Appia
  • Patent number: 10634778
    Abstract: Camera-assisted tracking of point objects in a radar system is provided. An extended Kalman filter framework based on both radar and camera observations is used to track point objects detected in frames of radar signal data. This framework provides a minimum mean square estimation of the current state of a point object based on previous and current observations from both frames of radar signals and corresponding camera images.
    Type: Grant
    Filed: October 21, 2015
    Date of Patent: April 28, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Yucheng Liu, Vikram VijayanBabu Appia, Muhammad Zubair Ikram
  • Patent number: 10542248
    Abstract: A method of image processing in a structured light imaging device is provided that includes receiving a captured image of a scene, wherein the captured image is captured by a camera of a projector-camera pair in the structured light imaging system, and wherein the captured image includes a pre-determined hierarchical binary pattern projected into the scene by the projector, wherein the pre-determined hierarchical binary pattern was formed by iteratively scaling a lower resolution binary pattern to multiple successively higher resolutions, rectifying the captured image to generated a rectified captured image, extracting a binary image from the rectified captured image at full resolution and at each resolution used to generate the pre-determined hierarchical binary pattern, and using the binary images to generate a depth map of the captured image.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: January 21, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Vikram VijayanBabu Appia
  • Patent number: 10523865
    Abstract: A method for displaying a surround view on a single display screen is disclosed. A plurality of image frames for a particular time may be received from a corresponding plurality of cameras. A viewpoint warp map corresponding to a predetermined first virtual viewpoint may be selected, wherein the viewpoint warp map defines a source pixel location in the plurality of image frames for each output pixel location in the display screen. The warp map was predetermined offline and stored for later use. An output image is synthesized for the display screen by selecting pixel data for each pixel of the output image from the plurality of image frames in accordance with the viewpoint warp map. The synthesized image is then displayed on a display screen.
    Type: Grant
    Filed: October 19, 2016
    Date of Patent: December 31, 2019
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Vikram VijayanBabu Appia, Sujith Shivalingappa, Brijesh Rameshbhai Jadav, Hemant Hariyani, Shashank Dabral, Mayank Mangla
  • Patent number: 10452960
    Abstract: An image classification system includes a convolutional neural network, a confidence predictor, and a fusion classifier. The convolutional neural network is configured to assign a plurality of probability values to each pixel of a first image of a scene and a second image of the scene. Each of the probability values corresponds to a different feature that the convolutional neural network is trained to identify. The confidence predictor is configured to assign a confidence value to each pixel of the first image and to each pixel of the second image. The confidence values correspond to a greatest of the probability values generated by the convolutional neural network for each pixel. The fusion classifier is configured to assign, to each pixel of the first image, a feature that corresponds to a higher of the confidence values assigned to the pixel of the first image and the second image.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: October 22, 2019
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Yingmao Li, Vikram VijayanBabu Appia, Ziguo Zhong, Tarek Aziz Lahlou
  • Publication number: 20190253625
    Abstract: A rear-stitched view panorama (RSVP) system is provided that includes at least one processor and a memory storing software instructions that, when executed by the least one processor, cause the RSVP system to compute a disparity map for a left center rear image and a right center rear image captured by a stereo camera mounted on a rear of a vehicle, transform a right rear image, a left rear image, a reference center rear image, and the disparity map to a virtual world view, the right rear image and left rear image captured by respective right and left cameras mounted on the vehicle, compute an optimal left seam and an optimal right seam based on the transformed disparity map, and stitch the transformed images based on respective optimal seams to generate a panorama.
    Type: Application
    Filed: April 18, 2019
    Publication date: August 15, 2019
    Inventors: Janice Shuay-Ann Pan, Vikram VijayanBabu Appia
  • Patent number: 10313584
    Abstract: A rear-stitched view panorama (RSVP) system is provided that includes at least one processor and a memory storing software instructions that, when executed by the least one processor, cause the RSVP system to compute a disparity map for a left center rear image and a right center rear image captured by a stereo camera mounted on a rear of a vehicle, transform a right rear image, a left rear image, a reference center rear image, and the disparity map to a virtual world view, the right rear image and left rear image captured by respective right and left cameras mounted on the vehicle, compute an optimal left seam and an optimal right seam based on the transformed disparity map, and stitch the transformed images based on respective optimal seams to generate a panorama.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: June 4, 2019
    Assignee: Texas Instruments Incorporated
    Inventors: Janice Shuay-Ann Pan, Vikram VijayanBabu Appia