Patents by Inventor Oscar Nestares

Oscar Nestares has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11256949
    Abstract: An example method is described herein. The method includes executing dense feature matching on an image pair that is down sampled to obtain a first set of feature correspondences for each pixel of the down sampled image pair. The method also includes calculating a neighborhood correspondence based on the first set of feature correspondences for each pixel in a first image of the image pair. Further, the method includes executing sparse feature matching on stereoscopic patch pairs from the image pair based on the neighborhood correspondence for each pixel to obtain correspondence estimates for each stereoscopic patch pair. Finally, the method includes refining the correspondence estimates for each stereoscopic patch pair to obtain a semi-dense set of feature correspondences by applying a geometric constraint to the correspondence estimates and retaining correspondences that satisfy the geometric constraint.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 22, 2022
    Assignee: INTEL CORPORATION
    Inventors: Oscar Nestares, Niloufar Pourian
  • Publication number: 20220046183
    Abstract: Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.
    Type: Application
    Filed: October 25, 2021
    Publication date: February 10, 2022
    Inventors: Maha El Choubassi, Oscar Nestares
  • Publication number: 20220013148
    Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
    Type: Application
    Filed: September 27, 2021
    Publication date: January 13, 2022
    Inventors: Gowri Somanath, Oscar Nestares
  • Publication number: 20220012860
    Abstract: Methods and apparatus are disclosed herein to synthesize six degree-of-freedom views from sparce RGB-depth inputs. An example apparatus includes at least one memory, instructions in the apparatus, and processor circuitry to execute the instructions to reproject a first red-green-blue (RGB) depth view and a second RGB depth view to a target camera position to obtain a first reprojected view and a second reprojected view, combine the first reprojected view and the second reprojected view into a blended view data based on a first weight map and a second weight map, the blended view including missing RGB depth information due to at least one of an occlusion or a disocclusion, and generate a six degree-of-freedom synthesized view of the blended view data, the synthesized view including the missing RGB depth information.
    Type: Application
    Filed: September 23, 2021
    Publication date: January 13, 2022
    Inventors: Fan Zhang, Oscar Nestares
  • Patent number: 11159742
    Abstract: An apparatus for high-speed video is described herein. The apparatus includes a camera array, wherein each camera of the camera array is to capture an image at a different time offset resulting in a plurality of images. The apparatus also includes a controller to interleave the plurality of images in chronological order and a view synthesis unit to synthesize a camera view from a virtual camera for each image of the plurality of images. Additionally, the apparatus includes a post-processing unit to remove any remaining artifacts from the plurality of images.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: October 26, 2021
    Assignee: Intel Corporation
    Inventors: Maha El Choubassi, Oscar Nestares
  • Patent number: 11133033
    Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
    Type: Grant
    Filed: July 7, 2020
    Date of Patent: September 28, 2021
    Assignee: Intel Corporation
    Inventors: Gowri Somanath, Oscar Nestares
  • Patent number: 11009766
    Abstract: Disclosed herein is display stacks for virtual reality (VR) displays arranged to present an image where a focal point of the image is presented in higher resolution than a periphery around the focal point. The disclosure provides systems and methods for presenting an image comprising a high resolution having a smaller field of view than that with which a lower resolution image is presented around a periphery of the high resolution image.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: May 18, 2021
    Assignee: Intel Corporation
    Inventors: Ginni Grover, Ronald Azuma, Oscar Nestares
  • Patent number: 11009764
    Abstract: Technology for improving performance of a personal display device by variably controlling the emission divergence and/or the emission direction of light from the pixels of the display as a function of the location of the pixel within a display.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: May 18, 2021
    Assignee: Intel Corporation
    Inventors: Jun Jiang, Zhiming Zhuang, Ginni Grover, Basel Salahieh, Oscar Nestares, David W. Browning
  • Publication number: 20210120225
    Abstract: An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.
    Type: Application
    Filed: December 23, 2020
    Publication date: April 22, 2021
    Inventors: Fan Zhang, Oscar Nestares
  • Publication number: 20210103764
    Abstract: Techniques related to optical flow estimation for equirectangular images are discussed. Such techniques include combining an optical flow map generated using an input pair of equirectangular images and an optical flow map generated using a transformed pair of equirectangular images rotated with respect to the input pair to move polar regions in the input pair to central regions in the transformed pair.
    Type: Application
    Filed: December 17, 2020
    Publication date: April 8, 2021
    Applicant: Intel Corporation
    Inventors: Niloufar Pourian, Oscar Nestares
  • Patent number: 10957027
    Abstract: Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying a convolution mask that approximates an inverse of a linear combination of at least the horizontal and vertical convolution matrices representative of gradient detection in the input images to a virtual intermediate gradient image that is a combination of at least an interpolated virtual image at the position, an interpolated horizontal gradient map at the position, and an interpolated vertical gradient map at the position to generate a final virtual image for the position.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: March 23, 2021
    Assignee: Intel Corporation
    Inventors: Vladan Popovic, Fan Zhang, Oscar Nestares, Kalpana Seshadrinathan
  • Publication number: 20210056998
    Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
    Type: Application
    Filed: July 7, 2020
    Publication date: February 25, 2021
    Inventors: Gowri Somanath, Oscar Nestares
  • Patent number: 10917633
    Abstract: An example system for generating stereoscopic light field panoramas includes a receiver to receive a plurality of synchronized images. The system also includes a calibrator and projector to calibrate the synchronized images, undistort the synchronized images, and project the undistorted images to a sphere to generate undistorted rectilinear images. The system further includes a disparity estimator to estimate a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images. The system includes a view interpolator to perform in-between view interpolation on the undistorted rectilinear images based on the optical flow. The system also further includes a light field panorama generator to generate a stereoscopic light field panorama for a plurality of perspectives using concentric viewing circles.
    Type: Grant
    Filed: September 15, 2017
    Date of Patent: February 9, 2021
    Assignee: INTEL CORPORATION
    Inventors: Fan Zhang, Oscar Nestares
  • Patent number: 10896348
    Abstract: Techniques related to feature detection and matching fisheye images are discussed. Such techniques include determining a geometric constraint for the feature matching using match results from a first image based feature matching and generating resultant matches based on applying the geometric constraint and a second image based feature matching that applies a looser image based feature matching requirement than the image based feature matching.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: January 19, 2021
    Assignee: Intel Corporation
    Inventors: Niloufar Pourian, Oscar Nestares
  • Publication number: 20210004969
    Abstract: Techniques related to multi-level optical flow estimation are discussed. Such techniques include partitioning each pair of input images into one or more partitions, separately performing optical flow estimation on the partitions, and merging the separately generated optical flow results into a final optical flow map for the pair of input images.
    Type: Application
    Filed: September 23, 2020
    Publication date: January 7, 2021
    Applicant: Intel Corporation
    Inventors: Niloufar Pourian, Oscar Nestares
  • Patent number: 10855966
    Abstract: Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: December 1, 2020
    Assignee: Intel Corporation
    Inventors: Bindita Chaudhuri, Fan Zhang, Oscar Nestares
  • Patent number: 10771758
    Abstract: Techniques related to generating a virtual view from multi-view images for presentation to a viewer are discussed. Such techniques include determining, based on a viewer position relative to a display region, first and second crop positions of planar image and cropping the planar image to a cropped planar image to fill the display region using the first and second crop positions such that the first and second crop positions define an asymmetric frustum between the cropped planar image and a virtual window corresponding to the display region.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: September 8, 2020
    Assignee: Intel Corporation
    Inventors: Oscar Nestares, Kalpana Seshadrinathan, Vladan Popovic, Horst Haussecker
  • Patent number: 10706890
    Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: July 7, 2020
    Assignee: Intel Corporation
    Inventors: Gowri Somanath, Oscar Nestares
  • Patent number: 10701282
    Abstract: A plurality of frames of a video recorded by a video camera and depth maps of the plurality of frames are stored in a data storage. One or more target video camera positions are determined. Each frame of the plurality of frames is associated with one or more of the target video camera positions. For each frame, one or more synthesized frames from the viewpoint of the one or more target camera positions associated with that frame are generated by applying a view interpolation algorithm to that frame using the color pixels of that frame and the depth map of that frame. Users can provide their input about the new camera positions and other camera parameters through multiple input modalities. The synthesized frames are concatenated to create a modified video. Other embodiments are also described and claimed.
    Type: Grant
    Filed: June 24, 2015
    Date of Patent: June 30, 2020
    Assignee: INTEL CORPORATION
    Inventors: Maha El Choubassi, Yan Xu, Alexey M. Supikov, Oscar Nestares
  • Publication number: 20200162715
    Abstract: Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.
    Type: Application
    Filed: January 24, 2020
    Publication date: May 21, 2020
    Applicant: Intel Corporation
    Inventors: Bindita Chaudhuri, Fan Zhang, Oscar Nestares