Patents by Inventor Alexander Berestov

Alexander Berestov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10445898
    Abstract: Various aspects of a system and a method for camera calibration by use of a rotatable three-dimensional (3-D) calibration object are disclosed herein. In accordance with an embodiment, the system includes a first electronic device, which determines a rotation pattern of the 3-D calibration object, based on a set of pre-selected images. The set of pre-selected images includes the 3-D calibration object captured at pre-defined viewing angles. Control information is communicated by the first electronic device to a second electronic device associated with the 3-D calibration object to rotate the 3-D calibration object in accordance with the determined rotation pattern. A plurality of image frames of the 3-D calibration object are captured to calibrate intrinsic and/or extrinsic camera parameters of the first electronic device.
    Type: Grant
    Filed: February 5, 2016
    Date of Patent: October 15, 2019
    Assignee: SONY CORPORATION
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Patent number: 10416667
    Abstract: Various aspects of a system and method for utilization of multiple-camera network to capture static and/or motion scenes are disclosed herein. The system comprises a plurality of unmanned aerial vehicles (UAVs). Each of the plurality of UAVs is associated with an imaging device configured to capture a plurality of images. A first UAV of the plurality of UAVs comprises a first imaging device configured to capture a first set of images of one or more static and/or moving objects. The first UAV is configured to receive focal lens information, current location and current orientation from one or more imaging devices. A target location and a target orientation of each of the one or more imaging devices are determined. Control information is communicated to the one or more other UAVs to modify the current location and current orientation to the determined target location and orientation of each of the one or more imaging devices.
    Type: Grant
    Filed: February 3, 2016
    Date of Patent: September 17, 2019
    Assignee: SONY CORPORATION
    Inventors: Alexander Berestov, Ming-Chang Liu, Chuen-Chien Lee
  • Patent number: 10362288
    Abstract: Various aspects of a method and a system for image processing are disclosed herein. The method includes processing an input image, which comprises structure information and detail information, using image processing (IP) blocks in an image processing pipeline. One or more of the IP blocks, such as the “lossy” IP blocks, process the input image with at least a partial loss of the detail information. By replacing the “lossy” IP blocks with redesigned image processing (IP) modules, the image processing pipeline reduces or avoids such loss of the detail information. A more efficient implementation of the improved pipeline is realized by using a master IP module when the “lossy” IP blocks are reordered and grouped together in the image processing pipeline. The method is further extended to process 3-D images to reduce or avoid loss of detail information in a 3-D image processing pipeline.
    Type: Grant
    Filed: January 9, 2015
    Date of Patent: July 23, 2019
    Assignee: SONY CORPORATION
    Inventors: Xiaogang Dong, Hiroaki Ebi, Jiro Takatori, Alexander Berestov, Kenichi Nishio, Tak Shing Wong
  • Publication number: 20190137731
    Abstract: A light-field adaptor for an interchangeable lens camera having an adaptor housing including a first end configured to be received in a mount interface of a camera and a second end configured to be coupled to a mount interface of an interchangeable lens, and a lens array disposed within the housing. The lens array includes a plurality of lenses disposed at a plurality of distances from the camera sensor and illuminates different areas of the sensor to capture information about the light field emanating from a scene. The lens array may be sized and positioned to use a captured light field to generate one or more of infinite—depth of field rendering, shallow depth of field rendering, and images focused at different scene depths.
    Type: Application
    Filed: June 13, 2018
    Publication date: May 9, 2019
    Applicant: SONY CORPORATION
    Inventor: Alexander Berestov
  • Patent number: 10210615
    Abstract: Various aspects of a system and a method for extrinsic camera parameters calibration by use of a three dimensional (3D) calibration are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which receives an image, which includes the 3D calibration object with a plurality of unique identifiers. One or more appearance parameters of the 3D calibration object and/or a plurality of intrinsic camera parameters of an image-capturing device that captured the received image, are further received. A positional probability is computed for each of the plurality of unique identifiers distributed in the received image. The plurality of unique identifiers of the 3D calibration object are located in the received image to calibrate the extrinsic camera parameters based on the computed positional probability, the received one or more appearance parameters of the 3D calibration object, and the plurality of intrinsic camera parameters.
    Type: Grant
    Filed: March 10, 2016
    Date of Patent: February 19, 2019
    Assignee: SONY CORPORATION
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Patent number: 9947111
    Abstract: A method to position multiple camera using camera ordering is described herein. Based on two known camera positions, a third camera position is able to be determined using acquired information and calculations.
    Type: Grant
    Filed: October 28, 2015
    Date of Patent: April 17, 2018
    Assignee: Sony Corporation
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Patent number: 9791264
    Abstract: A method to estimate a set of camera locations, in clockwise or counter-clockwise order, according to the videos captured by these cameras is described herein. In some embodiments, the cameras are assumed to be fixed, with no or very mild tilting angles and no rolling angles (the horizon is horizontal in each camera image). The difference of orientation (rolling angle) between each neighboring (closest) camera pair is able to be up to 45 degrees. Each camera is assumed to have overlapped views with at least one other camera. Each camera has one right neighboring camera and one left neighboring camera, except the first and the last cameras which have only one neighboring camera at one side. The locations of the cameras then are able to be expressed as a unique list counter-clockwise. The input videos are assumed to be synchronized in time.
    Type: Grant
    Filed: February 4, 2015
    Date of Patent: October 17, 2017
    Assignee: SONY CORPORATION
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Patent number: 9781412
    Abstract: The thick lens calibration method enables better calibration of complex camera devices such as devices with thick lens systems. The thick lens calibration method includes a two step process of calibrating using the distance between a second nodal point and an image sensor, and calibrating using the distance between the first and second nodal point.
    Type: Grant
    Filed: February 4, 2015
    Date of Patent: October 3, 2017
    Assignee: Sony Corporation
    Inventors: Xue Tu, Pingshan Li, Alexander Berestov
  • Patent number: 9767378
    Abstract: Various aspects of a method and system to track one or more objects in a video stream are disclosed herein. In accordance with an embodiment, the method includes computation of a first confidence score of a first geometrical shape that encompasses at least a portion of an object in a first image frame of the video stream. The first geometrical shape is utilized to track the object in the video stream. The first geometrical shape is split into a plurality of second geometrical shapes. The split of the first geometrical shape is based on a comparison of the computed first confidence score with a pre-defined threshold score.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: September 19, 2017
    Assignee: SONY CORPORATION
    Inventors: Houman Rastgar, Alexander Berestov
  • Publication number: 20170262971
    Abstract: Various aspects of a system and a method for extrinsic camera parameters calibration by use of a three dimensional (3D) calibration are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which receives an image, which includes the 3D calibration object with a plurality of unique identifiers. One or more appearance parameters of the 3D calibration object and/or a plurality of intrinsic camera parameters of an image-capturing device that captured the received image, are further received. A positional probability is computed for each of the plurality of unique identifiers distributed in the received image. The plurality of unique identifiers of the 3D calibration object are located in the received image to calibrate the extrinsic camera parameters based on the computed positional probability, the received one or more appearance parameters of the 3D calibration object, and the plurality of intrinsic camera parameters.
    Type: Application
    Filed: March 10, 2016
    Publication date: September 14, 2017
    Inventors: CHENG-YI LIU, ALEXANDER BERESTOV
  • Patent number: 9760791
    Abstract: Various aspects of a method and system for object tracking are disclosed herein. The method comprises computation of an overlap value between a first bounding box and a second bounding box, associated with an object in an image frame of a video stream. The overlap values are utilized to track the object in the video stream. The first bounding box encompasses at least a partial first portion of an object. The second bounding box encompasses at least a partial second portion of the object. A first score associated with the first bounding box and a second score associated with the second bounding box is computed based on a comparison of the computed overlap value with a pre-defined threshold value. The first bounding box is updated to a new bounding box that at least partially encompasses the object, based on the computed first score and the computed second score.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: September 12, 2017
    Assignee: SONY CORPORATION
    Inventors: Houman Rastgar, Alexander Berestov
  • Publication number: 20170228864
    Abstract: Various aspects of a system and a method for camera calibration by use of a rotatable three-dimensional (3-D) calibration object are disclosed herein. In accordance with an embodiment, the system includes a first electronic device, which determines a rotation pattern of the 3-D calibration object, based on a set of pre-selected images. The set of pre-selected images includes the 3-D calibration object captured at pre-defined viewing angles. Control information is communicated by the first electronic device to a second electronic device associated with the 3-D calibration object to rotate the 3-D calibration object in accordance with the determined rotation pattern. A plurality of image frames of the 3-D calibration object are captured to calibrate intrinsic and/or extrinsic camera parameters of the first electronic device.
    Type: Application
    Filed: February 5, 2016
    Publication date: August 10, 2017
    Inventors: CHENG-YI LIU, ALEXANDER BERESTOV
  • Publication number: 20170220037
    Abstract: Various aspects of a system and method for utilization of multiple-camera network to capture static and/or motion scenes are disclosed herein. The system comprises a plurality of unmanned aerial vehicles (UAVs). Each of the plurality of UAVs is associated with an imaging device configured to capture a plurality of images. A first UAV of the plurality of UAVs comprises a first imaging device configured to capture a first set of images of one or more static and/or moving objects. The first UAV is configured to receive focal lens information, current location and current orientation from one or more imaging devices. A target location and a target orientation of each of the one or more imaging devices are determined. Control information is communicated to the one or more other UAVs to modify the current location and current orientation to the determined target location and orientation of each of the one or more imaging devices.
    Type: Application
    Filed: February 3, 2016
    Publication date: August 3, 2017
    Inventors: ALEXANDER BERESTOV, MING-CHANG LIU, CHUEN-CHIEN LEE
  • Patent number: 9715721
    Abstract: Focus detection is to determine whether an image is in focus or not. Focus detection is able to be used for improving camera autofocus performance. Focus detection by using only one feature does not provide enough reliability to distinguish in-focus and slightly out-of-focus images. A focus detection algorithm of combining multiple features used to evaluate sharpness is described herein. A large image data set with in-focus and out-of-focus images is used to develop the focus detector for separating the in-focus images from out-of-focus images. Many features such as iterative blur estimation, FFT linearity, edge percentage, wavelet energy ratio, improved wavelet energy ratio, Chebyshev moment ratio and chromatic aberration features are able to be used to evaluate sharpness and determine big blur images.
    Type: Grant
    Filed: December 18, 2015
    Date of Patent: July 25, 2017
    Assignee: Sony Corporation
    Inventors: Pingshan Li, Jianing Wei, Xue Tu, Alexander Berestov, Takami Mizukura, Akira Matsui, Tomonori Shuda
  • Publication number: 20170178296
    Abstract: Focus detection is to determine whether an image is in focus or not. Focus detection is able to be used for improving camera autofocus performance. Focus detection by using only one feature does not provide enough reliability to distinguish in-focus and slightly out-of-focus images. A focus detection algorithm of combining multiple features used to evaluate sharpness is described herein. A large image data set with in-focus and out-of-focus images is used to develop the focus detector for separating the in-focus images from out-of-focus images. Many features such as iterative blur estimation, FFT linearity, edge percentage, wavelet energy ratio, improved wavelet energy ratio, Chebyshev moment ratio and chromatic aberration features are able to be used to evaluate sharpness and determine big blur images.
    Type: Application
    Filed: December 18, 2015
    Publication date: June 22, 2017
    Inventors: Pingshan Li, Jianing Wei, Xue Tu, Alexander Berestov, Takami Mizukura, Akira Matsui, Tomonori Shuda
  • Patent number: 9646202
    Abstract: An image processing system and method of operation includes: a source image having source pixels; homogeneous blocks in the source image having a block color; a homogeneous region in the source image formed by merging the homogeneous blocks having the block color within a color threshold; a text background region having text pixels and background pixels in the homogeneous region with the text background region having a texture feature above a texture threshold and a region size above a region size threshold; and a binary text mask representing the text pixels and the background pixels for displaying on a device.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: May 9, 2017
    Assignee: Sony Corporation
    Inventors: Golnaz Abdollahian, Alexander Berestov, Hiromasa Naganuma, Hiroshige Okamoto
  • Publication number: 20170124712
    Abstract: A method to position multiple camera using camera ordering is described herein. Based on two known camera positions, a third camera position is able to be determined using acquired information and calculations.
    Type: Application
    Filed: October 28, 2015
    Publication date: May 4, 2017
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Publication number: 20170061241
    Abstract: Various aspects of a method and system to track one or more objects in a video stream are disclosed herein. In accordance with an embodiment, the method includes computation of a first confidence score of a first geometrical shape that encompasses at least a portion of an object in a first image frame of the video stream. The first geometrical shape is utilized to track the object in the video stream. The first geometrical shape is split into a plurality of second geometrical shapes. The split of the first geometrical shape is based on a comparison of the computed first confidence score with a pre-defined threshold score.
    Type: Application
    Filed: August 31, 2015
    Publication date: March 2, 2017
    Inventors: HOUMAN RASTGAR, ALEXANDER BERESTOV
  • Publication number: 20170061229
    Abstract: Various aspects of a method and system for object tracking are disclosed herein. The method comprises computation of an overlap value between a first bounding box and a second bounding box, associated with an object in an image frame of a video stream. The overlap values are utilized to track the object in the video stream. The first bounding box encompasses at least a partial first portion of an object. The second bounding box encompasses at least a partial second portion of the object. A first score associated with the first bounding box and a second score associated with the second bounding box is computed based on a comparison of the computed overlap value with a pre-defined threshold value. The first bounding box is updated to a new bounding box that at least partially encompasses the object, based on the computed first score and the computed second score.
    Type: Application
    Filed: September 1, 2015
    Publication date: March 2, 2017
    Inventors: HOUMAN RASTGAR, ALEXANDER BERESTOV
  • Patent number: 9582727
    Abstract: A text recognition system and method of operation thereof including: a storage unit for storing a text unit; and a processing unit, connected to the storage unit, the processing unit including: a communication interface for receiving the text unit, a feature detection module for determining an isolated feature of the text unit, an angle detection module for determining angle features of the text unit, a feature vector module for generating a feature vector for the text unit based on the isolated feature and the angle features, and a text recognition module for determining recognized text using the feature vector for display on a display interface.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: February 28, 2017
    Assignee: SONY CORPORATION
    Inventors: Golnaz Abdollahian, Alexander Berestov, Hiromasa Naganuma, Hiroshige Okamoto