Patents by Inventor Albert Shalumov
Albert Shalumov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11770495Abstract: Systems and methods for generating a virtual view of a virtual camera based on an input image are described. A system for generating a virtual view of a virtual camera based on an input image can include a capturing device including a physical camera and a depth sensor. The system also includes a controller configured to determine an actual pose of the capturing device; determine a desired pose of the virtual camera for showing the virtual view; define an epipolar geometry between the actual pose of the capturing device and the desired pose of the virtual camera; and generate a virtual image depicting objects within the input image according to the desired pose of the virtual camera for the virtual camera based on an epipolar relation between the actual pose of the capturing device, the input image, and the desired pose of the virtual camera.Type: GrantFiled: August 13, 2021Date of Patent: September 26, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Patent number: 11748936Abstract: Systems and methods for generating a virtual view of a virtual camera based on an input scene are described. A capturing device typically includes a physical camera and a depth sensor and captures an input scene. A controller determines an actual pose of the capturing device and a desired pose of the virtual camera for showing the virtual view. The controller defines an epipolar geometry between the actual pose of the capturing device and the desired pose of the virtual camera. The controller generates an output image for the virtual camera based on an epipolar relation between the actual pose of the capturing device, the input scene, and the desired pose of the virtual camera.Type: GrantFiled: March 2, 2021Date of Patent: September 5, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Patent number: 11691566Abstract: Presented are intelligent vehicle systems with networked on-body vehicle cameras with camera-view augmentation capabilities, methods for making/using such systems, and vehicles equipped with such systems. A method for operating a motor vehicle includes a system controller receiving, from a network of vehicle-mounted cameras, camera image data containing a target object from a perspective of one or more cameras. The controller analyzes the camera image to identify characteristics of the target object and classify these characteristics to a corresponding model collection set associated with the type of target object. The controller then identifies a 3D object model assigned to the model collection set associated with the target object type. A new “virtual” image is generated by replacing the target object with the 3D object model positioned in a new orientation. The controller commands a resident vehicle system to execute a control operation using the new image.Type: GrantFiled: November 17, 2021Date of Patent: July 4, 2023Assignee: GM Global Technology Operations LLCInventors: Michael Slutsky, Albert Shalumov
-
Patent number: 11683458Abstract: Systems and methods for projecting a multi-faceted image onto a convex polyhedron based on an input image are described. A system can include a controller configured to determine a mapping between pixels within a wide-angle image and a multi-faceted image, and generate the multi-faceted image based on the mapping.Type: GrantFiled: July 29, 2021Date of Patent: June 20, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20230150429Abstract: Presented are intelligent vehicle systems with networked on-body vehicle cameras with camera-view augmentation capabilities, methods for making/using such systems, and vehicles equipped with such systems. A method for operating a motor vehicle includes a system controller receiving, from a network of vehicle-mounted cameras, camera image data containing a target object from a perspective of one or more cameras. The controller analyzes the camera image to identify characteristics of the target object and classify these characteristics to a corresponding model collection set associated with the type of target object. The controller then identifies a 3D object model assigned to the model collection set associated with the target object type. A new “virtual” image is generated by replacing the target object with the 3D object model positioned in a new orientation. The controller commands a resident vehicle system to execute a control operation using the new image.Type: ApplicationFiled: November 17, 2021Publication date: May 18, 2023Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20230050264Abstract: Systems and methods for generating a virtual view of a virtual camera based on an input image are described. A system for generating a virtual view of a virtual camera based on an input image can include a capturing device including a physical camera and a depth sensor. The system also includes a controller configured to determine an actual pose of the capturing device; determine a desired pose of the virtual camera for showing the virtual view; define an epipolar geometry between the actual pose of the capturing device and the desired pose of the virtual camera; and generate a virtual image depicting objects within the input image according to the desired pose of the virtual camera for the virtual camera based on an epipolar relation between the actual pose of the capturing device, the input image, and the desired pose of the virtual camera.Type: ApplicationFiled: August 13, 2021Publication date: February 16, 2023Inventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20230031894Abstract: Systems and methods for projecting a multi-faceted image onto a convex polyhedron based on an input image are described. A system can include a controller configured to determine a mapping between pixels within a wide-angle image and a multi-faceted image, and generate the multi-faceted image based on the mapping.Type: ApplicationFiled: July 29, 2021Publication date: February 2, 2023Inventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20220292289Abstract: Methods and system for training a neural network for depth estimation in a vehicle. The methods and systems receive respective training image data from at least two cameras. Fields of view of adjacent cameras of the at least two cameras partially overlap. The respective training image data is processed through a neural network providing depth data and semantic segmentation data as outputs. The neural network is trained based on a loss function. The loss function combines a plurality of loss terms including at least a semantic segmentation loss term and a panoramic loss term. The panoramic loss term includes a similarity measure regarding overlapping image patches of the respective image data that each correspond to a region of overlapping fields of view of the adjacent cameras. The semantic segmentation loss term quantifies a difference between ground truth semantic segmentation data and the semantic segmentation data output from the neural network.Type: ApplicationFiled: March 11, 2021Publication date: September 15, 2022Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Albert Shalumov, Michael Slutsky
-
Publication number: 20220284660Abstract: Systems and methods for generating a virtual view of a virtual camera based on an input scene are described. A capturing device typically includes a physical camera and a depth sensor and captures an input scene. A controller determines an actual pose of the capturing device and a desired pose of the virtual camera for showing the virtual view. The controller defines an epipolar geometry between the actual pose of the capturing device and the desired pose of the virtual camera. The controller generates an output image for the virtual camera based on an epipolar relation between the actual pose of the capturing device, the input scene, and the desired pose of the virtual camera.Type: ApplicationFiled: March 2, 2021Publication date: September 8, 2022Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20220284221Abstract: Systems and methods for generating a virtual view of a scene captured by a physical camera are described. The physical camera captures an input image with multiple pixels. A desired pose of a virtual camera for showing the virtual view is set. The actual pose of the physical camera is determined, and an epipolar geometry between the actual pose of the physical camera and the desired pose of the virtual camera is defined. The input image and depth data of the pixels of the input image are resampled in epipolar coordinates. A controller performs disparity estimation of the pixels of the input image and a deep neural network, DNN, corrects disparity artifacts in the output image for the desired pose of the virtual camera. The complexity of correcting disparity artifacts in the output image by a DNN is reduced by using epipolar geometry.Type: ApplicationFiled: March 2, 2021Publication date: September 8, 2022Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Michael Slutsky, Albert Shalumov
-
Publication number: 20170046811Abstract: A computer implemented method of producing output pixels for a graphics system includes the steps of receiving one or more input pixels from the graphics system; performing rendering operations on the one or more pixels, wherein the rendering including the steps of: selecting one or more pixels of interest the resolution of which are to be increased; defining a sampling grid or a sampling orientation; multi sampling the one or more pixels of interest having a first resolution and multiple sampling points; collecting information from each sampled point; storing information from each sampled point as a virtual pixel; defining one or more pixels the resolution of which are one of to remain the same as received from the graphics system or the resolution of which are to be reduced; and rendering pixels of interest in a higher resolution than the their first resolution by rendering each virtual pixel into a physical pixel in a displayable frame or offscreen buffer.Type: ApplicationFiled: October 25, 2016Publication date: February 16, 2017Inventors: Yoel Shoshan, Albert Shalumov
-
Patent number: 9536282Abstract: A computer implemented method of producing output pixels for display in a graphics system, in which the steps include performing rendering operations on one or more pixels, wherein the rendering operations includes the steps of using a POI analyzer to determine one or more of: (a) whether a pixel is a POI or a pixel not of interest (PNOI); (b) selecting different resolutions for a POI and for a PNOI.Type: GrantFiled: December 2, 2015Date of Patent: January 3, 2017Assignee: LUCIDLOGIX TECHNOLOGIES LTD.Inventors: Yoel Shoshan, Albert Shalumov
-
Patent number: 9508121Abstract: A computer implemented method of producing output pixels for a graphics system includes the steps of receiving one or more input pixels from the graphics system; performing rendering operations on the one or more pixels, wherein the rendering including the steps of: selecting one or more pixels of interest the resolution of which are to be increased; defining a sampling grid or a sampling orientation; multi sampling the one or more pixels of interest having a first resolution and multiple sampling points; collecting information from each sampled point; storing information from each sampled point as a virtual pixel; defining one or more pixels the resolution of which are one of to remain the same as received from the graphics system or the resolution of which are to be reduced; and rendering pixels of interest in a higher resolution than the their first resolution by rendering each virtual pixel into a physical pixel in a displayable frame or offscreen buffer.Type: GrantFiled: January 14, 2015Date of Patent: November 29, 2016Assignee: LUCIDLOGIX TECHNOLOGIES LTD.Inventors: Yoel Shoshan, Albert Shalumov
-
Publication number: 20160203578Abstract: A computer implemented method of producing output pixels for display in a graphics system, in which the steps include performing rendering operations on one or more pixels, wherein the rendering operations includes the steps of using a POI analyzer to determine one or more of: (a) whether a pixel is a POI or a pixel not of interest (PNOI); (b) selecting different resolutions for a POI and for a PNOI.Type: ApplicationFiled: December 2, 2015Publication date: July 14, 2016Inventors: Yoel Shoshan, Albert Shalumov
-
Publication number: 20160203583Abstract: A computer implemented method of producing output pixels for a graphics system includes the steps of receiving one or more input pixels from the graphics system; performing rendering operations on the one or more pixels, wherein the rendering including the steps of: selecting one or more pixels of interest the resolution of which are to be increased; defining a sampling grid or a sampling orientation; multi sampling the one or more pixels of interest having a first resolution and multiple sampling points; collecting information from each sampled point; storing information from each sampled point as a virtual pixel; defining one or more pixels the resolution of which are one of to remain the same as received from the graphics system or the resolution of which are to be reduced; and rendering pixels of interest in a higher resolution than the their first resolution by rendering each virtual pixel into a physical pixel in a displayable frame or offscreen buffer.Type: ApplicationFiled: January 14, 2015Publication date: July 14, 2016Inventors: Yoel Shoshan, Albert Shalumov