Patents by Inventor Ilya Klebanov
Ilya Klebanov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10009603Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.Type: GrantFiled: June 23, 2014Date of Patent: June 26, 2018Assignee: Avago Technologies General IP (Singapore) Pte. Ltd.Inventors: Marcus Kellerman, Xuemin Chen, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 9414080Abstract: A video transmitter compresses an uncompressed 3D video into a base view video and an enhancement view video using MPEG-4 MVC standard. The video transmitter allocates bits to compressed pictures of the uncompressed 3D video based on corresponding picture type. More bits are allocated to I-pictures than P-pictures, and more bits are allocated to P-pictures than B-pictures in a given coding view. More bits are allocated to a compressed picture of the base view video than a same type compressed picture of the enhancement view video. The correlation level between the base view video and the enhancement view video is utilized for bit-allocation in video compression. More bits are allocated to a picture in a lower coding layer than to the same type picture in a higher coding layer in a given coding view. Pictures with the same cording order are identified from different view videos for a joint bit-allocation.Type: GrantFiled: August 21, 2009Date of Patent: August 9, 2016Assignee: BROADCOM CORPORATIONInventors: Xuemin Chen, Samir Hulyalkar, Marcus Kellerman, Ilya Klebanov
-
Patent number: 9218644Abstract: A video processing device may generate a two dimensional (2D) output video stream from a three dimensional (3D) input video stream that comprises a plurality of view sequences. The plurality of view sequences may comprise sequences of stereoscopic left and right reference fields or frames. A view sequence may initially be selected as a base sequence for the 2D output video stream, and the 2D output video stream may be enhanced using video content and/or information from unselected view sequences. The video content and/or information utilized in enhancing the 2D output video stream may comprise depth information, and/or foreground and/or background information. The enhancement of the 2D input video stream may comprise improving depth, contrast, sharpness, and/or rate upconversion using frame and/or field based interpolation of images in the 2D output video stream.Type: GrantFiled: January 19, 2010Date of Patent: December 22, 2015Assignee: BROADCOM CORPORATIONInventors: Marcus Kellerman, Xuemin Chen, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 9161023Abstract: An interleaved multi-view video stream is received. The interleaved multi-view video stream includes one or more first view frames, one or more second view frames, and blanking frames in a sequential pattern. The blanking frames separate the first view frames from the second view frames in the sequential pattern. The interleaved multi-view video stream is displayed in the sequential pattern. In one embodiment, the blanking frames are detected, and operation of a viewing device is synchronized based at least in part on the blanking frames being detected.Type: GrantFiled: October 29, 2012Date of Patent: October 13, 2015Assignee: BROADCOM CORPORATIONInventors: Samir Hulyalkar, Xuemin Chen, Marcus Kellerman, Ilya Klebanov, Sunkwang Hong
-
Patent number: 9049466Abstract: A video transmitter identifies regions in pictures in a compressed three-dimensional (3D) video comprising a base view video and an enhancement view video. The identified regions are not referenced by other pictures in the compressed 3D video. The identified regions are watermarked. Pictures such as a high layer picture in the base view video and the enhancement view video are identified for watermarking. The identified regions in the base view and/or enhancement view videos are watermarked and multiplexed into a transport stream for transmission. An intended video receiver extracts the base view video, the enhancement view video and corresponding watermark data from the received transport stream. The corresponding extracted watermark data are synchronized with the extracted base view video and the extracted enhancement view video, respectively, for watermark insertion. The resulting base view and enhancement view videos are decoded into a left view video and a right view video, respectively.Type: GrantFiled: October 4, 2012Date of Patent: June 2, 2015Assignee: Broadcom CorporationInventors: Xuemin Chen, Samir Hulyalkar, Marcus Kellerman, Ilya Klebanov
-
Publication number: 20150015671Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.Type: ApplicationFiled: June 23, 2014Publication date: January 15, 2015Inventors: Marcus Kellerman, Xuemin Chen, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 8913503Abstract: Systems, methods, and computer-readable storage media that may be used to encode and multiplex video are provided. One method includes receiving uncompressed three-dimensional (3D) video including a left view video and a right view video. The method further includes encoding the left view video and the right view video into a base view video and an enhancement view video. One or more pictures in the base view video that are not used to predict corresponding pictures in the enhancement view video are dropped based on available memory resources. The method further includes generating residual view video by subtracting base view pictures from corresponding enhancement view pictures, and multiplexing the base view video and the generated residual view video into a single transport stream.Type: GrantFiled: April 22, 2013Date of Patent: December 16, 2014Assignee: Broadcom CorporationInventors: Xuemin Chen, Marcus Kellerman, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 8803906Abstract: A video receiver receives a compound transport stream (TS) comprising 3D program video streams and spliced advertising streams. The received one or more 3D program video streams are extracted and decoded. Targeted advertising streams are extracted from the received advertising streams according to user criteria. Targeted advertising graphic objects of the extracted or replaced targeted advertising streams are spliced into the decoded 3D program video streams. The decoded 3D program video with the spliced targeted advertising graphic objects is presented in a 2D video. The extracted or replaced targeted advertising streams are processed to generate the targeted advertising graphic objects to be spliced based on focal point of view. The generated targeted advertising graphic objects are located according to associated scene graph information. The decoded 3D program video streams and the spliced targeted advertising graphic objects are converted into a 2D video for display.Type: GrantFiled: August 24, 2009Date of Patent: August 12, 2014Assignee: Broadcom CorporationInventors: Xuemin Chen, Samir Hulyalkar, Marcus Kellerman, Ilya Klebanov
-
Patent number: 8762846Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.Type: GrantFiled: November 16, 2009Date of Patent: June 24, 2014Assignee: Broadcom CorporationInventors: Marcus Kellerman, Xuemin Chen, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 8704932Abstract: A video processing system receives left and right 3D video and/or graphics frames and generates noise reduced left 3D video, right 3D video and/or graphics frames based on parallax compensated left and right frames. Displacement of imagery and/or pixel structures is determined relative to opposite side left and/or right frames. Parallax vectors are determined for parallax compensated left 3D video, right 3D video and/or graphics frames. A search area for displacement may be bounded by parallax limitations. Left 3D frames may be blended with the parallax compensated right 3D frames. Right 3D frames may be blended with the parallax compensated left 3D frames. The left 3D video, right 3D video and/or graphics frames comprise images that are captured, representative of and/or are displayed at a same time instant or at different time instants. Motion estimation, motion adaptation and/or motion compensation techniques may be utilized with parallax techniques.Type: GrantFiled: October 23, 2009Date of Patent: April 22, 2014Assignee: Broadcom CorporationInventors: Samir Hulyalkar, Xuemin Chen, Marcus Kellerman, Ilya Klebanov
-
Patent number: 8634025Abstract: A device for rapidly instituting an active mode of a digital-television enabled system, the system including a first, volatile memory configured to load and store software instructions, includes: an input configured to receive first digital audio and video information; a first output configured to convey second audio and information toward a display regarding the first audio and video information; at least one second output configured to convey commands to, and receive information from, the first memory; and a processor configured to perform functions in accordance with software instructions stored in first and second memories and to cause the first memory to load software instructions for provision to the processor such that first instructions for processing at least one of the first audio information and the first video information are loaded and stored by the first memory with a higher priority than second instructions for performing other functionality.Type: GrantFiled: August 18, 2011Date of Patent: January 21, 2014Assignees: Advanced Micro Devices, Inc., ATI Technologies ULCInventors: Kwok P. Hui, Ilya Klebanov
-
Publication number: 20130272566Abstract: A video transmitter identifies regions in pictures in a compressed three-dimensional (3D) video comprising a base view video and an enhancement view video. The identified regions are not referenced by other pictures in the compressed 3D video. The identified regions are watermarked. Pictures such as a high layer picture in the base view video and the enhancement view video are identified for watermarking. The identified regions in the base view and/or enhancement view videos are watermarked and multiplexed into a transport stream for transmission. An intended video receiver extracts the base view video, the enhancement view video and corresponding watermark data from the received transport stream. The corresponding extracted watermark data are synchronized with the extracted base view video and the extracted enhancement view video, respectively, for watermark insertion. The resulting base view and enhancement view videos are decoded into a left view video and a right view video, respectively.Type: ApplicationFiled: October 4, 2012Publication date: October 17, 2013Inventors: Xuemin CHEN, Samir HULYALKAR, Marcus KELLERMAN, Ilya KLEBANOV
-
Patent number: 8548063Abstract: A device and method for receiving a compressed video bit stream, and providing decoded video pixels and associated video attributes synchronously to a video processor are disclosed. A compressed video bit stream is received and decoded. The decoded pictures have associated video attributes. A subset of the video attributes is provided to a video processor interconnected to a display. The video attributes are provided synchronously with the picture or pixel data so that the attributes are available to video processor before the associated picture is displayed.Type: GrantFiled: April 13, 2006Date of Patent: October 1, 2013Assignee: Broadcom CorporationInventors: Ilya Klebanov, Allen J. Porter
-
Publication number: 20130235157Abstract: A video receiver receives a compressed 3D video comprising a base view video and a residual view video from a video transmitter. The video receiver decodes the received base view video and an enhancement view video of the received compressed 3D video into a left view video and a right view video. Base view pictures are generated selectively based on available memory resource. The residual view video is generated by subtracting base view pictures from corresponding enhancement view pictures. The received base view and residual view videos are buffered for video decoding. Pictures in the buffered residual view video are added to corresponding pictures in the buffered base view video for enhancement view decoding. The left view video and/or the right view video are generated from the resulting decoded base view and enhancement view pictures. A motion vector used for a disparity predicted macroblock is applied to adjacent macroblock pre-fetching.Type: ApplicationFiled: April 22, 2013Publication date: September 12, 2013Applicant: Broadcom CorporationInventors: XUEMIN CHEN, MARCUS KELLERMAN, SAMIR HULYALKAR, ILYA KLEBANOV
-
Patent number: 8487981Abstract: A video processor decompresses stereoscopic left and right reference frames of compressed 3D video. New left and right frames are interpolated. The frames may be stored and/or communicated for display. The left and right frames are combined into a single frame of a single stream or may be sequenced in separate left and right streams. The left and right frames are interpolated based on the combined single stream and/or based on the separate left and right streams. Motion vectors are determined for one of the separate left or right streams. The frames are interpolated utilizing motion compensation. Areas of occlusion are determined in the separate left and right streams. Pixels are interpolated for occluded areas of left or right frames of separate streams from uncovered areas in corresponding opposite side frames. The left and right interpolated and/or reference frames are displayed as 3D and/or 2D video.Type: GrantFiled: September 4, 2009Date of Patent: July 16, 2013Assignee: Broadcom CorporationInventors: Samir Hulyalkar, Xuemin Chen, Marcus Kellerman, Ilya Klebanov
-
Patent number: 8472625Abstract: A video receiver receives a compressed 3D video comprising a base view video and an enhancement view video. The base view video and the enhancement view video are encrypted using same encryption engine and buffered into corresponding coded data buffers (CDBs), respectively. The buffered base view and enhancement view videos are decrypted using same decryption engine corresponding to the encryption engine. The decrypted base view and enhancement view videos are decoded for viewing. The video receiver is also operable to encrypt video content of the received compressed 3D video according to corresponding view information and/or coding layer information. The resulting encrypted video content and unencrypted video content of the received compressed 3D video are buffered into corresponding CDBs, respectively. The buffered encrypted video content are decrypted and are decoded together with the buffered unencrypted video content of the received compressed 3D video for reviewing.Type: GrantFiled: September 16, 2009Date of Patent: June 25, 2013Assignee: Broadcom CorporationInventors: Xuemin Chen, Samir Hulyalkar, Marcus Kellerman, Ilya Klebanov
-
Patent number: 8428122Abstract: A video receiver receives a compressed 3D video comprising a base view video and a residual view video from a video transmitter. The video receiver decodes the received base view video and an enhancement view video of the received compressed 3D video into a left view video and a right view video. Base view pictures are generated selectively based on available memory resource. The residual view video is generated by subtracting base view pictures from corresponding enhancement view pictures. The received base view and residual view videos are buffered for video decoding. Pictures in the buffered residual view video are added to corresponding pictures in the buffered base view video for enhancement view decoding. The left view video and/or the right view video are generated from the resulting decoded base view and enhancement view pictures. A motion vector used for a disparity predicted macroblock is applied to adjacent macroblock pre-fetching.Type: GrantFiled: September 16, 2009Date of Patent: April 23, 2013Assignee: Broadcom CorporationInventors: Xuemin Chen, Marcus Kellerman, Samir Hulyalkar, Ilya Klebanov
-
Patent number: 8300087Abstract: A sequential pattern comprising contiguous black frames inserted between left and right 3D video and/or graphics frames may be displayed on an LCD display. The pattern may comprise two or three contiguous left frames followed by contiguous black frames followed by two or three contiguous right frames followed by contiguous black frames. The left and/or right frames may comprise interpolated frames and/or may be displayed in ascending order. The contiguous black frames are displayed longer than liquid crystal response time. 3D shutter glasses are synchronized with the black frames. A left lens transmits light when left frames followed by contiguous black frames are displayed and a right lens transmits light when right frames followed by contiguous black frames are displayed. A 3D pair of 24 Hz frames or two 3D pairs of 60 Hz frames per pattern are displayed on a 240 Hz display.Type: GrantFiled: October 23, 2009Date of Patent: October 30, 2012Assignee: Broadcom CorporationInventors: Samir Hulyalkar, Xuemin Chen, Marcus Kellerman, Ilya Klebanov, Sunkwang Hong
-
Patent number: 8300881Abstract: A video transmitter identifies regions in pictures in a compressed three-dimensional (3D) video comprising a base view video and an enhancement view video. The identified regions are not referenced by other pictures in the compressed 3D video. The identified regions are watermarked. Pictures such as a high layer picture in the base view video and the enhancement view video are identified for watermarking. The identified regions in the base view and/or enhancement view videos are watermarked and multiplexed into a transport stream for transmission. An intended video receiver extracts the base view video, the enhancement view video and corresponding watermark data from the received transport stream. The corresponding extracted watermark data are synchronized with the extracted base view video and the extracted enhancement view video, respectively, for watermark insertion. The resulting base view and enhancement view videos are decoded into a left view video and a right view video, respectively.Type: GrantFiled: September 16, 2009Date of Patent: October 30, 2012Assignee: Broadcom CorporationInventors: Xuemin Chen, Samir Hulyalkar, Marcus Kellerman, Ilya Klebanov
-
Publication number: 20120038835Abstract: A device for rapidly instituting an active mode of a digital-television enabled system, the system including a first, volatile memory configured to load and store software instructions, includes: an input configured to receive first digital audio and video information; a first output configured to convey second audio and information toward a display regarding the first audio and video information; at least one second output configured to convey commands to, and receive information from, the first memory; and a processor configured to perform functions in accordance with software instructions stored in first and second memories and to cause the first memory to load software instructions for provision to the processor such that first instructions for processing at least one of the first audio information and the first video information are loaded and stored by the first memory with a higher priority than second instructions for performing other functionality.Type: ApplicationFiled: August 18, 2011Publication date: February 16, 2012Applicants: ATI TECHNOLOGIES ULC, ADVANCED MICRO DEVICES, INC.Inventors: Ilya Klebanov, Kwok P. Hui