Signal Formatting Patents (Class 348/43)
  • Patent number: 10129558
    Abstract: This disclosure relates to processing video data, including processing video data that is represented by an HDR/WCG color representation. In accordance with one or more aspects of the present disclosure, one or more Supplemental Enhancement Information (SEI) Messages may be used to signal syntax elements and or other information that allow a video decoder or video postprocessing device to reverse the dynamic range adjustment (DRA) techniques of this disclosure to reconstruct the original or native color representation of the video data. Dynamic range adjustment (DRA) parameters may be applied to video data in accordance with one or more aspects of this disclosure in order to make better use of an HDR/WCG color representation, and may include the use of global offset values, as well as local scale and offset values for partitions of color component values.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: November 13, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Dmytro Rusanovskyy, Joel Sole Rojals, Sungwon Lee, Done Bugdayci Sansli, Marta Karczewicz
  • Patent number: 10117629
    Abstract: Imaging techniques that may be used in applications such as differential phase contrast imaging are disclosed that include, for example, configuring a beam source and a beam detector such that a beam connects the two, positioning an object, a phase grating and an analyzer grating in the beam path, producing multiple data sets based on various analyzer grating positions, and conducting a regression analysis using a predetermined function having a set of fitting coefficients to establish those fitting coefficients. In those techniques, the fitting coefficients may be used to characterize a set of interference properties associated with the object.
    Type: Grant
    Filed: December 3, 2015
    Date of Patent: November 6, 2018
    Assignee: Board of Supervisors of Louisiana State University and Agricultural and Mechanical College
    Inventors: Leslie G. Butler, Kyungmin Ham, Warren W. Johnson
  • Patent number: 10123022
    Abstract: In a picture encoding device and a picture decoding device, the access to a reference frame memory is suppressed. The picture encoding device is comprised of a first encoder for intra picture encoding, a second encoder for inter picture encoding, and an intermediate buffer. A local decoded picture generated by the first encoder is stored as a reference picture in the intermediate buffer, and the inter picture encoding by the second encoder is performed by referring to the local decoded picture in the intermediate buffer. A picture decoding device is comprised of a first decoder for intra picture decoding, a second decoder for inter picture decoding, and an intermediate buffer. A local decoded picture generated by the first decoder is stored as a reference picture in the intermediate buffer, and the inter picture decoding by the second decoder is performed by referring the local decoded picture in the intermediate buffer.
    Type: Grant
    Filed: June 24, 2015
    Date of Patent: November 6, 2018
    Assignee: RENESAS ELECTRONICS CORPORATION
    Inventors: Toshiyuki Kaya, Seiji Mochizuki, Tetsuya Shibayama, Kenichi Iwata, Hiroshi Ueda, Ren Imaoka
  • Patent number: 10110922
    Abstract: A method of illumination compensation for three-dimensional or multi-view encoding and decoding. The method incorporates an illumination compensation flag only if the illumination compensation is enabled and the current coding unit is processed by one 2N×2N prediction unit. The illumination compensation is applied to the current coding unit according to the illumination compensation flag. The illumination compensation flag is incorporated when the current coding unit is coded in Merge mode without checking whether a current reference picture is an inter-view reference picture.
    Type: Grant
    Filed: April 3, 2014
    Date of Patent: October 23, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Kai Zhang, Yi-Wen Chen, Jicheng An, Jian-Liang Lin
  • Patent number: 10110925
    Abstract: A method of video coding utilizing ARP (advanced residual prediction) by explicitly signaling the temporal reference picture or deriving the temporal reference picture at the encoder and the decoder using identical process is disclosed. To encode or decode a current block in a current picture from a dependent view, a corresponding block in a reference view corresponding to the current block is determined based on a DV (disparity vector). For the encoder side, the temporal reference picture in the reference view of the corresponding block is explicitly signaled using syntax element(s) in the slice header or derived using an identical process as the decoder. For the decoder side, the temporal reference picture in the reference view of the corresponding block is determined according to the syntax element(s) in the slice header or derived using an identical process as the decoder. The temporal reference picture is then used for ARP.
    Type: Grant
    Filed: September 15, 2014
    Date of Patent: October 23, 2018
    Assignee: HFI Innovation Inc.
    Inventors: Jian-Liang Lin, Yi-Wen Chen, Yu-Wen Huang, Yu-Lin Chang
  • Patent number: 10104142
    Abstract: A data processing device, data processing method, program, recording medium, and data processing system have a data size calculation unit that calculates the data size of a joined frame generated if an assumption is made that a first frame inside a first video stream and a second frame inside a second video stream are joined; a header creation unit that creates a header for a multiplexed stream including a joined video stream, using the data size information for the joined frame; a joined video stream generation unit that generates the joined video stream; and a multiplexed stream output unit that performs header output processing for the multiplexed stream or outputs the multiplexed stream including the joined video stream.
    Type: Grant
    Filed: August 5, 2014
    Date of Patent: October 16, 2018
    Assignee: THE UNIVERSITY OF ELECTRO-COMMUNICATIONS
    Inventor: Hiroyuki Kasai
  • Patent number: 10091485
    Abstract: A method of encoding and reconstructing a depth image using color image information includes segmenting a color image and a depth image corresponding to the color image into block units, selecting a position of a pixel sampling value from each block of the depth image using the color image information, and encoding the pixel sampling value of the selected position as depth information.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: October 2, 2018
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventor: Han Shin Lim
  • Patent number: 10085040
    Abstract: A prediction vector generation device generating a prediction vector of a disparity vector of a target block in a non-base viewpoint image includes a conversion pixel determination unit determining at least one pixel position in a depth block corresponding to the target block in a depth map corresponding to the non-base viewpoint image, a disparity vector conversion unit calculating a representative value of a depth value of the at least one pixel position determined by the conversion pixel determination unit and converting the representative value into a disparity vector, and a prediction vector determination unit generating the prediction vector of the disparity vector of the target block by using the disparity vector generated by the disparity vector conversion unit. This prediction vector generation device provides good encoding efficiency and suppresses increases in the amount of computation.
    Type: Grant
    Filed: July 11, 2017
    Date of Patent: September 25, 2018
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tadashi Uchiumi, Tomohiro Ikai, Yoshiya Yamamoto
  • Patent number: 10085041
    Abstract: A method and apparatus for depth lookup table (DLT) signaling in a three-dimensional and multi-view coding system. The method identifies one or more pictures to be processed. If one or more pictures contain depth data, then the method determines the DLT associated with said one or more pictures, applies predictive coding to the DLT based on the previous DLT, includes syntax related to the DLT in the PPS, and includes first bit-depth information related to first depth samples of the DLT in the PPS. The first bit-depth information is consistent with second bit depth information signaled in a sequence level. The method further signals the PPS in a video bitstream for a sequence including said one or more pictures. A circuit is also provided that embodies circuitry configured to carry out the operations specified above.
    Type: Grant
    Filed: September 6, 2017
    Date of Patent: September 25, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Kai Zhang, Jicheng An, Xianguo Zhang, Han Huang
  • Patent number: 10075700
    Abstract: The present disclosure improves 3D representation (by means of adjusting disparity between pictures) in stereoscopic or autostereoscopic images in order to better fit the natural viewing geometry by modifying each image of a stereo pair with a geometric transform centered on an intersection point of an imaging plane and a gaze direction for each of eyes. An observer's view is modeled independently for the left and right eyes, and the left and right views are processed independently with the goal to re-align pixel directions for each of eyes to make these directions more in correspondence with natural vision for the observer.
    Type: Grant
    Filed: September 23, 2015
    Date of Patent: September 11, 2018
    Assignee: Thomson Licensing
    Inventors: Laurent Blonde, Cyril Vienne, Thai-Quan Huynh-Thu
  • Patent number: 10075696
    Abstract: The invention is related to a method of determining a disparity information associated with at least a block of pixel of a first view of a scene, a matrix of views comprising the first view and a plurality of second views of the scene. The first and second views are obtained by demultiplexing a raw image of the scene acquired with a plenoptic camera but are not demosaiced. The method comprises comparing a first color pattern associated with the first block of the first view with at least one second color pattern associated with at least one second block of at least one of the second views belonging to the row or the column comprising the first view in the matrix; selecting at least one second block if the associated second color pattern corresponds at least partially to the first color pattern; and determining the disparity information associated with the first block by using the selected at least one second block and the first block.
    Type: Grant
    Filed: November 26, 2014
    Date of Patent: September 11, 2018
    Assignee: THOMSON LICENSING
    Inventors: Neus Sabater, Valter Drazic, Gustavo Luiz Sandri
  • Patent number: 10070172
    Abstract: The present invention relates to the provision of a method and/or an apparatus for processing broadcast data by using an external device. The apparatus for processing the broadcast data according to one embodiment of the present invention comprises: a reception unit for receiving video data and audio data; a decoder for decoding the received video data and the received audio data; an interface unit for transmitting, to an external device, characteristics information of the video data and the audio data, and receiving, from the external device, control information for controlling the display of the decoded video data and the playback of the decoded audio data; a display unit for displaying the decoded video data on the basis of the received control information; and an audio playback unit for playing the decoded audio data on the basis of the received control information.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: September 4, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Soojin Hwang, Jongyeul Suh
  • Patent number: 10070130
    Abstract: In one example, a method of coding video data includes coding, from an encoded video bitstream, a syntax element that indicates a number of lines of video data that are in one or more of a plurality of sub-PUs of a current prediction unit (PU) of a current coding unit (CU) of video data. In this example, the method further includes determining, for each respective sub-PU of the plurality of sub-PUs, a respective vector that represents a displacement between the respective sub-PU and a respective predictor block from a plurality of previously decoded blocks of video data. In this example, the method further includes reconstructing each sub-PU of the plurality of sub-PUs based on the respective predictor blocks of video data.
    Type: Grant
    Filed: January 28, 2016
    Date of Patent: September 4, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Krishnakanth Rapaka, Vadim Seregin, Chao Pang, Marta Karczewicz
  • Patent number: 10067663
    Abstract: A system for setting a three-dimensional (3D) effect includes a memory seat for transmitting and receiving memory seat information of a driver and a 3D cluster for matching the memory seat information and 3D effect setting information and allowing the driver to set the 3D effect or set a two-dimension (2D) mode.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: September 4, 2018
    Assignee: HYUNDAI MOTOR COMPANY
    Inventor: Ju Hyuk Kim
  • Patent number: 10057559
    Abstract: A 3D source device for outputting a three-dimensional image signal, the three-dimensional image signal comprising multi-view image data, the 3D source device comprising an input for receiving image data; a generator arranged to generate the three-dimensional image signal based on the image data, the three-dimensional image signal comprising a first component comprising multiple 2D images for use in stereoscopic viewing, a second component comprising overlay data and a third component defining disparity signaling information for use in overlaying image data over the respective ones of the multiple 2D images. New disparity signaling information in a further third component overrules the disparity signaling information in the third component.
    Type: Grant
    Filed: December 2, 2011
    Date of Patent: August 21, 2018
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventor: Wiebe De Haan
  • Patent number: 10049495
    Abstract: There is provided a system for providing virtual reality content. The system includes a computing arrangement that is operable to execute image generating instructions to process the virtual reality content to generate image data, and a display arrangement that is operable to render the generated image data. The computing arrangement, when executing the image generating instructions, is operable to intercept drawing calls to one or more graphics libraries from application software that executes in operation in computing hardware of a user-wearable device of the system, or to intercept drawing calls from the one or more graphics libraries to a graphics driver of the display arrangement, wherein the user-wearable device includes the display arrangement; and to modulate camera and projection matrices of the drawing calls to create two images having a substantially hemi-spherical field of view for presentation to corresponding eyes of the user.
    Type: Grant
    Filed: January 13, 2016
    Date of Patent: August 14, 2018
    Assignee: Hashplay Inc.
    Inventors: Ingo Nadler, Jan-Philipp Alexander Mohr
  • Patent number: 10051275
    Abstract: In a general aspect, a method of encoding video content can include manipulating bits of a first view and a second view of a three-dimensional, (3D) video frame to occupy a first slice of the video frame and a second slice of the video frame, respectively. A boundary can be formed between the first and second slices. The method can also include encoding the bits of each of the first slice and the second slice separately from each other to form a first independently compressed video slice and a second independently compressed video slice. The method can further include multiplexing the first and second independently compressed video slices to form a transport stream. The transport stream can be operable to be processed to render at least one of two-dimensional (2D) video and 3D video.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: August 14, 2018
    Assignee: Google Technology Holdings LLC
    Inventor: Ajay K. Luthra
  • Patent number: 10045048
    Abstract: The present invention relates to a video decoding apparatus and a method for decoding a multi-view video, and the video decoding apparatus according to the present invention comprises: an entropy-decoding unit for entropy-decoding a bitstream and outputting video information required for decoding a current block in a depth picture; a memory for saving pictures referenced when decoding the current block; and a prediction unit for inducing a prediction sample of the current block, by using motion information of a texture picture within the same view as motion information of the current block.
    Type: Grant
    Filed: October 20, 2014
    Date of Patent: August 7, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Junghak Nam, Jin Heo, Taesup Kim, Jungdong Seo, Sehoon Yea
  • Patent number: 10038891
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: May 2, 2018
    Date of Patent: July 31, 2018
    Assignee: Dolby Laboratories Licensing Coporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 10027959
    Abstract: A video decoding method according to an embodiment of the present invention may include determining a type of a filter to be applied to a first-layer picture which a second-layer picture as a decoding target refers to; determining a filtering target of the first-layer picture to which the filter is applied; filtering the filtering target based on the type of the filter; and adding the filtered first-layer picture to a second-layer reference picture list. Accordingly, the video decoding method and an apparatus using the same may reduce a prediction error in an upper layer and enhance encoding efficiency.
    Type: Grant
    Filed: November 4, 2016
    Date of Patent: July 17, 2018
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jin Ho Lee, Jung Won Kang, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 10026217
    Abstract: In order to allow a plurality of stereoscopic image sequences to be represented with comparatively good image quality, a method is provided which comprises the following method steps: i. receiving at least two sequences of multi-colored images in parallel; ii. breaking down each image into the basic colors thereof; iii. parallel processing the parts of an image that have been broken down into the basic colors in at least one respective data channel per basic color; iv. simultaneously displaying all parts of an image that have been broken down into the basic colors, wherein sequentially the images of different image sequences follow each other.
    Type: Grant
    Filed: August 29, 2011
    Date of Patent: July 17, 2018
    Assignee: Bauhaus Universität Weimar
    Inventors: Armin Zink, Bernd Frohlich
  • Patent number: 10021363
    Abstract: An apparatus for processing a source image to generate a target image is provided. The target image includes a plurality of target pictures. The apparatus includes a first image processing circuit and a second image processing circuit. The first image processing circuit separates the source image into a first image including a first part of the source image and a second image including a second part of the source image. The second image processing circuit processes the first image to obtain a plurality of target first pictures according to a first setting, process the second image to obtain a plurality of target second pictures according to a second setting, and combine each of the target first pictures with a corresponding one of the target second pictures to obtain the plurality of target pictures. A method for processing a source image to generate a target image is also provided.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: July 10, 2018
    Assignee: Novatek Microelectronics Corp.
    Inventors: Chieh-Cheng Chen, Chih-Chia Kuo
  • Patent number: 10021367
    Abstract: A method and apparatus of three-dimensional/multi-view coding using a candidate list including a second inter-view candidate in the candidate list for Merge mode, Skip mode or AMVP based (Advanced Motion Vector Prediction based) Inter mode are disclosed. The second inter-view candidate can be derived based on already coded or decoded texture data for the candidate list to include. For example, the second inter-view candidate can be determined from the motion information associated with a corresponding block in a reference view, where the corresponding block is located according to the location of the right-bottom neighboring block and a selected disparity vector. The right-bottom neighboring block is located across from a right-bottom corner of the current texture block. The second inter-view candidate can be inserted into the candidate list only when the number of previous available candidates is smaller than a pre-specified number.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: July 10, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Jian-Liang Lin, Yi-Wen Chen
  • Patent number: 10015465
    Abstract: Stereoscopic video data and corresponding depth map data for multi-view auto-stereoscopic displays are coded using a multiplexed asymmetric image frame that combines an image data partition and a depth map data partition, wherein the size of the image data partition is different than the size of the depth map data partition. The image data partition comprises one or more of the input views while the depth map partition comprises at least a portion of the depth map data rotated with respect to the orientation of the image data in the multiplexed output image frame.
    Type: Grant
    Filed: April 4, 2014
    Date of Patent: July 3, 2018
    Assignees: Dolby International AB, Koninklijke Philips N.V.
    Inventors: Wilhelmus Henrikus Bruls, Klaas Heinrich Schueuer, Philipp Kraetzer
  • Patent number: 10009594
    Abstract: Device (100) comprises: a stereo image acquisition unit (101) for acquiring a standard image and a reference image for a stereo image; an image segmenting unit (102) for acquiring standard pixel data and reference pixel data from the stereo image; a phase correction unit (103) for carrying out for each of the pixel data a phase correction process making the values of the standard pixel data more symmetrical; a windowing unit (104) for applying a windowing function to each of the pixel data that have undergone phase correction; a phase correlation unit 105 for calculating a phase correlation value between the two pixel data that have undergone windowing; and a peak position detection unit (106) for calculating, on the basis of the phase correlation value, the parallax of a corresponding point of the reference image with respect to a standard point on the standard image.
    Type: Grant
    Filed: July 4, 2013
    Date of Patent: June 26, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takuya Nanri, Hisashi Kurokawa, Takeshi Ishihara, Hirofumi Nishimura
  • Patent number: 10009592
    Abstract: A method for processing a 3-dimensional image including an additional object in a system providing a multi-view image according to one embodiment of the present invention comprises the steps of: receiving video images and depth images from a plurality of views; configuring one additional object of additional objects displayed in the video images from the plurality of views as a reference additional object; calculating disparity between pixels of an area in which the reference additional object is displayed and a video image, which is adjacent to an edge of the reference additional object; applying a disparity value, which is larger the or equal to a value of the calculated disparity, to the reference additional object, so as to combine the reference additional object with a first view video image and a second view video image; and formatting the first view video image and the second view video image, with which the reference additional object has been combined, as 3-dimensional images.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: June 26, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Gyoyoon Lee, Jongyeul Suh
  • Patent number: 10003805
    Abstract: A video decoding method includes determining, from among a first sample and a second sample with different color components, at least one second sample that is used to correct a value of the first sample; determining a filter parameter set based on a band including the value of the first sample, wherein the band is from among a plurality of bands determined by dividing a total range of sample values into signaled intervals or predetermined intervals; and filtering a value of the at least one second sample by using the determined filter parameter set and correcting the value of the first sample by using a value obtained by the filtering, wherein the first sample is any one of a luma sample and a chroma sample, and the second sample is any one of the luma sample and the chroma sample that is not the first sample.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: June 19, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Alexander Alshin, Yong-jin Cho
  • Patent number: 10003784
    Abstract: A stereo image matching apparatus includes a processor which includes: a bit distributor distributing values of each pixel of stereo images into sequential N bits and outputting a plurality of stereo images including the sequential N bits; a plurality of cost calculators each receiving the plurality of stereo images and calculating matching cost values for each pixel of each of the stereo images; a confidence calculator calculating a matching confidence by using cost characteristics lit of the respective matching cost values calculated by the plurality of cost calculators; and a depth determiner determining that a depth value of which the matching confidence is high and the matching cost values are relatively low is a final depth value.
    Type: Grant
    Filed: December 2, 2016
    Date of Patent: June 19, 2018
    Assignee: Hyundai Motor Company
    Inventors: Dong Ha Lee, Jae Hong Lee, Tae Gon Park
  • Patent number: 9998762
    Abstract: The present invention relates to a method and an apparatus for processing video signals, and more specifically, to a method and an apparatus for processing video signals which applies deformation compensation to decode a current texture block. The present invention can increase the accuracy of an inter-prediction by obtaining the position of a block within a reference picture referenced by the current texture block, by means of using deformation compensation parameter information, and obtaining a pixel value of the block within the reference picture that is obtained from a prediction value of the current texture block.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: June 12, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Jin Heo, Jiwook Jung, Sehoon Yea, Moonmo Koo, Taesup Kim, Jaewon Sung, Eunyong Son
  • Patent number: 9998760
    Abstract: A method and apparatus for three-dimensional video encoding or decoding with conditionally constrained disparity vector are disclosed. In one embodiment, a derived DV (disparity vector) for the current texture block is determined and DV constraint is applied or is not applied to the derived DV to obtain a final derived DV. Inter-view predictive encoding or decoding is then applied to the input data utilizing at least one of selected coding tools, wherein a same final derived DV is used by all selected coding tools, and the selected coding tools comprise inter-view residual prediction, view synthesis prediction and inter-view motion parameter prediction.
    Type: Grant
    Filed: November 15, 2013
    Date of Patent: June 12, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Yi-Wen Chen, Jian-Liang Lin
  • Patent number: 9998800
    Abstract: Disclosed are a method and apparatus for providing a three-dimensional (3D) broadcast service using images with asymmetric aspect ratios and a method and apparatus for reproducing a 3D broadcast service. The method of providing the 3D broadcast service includes adjusting a second viewpoint image to be composed with a first viewpoint image into a 3D form with respect to the first viewpoint image and the second viewpoint image for 3D broadcasting, encoding the first viewpoint image and the adjusted second viewpoint image, and generating a broadcast stream of the first viewpoint image and a broadcast stream of the second viewpoint image by multiplexing the first viewpoint image and the second viewpoint image.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: June 12, 2018
    Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, HIDEA SOLUTIONS CO., LTD., KOOKMIN UNIVERSITY INDUSTRY ACADEMY COOPERATION FOUNDATION
    Inventors: Joo Young Lee, Sung Hoon Kim, Hyon Gon Choo, Jin Soo Choi, Jin Woong Kim, Suk Jin Hong, Jin Suk Kwak, Dong Wook Kang, Kyeong Hoon Jung
  • Patent number: 9998761
    Abstract: The disclosure relates to an apparatus for coding a bit stream representing a three-dimensional video comprising a sequence of views, wherein a depth map is associated to each view, the depth map comprising depth information of the view with respect to a position to the camera capturing the view, the apparatus comprising: a partitioner for partitioning the depth map into coding units; a determiner for determining a type of model function for each coding unit based on the depth information of the coding unit; a reducer for reducing the coding unit to a single residual value for each segment generated by model function; and a signaler for signaling the model function used and the residual value into the bitstream.
    Type: Grant
    Filed: January 13, 2015
    Date of Patent: June 12, 2018
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Fabian Jaeger, Mathias Wien
  • Patent number: 9992508
    Abstract: An image encoding method includes: determining whether a current picture is a TSA picture or a trailing picture; and encoding a plurality of pictures according to whether the current picture is the TSA picture or a trailing picture. The determining includes: determining the current picture to be the TSA picture when the current picture does not belong to the highest layer and corresponds to a first field, and determining the current picture to be the trailing picture when the current picture belongs to the highest layer or corresponds to a second field.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: June 5, 2018
    Assignee: SUN PATENT TRUST
    Inventors: Kengo Terada, Takahiro Nishi, Hisao Sasai
  • Patent number: 9992494
    Abstract: A method of simplified depth-based block partitioning (DBBP) for three-dimensional and multi-view video coding is disclosed. In one embodiment, the derivation of a representative value of a corresponding depth block or a reference texture block in a reference view for generating a segmentation mask and selecting a block partition are unified. In another embodiment, the first representative value, the second representative value, or both are calculated from partial samples of the corresponding depth block or the reference texture block. In yet another embodiment, a first representative value for first samples in a first partitioned block of the corresponding depth block or the reference texture block, and a second representative value for second samples in a second partitioned block of the corresponding depth block or the reference texture block for each of block partition candidates are determined.
    Type: Grant
    Filed: December 27, 2014
    Date of Patent: June 5, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Xianguo Zhang, Kai Zhang, Jicheng An, Han Huang, Jian-Liang Lin
  • Patent number: 9992513
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable efficient change of reference relationship of views in multi-view coding. In the present technology, as for inter-view reference images, a used_by_curr flag is also set to an image having a possibility of being referred, in a slice header or syntax of an SPS. Only an image with the used_by_curr flag of 1 is added to a temporal list used in generating a reference list. Therefore, the temporal list (RefPicListTemp0[rldx]) of L0 is generated in an order of a short-term (before) reference image of an index 0, a short-term (after) reference image of an index 1, and inter-view reference images of indexes 2 and 3. The present disclosure can be applied to an image processing apparatus, for example.
    Type: Grant
    Filed: December 9, 2013
    Date of Patent: June 5, 2018
    Assignee: SONY CORPORATION
    Inventors: Yoshitomo Takahashi, Ohji Nakagami
  • Patent number: 9992476
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: January 22, 2018
    Date of Patent: June 5, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 9986262
    Abstract: The present invention relates to a reference frame selection technique for an error resilience of video codec using multiple reference frames. The reference frame selection technique for an error resilience of video codec using multiple reference frames according to the present invention comprises the steps of: performing a motion estimation individually in each of the multiple reference frames so as to search a reference macroblock of the macroblock to be coded; checking the degree of match between the reference macroblock region found by the motion estimation and the intra-coded macroblock of the reference frame; and selecting the motion vector (MV) of the reference macroblock which is relatively best matched to the intra-coded macroblock of the reference frame from among the reference macroblocks found in each of the multiple reference frames.
    Type: Grant
    Filed: March 25, 2013
    Date of Patent: May 29, 2018
    Assignee: INDUSTRY-ACADEMIC COOPERATION FOUNDATION CHOSUN UNIVERSITY
    Inventors: Jae-Young Pyun, Hee-Seon Gang
  • Patent number: 9986220
    Abstract: A system for transferring 3D video information has a transmitter (100) to broadcast a signal (104) to a receiver (110). The 3D video information includes auxiliary data for display in an overlay area on the 3D video data, like subtitles. The 3D video data has a left view and a right view arranged in a 2D frame in a main arrangement, e.g. side-by-side. An auxiliary left and right view of the auxiliary data are arranged in an auxiliary data stream according to a 2D transmission format in an auxiliary arrangement that corresponds to the main arrangement, e.g. also side-by-side. In addition, a 2D version of the auxiliary data and auxiliary disparity data indicative of the disparity to be applied to the 2D version of auxiliary data when overlayed on the left view and the right view is included in the transport stream. Advantageously the receiver may use a suitable version of the auxiliary data based on the receiver processing architecture.
    Type: Grant
    Filed: July 6, 2011
    Date of Patent: May 29, 2018
    Assignee: Koninklijke Philips N.V.
    Inventors: Philip Steven Newton, Robert Albertus Brondijk, Wiebe De Haan
  • Patent number: 9980003
    Abstract: Disclosed herein is a receiving device including: a receiver configured to receive broadcast content; a trigger information acquirer configured to acquire trigger information for identifying a command to control an operation of an application program that is run in conjunction with the broadcast content and is delivered via a network; a correspondence table acquirer configured to acquire a correspondence table in which the command is associated with information for identifying the command; and a control section configured to control operations of a subject application program and another application program other than the subject application program in response to the command identified by the trigger information and the correspondence table.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: May 22, 2018
    Assignee: Saturn Licensing LLC
    Inventors: Naohisa Kitazato, Mark Eyer
  • Patent number: 9973742
    Abstract: A pair of video streams is prepared for stereoscopic display. A pair of frames is rectified. Each of the pair of frames is from a respective stream of the pair of video streams. A reduced video stream is generated by removing from one of the pair of video streams a set of correlative data that is present in or can be predicted from the other of the pair of video streams. The reduced video stream and the other of the pair of video streams are compressed for use in stereoscopic display of the reduced video stream and the other of the pair of video streams.
    Type: Grant
    Filed: November 30, 2010
    Date of Patent: May 15, 2018
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Viswanathan Swaminathan, Hyojin Kim
  • Patent number: 9972251
    Abstract: Disclosed is a method of driving an organic light emitting diode display that includes a first organic light emitting diode, and a first driving circuit to operate the first organic light emitting diode, the method includes supplying a first gate pulse and a second gate pulse to a first gate line connected to the first driving circuit, and supplying a first data signal and a first compensation signal to a data line connected to the first driving circuit.
    Type: Grant
    Filed: July 22, 2016
    Date of Patent: May 15, 2018
    Assignee: LG DISPLAY CO., LTD.
    Inventors: Ho-Jin Ryu, Seong-Hyun Kim
  • Patent number: 9961368
    Abstract: The present invention variably adjusts the maximum splitting information of a conversion unit according to the type of prediction unit and the splitting information on a coding unit and selects the optimal splitting information on the conversion unit. The present invention determines the maximum splitting information on the conversion unit of a depth block by using the maximum splitting information on the conversion unit for texture data. The present invention may lower complexity without a loss in efficiency by variably adjusting the maximum splitting information on the conversion unit in consideration of the characteristics of the depth data. The present invention may lower complexity by determining the maximum splitting information on the conversion unit of the depth data by using similar characteristics between the texture data and the depth data.
    Type: Grant
    Filed: April 24, 2013
    Date of Patent: May 1, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Jin Heo, Jiwook Jung, Sehoon Yea, Moonmo Koo, Taesup Kim, Jaewon Sung, Eunyong Son
  • Patent number: 9961370
    Abstract: A method and apparatus for a three-dimensional encoding or decoding system incorporating view synthesis prediction (VSP) with reduced computational complexity and/or memory access bandwidth are disclosed. The system applies the VSP process to the texture data only and applies non-VSP process to the depth data. Therefore, when a current texture block in a dependent view is coded according to VSP by backward warping the current texture block to the reference picture using an associated depth block and the motion parameter inheritance (MPI) mode is selected for the corresponding depth block in the dependent view, the corresponding depth block in the dependent view is encoded or decoded using non-VSP inter-view prediction based on motion information inherited from the current texture block.
    Type: Grant
    Filed: April 2, 2014
    Date of Patent: May 1, 2018
    Assignee: HFI Innovation Inc.
    Inventors: Yi-Wen Chen, Jicheng An, Jian-Liang Lin
  • Patent number: 9955861
    Abstract: A single imaging platform for making in vivo measurements of an individual's eye, where the measurements are sufficient to construct an optical model of the individual's eye. The platform includes a plenoptic opthalmic camera and an illumination module. In one configuration, the plenoptic opthalmic camera captures a plenoptic image of a corneal anterior surface of the individual's eye. In another configuration, the plenoptic opthalmic camera operates as a wavefront sensor to measure a wavefront produced by the individual's eye.
    Type: Grant
    Filed: March 7, 2016
    Date of Patent: May 1, 2018
    Assignee: Ricoh Company, Ltd.
    Inventors: Liang Gao, Ivana Tosic
  • Patent number: 9948939
    Abstract: In an example, a method of coding video data includes determining a location of a temporal reference block indicated by a temporal motion vector to a current block of video data, where the current block and the temporal reference block are located in a first layer of video data. The method also includes interpolating, with a first type of interpolation, a location of a disparity reference block indicated by a disparity vector of the current block, where the disparity reference block is located in a second, different layer, and where the first type of interpolation comprises a bi-linear filter. The method also includes determining a temporal-disparity reference block of the disparity reference block indicated by a combination of the temporal motion vector and the disparity vector, and coding the current block based on the temporal reference block, the disparity reference block, and the temporal-disparity reference block.
    Type: Grant
    Filed: December 5, 2013
    Date of Patent: April 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Ying Chen, Marta Karczewicz
  • Patent number: 9948915
    Abstract: In accordance with one or more techniques of this disclosure, a video coder may divide a current prediction unit (PU) into a plurality of sub-PUs. Each of the sub-PUs may have a size smaller than a size of the PU. Furthermore, the current PU may be in a depth view of the multi-view video data. For each respective sub-PU from the plurality of sub-PUs, the video coder may identify a reference block for the respective sub-PU. The reference block may be co-located with the respective sub-PU in a texture view corresponding to the depth view. The video coder may use motion parameters of the identified reference block for the respective sub-PU to determine motion parameters for the respective sub-PU.
    Type: Grant
    Filed: July 23, 2014
    Date of Patent: April 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Ying Chen, Li Zhang
  • Patent number: 9934575
    Abstract: According to some aspects, an image processing apparatus is provided, comprising circuitry configured to receive an input image, the input image being supplied as a stereoscopic image including a left image for a left eye and a right image for a right eye, calculate depth information for each of a plurality of sub-regions of the input image based at least in part on the right image and the left image, and determine, for each of the plurality of sub-regions of the input image, at least one luminance component based at least in part on the depth information and a function indicating a relationship between depth information and luminance value.
    Type: Grant
    Filed: June 25, 2015
    Date of Patent: April 3, 2018
    Assignee: Sony Corporation
    Inventors: Shuichi Takahashi, Takanori Ishikawa, Isao Ohashi, Satoshi Shioiri
  • Patent number: 9918067
    Abstract: The present invention is drawn to a device for use with first stereoscopic data, second stereoscopic data and a display device. The device includes an input portion, a convergence data detecting portion, a convergence plane portion, a comparing portion and a modification portion. The input portion can receive the first stereoscopic data and the second stereoscopic data. The convergence data detecting portion can detect first convergence data within the first stereoscopic data and can detect second convergence data within the second stereoscopic data. The convergence plane portion can determine a first convergence plane based on the first convergence data and can determine a second convergence plane based on the second convergence data. The comparing portion can compare the first convergence plane and the second convergence plane and can generate a convergence plane comparison. The modification portion can modify the first convergence data based on the convergence plane comparison.
    Type: Grant
    Filed: August 2, 2016
    Date of Patent: March 13, 2018
    Assignee: Texas Instruments Incorporated
    Inventors: Veeramanikandan Raju, Gregory R. Hewes
  • Patent number: 9918063
    Abstract: Provided are methods and apparatuses for encoding and decoding a multiview video. The method of decoding the multiview video includes obtaining a data unit including encoding information of texture pictures and depth map pictures of a multiview image related to a same point of time, obtaining, from the data unit, view information of pictures that are encoded and are included in the data unit, type information indicating a type of each of the pictures from among the texture pictures and the depth map pictures, and reference flag information indicating whether each of the pictures is previously inter-layer predicted by referring to a texture picture of the same point of time or to a depth map picture of the same point of time, determining an encoding order of the pictures, based on the obtained information, and decoding the texture pictures and depth map pictures based on the determined encoding order.
    Type: Grant
    Filed: October 23, 2014
    Date of Patent: March 13, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Byeong-doo Choi, Jae-hyun Kim, Jeong-hoon Park
  • Patent number: 9911344
    Abstract: A camera-based obstacle detection system includes a first camera, a second camera, and one or more processors configured to acquire a first image from the first camera, acquire a second image from the second camera, determine a depth of an object based on a location of the object in the first image relative to a location of the object in the second image, and in response to the depth exceeding a threshold depth value, generate an alert.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: March 6, 2018
    Assignee: Honeywell International Inc.
    Inventors: Tomas Kabrt, George Papageorgiou, Jean-Luc Derouineau, Tomas Marczi, Michal Orlita