Signal Formatting Patents (Class 348/43)
  • Patent number: 10051275
    Abstract: In a general aspect, a method of encoding video content can include manipulating bits of a first view and a second view of a three-dimensional, (3D) video frame to occupy a first slice of the video frame and a second slice of the video frame, respectively. A boundary can be formed between the first and second slices. The method can also include encoding the bits of each of the first slice and the second slice separately from each other to form a first independently compressed video slice and a second independently compressed video slice. The method can further include multiplexing the first and second independently compressed video slices to form a transport stream. The transport stream can be operable to be processed to render at least one of two-dimensional (2D) video and 3D video.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: August 14, 2018
    Assignee: Google Technology Holdings LLC
    Inventor: Ajay K. Luthra
  • Patent number: 10049495
    Abstract: There is provided a system for providing virtual reality content. The system includes a computing arrangement that is operable to execute image generating instructions to process the virtual reality content to generate image data, and a display arrangement that is operable to render the generated image data. The computing arrangement, when executing the image generating instructions, is operable to intercept drawing calls to one or more graphics libraries from application software that executes in operation in computing hardware of a user-wearable device of the system, or to intercept drawing calls from the one or more graphics libraries to a graphics driver of the display arrangement, wherein the user-wearable device includes the display arrangement; and to modulate camera and projection matrices of the drawing calls to create two images having a substantially hemi-spherical field of view for presentation to corresponding eyes of the user.
    Type: Grant
    Filed: January 13, 2016
    Date of Patent: August 14, 2018
    Assignee: Hashplay Inc.
    Inventors: Ingo Nadler, Jan-Philipp Alexander Mohr
  • Patent number: 10045048
    Abstract: The present invention relates to a video decoding apparatus and a method for decoding a multi-view video, and the video decoding apparatus according to the present invention comprises: an entropy-decoding unit for entropy-decoding a bitstream and outputting video information required for decoding a current block in a depth picture; a memory for saving pictures referenced when decoding the current block; and a prediction unit for inducing a prediction sample of the current block, by using motion information of a texture picture within the same view as motion information of the current block.
    Type: Grant
    Filed: October 20, 2014
    Date of Patent: August 7, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Junghak Nam, Jin Heo, Taesup Kim, Jungdong Seo, Sehoon Yea
  • Patent number: 10038891
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: May 2, 2018
    Date of Patent: July 31, 2018
    Assignee: Dolby Laboratories Licensing Coporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 10026217
    Abstract: In order to allow a plurality of stereoscopic image sequences to be represented with comparatively good image quality, a method is provided which comprises the following method steps: i. receiving at least two sequences of multi-colored images in parallel; ii. breaking down each image into the basic colors thereof; iii. parallel processing the parts of an image that have been broken down into the basic colors in at least one respective data channel per basic color; iv. simultaneously displaying all parts of an image that have been broken down into the basic colors, wherein sequentially the images of different image sequences follow each other.
    Type: Grant
    Filed: August 29, 2011
    Date of Patent: July 17, 2018
    Assignee: Bauhaus Universität Weimar
    Inventors: Armin Zink, Bernd Frohlich
  • Patent number: 10027959
    Abstract: A video decoding method according to an embodiment of the present invention may include determining a type of a filter to be applied to a first-layer picture which a second-layer picture as a decoding target refers to; determining a filtering target of the first-layer picture to which the filter is applied; filtering the filtering target based on the type of the filter; and adding the filtered first-layer picture to a second-layer reference picture list. Accordingly, the video decoding method and an apparatus using the same may reduce a prediction error in an upper layer and enhance encoding efficiency.
    Type: Grant
    Filed: November 4, 2016
    Date of Patent: July 17, 2018
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jin Ho Lee, Jung Won Kang, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 10021367
    Abstract: A method and apparatus of three-dimensional/multi-view coding using a candidate list including a second inter-view candidate in the candidate list for Merge mode, Skip mode or AMVP based (Advanced Motion Vector Prediction based) Inter mode are disclosed. The second inter-view candidate can be derived based on already coded or decoded texture data for the candidate list to include. For example, the second inter-view candidate can be determined from the motion information associated with a corresponding block in a reference view, where the corresponding block is located according to the location of the right-bottom neighboring block and a selected disparity vector. The right-bottom neighboring block is located across from a right-bottom corner of the current texture block. The second inter-view candidate can be inserted into the candidate list only when the number of previous available candidates is smaller than a pre-specified number.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: July 10, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Jian-Liang Lin, Yi-Wen Chen
  • Patent number: 10021363
    Abstract: An apparatus for processing a source image to generate a target image is provided. The target image includes a plurality of target pictures. The apparatus includes a first image processing circuit and a second image processing circuit. The first image processing circuit separates the source image into a first image including a first part of the source image and a second image including a second part of the source image. The second image processing circuit processes the first image to obtain a plurality of target first pictures according to a first setting, process the second image to obtain a plurality of target second pictures according to a second setting, and combine each of the target first pictures with a corresponding one of the target second pictures to obtain the plurality of target pictures. A method for processing a source image to generate a target image is also provided.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: July 10, 2018
    Assignee: Novatek Microelectronics Corp.
    Inventors: Chieh-Cheng Chen, Chih-Chia Kuo
  • Patent number: 10015465
    Abstract: Stereoscopic video data and corresponding depth map data for multi-view auto-stereoscopic displays are coded using a multiplexed asymmetric image frame that combines an image data partition and a depth map data partition, wherein the size of the image data partition is different than the size of the depth map data partition. The image data partition comprises one or more of the input views while the depth map partition comprises at least a portion of the depth map data rotated with respect to the orientation of the image data in the multiplexed output image frame.
    Type: Grant
    Filed: April 4, 2014
    Date of Patent: July 3, 2018
    Assignees: Dolby International AB, Koninklijke Philips N.V.
    Inventors: Wilhelmus Henrikus Bruls, Klaas Heinrich Schueuer, Philipp Kraetzer
  • Patent number: 10009594
    Abstract: Device (100) comprises: a stereo image acquisition unit (101) for acquiring a standard image and a reference image for a stereo image; an image segmenting unit (102) for acquiring standard pixel data and reference pixel data from the stereo image; a phase correction unit (103) for carrying out for each of the pixel data a phase correction process making the values of the standard pixel data more symmetrical; a windowing unit (104) for applying a windowing function to each of the pixel data that have undergone phase correction; a phase correlation unit 105 for calculating a phase correlation value between the two pixel data that have undergone windowing; and a peak position detection unit (106) for calculating, on the basis of the phase correlation value, the parallax of a corresponding point of the reference image with respect to a standard point on the standard image.
    Type: Grant
    Filed: July 4, 2013
    Date of Patent: June 26, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takuya Nanri, Hisashi Kurokawa, Takeshi Ishihara, Hirofumi Nishimura
  • Patent number: 10009592
    Abstract: A method for processing a 3-dimensional image including an additional object in a system providing a multi-view image according to one embodiment of the present invention comprises the steps of: receiving video images and depth images from a plurality of views; configuring one additional object of additional objects displayed in the video images from the plurality of views as a reference additional object; calculating disparity between pixels of an area in which the reference additional object is displayed and a video image, which is adjacent to an edge of the reference additional object; applying a disparity value, which is larger the or equal to a value of the calculated disparity, to the reference additional object, so as to combine the reference additional object with a first view video image and a second view video image; and formatting the first view video image and the second view video image, with which the reference additional object has been combined, as 3-dimensional images.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: June 26, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Gyoyoon Lee, Jongyeul Suh
  • Patent number: 10003784
    Abstract: A stereo image matching apparatus includes a processor which includes: a bit distributor distributing values of each pixel of stereo images into sequential N bits and outputting a plurality of stereo images including the sequential N bits; a plurality of cost calculators each receiving the plurality of stereo images and calculating matching cost values for each pixel of each of the stereo images; a confidence calculator calculating a matching confidence by using cost characteristics lit of the respective matching cost values calculated by the plurality of cost calculators; and a depth determiner determining that a depth value of which the matching confidence is high and the matching cost values are relatively low is a final depth value.
    Type: Grant
    Filed: December 2, 2016
    Date of Patent: June 19, 2018
    Assignee: Hyundai Motor Company
    Inventors: Dong Ha Lee, Jae Hong Lee, Tae Gon Park
  • Patent number: 10003805
    Abstract: A video decoding method includes determining, from among a first sample and a second sample with different color components, at least one second sample that is used to correct a value of the first sample; determining a filter parameter set based on a band including the value of the first sample, wherein the band is from among a plurality of bands determined by dividing a total range of sample values into signaled intervals or predetermined intervals; and filtering a value of the at least one second sample by using the determined filter parameter set and correcting the value of the first sample by using a value obtained by the filtering, wherein the first sample is any one of a luma sample and a chroma sample, and the second sample is any one of the luma sample and the chroma sample that is not the first sample.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: June 19, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Alexander Alshin, Yong-jin Cho
  • Patent number: 9998762
    Abstract: The present invention relates to a method and an apparatus for processing video signals, and more specifically, to a method and an apparatus for processing video signals which applies deformation compensation to decode a current texture block. The present invention can increase the accuracy of an inter-prediction by obtaining the position of a block within a reference picture referenced by the current texture block, by means of using deformation compensation parameter information, and obtaining a pixel value of the block within the reference picture that is obtained from a prediction value of the current texture block.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: June 12, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Jin Heo, Jiwook Jung, Sehoon Yea, Moonmo Koo, Taesup Kim, Jaewon Sung, Eunyong Son
  • Patent number: 9998760
    Abstract: A method and apparatus for three-dimensional video encoding or decoding with conditionally constrained disparity vector are disclosed. In one embodiment, a derived DV (disparity vector) for the current texture block is determined and DV constraint is applied or is not applied to the derived DV to obtain a final derived DV. Inter-view predictive encoding or decoding is then applied to the input data utilizing at least one of selected coding tools, wherein a same final derived DV is used by all selected coding tools, and the selected coding tools comprise inter-view residual prediction, view synthesis prediction and inter-view motion parameter prediction.
    Type: Grant
    Filed: November 15, 2013
    Date of Patent: June 12, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Yi-Wen Chen, Jian-Liang Lin
  • Patent number: 9998761
    Abstract: The disclosure relates to an apparatus for coding a bit stream representing a three-dimensional video comprising a sequence of views, wherein a depth map is associated to each view, the depth map comprising depth information of the view with respect to a position to the camera capturing the view, the apparatus comprising: a partitioner for partitioning the depth map into coding units; a determiner for determining a type of model function for each coding unit based on the depth information of the coding unit; a reducer for reducing the coding unit to a single residual value for each segment generated by model function; and a signaler for signaling the model function used and the residual value into the bitstream.
    Type: Grant
    Filed: January 13, 2015
    Date of Patent: June 12, 2018
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Fabian Jaeger, Mathias Wien
  • Patent number: 9998800
    Abstract: Disclosed are a method and apparatus for providing a three-dimensional (3D) broadcast service using images with asymmetric aspect ratios and a method and apparatus for reproducing a 3D broadcast service. The method of providing the 3D broadcast service includes adjusting a second viewpoint image to be composed with a first viewpoint image into a 3D form with respect to the first viewpoint image and the second viewpoint image for 3D broadcasting, encoding the first viewpoint image and the adjusted second viewpoint image, and generating a broadcast stream of the first viewpoint image and a broadcast stream of the second viewpoint image by multiplexing the first viewpoint image and the second viewpoint image.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: June 12, 2018
    Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, HIDEA SOLUTIONS CO., LTD., KOOKMIN UNIVERSITY INDUSTRY ACADEMY COOPERATION FOUNDATION
    Inventors: Joo Young Lee, Sung Hoon Kim, Hyon Gon Choo, Jin Soo Choi, Jin Woong Kim, Suk Jin Hong, Jin Suk Kwak, Dong Wook Kang, Kyeong Hoon Jung
  • Patent number: 9992508
    Abstract: An image encoding method includes: determining whether a current picture is a TSA picture or a trailing picture; and encoding a plurality of pictures according to whether the current picture is the TSA picture or a trailing picture. The determining includes: determining the current picture to be the TSA picture when the current picture does not belong to the highest layer and corresponds to a first field, and determining the current picture to be the trailing picture when the current picture belongs to the highest layer or corresponds to a second field.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: June 5, 2018
    Assignee: SUN PATENT TRUST
    Inventors: Kengo Terada, Takahiro Nishi, Hisao Sasai
  • Patent number: 9992513
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable efficient change of reference relationship of views in multi-view coding. In the present technology, as for inter-view reference images, a used_by_curr flag is also set to an image having a possibility of being referred, in a slice header or syntax of an SPS. Only an image with the used_by_curr flag of 1 is added to a temporal list used in generating a reference list. Therefore, the temporal list (RefPicListTemp0[rldx]) of L0 is generated in an order of a short-term (before) reference image of an index 0, a short-term (after) reference image of an index 1, and inter-view reference images of indexes 2 and 3. The present disclosure can be applied to an image processing apparatus, for example.
    Type: Grant
    Filed: December 9, 2013
    Date of Patent: June 5, 2018
    Assignee: SONY CORPORATION
    Inventors: Yoshitomo Takahashi, Ohji Nakagami
  • Patent number: 9992476
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: January 22, 2018
    Date of Patent: June 5, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 9992494
    Abstract: A method of simplified depth-based block partitioning (DBBP) for three-dimensional and multi-view video coding is disclosed. In one embodiment, the derivation of a representative value of a corresponding depth block or a reference texture block in a reference view for generating a segmentation mask and selecting a block partition are unified. In another embodiment, the first representative value, the second representative value, or both are calculated from partial samples of the corresponding depth block or the reference texture block. In yet another embodiment, a first representative value for first samples in a first partitioned block of the corresponding depth block or the reference texture block, and a second representative value for second samples in a second partitioned block of the corresponding depth block or the reference texture block for each of block partition candidates are determined.
    Type: Grant
    Filed: December 27, 2014
    Date of Patent: June 5, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Xianguo Zhang, Kai Zhang, Jicheng An, Han Huang, Jian-Liang Lin
  • Patent number: 9986262
    Abstract: The present invention relates to a reference frame selection technique for an error resilience of video codec using multiple reference frames. The reference frame selection technique for an error resilience of video codec using multiple reference frames according to the present invention comprises the steps of: performing a motion estimation individually in each of the multiple reference frames so as to search a reference macroblock of the macroblock to be coded; checking the degree of match between the reference macroblock region found by the motion estimation and the intra-coded macroblock of the reference frame; and selecting the motion vector (MV) of the reference macroblock which is relatively best matched to the intra-coded macroblock of the reference frame from among the reference macroblocks found in each of the multiple reference frames.
    Type: Grant
    Filed: March 25, 2013
    Date of Patent: May 29, 2018
    Assignee: INDUSTRY-ACADEMIC COOPERATION FOUNDATION CHOSUN UNIVERSITY
    Inventors: Jae-Young Pyun, Hee-Seon Gang
  • Patent number: 9986220
    Abstract: A system for transferring 3D video information has a transmitter (100) to broadcast a signal (104) to a receiver (110). The 3D video information includes auxiliary data for display in an overlay area on the 3D video data, like subtitles. The 3D video data has a left view and a right view arranged in a 2D frame in a main arrangement, e.g. side-by-side. An auxiliary left and right view of the auxiliary data are arranged in an auxiliary data stream according to a 2D transmission format in an auxiliary arrangement that corresponds to the main arrangement, e.g. also side-by-side. In addition, a 2D version of the auxiliary data and auxiliary disparity data indicative of the disparity to be applied to the 2D version of auxiliary data when overlayed on the left view and the right view is included in the transport stream. Advantageously the receiver may use a suitable version of the auxiliary data based on the receiver processing architecture.
    Type: Grant
    Filed: July 6, 2011
    Date of Patent: May 29, 2018
    Assignee: Koninklijke Philips N.V.
    Inventors: Philip Steven Newton, Robert Albertus Brondijk, Wiebe De Haan
  • Patent number: 9980003
    Abstract: Disclosed herein is a receiving device including: a receiver configured to receive broadcast content; a trigger information acquirer configured to acquire trigger information for identifying a command to control an operation of an application program that is run in conjunction with the broadcast content and is delivered via a network; a correspondence table acquirer configured to acquire a correspondence table in which the command is associated with information for identifying the command; and a control section configured to control operations of a subject application program and another application program other than the subject application program in response to the command identified by the trigger information and the correspondence table.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: May 22, 2018
    Assignee: Saturn Licensing LLC
    Inventors: Naohisa Kitazato, Mark Eyer
  • Patent number: 9973742
    Abstract: A pair of video streams is prepared for stereoscopic display. A pair of frames is rectified. Each of the pair of frames is from a respective stream of the pair of video streams. A reduced video stream is generated by removing from one of the pair of video streams a set of correlative data that is present in or can be predicted from the other of the pair of video streams. The reduced video stream and the other of the pair of video streams are compressed for use in stereoscopic display of the reduced video stream and the other of the pair of video streams.
    Type: Grant
    Filed: November 30, 2010
    Date of Patent: May 15, 2018
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Viswanathan Swaminathan, Hyojin Kim
  • Patent number: 9972251
    Abstract: Disclosed is a method of driving an organic light emitting diode display that includes a first organic light emitting diode, and a first driving circuit to operate the first organic light emitting diode, the method includes supplying a first gate pulse and a second gate pulse to a first gate line connected to the first driving circuit, and supplying a first data signal and a first compensation signal to a data line connected to the first driving circuit.
    Type: Grant
    Filed: July 22, 2016
    Date of Patent: May 15, 2018
    Assignee: LG DISPLAY CO., LTD.
    Inventors: Ho-Jin Ryu, Seong-Hyun Kim
  • Patent number: 9955861
    Abstract: A single imaging platform for making in vivo measurements of an individual's eye, where the measurements are sufficient to construct an optical model of the individual's eye. The platform includes a plenoptic opthalmic camera and an illumination module. In one configuration, the plenoptic opthalmic camera captures a plenoptic image of a corneal anterior surface of the individual's eye. In another configuration, the plenoptic opthalmic camera operates as a wavefront sensor to measure a wavefront produced by the individual's eye.
    Type: Grant
    Filed: March 7, 2016
    Date of Patent: May 1, 2018
    Assignee: Ricoh Company, Ltd.
    Inventors: Liang Gao, Ivana Tosic
  • Patent number: 9961368
    Abstract: The present invention variably adjusts the maximum splitting information of a conversion unit according to the type of prediction unit and the splitting information on a coding unit and selects the optimal splitting information on the conversion unit. The present invention determines the maximum splitting information on the conversion unit of a depth block by using the maximum splitting information on the conversion unit for texture data. The present invention may lower complexity without a loss in efficiency by variably adjusting the maximum splitting information on the conversion unit in consideration of the characteristics of the depth data. The present invention may lower complexity by determining the maximum splitting information on the conversion unit of the depth data by using similar characteristics between the texture data and the depth data.
    Type: Grant
    Filed: April 24, 2013
    Date of Patent: May 1, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Jin Heo, Jiwook Jung, Sehoon Yea, Moonmo Koo, Taesup Kim, Jaewon Sung, Eunyong Son
  • Patent number: 9961370
    Abstract: A method and apparatus for a three-dimensional encoding or decoding system incorporating view synthesis prediction (VSP) with reduced computational complexity and/or memory access bandwidth are disclosed. The system applies the VSP process to the texture data only and applies non-VSP process to the depth data. Therefore, when a current texture block in a dependent view is coded according to VSP by backward warping the current texture block to the reference picture using an associated depth block and the motion parameter inheritance (MPI) mode is selected for the corresponding depth block in the dependent view, the corresponding depth block in the dependent view is encoded or decoded using non-VSP inter-view prediction based on motion information inherited from the current texture block.
    Type: Grant
    Filed: April 2, 2014
    Date of Patent: May 1, 2018
    Assignee: HFI Innovation Inc.
    Inventors: Yi-Wen Chen, Jicheng An, Jian-Liang Lin
  • Patent number: 9948915
    Abstract: In accordance with one or more techniques of this disclosure, a video coder may divide a current prediction unit (PU) into a plurality of sub-PUs. Each of the sub-PUs may have a size smaller than a size of the PU. Furthermore, the current PU may be in a depth view of the multi-view video data. For each respective sub-PU from the plurality of sub-PUs, the video coder may identify a reference block for the respective sub-PU. The reference block may be co-located with the respective sub-PU in a texture view corresponding to the depth view. The video coder may use motion parameters of the identified reference block for the respective sub-PU to determine motion parameters for the respective sub-PU.
    Type: Grant
    Filed: July 23, 2014
    Date of Patent: April 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Ying Chen, Li Zhang
  • Patent number: 9948939
    Abstract: In an example, a method of coding video data includes determining a location of a temporal reference block indicated by a temporal motion vector to a current block of video data, where the current block and the temporal reference block are located in a first layer of video data. The method also includes interpolating, with a first type of interpolation, a location of a disparity reference block indicated by a disparity vector of the current block, where the disparity reference block is located in a second, different layer, and where the first type of interpolation comprises a bi-linear filter. The method also includes determining a temporal-disparity reference block of the disparity reference block indicated by a combination of the temporal motion vector and the disparity vector, and coding the current block based on the temporal reference block, the disparity reference block, and the temporal-disparity reference block.
    Type: Grant
    Filed: December 5, 2013
    Date of Patent: April 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Ying Chen, Marta Karczewicz
  • Patent number: 9934575
    Abstract: According to some aspects, an image processing apparatus is provided, comprising circuitry configured to receive an input image, the input image being supplied as a stereoscopic image including a left image for a left eye and a right image for a right eye, calculate depth information for each of a plurality of sub-regions of the input image based at least in part on the right image and the left image, and determine, for each of the plurality of sub-regions of the input image, at least one luminance component based at least in part on the depth information and a function indicating a relationship between depth information and luminance value.
    Type: Grant
    Filed: June 25, 2015
    Date of Patent: April 3, 2018
    Assignee: Sony Corporation
    Inventors: Shuichi Takahashi, Takanori Ishikawa, Isao Ohashi, Satoshi Shioiri
  • Patent number: 9918063
    Abstract: Provided are methods and apparatuses for encoding and decoding a multiview video. The method of decoding the multiview video includes obtaining a data unit including encoding information of texture pictures and depth map pictures of a multiview image related to a same point of time, obtaining, from the data unit, view information of pictures that are encoded and are included in the data unit, type information indicating a type of each of the pictures from among the texture pictures and the depth map pictures, and reference flag information indicating whether each of the pictures is previously inter-layer predicted by referring to a texture picture of the same point of time or to a depth map picture of the same point of time, determining an encoding order of the pictures, based on the obtained information, and decoding the texture pictures and depth map pictures based on the determined encoding order.
    Type: Grant
    Filed: October 23, 2014
    Date of Patent: March 13, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Byeong-doo Choi, Jae-hyun Kim, Jeong-hoon Park
  • Patent number: 9918067
    Abstract: The present invention is drawn to a device for use with first stereoscopic data, second stereoscopic data and a display device. The device includes an input portion, a convergence data detecting portion, a convergence plane portion, a comparing portion and a modification portion. The input portion can receive the first stereoscopic data and the second stereoscopic data. The convergence data detecting portion can detect first convergence data within the first stereoscopic data and can detect second convergence data within the second stereoscopic data. The convergence plane portion can determine a first convergence plane based on the first convergence data and can determine a second convergence plane based on the second convergence data. The comparing portion can compare the first convergence plane and the second convergence plane and can generate a convergence plane comparison. The modification portion can modify the first convergence data based on the convergence plane comparison.
    Type: Grant
    Filed: August 2, 2016
    Date of Patent: March 13, 2018
    Assignee: Texas Instruments Incorporated
    Inventors: Veeramanikandan Raju, Gregory R. Hewes
  • Patent number: 9911344
    Abstract: A camera-based obstacle detection system includes a first camera, a second camera, and one or more processors configured to acquire a first image from the first camera, acquire a second image from the second camera, determine a depth of an object based on a location of the object in the first image relative to a location of the object in the second image, and in response to the depth exceeding a threshold depth value, generate an alert.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: March 6, 2018
    Assignee: Honeywell International Inc.
    Inventors: Tomas Kabrt, George Papageorgiou, Jean-Luc Derouineau, Tomas Marczi, Michal Orlita
  • Patent number: 9912965
    Abstract: Methods and apparatus for stereoscopic image encoding and decoding are described. Left and right eye images are encoded following an entropy reduction operation being applied to one of the eye images when there is a difference between the left and right images of an image pair. Information about regions of negative parallax within the entropy reduced image of an image pair is encoded along with the images. Upon decoding a sharpening filter is applied to the image in an image pair which was subjected to the entropy reduction operation. In addition edge enhancement filtering is performed on the regions of the recovered entropy reduced image which are identified in the encoded image data as regions of negative parallax. Interleaving of left and right eye images at the input of the encoder combined with entropy reduction allows for efficient encoding, storage, and transmission of 3D images.
    Type: Grant
    Filed: April 4, 2016
    Date of Patent: March 6, 2018
    Assignee: NextVR Inc.
    Inventors: David Cole, Alan McKay Moss, David Roller, Jr.
  • Patent number: 9912931
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: March 6, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 9904064
    Abstract: A double-vision-device alignment device and a double-vision-device alignment method are provided. The double-vision-device alignment device is configured to accurately align a display panel with a double-vision device, and comprising: a first chromaticity detecting unit, configured to detect a color in a first viewing region; a second chromaticity detecting unit, configured to detect a color in a second viewing region, wherein the first viewing region and the second viewing region are formed by light splitting of the double-vision device, and the first viewing region and the second viewing region correspond to different display regions of the display panel, respectively. It is judged whether an alignment is accurate by detection of a chromaticity detecting unit, which can prevent an alignment result from being affected by human factors, improve accuracy and efficiency, and reduce labor intensity, and the device can be operated by non-professionals.
    Type: Grant
    Filed: December 17, 2014
    Date of Patent: February 27, 2018
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Naifu Wu, Wei Wei, Chia Chiang Lin, Tao Wang, Chunmiao Zhou, Kun Wu
  • Patent number: 9898856
    Abstract: Systems and methods for automatically correcting apparent distortions in close range photographs that are captured using an imaging system capable of capturing images and depth maps are disclosed. In many embodiments, faces are automatically detected and segmented from images using a depth-assisted alpha matting. The detected faces can then be re-rendered from a more distant viewpoint and composited with the background to create a new image in which apparent perspective distortion is reduced.
    Type: Grant
    Filed: September 29, 2014
    Date of Patent: February 20, 2018
    Assignee: FotoNation Cayman Limited
    Inventors: Samuel Yang, Manohar Srikanth, Dan Lelescu, Kartik Venkataraman
  • Patent number: 9894369
    Abstract: An image decoding method supporting a plurality of layers according to the present invention may comprise the steps of: when an initial reference picture list of a current picture is configured, receiving flag information indicating whether reference picture set information of a reference layer to which the current picture refers is used; generating the initial reference picture list on the basis of the flag information; and predicting the current picture on the basis of the initial reference picture list. Accordingly, the present invention provides a method for generating a reference picture list including a picture of a layer, which is different from a layer to be currently encoded and decoded, and an apparatus using the same.
    Type: Grant
    Filed: July 25, 2014
    Date of Patent: February 13, 2018
    Assignee: KT CORPORATION
    Inventors: Bae Keun Lee, Joo Young Kim
  • Patent number: 9892252
    Abstract: The present disclosure generally relates to visually varying an image using parallax image layers, and more specifically, relates to visually varying presentation of an access right displayed on a mobile device to enhance verification of access to resources. The variation of multiple layers of an image may be based on sensor data detected at the mobile device.
    Type: Grant
    Filed: July 20, 2017
    Date of Patent: February 13, 2018
    Assignee: Live Nation Entertainment, Inc.
    Inventors: Adit Shukla, Duncan Lewis, Patrick Jackson
  • Patent number: 9877010
    Abstract: One exemplary embodiment involves identifying a plane defined by a plurality of three-dimensional (3D) track points rendered on a two-dimensional (2D) display, wherein the 3D track points are rendered at a plurality of corresponding locations of a video frame. The embodiment also involves displaying a target marker at the plane defined by the 3D track points to allow for visualization of the plane, wherein the target marker is displayed at an angle that corresponds with an angle of the plane. Additionally, the embodiment involves inserting a 3D object at a location in the plane defined by the 3D track points to be embedded into the video frame. The location of the 3D object is based at least in part on the target marker.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: January 23, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: James Acquavella, David Simons, Daniel M. Wilk
  • Patent number: 9866813
    Abstract: Representation and coding of multi-view images are carried out through tapestry encoding. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. The tapestry image is generated from a leftmost view image, a rightmost view image, a disparity map and an occlusion map.
    Type: Grant
    Filed: June 20, 2014
    Date of Patent: January 9, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Gregory John Ward, Timo Kunkel, Scott Daly
  • Patent number: 9860511
    Abstract: Displaying a stereo image in a favorable manner is enabled. First disparity information (disparity information corresponding to the nearest object reproduction position in a certain area of a picture display screen) and second disparity information (disparity information corresponding to the farthest object reproduction position in the certain area of the picture display screen) which are obtained for each of certain pictures of image data are inserted into a video stream, and the video stream is transmitted. On the basis of the first disparity information and the second disparity information, a receiving side is capable of checking whether or not disparity angles in a same-side direction and a crossing direction are within a certain range in which viewing does not cause any health problems, and reconfiguring left-eye image data and right-eye image data which form a stereo image if necessary.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: January 2, 2018
    Assignee: Sony Corporation
    Inventor: Ikuo Tsukagoshi
  • Patent number: 9854333
    Abstract: The present invention relates to a method and apparatus for transmitting and receiving a broadcast signal for providing HEVC based IP broadcast service. The method for transmitting a broadcast signal according to an embodiment of the present invention comprises the steps of: generating a video stream by encoding video data; generating signaling information which includes any one among information indicating the generated video stream is a HEVC video stream, information indicating the characteristic of the generated video stream, and information indicating a broadcast service on the basis of the generated video stream is the HEVC based broadcasting service; multiplexing the generated video stream and the signaling information; and transmitting the multiplexed broadcast stream.
    Type: Grant
    Filed: October 29, 2014
    Date of Patent: December 26, 2017
    Assignee: LG Electronics Inc.
    Inventors: Soojin Hwang, Jongyeul Suh, Joonhee Yoon, Hyunmook Oh
  • Patent number: 9854271
    Abstract: Hybrid video decoder supporting intermediate view synthesis of an intermediate view video from a first- and a second-view video which are predictively coded into a multi-view data signal with frames of the second-view video being spatially subdivided into sub-regions and the multi-view data signal having a prediction mode is provided, having: an extractor configured to respectively extract, from the multi-view data signal, for sub-regions of the frames of the second-view video, a disparity vector and a prediction residual; a predictive reconstructor configured to reconstruct the sub-regions of the frames of the second-view video, by generating a prediction from a reconstructed version of a portion of frames of the first-view video using the disparity vectors and a prediction residual for the respective sub-regions; and an intermediate view synthesizer configured to reconstruct first portions of the intermediate view video.
    Type: Grant
    Filed: September 6, 2016
    Date of Patent: December 26, 2017
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Thomas Wiegand, Karsten Mueller, Philipp Merkle
  • Patent number: 9848205
    Abstract: A method for predictive encoding of a depth map, includes the steps of receiving a depth map; dividing the depth map to blocks; performing quad-tree decomposition of the depth map to sub-blocks; approximating each of the sub-blocks by a plane, wherein the plane is associated with three plane points; and determining an order of coding of the sub-blocks; and providing an encoded depth map in a form of a set of planes defined by parameters. The method includes, while encoding consecutive sub-blocks: calculating predictors for the plane points of the currently-encoded sub-block (C); calculating differences between the actual values of the plane points and the values of the corresponding predictors; and providing the parameters of the plane for the currently-encoded sub-block (C) in form of the differences.
    Type: Grant
    Filed: June 29, 2015
    Date of Patent: December 19, 2017
    Assignee: POLITECHNIKA POZNANSKA
    Inventors: Marek Domanski, Tomasz Grajek, Damian Karwowski, Krzysztof Klimaszewski, Olgierd Stankiewicz, Jakub Stankowski, Krzysztof Wegner
  • Patent number: 9846972
    Abstract: A method of interaction using augmented reality may include aligning a local augmented reality (AR) view to a remote AR view of a remote user, receiving remote annotations from the remote user, sending local annotations registered to a local view to the remote user, and manipulating local view with remote and local annotations. The method may also include capturing a first video image using a camera, generating first augmented reality (AR) coordinates corresponding to the first video image, receiving second AR coordinates, 3D object information and second video frame from remote user, loading 3D content and instructions from a remote storage, and updating positions and existence of the received 3D object information and the loaded 3D content.
    Type: Grant
    Filed: April 5, 2016
    Date of Patent: December 19, 2017
    Assignee: SCOPE TECHNOLOGIES US Inc.
    Inventors: Scott Montgomerie, David Nedohin, Graham Melley
  • Patent number: 9843785
    Abstract: Stereoscopic images are subsampled and placed in a “checkerboard” pattern in an image. The image is encoded in a monoscopic video format. The monoscopic video is transmitted to a device where the “checkerboard” is decoded. Portions of the checkerboard (e.g., “black” portions) are used to reconstruct one of the stereoscopic images and the other portion of the checkerboard (e.g., “white” portions) are used to reconstruct the other image. The subsamples are, for example, taken from the image in a location coincident to the checkerboard position in which the subsamples are encoded.
    Type: Grant
    Filed: June 16, 2017
    Date of Patent: December 12, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Walter J. Husak, David Ruhoff, Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 9838712
    Abstract: A method of signaling depth-based block partitioning (DBBP) for multi-view or three-dimensional (3D) video coding is disclosed. In one embodiment, the DBBP flag is signaled for all candidate prediction modes of the current texture coding unit including a non-2N×N partition mode. The group of candidate prediction modes may consist of 2N×N partition mode and N×2N partition mode. If the DBBP flag indicates the DBBP being used for the current texture coding unit, DBBP encoding is applied to the current texture coding unit or DBBP decoding is applied to one or more PUs associated with the current texture coding unit to recover the current texture coding unit. If the DBBP flag indicates the DBBP being not used for the current texture coding unit, a prediction partition mode is signaled at an encoder side or parsed at a decoder side from a CU (coding unit) level of the bitstream.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: December 5, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Jian-Liang Lin, Yi-Wen Chen, Xianguo Zhang, Kai Zhang, Jicheng An, Han Huang