Signal Formatting Patents (Class 348/43)
  • Patent number: 9838756
    Abstract: Provided is a method and apparatus for outputting an additional image independently of a reference image in a broadcasting receiver including a communicator to receive a stream of an additional image of a three-dimensional (3D) broadcast in non-real time, and receive a stream of a reference image of the 3D broadcast in real-time and a processor to generate a 3D image of the 3D broadcast based on the stream of the additional image and the stream of the reference image.
    Type: Grant
    Filed: August 27, 2014
    Date of Patent: December 5, 2017
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Kug Jin Yun, Jin Young Lee, Won Sik Cheong, Gwang Soon Lee, Nam Ho Hur
  • Patent number: 9838712
    Abstract: A method of signaling depth-based block partitioning (DBBP) for multi-view or three-dimensional (3D) video coding is disclosed. In one embodiment, the DBBP flag is signaled for all candidate prediction modes of the current texture coding unit including a non-2N×N partition mode. The group of candidate prediction modes may consist of 2N×N partition mode and N×2N partition mode. If the DBBP flag indicates the DBBP being used for the current texture coding unit, DBBP encoding is applied to the current texture coding unit or DBBP decoding is applied to one or more PUs associated with the current texture coding unit to recover the current texture coding unit. If the DBBP flag indicates the DBBP being not used for the current texture coding unit, a prediction partition mode is signaled at an encoder side or parsed at a decoder side from a CU (coding unit) level of the bitstream.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: December 5, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Jian-Liang Lin, Yi-Wen Chen, Xianguo Zhang, Kai Zhang, Jicheng An, Han Huang
  • Patent number: 9838674
    Abstract: A display including an optical element disposed on a pixel array of a display panel; an optimal viewing distance control device configured to adjust primary view images seen through both eyes of a viewer to a first view image and second view image based on a viewer's position information sensed by a sensor, to automatically adjust other view images between the primary view images to view images separated at regular intervals, and to produce a view map using the adjusted primary view images and the adjusted other view images between the primary view images; a 3D formatter configured to map pixel data of a multi-view image based on the view map received from the optimal viewing distance control device; and a display panel driving circuit configured to write the pixel data of the multi-view image received from the 3D formatter to the display panel.
    Type: Grant
    Filed: December 17, 2013
    Date of Patent: December 5, 2017
    Assignee: LG DISPLAY CO., LTD.
    Inventors: Seongho Cho, Keongjin Lee
  • Patent number: 9832479
    Abstract: A motion estimation apparatus and method (carried out electronically) provides for encoding of multiview video, such as stereoscopic video, by providing motion estimation for pixels in a dependent eye view, using motion vector information from a colocated group of pixels in a base eye view and neighboring pixels to the colocated group of pixels in the base eye view. The method and apparatus encodes a group of pixels in a dependent eye view based on the estimated motion vector information. The method and apparatus may also include obtaining a frame of pixels that includes both base eye view pixels and dependent eye pixels so that, for example, frame compatible format packing can be employed. In one example, estimating the motion vector information for a block of pixels, for example, in a dependent eye view is based on a median value calculation of motion vectors for a block of pixels in a base eye view and motion vectors for neighboring blocks of pixels to the colocated group of pixels in the base eye view.
    Type: Grant
    Filed: October 4, 2013
    Date of Patent: November 28, 2017
    Assignee: ATI Technologies ULC
    Inventor: Jiao Wang
  • Patent number: 9830843
    Abstract: A 3D display driving method and a 3D glasses driving method are provided. In the 3D display driving method, after a left-eye image and a right-eye image in a stereoscopic image pair of each frame are displayed, one frame of buffer image is inserted, then a left-eye image and a right-eye image in a stereoscopic image pair of a next frame are displayed. By inserting one frame of buffer image between two consecutive frames of left-eye and right-eye image pairs, the dizziness and blurring feeling generated due to the visual persistence characteristics of the human eyes when the human brain processes different image pairs are relieved.
    Type: Grant
    Filed: October 11, 2014
    Date of Patent: November 28, 2017
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Yanbing Wu
  • Patent number: 9819945
    Abstract: A device for processing video data includes a memory configured to store at least a portion of a bitstream of multi-layer video data and one or more processors configured to generate a first video coding layer (VCL) network abstraction layer (NAL) unit for a first picture of an access unit, the first VCL NAL unit comprising a first slice type; generate a second VCL NAL unit for a second picture of the access unit, the second VCL NAL unit comprising a second slice type; and generate an access unit delimiter (AUD) NAL unit based on the first and second slice types.
    Type: Grant
    Filed: June 24, 2015
    Date of Patent: November 14, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Adarsh Krishnan Ramasubramonian
  • Patent number: 9807142
    Abstract: The embodiments of the present invention relate to methods and arrangements for accomplishing trick modes. This is achieved by assigning samples within a track to sample groups, wherein all samples within a sample group belong to one temporal level and by allowing the client to access one temporal level independently of lower temporal levels. In this way, the flexibility for the client regarding play out of different frame rates is increased which can result in a lower bandwidth utilization.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: October 31, 2017
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Per Fröjdh, Torbjörn Einarsson
  • Patent number: 9800893
    Abstract: A method and related apparatus for decoding an image sequence from a bitstream, wherein an identifier indicating if all output pictures are decodable with a predefined set of reference pictures is decoded; an indication of required reference pictures for a given output picture is decoded; the indicated at least one reference picture for the given output picture is decoded; and the at least one output picture is decoded.
    Type: Grant
    Filed: April 16, 2014
    Date of Patent: October 24, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Jani Lainema, Miska Matias Hannuksela, Kemal Ugur, Vinod Kumar Malamal Vadakital
  • Patent number: 9800865
    Abstract: The present invention concerns the field of stereoscopic vision systems and more particularly the management of the position of the focal plane in a stereoscopic scene. The invention aims to propose a method for managing the focal plane within a stereoscopic image or a sequence of stereoscopic images. A translation of the right and left images is effected in order to place the focal plane in front of the scene viewed. Advantageously, the depth of the major objects of the scene is estimated by a division of the images into a plurality of zones and estimation of the depth of each of the zones. The depth of the focal plane is then calculated so that most of the scene is behind the focal plane.
    Type: Grant
    Filed: February 21, 2012
    Date of Patent: October 24, 2017
    Assignee: NINTENDO EUROPEAN RESEARCH AND DEVELOPMENT SAS
    Inventors: Alexandre Delattre, Jerome Larrieu
  • Patent number: 9794510
    Abstract: A multi-vision device can include a first display set configured to display a first split image of an entire image of content according to a progressive scanning method; a second display set disposed on a lower side of the first display set to display a second split image of the entire image; and a control unit configured to scan the second split image on the second display set according to a reverse-progressive scanning method, invert the scanned second split image vertically and display the inverted second split image on the second display set.
    Type: Grant
    Filed: September 1, 2016
    Date of Patent: October 17, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Youngkyu Jo, Inhyuk Choi, Jungwoo Myung, Kyoungwon Min
  • Patent number: 9794543
    Abstract: An information processing apparatus for processing stereo images of an object includes a disparity calculator to calculate a disparity of the stereo images. The disparity calculator includes an evaluation value calculator to calculate a correlation evaluation value in a search range set for the stereo images; an extreme value detector to detect an extreme value of the correlation evaluation value; a threshold setting unit to set a threshold range for the detected extreme value; a counting unit to count the number of the extreme value existing within the threshold range; and an updating unit to update the set threshold range to a new threshold range when a new extreme value indicating a higher correlation level of the disparity compared to the set threshold range is detected. The counting unit counts the number of the extreme value in a threshold range updated most recently in the search range.
    Type: Grant
    Filed: February 22, 2016
    Date of Patent: October 17, 2017
    Assignee: Ricoh Company, Ltd.
    Inventors: Hiroyoshi Sekiguchi, Soichiro Yokota, Eita Watanabe, Reiko Kuromizu, Yuji Takahashi
  • Patent number: 9787970
    Abstract: The present invention concerns the field of stereoscopic photography devices and more precisely calibration thereof. The invention proposes a method for calibrating a stereoscopic photography device that calculates a set of correction parameters for the images. These parameters are classed according to an order of importance. The first-order correction parameters are estimated first, the second-order correction parameters secondly. Advantageously, the first-order parameters are refined by taking account of the estimation values of the second-order parameters. Advantageously, a measurement of the relevance of the scene is carried out before the actual calibration.
    Type: Grant
    Filed: February 22, 2012
    Date of Patent: October 10, 2017
    Assignee: NINTENDO EUROPEAN RESEARCH AND DEVELOPMENT SAS
    Inventors: Alexandre Delattre, Jérôme Larrieu
  • Patent number: 9787967
    Abstract: Embodiments of the present disclosure describe devices, methods, computer-readable media and systems configurations for signaling stereoscopic three-dimensional video content capabilities of a device in a communications network. Other embodiments may be described and claimed.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: October 10, 2017
    Assignee: Intel Corporation
    Inventor: Ozgur Oyman
  • Patent number: 9781405
    Abstract: Systems and methods provide accurate pixel depth information to be applied to a single image taken by a single camera in generating a three-dimensional (3D) image. In particular, two or more images can be captured during, e.g., lateral movement of a camera to ascertain depth in a scene on a pixel level. Use of an optical image stabilization (OIS) system that can provide at least three axes of stabilization eliminates the variability associated with conventional systems that create problems with image registration. Further still, and because actual pixel depth information is being calculated rather than merely generating stereoscopic images to trick the eyes into perceiving depth, the pixel depth information that is calculated can be leveraged in other ways, such as for providing automated measurements merely by taking a picture of an object or scene.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: October 3, 2017
    Assignee: MEMS Drive, Inc.
    Inventor: Roman Gutierrez
  • Patent number: 9781416
    Abstract: In one example of the disclosure, a method of coding video data comprises coding video data using texture-first coding, and performing an NBDV derivation process for a block of the video data using a plurality of neighboring blocks. The NBDV derivation process comprises designating a motion vector associated with a neighboring block of the plurality of neighboring blocks coded with a block-based view synthesis prediction (BVSP) mode as an available disparity motion.
    Type: Grant
    Filed: February 25, 2014
    Date of Patent: October 3, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Ying Chen, Jewon Kang
  • Patent number: 9769462
    Abstract: A system and method for combining and/or displaying text with three-dimensional content. The system and method inserts text at the same level as the highest depth value in the 3D content. One example of 3D content is a two-dimensional image and an associated depth map. In this case, the depth value of the inserted text is adjusted to match the largest depth value of the given depth map. Another example of 3D content is a plurality of two-dimensional images and associated depth maps. In this case, the depth value of the inserted text is continuously adjusted to match the largest depth value of a given depth map. A further example of 3D content is stereoscopic content having a right eye image and a left eye image. In this case the text in one of the left eye image and right eye image is shifted to match the largest depth value in the stereoscopic image. Yet another example of 3D content is stereoscopic content having a plurality of right eye images and left eye images.
    Type: Grant
    Filed: December 19, 2007
    Date of Patent: September 19, 2017
    Assignee: THOMSON Licensing
    Inventors: Izzat Izzat, Dong-Qing Zhang, Yousef Wasef Nijim
  • Patent number: 9767351
    Abstract: A method and system are disclosed for locating or otherwise generating positional information for an object, such as but not limited generating positional coordinates for an object attached to an athlete engaging in an athletic event. The positional coordinates may be processed with other telemetry and biometrical information to provide real-time performance metrics while the athlete engages in the athletic event.
    Type: Grant
    Filed: October 29, 2014
    Date of Patent: September 19, 2017
    Assignee: AvidaSports, LLC
    Inventors: Bruce J. Burton, Paul C. Duckworth, Ryan D. Johnson, Warren Guthrie
  • Patent number: 9769453
    Abstract: A method including determining an aggregate cost for pixels in a frame under construction; applying a disparity computation for the pixels in the frame under construction; and storing the frame in a memory. Determining the aggregate cost for the pixels in a frame under construction includes use of at least one previous aggregate cost for the pixels in a previous frame, where the aggregate cost is determined with use of edge-aware filtering and a minimum spanning tree (MST). The disparity computation includes use of a confidence based temporal filtering of disparities at least partially using a disparity computation for the pixels in the previous frame.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: September 19, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Veldandi Muninder, Hoseok Chang
  • Patent number: 9762863
    Abstract: The invention relates to a method of sampling and displaying information comprising scanning a beam over the sample in a series of N overlapping sub-frames, each comprising Mn scan positions, thereby irradiating the sample at N×Mn scan positions, which form the field of view; detecting a signal, sampled for each scan position, emanating from the sample; and displaying the sub-frames having at least N×Mn pixels in such a way, that after the series of N scans each of the pixels displays information derived from the signal from one or more scan positions; in which after the scan of the first sub-frame each of the pixels displays information derived from the scan positions of the first sub-frame; and after the scan of the second sub-frame each of the pixels displays information derived during the scanning of the first, the second, or both sub-frames.
    Type: Grant
    Filed: November 26, 2013
    Date of Patent: September 12, 2017
    Assignee: FEI Company
    Inventors: Pavel Poto{hacek over (c)}ek, Martinus Petrus Maria Bierhoff, Tomá{hacek over (s)} Vystav{hacek over (e)}l, Luká{hacek over (s)} Dryb{hacek over (c)}ák
  • Patent number: 9762909
    Abstract: An image decoding method supporting a plurality of layers according to the present invention may comprise the steps of: receiving location information on a location in which an inter-layer reference picture set for one or more reference layers, to which a current picture can refer, is added to a reference picture list; generating an initial reference picture list including the inter-layer reference picture set on the basis of the location information; and predicting the current picture on the basis of the initial reference picture list. Accordingly, the present invention provides a method for signaling location information on a location in which an inter-layer reference picture is added to a reference picture list, and an apparatus using the same.
    Type: Grant
    Filed: July 25, 2014
    Date of Patent: September 12, 2017
    Assignee: KT CORPORATION
    Inventors: Bae Keun Lee, Joo Young Kim
  • Patent number: 9756126
    Abstract: Provided is an information processing device including a setting unit configured to set an angle of view and a display direction of image data to be transmitted to a transmission target device within a range of an angle of view and a display direction represented by capability information based on a display state of an image represented by the image data to be transmitted to the transmission target device on a display screen or a state of an application relating to reproduction of the image data and the capability information with regard to the transmission target device representing the angle of view of the image and the display direction of the image, and a communication control unit configured to cause setting information representing a setting relating to the image data to be transmitted including the set angle of view and display direction to be transmitted to the transmission target device.
    Type: Grant
    Filed: May 22, 2014
    Date of Patent: September 5, 2017
    Assignee: Sony Corporation
    Inventor: Kunihiko Miyake
  • Patent number: 9756315
    Abstract: A picture switch is performed to select a right picture and a left picture, a right picture and a right picture, or a left picture and a left picture without changing the kind and format of a video signal before and after a switch of a 2D picture and a 3D picture of an endoscopic system, and a picture shift is performed to horizontally shift the right picture and the left picture, and the pictures are then output to a monitor.
    Type: Grant
    Filed: October 2, 2015
    Date of Patent: September 5, 2017
    Assignee: OLYMPUS CORPORATION
    Inventors: Masakazu Mizoguchi, Hiroshi Ushiroda
  • Patent number: 9756336
    Abstract: A method and apparatus for video encoding or decoding utilizing adaptive background residual prediction is disclosed. The present invention adaptively applies background residual prediction to a current block based on a selection decision. The coding block is split into one or more coding sub-blocks. A reference sub-block in a reference picture is located for a current coding sub-block of the current coding block according to a motion vector associated with the current coding block. A background reference sub-block in a background picture is located for the reference sub-block, where the background reference sub-block is at a first co-located location as the reference sub-block. The method then selects a first predictor or a second predictor to encode or decode the current sub-block based on a selection decision. The first predictor corresponds to the reference sub-block, and the second predictor is derived according to the reference sub-block and the background picture.
    Type: Grant
    Filed: November 20, 2014
    Date of Patent: September 5, 2017
    Assignee: MEDIATEK Singapore Pte. Ltd.
    Inventors: Xianguo Zhang, Kai Zhang, Jicheng An
  • Patent number: 9756330
    Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.
    Type: Grant
    Filed: May 9, 2014
    Date of Patent: September 5, 2017
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Patent number: 9754159
    Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
    Type: Grant
    Filed: March 3, 2015
    Date of Patent: September 5, 2017
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, David A. Newman
  • Patent number: 9749622
    Abstract: The way of predicting a current block by assigning constant partition values to the partitions of a bi-partitioning of a block is quite effective, especially in case of coding sample arrays such as depth/disparity maps where the content of these sample arrays is mostly composed of plateaus or simple connected regions of similar value separated from each other by steep edges. The transmission of such constant partition values would, however, still need a considerable amount of side information which should be avoided. This side information rate may be further reduced if mean values of values of neighboring samples associated or adjoining the respective partitions are used as predictors for the constant partition values.
    Type: Grant
    Filed: May 9, 2014
    Date of Patent: August 29, 2017
    Assignee: GE VIDEO COMPRESSION, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Patent number: 9743066
    Abstract: Multi-view video encoding using early Merge mode decision and/or early CU split termination is disclosed. The present invention encodes a current coding block using the Merge/Skip mode without evaluating coding performance for at least one of Inter modes and Intra modes if the coding conditions associated with the current coding block and a neighboring block set of the current coding block are asserted. The coding conditions may correspond to whether the coding performance of the Skip mode is better than the coding performance of 2N×2N Merge mode for the current coding block and whether all blocks in the neighboring block set select the Merge mode or the Skip mode. Similarly, the process of splitting the current coding block into smaller coding blocks can be terminated without evaluating coding performance associated with the smaller coding blocks from splitting the current coding block if some coding conditions are asserted.
    Type: Grant
    Filed: July 11, 2014
    Date of Patent: August 22, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Na Zhang, Jicheng An, Jian-Liang Lin, Yi-Wen Chen, Kai Zhang
  • Patent number: 9734579
    Abstract: Methods and systems for rendering a three-dimensional (3D) data model of an object are provided. An example method may include receiving information associated with a first 3D data model and a second 3D data model of an object. The method may also include rendering a first set of images of the first 3D data model, and rendering a second set of images of the second 3D data model. The method may also include comparing respective images of the first set of images to images of the second set of images to determine a plurality of image difference scores between the respective images of the first set of images and the images of the second set of images. The method may also include determining an object difference score based on the determined plurality of image difference scores.
    Type: Grant
    Filed: February 3, 2015
    Date of Patent: August 15, 2017
    Assignee: Google Inc.
    Inventors: Jonathan Weill, Dror Aiger
  • Patent number: 9736497
    Abstract: A prediction vector generation device generating a prediction vector of a disparity vector of a target block in a non-base viewpoint image includes a conversion pixel determination unit determining at least one pixel position in a depth block corresponding to the target block in a depth map corresponding to the non-base viewpoint image, a disparity vector conversion unit calculating a representative value of a depth value of the at least one pixel position determined by the conversion pixel determination unit and converting the representative value into a disparity vector, and a prediction vector determination unit generating the prediction vector of the disparity vector of the target block by using the disparity vector generated by the disparity vector conversion unit. This prediction vector generation device provides good encoding efficiency and suppresses increases in the amount of computation.
    Type: Grant
    Filed: July 2, 2013
    Date of Patent: August 15, 2017
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tadashi Uchiumi, Tomohiro Ikai, Yoshiya Yamamoto
  • Patent number: 9734392
    Abstract: An image processing device includes a processor; and a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute: acquiring a first image and a second image which are captured by cameras having optical axes different from each other; calculating a calculation length of a first portion of a user in a world coordinate system based on parallax of a camera coordinate system of a first portion which is included in the first image and the second image; and detecting non-synchronization state of image capturing timings of the first image and the second image based on a change amount of the calculation length.
    Type: Grant
    Filed: September 17, 2014
    Date of Patent: August 15, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Genta Suzuki
  • Patent number: 9736454
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding. In some embodiments the method for encoding comprises examining availability of a depth block co-located with a texture block, determining a prediction method for a texture block on the basis of availability of a co-located depth block; and deriving a first prediction block for the texture block on the basis of the availability of the co-located depth block. The method further comprises deriving a first prediction block for the texture block on the basis of the co-located depth block, if the co-located depth block is available, and otherwise deriving a second prediction block for the texture block without using the co-located depth block. There are also disclosed corresponding method for various methods, apparatuses and computer program products for video decoding.
    Type: Grant
    Filed: September 20, 2013
    Date of Patent: August 15, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Miska Matias Hannuksela, Dmytro Rusanovskyy
  • Patent number: 9729852
    Abstract: A video signal is processed in a video device (50). The video signal transfers video data representing either three dimensional video [3D] content formatted according to a 3D format or 2D content formatted according to a 2D format. The video signal has a 2D frame and a control structure of a 2D format for being compatible with existing distribution systems. The device has a processor (52) for providing a 3D status signal indicative of the format of the video signal. The processor determines a respective format score for at least one of the possible 3D formats by processing the video data according to respective predetermined format properties for deriving and comparing respective 3D subframes, and sets the 3D status signal based on an assessment of the format score to indicate the format of the video signal. Advantageously the 3D format is detected automatically and a 3D display can be controlled accordingly.
    Type: Grant
    Filed: March 29, 2016
    Date of Patent: August 8, 2017
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventor: Wilhelmus Hendrikus Alfonsus Bruls
  • Patent number: 9723291
    Abstract: A plurality of video input units generate video frames and provide shooting characteristics. A 3D video frame generator creates a 3D video frame by combining a plurality of video frames, which are provided from the plurality of video input units, respectively, and provides 3D video frame composition information indicating a composition type of the plurality of video frames included in the 3D video frame, and resolution control information indicating adjustment/non-adjustment of resolutions of the video frames. A 3D video frame encoder outputs an encoded 3D video stream by encoding the 3D video frame provided from the 3D video frame generator. A composition information checker checks 3D video composition information including the shooting information, the 3D video frame composition information, and the resolution control information. A 3D video data generator generates 3D video data by combining the 3D video composition information and the encoded 3D video stream.
    Type: Grant
    Filed: January 18, 2012
    Date of Patent: August 1, 2017
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Gun Ill Lee, Kwang-Cheol Choi, Jae-Yeon Song, Seo-Young Hwang
  • Patent number: 9716900
    Abstract: In an example, a method for video coding includes processing a Supplemental Enhancement Information (SEI) Network Abstraction Layer (NAL) unit that comprises one or more SEI message structures in a raw byte sequence payload (RBSP), such that one or more SEI message structure includes at least one nesting SEI message structure having one or more SEI messages. In various embodiments, the SEI NAL unit is processed, and a syntax element, indicative of a number of SEI messages comprised within the at least one nesting message structure, is coded.
    Type: Grant
    Filed: June 17, 2015
    Date of Patent: July 25, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Fnu Hendry, Ye-Kui Wang
  • Patent number: 9716920
    Abstract: In one example, an apparatus includes a processor configured to receive video data for two or more views of a scene, determine horizontal locations of camera perspectives for each of the two or more views, assign view identifiers to the two or more views such that the view identifiers correspond to the relative horizontal locations of the camera perspectives, form a representation comprising a subset of the two or more views, and, in response to a request from a client device, send information indicative of a maximum view identifier and a minimum view identifier for the representation to the client device.
    Type: Grant
    Filed: June 6, 2011
    Date of Patent: July 25, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Ying Chen, Peisong Chen, Marta Karczewicz
  • Patent number: 9710958
    Abstract: An image processing apparatus may include a light capturing unit to generate light environment information by photographing or capturing a light environment of an object, and an object capturing unit to generate object information by photographing or capturing the object. The image processing apparatus may further include a modeling unit to generate a 3-dimensional (3D) model by reflecting or combining the light environment information and the object information, and a rendering unit to render a resultant image with respect to at least one view using the 3D model.
    Type: Grant
    Filed: November 29, 2012
    Date of Patent: July 18, 2017
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: In Woo Ha, Tae Hyun Rhee
  • Patent number: 9704253
    Abstract: In a method for determining a depth map from stereo images, the disparity for a pixel is determined from a discrete quantity of predefined disparity values that are distributed over the entire predefined disparity value range. The distribution has at least two different distances between different pairs of adjacent disparity values. In this method, it is possible that only those disparities for which a more precise determination is required, will be more precisely calculated.
    Type: Grant
    Filed: January 14, 2014
    Date of Patent: July 11, 2017
    Assignee: Conti Temic microelectronic GmbH
    Inventors: Frederik Lange, Robert Stueck, Christian Exner, Alexander Bachmann, Gregory Baratoff
  • Patent number: 9706213
    Abstract: An image encoding method includes: determining whether a current picture is a TSA picture or a trailing picture; and encoding a plurality of pictures according to whether the current picture is the TSA picture or a trailing picture. The determining includes: determining the current picture to be the TSA picture when the current picture does not belong to the highest layer and corresponds to a first field, and determining the current picture to be the trailing picture when the current picture belongs to the highest layer or corresponds to a second field.
    Type: Grant
    Filed: June 4, 2015
    Date of Patent: July 11, 2017
    Assignee: SUN PATENT TRUST
    Inventors: Kengo Terada, Takahiro Nishi, Hisao Sasai
  • Patent number: 9699399
    Abstract: A mobile terminal which reproduces a video including image data and audio data and a control method thereof are provided. The mobile terminal which reproduces a video including image data and audio data includes a display unit configured to display an image corresponding to the image data based on a reproduction command with respect to the video, a subtitle processing unit configured to output subtitles related to the video along with the image to the display unit, and a controller configured to control the subtitle processing unit to change a display format of the subtitles according to sound characteristics of the audio data related to the image.
    Type: Grant
    Filed: November 16, 2012
    Date of Patent: July 4, 2017
    Assignee: LG ELECTRONICS INC.
    Inventor: Jihwan Kim
  • Patent number: 9699462
    Abstract: System and method embodiments are provided for achieving improved View Synthesis Distortion (VSD) calculation and more accurate distortion estimation of encoded video frames. An embodiment method includes obtaining a depth map value for a video frame and determining a weighting factor for depth distortion in accordance with the depth map value. The weighting factor maps a pixel range of the depth map value to an output function having higher values for closer image objects and lower values for farther image objects. The VSD for the video frame is then calculated as a function of absolute horizontal texture gradients weighted by a depth distortion value and the weighting factor determined in accordance with the depth map value.
    Type: Grant
    Filed: January 2, 2015
    Date of Patent: July 4, 2017
    Assignees: Futurewei Technologies, Inc., Santa Clara University
    Inventors: Zhouye Gu, Jianhua Zheng, Nam Ling, Chen-Xiong Zhang
  • Patent number: 9686567
    Abstract: The present invention relates to an integrated video encoder/decoder supporting multilayer pictures with different types. The integrated video encoder according to the present invention includes a base encoder including an encoding algorithm module to encode a base-layer picture among multilayer pictures; and a partial encoder including an additional encoding algorithm module to encode an enhancement-layer picture based on a video coding type of the multilayer pictures.
    Type: Grant
    Filed: July 10, 2014
    Date of Patent: June 20, 2017
    Assignee: UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
    Inventors: Gwang Hoon Park, Kyung Yong Kim, Young Su Heo, Yoon Jin Lee
  • Patent number: 9686526
    Abstract: There is provided a method of determining the quality of a three dimensional (3D) video stream, wherein the 3D video comprises at least one 3D view composition, each 3D view composition defining a plurality of two dimensional (2D) views. The method comprises determining a characteristic of each of a plurality of 2D views. The method further comprises calculating a variation in the characteristic, the variation calculated between the 2D views corresponding to the same 3D view composition. The method further still comprises calculating a quality score for the 3D video sequence, the quality score based upon the calculated variation.
    Type: Grant
    Filed: March 29, 2012
    Date of Patent: June 20, 2017
    Assignee: Telefonaktiebolaget L M Ericsson (publ)
    Inventors: Martin Pettersson, Usman Hakeem
  • Patent number: 9674532
    Abstract: The present invention relates to an image decoding method and to an apparatus using same. The image decoding method includes the steps of: receiving a bitstream including random access image information; and predicting the random access image and an image following the random access image in terms of a decoding sequence on the basis of the random access image information.
    Type: Grant
    Filed: June 24, 2013
    Date of Patent: June 6, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Chulkeun Kim, Joonyoung Park, Sangoh Jeong, Hendry Hendry, Byeongmoon Jeon, Jungsun Kim
  • Patent number: 9667990
    Abstract: For each respective coding unit (CU) of a slice of a picture of the video data, a video coder may set, in response to determining that the respective CU is the first CU of a coding tree block (CTB) row of the picture or the respective CU is the first CU of the slice, a derived disparity vector (DDV) to an initial value. Furthermore, the video coder may perform a neighbor-based disparity vector derivation (NBDV) process that attempts to determine a disparity vector for the respective CU. When performing the NBDV process does not identify an available disparity vector for the respective CU, the video coder may determine that the disparity vector for the respective CU is equal to the DDV.
    Type: Grant
    Filed: May 29, 2014
    Date of Patent: May 30, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Ying Chen, Li Zhang
  • Patent number: 9635357
    Abstract: In one example of the disclosure, a method of coding video data comprises coding video data using texture-first coding, and performing an NBDV derivation process for a block of the video data using a plurality of neighboring blocks. The NBDV derivation process comprises designating a motion vector associated with a neighboring block of the plurality of neighboring blocks coded with a block-based view synthesis prediction (BVSP) mode as an available disparity motion.
    Type: Grant
    Filed: February 25, 2014
    Date of Patent: April 25, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Li Zhang, Ying Chen, Jewon Kang
  • Patent number: 9635343
    Abstract: A stereoscopic endoscopic image processing apparatus includes: a synchronization adjustment portion that performs a synchronization adjustment between a left-eye image signal and a right-eye image signal; an image analysis portion that analyzes a region that an image of a treatment instrument occupies in a peripheral region around a central region in an image of one image signal; a blur region setting portion that, with respect to the image in the peripheral region around the central region in which blur processing is not performed, sets a region in which to perform blur processing in accordance with an analysis result of the image analysis portion; and an image compositing portion that composites and outputs a 3D image with respect to which blur processing is performed on the left-eye image and the right-eye image, respectively, in accordance with a setting result of the blur region setting portion.
    Type: Grant
    Filed: May 24, 2016
    Date of Patent: April 25, 2017
    Assignee: OLYMPUS CORPORATION
    Inventors: Makoto Kasumi, Masashi Umemura, Shusuke Tsuchiya
  • Patent number: 9628780
    Abstract: The present invention relates to a device and method for receiving digital broadcast signals including three-dimensional images.
    Type: Grant
    Filed: December 8, 2011
    Date of Patent: April 18, 2017
    Assignee: LG Electronics Inc.
    Inventors: Jongyeul Suh, Jeehyun Choe, Jinpil Kim, Kwansuk Kim
  • Patent number: 9628769
    Abstract: An apparatus and method for generating a disparity map in a receiving device, e.g., a set-top box, that enables user control for adjusting image depth in a stereo image set are provided. The apparatus and method provide for receiving a signal comprising a left eye image and a right eye image, encoding the left eye image as a reference image, predictively coding the right eye image using the coded left eye image as the reference image, capturing motion indicators generated during encoding of the right eye image, and generating a disparity map between the left eye image and right eye image using the motion indicators.
    Type: Grant
    Filed: February 15, 2011
    Date of Patent: April 18, 2017
    Assignee: Thomson Licensing DTV
    Inventor: Thomas Edward Horlander
  • Patent number: 9626939
    Abstract: Image information displayed on an electronic device can be adjusted based at least in part upon a relative position of a viewer with respect to a device. In some embodiments, image stabilization can be provided such that an image remains substantially consistent from the point of view of the viewer, not the display element of the device. The image can be stretched, rotated, compressed, or otherwise manipulated based at least in part upon the relative viewing position. Similarly, the viewer can move relative to the device to obtain different views, but views that are consistent with the viewer looking at an object, for example, through a piece of glass. The device can overlay information on the image that will adjust with the adjusted image. Three-dimensional modeling and display can be used to offset parallax and focus point effects.
    Type: Grant
    Filed: January 2, 2014
    Date of Patent: April 18, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Kenneth Mark Karakotsios, Isaac Scott Noble
  • Patent number: 9628771
    Abstract: A method and apparatus for reproducing a multimedia content are provided. The apparatus includes: a receiver which is configured to receive, through different paths, a first signal including a left-side image and a first synchronization information item, and a second signal including a right-side image and a second synchronization information item; and a signal processor which is configured to synchronize and reproduce the left-side image and the right-side image using the first synchronization information item and the second synchronization information item.
    Type: Grant
    Filed: December 7, 2011
    Date of Patent: April 18, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hong-seok Park, Jae-jun Lee, Yu-sung Joo, Yong-seok Jang, Hee-jean Kim, Dae-jong Lee, Moon-seok Jang, Yong-Tae Kim