Signal Formatting Patents (Class 348/43)
  • Patent number: 11558641
    Abstract: An image coding method according to the present document comprises the steps of: deriving transform coefficients for a current block on the basis of residual-related information; and generating residual samples of the current block on the basis of the transform coefficients. The residual-related information comprises low frequency non-separable transform (LFNST) index information, showing information relating to non-separable transform for low-frequency transform coefficients of the current block, on the basis of a matrix-based intra-prediction (MIP) flag showing whether or not MIP is applied to the current block. The residual samples are generated from the transform coefficients on the basis of the LFNST index information.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: January 17, 2023
    Assignee: LG Electronics Inc.
    Inventors: Junghak Nam, Jaehyun Lim, Moonmo Koo, Seunghwan Kim
  • Patent number: 11544418
    Abstract: Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include superimposing a first 3D model of an object onto the 2D environment, and replacing the first 3D model of the object with a second 3D model of an object. Further, the method may include superimposing a smart 3D model of an object onto the 2D environment. Additionally, the method may include a code or mark to identify images of the 2D environment to which 3D models of objects have been superimposed.
    Type: Grant
    Filed: March 20, 2020
    Date of Patent: January 3, 2023
    Assignee: WEST TEXAS TECHNOLOGY PARTNERS, LLC
    Inventor: Milos Jovanovic
  • Patent number: 11539778
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: December 27, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11539926
    Abstract: According to an embodiment, an image projection device outputting an image to a screen comprises an input unit receiving an image from an outside, a sensor unit sensing a viewer's position and gaze direction, a controller correcting the received image into a preset model based on the viewer's position and gaze direction sensed by the sensor unit, and an output unit outputting the preset model.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: December 27, 2022
    Inventors: Seon Kyu Yoon, Sung Kuk Chun, Ha Mong Shim, Sungjoon Kim
  • Patent number: 11528412
    Abstract: An apparatus for stitching together multiple camera images to form a blended image having an output projection format. The apparatus is configured to convert each of the multiple camera images into the output projection format. It is configured to stitch together the converted images to form a single image. It is also configured to output the single image as the blended image having the output projection format.
    Type: Grant
    Filed: June 21, 2018
    Date of Patent: December 13, 2022
    Assignee: Avago Technologies International Sales Pte. Limited
    Inventors: James Andrew Hutchinson, Thomas Oscar Miller, Stephen John Barlow, Jack Stuart Haughton
  • Patent number: 11528509
    Abstract: A video transmission method that includes predicting, from a texture picture or a depth picture of an anchor viewing position, a picture for a target viewing position on the basis of target viewing position information and processing a prediction error with respect to the predicted picture on the basis of a source picture of the target viewing position. An error-prone region map is generated on the basis of the predicted picture and the source picture. The video transmission method also includes patch packing the prediction error-processed picture on the basis of the error-prone region map and encoding the packed patch on the basis of the texture picture or the depth picture of the anchor viewing position.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: December 13, 2022
    Assignee: LG Electronics Inc.
    Inventors: Hyunmook Oh, Sejin Oh
  • Patent number: 11516266
    Abstract: Techniques are described enabling users to transfer the association of a cloud-managed video encoding or decoding device from one region of a cloud provider network to another. A video processing service of a cloud provider network enables users to purchase video encoding or decoding devices that can be used to encode and reliably transfer video content to the video processing service from locations of the users' choice. The video processing service receives a request to transfer the association of a video encoding or decoding device from one region of the cloud provider to another and the video processing service executes workflows that enable the association of a video encoding or decoding device to be transferred to one region from another.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: November 29, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Akhil Ramachandran, Sai Rahul Kasula, Matthew Rives Vegas, Darin J. Klaas, Brian J. Rundle, Gregory Truax, Kevin Moore
  • Patent number: 11516453
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that enable processing to be performed simply, and a program. By converting a point cloud representing a three-dimensional structure into two dimensions, a geometry image and a texture image, and three-dimensional information metadata required for constructing the geometry image and the texture image in three dimensions are obtained. Then, one PC sample included in a Point Cloud displayed at a specific time is generated by storing the geometry image, the texture image, and the three-dimensional information metadata in accordance with a playback order required at a time of reproducing and playing back the geometry image and the texture image in three dimensions on the basis of the three-dimensional information metadata. It is possible to apply to a data generation device that generates data for distribution of a Point Cloud.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: November 29, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami
  • Patent number: 11496540
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: November 8, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11488635
    Abstract: Disclosed are a method an electronic device and a computer storage medium for generating a video. The method includes: receiving a video generating instruction, wherein the video generating instruction is generated in response to a user operation on a video generating link on a video playback page; obtaining video templates based on the video generating instruction, where the video templates comprises a first video template, and the first video template is a template adopted by a current video shown on the video playback page; determining a target template based on the video template; and generating the video based on the target template.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: November 1, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Qian Wang, Paliwan Pahaerding, Ying Shu, Chang Sun
  • Patent number: 11489900
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: November 1, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11490126
    Abstract: At lease a computer program product is provided for efficiently encoding or decoding a video frame. The computer program product when executed by one or more processors configures the one or more processors to compress or encode the different video subsections within the video frame with different compression methods. The visual artifact is reduced between the different video subsections encoded or compressed with the different compression methods within the video frame.
    Type: Grant
    Filed: June 13, 2022
    Date of Patent: November 1, 2022
    Inventor: Yendo Hu
  • Patent number: 11483534
    Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: October 25, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Kug Jin Yun, Jun Young Jeong, Gwang Soon Lee, Hong Chang Shin, Ho Min Eum
  • Patent number: 11480707
    Abstract: An optoelectronic sensor for detecting objects in a monitored zone is provided, wherein the sensor has a scanning unit that is movable about an axis of rotation and that has a plurality of scanning modules accommodated therein for a periodic scanning of the monitored zone and for a generation of corresponding received signals and that has a control and evaluation unit for acquiring information on the objects from the received signals; and wherein the scanning modules each comprise a light transmitter for transmitting a light beam and a light receiver for generating a respective received signal from the light beam remitted by the objects. A respective mirror element is here associated with the scanning modules to set an angle of elevation of a respective scanning plane detected by a scanning module with respect to a central scanning plane perpendicular to the axis of rotation.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: October 25, 2022
    Assignee: SICK AG
    Inventors: Sascha Steinkogler, Roland Gehring, Konrad Winterer
  • Patent number: 11483592
    Abstract: A system is provided for efficiently encoding and decoding a video frame with different subsections to improve and reduce visual distortion. The system comprises an encoder for encoding the different video subsections within the video frame with different compression methods. The system also comprises a correspond decoder for decoding the encoded video frame by the encoder. Therefore, the visual distortion is reduced between the different video subsections encoded with the different compression methods.
    Type: Grant
    Filed: June 13, 2022
    Date of Patent: October 25, 2022
    Inventor: Yendo Hu
  • Patent number: 11483536
    Abstract: A method and a device provide for transmitting information representing a viewpoint in a 3D scene represented with a set of volumetric video contents; receiving a first volumetric video content of the set, the first volumetric video content being according to a range of points of view comprising the viewpoint, the first volumetric video content being represented with a set of first patches, each of which corresponds to a 2D parametrization of a first group of points in a 3D part of the 3D scene associated with the first volumetric video content, and at least one first patch refers to an area of a second patch corresponding to a 2D parametrization of a second group of points in another 3D part of the 3D scene associated with a second volumetric video content of the set of volumetric video contents.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: October 25, 2022
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Julien Fleureau, Renaud Dore, Charles Salmon-Legagneur, Remi Houdaille
  • Patent number: 11475232
    Abstract: A method for processing an image, which is performed by an image processing apparatus, is provided. The method includes acquiring a first image including an object and a second image including an object identical to the object in the first image under the same condition, acquiring three-dimensional direction information of a specific part of the object in the first image, and providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: October 18, 2022
    Assignee: Suprema Inc.
    Inventors: Hyogi Lee, Kideok Lee, Bong Seop Song
  • Patent number: 11458393
    Abstract: A method of generating a representation of a virtual environment includes obtaining a mesh of at least part of the virtual environment; detecting the continuous and non-overlapping portions of that mesh, hereafter ‘patches’; populating a texture map with representations of the patches by, for successive patches in order of large to small, identifying a position on the texture map where a current patch meets a non-overwrite criterion, wherein the a non-overwrite criterion requires that texels corresponding to the current patch do not overwrite texels of any previously positioned patch, and successive positions for each current patch are tested at intervals starting from a common origin position; and associating the current patch with the identified position; setting colour values for the texels of the texture map responsive to colour information corresponding to the obtained mesh; and outputting the obtained mesh and texture map for use by a third party.
    Type: Grant
    Filed: October 23, 2019
    Date of Patent: October 4, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Andrew Swann, Hugh Alexander Dinsdale Spencer
  • Patent number: 11463497
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: October 4, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11457220
    Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes determining, for encoding a current video block of a video into a bitstream representation of the current video block, a type of neighboring samples of the current video block to be used according to a rule, and adding, based on the determining, an encoded representation of the current video block to the bitstream representation, where the current video block is encoded using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: September 27, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11457053
    Abstract: A computerized method for transmitting one or more video streams, the method may include receiving at least one input video stream that comprises visual information obtained from multiple fields of view that differ from each other; converting the at least one input video stream to a group of encoded independent self-contained video streams (EISCVSs), by performing a codec-agnostic process; wherein different EISCVSs comprise visual information from different spatial segments of the at least one input video stream; receiving a first request to receive video information related to a first direction related to a first user; generating a first video stream that comprises a first sub-set of EISCVSs that is related to the first direction; and sending the first video stream to a device of the first user, over a first communication link that has a first bandwidth that is lower than a bandwidth required to convey the input video stream.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: September 27, 2022
    Assignee: DAZN MEDIA ISRAEL LTD.
    Inventors: Guy Zisman, Amir Segev
  • Patent number: 11457242
    Abstract: A method of decoding video data includes decoding, from a coded video bitstream and as an unsigned integer 0-th order Exp-Golomb-coded syntax element with the left bit first, a value that specifies a target recovery point picture for a current picture of a current sequence of pictures, wherein the target recovery point picture is located at or after the current picture in display order; and recovering decoding of the current sequence of pictures at the target recovery point picture.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: September 27, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Muhammed Zeyd Coban, Adarsh Krishnan Ramasubramonian, Vadim Seregin, Marta Karczewicz
  • Patent number: 11425387
    Abstract: A method of processing video data includes determining, by processing circuitry, a plurality of neighboring samples for predicting a current block. The plurality of neighboring samples are arranged outside of a region of a current picture, the region comprising the current block, a row of samples adjacent to a top row of the current block, and a column of samples adjacent to a left column of the current block. The method further comprises deriving, by the processing circuitry, local illumination compensation information for the current block using the plurality of neighboring samples and generating, by the processing circuitry, a prediction block using the local illumination compensation information.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: August 23, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Kai Zhang, Li Zhang, Wei-Jung Chien, Marta Karczewicz
  • Patent number: 11418838
    Abstract: High frame rate image data having backward compatibility is favorably transmitted. Image data of each picture of a base layer included in a base stream sent from a transmission side has been subjected to a mixing process in a linear space or a non-linear space. On a reception side, the inverse mixing process can be performed appropriately by performing in a corresponding space on the basis of processing space information indicating whether or not the mixing process is performed in the linear space or the non-linear space.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: August 16, 2022
    Assignee: SATURN LICENSING LLC
    Inventor: Ikuo Tsukagoshi
  • Patent number: 11412204
    Abstract: A camera, including: two imaging systems each comprising a different optical path corresponding to a different viewing angle of an object; one or more illumination sources; a mask disposed with multiple pairs of apertures, wherein each aperture of each aperture pair corresponds to a different one of the imaging systems; at least one detector configured to acquire multiple image pairs of the object from the two imaging systems via the multiple pairs of apertures; and a processor configured to produce from the multiple acquired image pairs a multi-layer three dimensional reconstruction of the object.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: August 9, 2022
    Assignee: CHERRY IMAGING LTD.
    Inventors: Vardit Eckhouse, David Aziz
  • Patent number: 11386570
    Abstract: According to one embodiment, a measurement method includes: acquiring a first picture including a background image and a substance, the substance allowing transmission of light from the background image; acquiring a second picture including the background image and the substance in a different positional relation with respect to the first picture; and calculating a first displacement amount representing a difference in position of the background image between the first picture and the second picture.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: July 12, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Kiminori Toya, Hiroshi Ohno
  • Patent number: 11388612
    Abstract: A communication terminal device is a glasses-type communication terminal device having an optically transmissive display mounted thereon. The communication terminal device includes first and second radio-frequency modules that perform radio-frequency signal processing and a baseband module that is connected to the first and second radio-frequency modules via communication lines so as to be communicable and that performs baseband signal processing. The first and second radio-frequency modules are selectively switched by the baseband module to perform a reception operation. When the first radio-frequency module performs the reception operation, a reception signal received by the first radio-frequency module is retransmitted from the second radio-frequency module.
    Type: Grant
    Filed: January 6, 2021
    Date of Patent: July 12, 2022
    Assignee: MURATA MANUFACTURING CO., LTD.
    Inventors: Ryuken Mizunuma, Satoshi Tanaka, Yasuhisa Yamamoto, Akiko Itabashi
  • Patent number: 11388445
    Abstract: At least a method and an apparatus are provided for efficiently encoding or decoding a video frame to smooth out or reduce visual distortions such as mosquito noise between different video subsections encoded with different compression methods within a video frame. For example, a plurality of surrounding neighboring video subsections of the video frame are compressed using a first compression method (e.g., inter coding), with an associated first compression parameter set. The center video subsection of the video frame is twice compressed, first with the same first compression method, then with a different, second compression method (e.g., intra coding). Therefore, the mosquito noise or visual artifact is reduced between the video subsections encoded with the different compression methods.
    Type: Grant
    Filed: March 10, 2022
    Date of Patent: July 12, 2022
    Inventor: Yendo Hu
  • Patent number: 11386874
    Abstract: A system performs image stabilization of a display in a vehicle, in particular a motor vehicle. The system includes at least one display, in particular a monitor, for visualization; at least one sensor, in particular an acceleration sensor; and a computer unit, in particular an on-board computer. The system is designed to detect, by way of the sensor, a shock to the vehicle, in particular as a result of unevenness of the roadway, and to carry out on the basis thereof, a compensation calculation by use of the computer unit and to output a correction signal to the display, in order to stabilize the visualization on the display.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: July 12, 2022
    Assignee: Bayerische Motoren Werke Aktiengesellschaft
    Inventors: Georg Burkhard, Elisabeth Schmidt
  • Patent number: 11381740
    Abstract: An image pickup apparatus, image processing apparatus and corresponding program and method are disclosed. In one example, a second captured image acquired from another apparatus is aligned with a first captured image. Image stabilization is carried out in response to a positional relation between the captured images. For example, when overlapping between the captured images is equal to or smaller than an image stabilization limitation threshold value, the image stabilization is stopped or a correction range is limited for at least one of the captured images. When the amount of overlapping is larger than the image stabilization limitation threshold value, the image stabilization for both of the captured images is carried out without limitation. The captured images are aligned with each other by using the captured image with limited image stabilization, or both captured images where stabilization is carried out without limitation, thereby producing a panoramic image.
    Type: Grant
    Filed: January 12, 2021
    Date of Patent: July 5, 2022
    Assignee: Sony Group Corporation
    Inventors: Kazuhiro Shimauchi, Daisuke Tahara, Nobuho Ikeda, Atsushi Kimura
  • Patent number: 11367251
    Abstract: The disclosed technology presents a device and a method, respectively, for generating an augmented reality (AR) image (or AR video). The device configures to obtain a first image of a scene, obtain a second image of an object, obtain a depth range, and capture a third image of only the parts of the scene inside the depth range. Further, the device configures to generate occlusion information based on the third image, and overlay the first image and the second image based on the occlusion information to generate the AR image.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: June 21, 2022
    Assignee: IMEC vzw
    Inventor: Maarten Rosmeulen
  • Patent number: 11361458
    Abstract: A three-dimensional geometry measurement apparatus includes: a relationship identification part that identifies a combination of a first imaging pixel and a second imaging pixel corresponding to the same projection coordinate; a determination part that determines, whether or not at least one of the first imaging pixel or the second imaging pixel is a defective pixel on the basis of a distance between a projection pixel of the projection image; and a geometry measurement part that measures a geometry of an object to be measured using the first imaging pixel or the second imaging pixel corresponding to the combination, for which the first imaging pixel and the second imaging pixel that are determined to be not the defective pixel.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: June 14, 2022
    Assignee: MITUTOYO CORPORATION
    Inventor: Kaoru Miyata
  • Patent number: 11343524
    Abstract: A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 24, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 11340736
    Abstract: Provided is an image display method for performing drawing in a display region overlapping at least with a part of an external scene in a state in which the external scene is visible. The image display method images a region including the display region, and extracts an operating object from a captured image in which this region is imaged, as a region of a color of the operating object. In accordance with a size of the region of the color thus extracted, a drawing mode of the operating object is changed, and image display in the display region is controlled in accordance with the changed drawing mode. As the control of the image display, for example, performing drawing, and moving or replicating a drawn image is assumed.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: May 24, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Takashi Tomizawa, Hiroaki Baba
  • Patent number: 11341677
    Abstract: A position estimation apparatus, a tracker, a position estimation method, and a program which enable estimation of the position or orientation of each of plural trackers in a common coordinate system are provided. A point cloud storage section (80) stores a common point cloud with positions expressed using a common coordinate system. A position estimation section (86) estimates the position or orientation of a first tracker in the common coordinate system on the basis of the common point cloud and first feature point data. The position estimation section (86) estimates the position or orientation of a second tracker in the common coordinate system on the basis of the common point cloud and second feature point data.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: May 24, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Yoshinori Ohashi
  • Patent number: 11343488
    Abstract: A system for encoding and decoding a video coding block of a multi-view video signal is provided. A decoder is configured to decode a texture-depth video coding block (t0, d0) of a first texture frame and a first depth map associated with a first view for providing a decoded texture-depth video coding block (t0, d0) and the first depth map. A synthesized predicted texture-depth video coding block (tsyn, dsyn) of a view synthesis texture frame and a view synthesis depth map associated with a second view is generated. An inpainted synthesized predicted texture-depth video coding block is generated. Based on the impainted predicted texture-depth video block, the decoder reconstructs a texture-depth video coding block (t1, d1) of a second texture frame and a second depth map associated with the second view. An encoder is configured to encode the texture-depth video coding block in a manner that complements the decoding provided by the decoder.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: May 24, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 11341740
    Abstract: An object identification method and an object identification device, the object identification method comprises: capturing color images and depth images that are aligned; performing motion detection on the captured color images and depth images to acquire a motion start frame and a motion end frame; comparing the motion end frame with the motion start frame in the color images to acquire a set of motion pixels; performing connected component analysis on the acquired set of motion pixels to obtain at least one connected component; and identifying an object in the at least one connected component.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: May 24, 2022
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Tong Liu, Xiangyang Liu, Zhiguo Zhang, Hui Rao
  • Patent number: 11343489
    Abstract: There is provided an image encoding/decoding method and apparatus. The image encoding method of the present invention includes: generating at least one candidate block including warped reference picture (WRP) Flag information in an advanced motion vector prediction (AMVP) mode; constructing a candidate list including the at least one candidate block; and generating a prediction block of a current block based on the candidate list.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: May 24, 2022
    Assignees: Electronics and Telecommunications Research Institute, UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
    Inventors: Jung Won Kang, Ha Hyun Lee, Sung Chang Lim, Jin Ho Lee, Hui Yong Kim, Gwang Hoon Park, Tae Hyun Kim, Dae Young Lee
  • Patent number: 11336965
    Abstract: Provided are a method and apparatus for processing a video bitstream, a network device and a readable storage medium. The method includes: parsing a bitstream to be extracted, and acquiring parameter information about an extractable sub-bitstream from a data unit of the bitstream to be extracted; determining a picture type parameter value of a random access picture in the sub-bitstream according to the parameter information; and configuring, in a process of extracting the sub-bitstream from the bitstream to be extracted, a picture type parameter value in a data unit of the sub-bitstream according to the picture type parameter value of the random access picture.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: May 17, 2022
    Assignee: Xi'An Zhongxing New Software Co., Ltd.
    Inventors: Ming Li, Zhao Wu, Ping Wu, Xiaoquan Hua
  • Patent number: 11328748
    Abstract: A recording medium includes a video stream of a standard-luminance range and a video stream of high-luminance range, which are used selectively in accordance with a playback environment. The recording medium also includes a subtitle stream of the standard-luminance range and a subtitle stream of the high-luminance range, which are used selectively in accordance with the playback environment. A playlist file includes a management region where playback control information relating to a main stream is stored, and includes an extended region. The management region stores first playback control information specifying playing of the video stream of the high-luminance range and the subtitle stream of the high-luminance range in combination. The extended region stores second playback control information specifying playing of the video stream of the standard-luminance range and the subtitle stream of the standard-luminance range in combination.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: May 10, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hiroshi Yahata, Tadamasa Toma
  • Patent number: 11327317
    Abstract: [Problem] To provide an information processing apparatus, an information processing method, and a program. [Solution] An information processing apparatus including a display control unit that causes a display unit to display a virtual image in a three-dimensional space. The display control unit causes the display unit to display only one of a left-eye image and a right-eye image corresponding to the virtual image if it is determined that the virtual image is located outside of a predetermined range in a depth direction when viewed from a user of the display unit, and causes the display unit to display the left-eye image and the right-eye image if it is determined that the virtual image is located inside of the predetermined range.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: May 10, 2022
    Assignee: SONY CORPORATION
    Inventors: Kazuma Aiki, Ryo Fukazawa, Jun Kimura
  • Patent number: 11330301
    Abstract: The present application provides a method and a device of encoding and decoding based on free viewpoint, and relates to the technical field of video encoding. The method includes: generating a planar splicing image and splice information based on multiple single-viewpoint videos at a server side; generating a planar splicing video based on the planar splicing image; generating camera side information of the planar splicing video based on camera side information existing in the multiple single-viewpoint videos; and encoding the planar splicing video, the splice information and the camera side information of the planar splicing video to generate a planar splicing video bit stream, and decoding a planar splicing video bit stream to acquire a virtual viewpoint according to viewpoint information of a viewer at client side.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: May 10, 2022
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Zhenyu Wang, Wen Gao
  • Patent number: 11323734
    Abstract: A method includes receiving an input video stream and scaling the input video stream into two or more spatial layers. For each spatial layer, the method also includes generating a temporal layer prediction pattern by: obtaining a temporal base layer for a corresponding spatial layer; identifying, based on the temporal base layer, a plurality of temporal layers and a plurality of temporal time slots during a temporal period; and aligning the temporal base layer for the corresponding spatial layer with one of the temporal time slots during the temporal period. Each temporal time slot is associated with one of the temporal base layer or one of the plurality of temporal layers for the corresponding spatial layer. The temporal base layer for each corresponding spatial layer is aligned with a different temporal time slot than each other temporal base layer for each other corresponding spatial layer.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: May 3, 2022
    Assignee: Google LLC
    Inventor: Michael Horowitz
  • Patent number: 11315271
    Abstract: A point cloud intensity completion method and system based on semantic segmentation are provided. The point cloud intensity completion method includes: acquiring an RGB image and point cloud data of a road surface synchronously by a photographic camera and a lidar; performing spatial transformation on the point cloud data by using a conversion matrix to generate a two-dimensional reflection intensity projection map and a two-dimensional depth projection map; performing reflection intensity completion on the RGB image and the two-dimensional reflection intensity projection map to obtain a single-channel reflection intensity projection map; performing depth completion on the RGB image and the two-dimensional depth projection map to obtain a single-channel depth projection map; and performing coarse-grained completion on the RGB image, the single-channel reflection intensity projection map and the single-channel depth projection map to obtain a two-dimensional coarse-grained reflectance intensity projection map.
    Type: Grant
    Filed: September 25, 2021
    Date of Patent: April 26, 2022
    Assignee: TSINGHUA UNIVERSITY
    Inventors: Jun Li, Xinyu Zhang, Zhiwei Li, Zhenhong Zou, Yi Huang
  • Patent number: 11317074
    Abstract: A method for transmitting data for a three-dimensional image is provided. The method comprises the steps of: generating a plurality of voxelized points corresponding to a plurality of voxels, respectively, from a plurality of points constituting a three-dimensional image; grouping the plurality of voxelized points into a plurality of segments, wherein each of the plurality of segments includes at least one of the plurality of voxelized points; for each segment, projecting the plurality of points and generating a plurality of two-dimensional images; generating a packed two-dimensional image from the generated plurality of two-dimensional images; decoding data for the packed two-dimensional image, and encapsulating same; and transmitting the decoded and encapsulated data.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: April 26, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jihwan Woo, Sungryeul Rhyu
  • Patent number: 11310523
    Abstract: A method of video decoding performed by a video decoder includes receiving a coded video bitstream containing a current picture. The method includes determining whether a current block in the current picture is coded in intra block copy (IBC) mode. The method includes in response to a determination that the current block is coded in IBC mode, determining whether a mode with a motion vector offset is enabled for the IBC encoded current block. The method further includes in response to a determination that the mode with the motion vector offset is enabled for the IBC encoded current block, decoding the current block in accordance with an offset associated with the current block. Furthermore, the fractional offsets are not permitted for the IBC encoded current block.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: April 19, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 11302021
    Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: April 12, 2022
    Assignee: SONY CORPORATION
    Inventor: Hiroshi Oryoji
  • Patent number: 11303872
    Abstract: Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: April 12, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Praveen Babu J D, Sean Christopher Riley
  • Patent number: 11297298
    Abstract: A method for processing 360-degree image data by a device for receiving a 360-degree video according to the present invention comprises the steps of: receiving 360-degree image data; obtaining information relating to an encoded picture and metadata from the 360-degree image data, wherein the metadata includes camera lens information; decoding a picture including a target circular area on the basis of the information relating to the encoded picture; and rendering the target circular area by processing same on the basis of the camera lens information.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: April 5, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyunmook Oh, Sejin Oh
  • Patent number: RE49308
    Abstract: Provided is a scalable video-decoding method based on multiple layers. The scalable video-decoding method according to the present invention comprises: a step of predicting first filter information of a video to be filtered using the information contained in an object layer and/or information contained in another layer, and generating second filter information in accordance with the prediction; and a step of filtering the video to be filtered using the second filter information. According to the present invention, the amount of information being transmitted is reduced, and video compression performance is improved.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: November 22, 2022
    Inventors: Sung Chang Lim, Hui Yong Kim, Se Yoon Jeong, Suk Hee Cho, Jong Ho Kim, Ha Hyun Lee, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Hae Chul Choi