Patents Examined by Yulin Sun
-
Patent number: 11336919Abstract: There is provided an image processing apparatus and a method that can suppress an increase in the memory capacity necessary for an orthogonal transform and an inverse orthogonal transform. A submatrix as part of a transform matrix in a first size is used to derive a transform matrix in a second size that is a size smaller than the first size. The derived transform matrix is used to apply an inverse orthogonal transform to coefficient data in which a predicted residual of an image is orthogonally transformed. In this way, an image is generated. The present disclosure can be applied to, for example, an image processing apparatus, an image decoding apparatus, an image encoding apparatus, or the like.Type: GrantFiled: March 18, 2019Date of Patent: May 17, 2022Assignee: SONY CORPORATIONInventor: Takeshi Tsukuba
-
Patent number: 11323727Abstract: Systems and methods for performing polar decoding using a transformation of the coded bits prior to polar decoding and an inverse transformation of the resulting data bits after polar decoding are disclosed. In some embodiments, a method of operation of a receiving node to perform polar decoding comprises transforming a received code bit vector yN in accordance with a transformation TN to thereby provide a transformed code bit vector Y?N=YNTN, performing polar decoding of the transformed code bit vector y?N to thereby provide a transformed data bit vector v?N, and inversely transforming the transformed data bit vector v?N in accordance with an inverse transformation TN?1 to thereby provide an estimated data bit vector vN=v?NTN?1. In some embodiments, the transformation TN re-orders coded bits in the coded bit vector yN such that some future frozen bit(s) are swapped in front of some information bit(s) prior to performing polar decoding.Type: GrantFiled: February 5, 2018Date of Patent: May 3, 2022Assignee: Telefonaktiebolaget LM Ericsson (publ)Inventors: Dennis Hui, Yufei Blankenship
-
Patent number: 11308347Abstract: The invention is related to a method of determining a similarity transformation between first coordinates and second coordinates of 3D features, comprising providing a first plurality of 3D features having first coordinates in a first coordinate system which is associated with a first geometrical model of a first real object, wherein the first plurality of 3D features describes physical 3D features of the first real object, providing a second coordinate system, providing image information associated with a plurality of images captured by at least one camera, for each respective 3D feature of at least part of the first plurality of 3D features, wherein the respective 3D feature is captured by at least two of the plurality of images, determining camera poses of the at least one camera in the second coordinate system while the at least two of the plurality of images are captured, determining for the respective 3D feature a second coordinate in the second coordinate system according to the at least two of the pluType: GrantFiled: August 25, 2020Date of Patent: April 19, 2022Assignee: Apple Inc.Inventors: Daniel Ulbricht, Thomas Olszamowski
-
Patent number: 11310521Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.Type: GrantFiled: November 22, 2020Date of Patent: April 19, 2022Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
-
Patent number: 11303933Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.Type: GrantFiled: September 30, 2019Date of Patent: April 12, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 11303823Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.Type: GrantFiled: March 3, 2020Date of Patent: April 12, 2022Assignee: Proprio, Inc.Inventors: James Andrew Youngquist, David Julio Colmenares, Adam Gabriel Jones
-
Patent number: 11277634Abstract: The present invention relates to a method and apparatus for processing a video signal, which can increase the accuracy of the motion vector prediction through motion vector scaling which takes a difference in the temporal distance between reference pictures into consideration. To this end, the present invention provides a video signal processing method and a video signal processing apparatus using the same, and the method comprises the steps of: scaling at least one neighboring partition motion vector for a motion vector prediction of the current partition; scaling the neighboring partition motion vector, which has been selected, when the reference picture of the neighboring partition motion vector is different from the reference picture of the current partition; acquiring a motion vector prediction value of the current partition using the scaled motion vector; and acquiring a motion vector of the current partition using the motion vector prediction value.Type: GrantFiled: July 7, 2020Date of Patent: March 15, 2022Assignee: LG ELECTRONICS INC.Inventors: Joonyoung Park, Seungwook Park, Jaehyun Lim, Jungsun Kim, Younghee Choi, Jaewon Sung, Byeongmoon Jeon, Yongjoon Jeon
-
Patent number: 11272202Abstract: A method for coding video data is disclosed. The method comprising: receiving a rectangular array of coefficient level values having a width and a height; and for each coefficient level value included in the rectangular array, generating a corresponding transform coefficient value, wherein generating a corresponding transform coefficient value includes scaling a coefficient level value based on a quantization parameter and the width and the height of the rectangular array.Type: GrantFiled: December 27, 2017Date of Patent: March 8, 2022Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company LimitedInventors: Kiran Mukesh Misra, Jie Zhao, Christopher Andrew Segall
-
Patent number: 11272205Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.Type: GrantFiled: November 22, 2020Date of Patent: March 8, 2022Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
-
Patent number: 11259037Abstract: A method of decoding a received set of encoded data representing information that has been compressed, wherein the encoded data set is divided into a hierarchy of subsets, is provided. The method comprises: obtaining, from at least one first subset, a respective set of offset values; and decoding a plurality of second subsets, each comprising a data structure of metadata and data, to derive a series of data values, wherein each second subset corresponds to a region of the information that has been compressed. Each offset value is associated with a second subset and indicates a relative position within the encoded data set that corresponds to the earliest element of the associated second subset with respect to the position within the encoded data set that corresponds to an element of another subset of the hierarchy of subsets.Type: GrantFiled: December 6, 2018Date of Patent: February 22, 2022Assignee: V-NOVA INTERNATIONAL LIMITEDInventors: Ivan Makeev, Balázs Keszthelyi, Stergios Poularakis, Michele Sanna, Robert Ettinger
-
Patent number: 11259024Abstract: A method, computer program, and computer system for video coding is provided. Video data including one or more quantized coefficients is received. One or more index values associated with the quantized coefficients are mapped to one or more step values based on an exponential mapping. The video data is decoded based on the one or more step values.Type: GrantFiled: November 16, 2020Date of Patent: February 22, 2022Assignee: TENCENT AMERICA LLCInventors: Madhu Peringassery Krishnan, Xin Zhao, Shan Liu
-
Patent number: 11245916Abstract: The present disclosure relates to means to enable reduction of memory access in motion vector determination and/or refinement for a prediction block. In particular, the present disclosure relates to means to enable reduction of memory access in motion vector determination and/or refinement performed on a sub prediction block basis. In other words, a prediction block is split into sub prediction blocks for which at least the motion vector refinement is performed individually. The memory access window which limits the samples accessible during the motion vector determination and refinement of the sub prediction blocks does not exceed the memory access window for performing the motion vector determination and/or refinement for the prediction block.Type: GrantFiled: April 9, 2020Date of Patent: February 8, 2022Assignee: Huawei Technologies Co., Ltd.Inventors: Semih Esenlik, Zhijie Zhao, Anand Meher Kotra, Han Gao
-
Patent number: 11228752Abstract: A display device may include a panel including a plurality of pixels and an optical layer. The display device may include a processor configured to generate an image of the panel based on a location relationship between the pixels and the optical elements so that a plurality of rays corresponding to the image propagate evenly at a viewing distance. The location relationship is based on an optical parameter of the optical layer.Type: GrantFiled: April 8, 2016Date of Patent: January 18, 2022Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jinho Lee, Yang Ho Cho, Dong Kyung Nam, Juyong Park
-
Patent number: 11206423Abstract: A moving picture coding method including: determining whether or not (a) a picture including a co-located block and (b) a current picture to be coded are included in a same view, the co-located block being a block that is included in a picture different from the current picture and is at a position corresponding to a position of a current block to be coded included in the current picture; adjusting the position of the co-located block when the picture including the co-located block and the current picture are included in different views; and adding to the list an entry including a motion vector derived from the co-located block, wherein the adjusting includes: obtaining a disparity vector between the view including the picture including the co-located block and the view including the current picture; and adjusting the position of the co-located block by the obtained disparity vector.Type: GrantFiled: December 18, 2019Date of Patent: December 21, 2021Assignee: SUN PATENT TRUSTInventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu, Kengo Terada
-
Patent number: 11180085Abstract: An exterior rearview device includes a base suited to be fixed to a vehicle, a head mounted on the base, at least one of a mirror and a display attached to the head and at least one of a camera and an illumination device attached to the base, a locking system with a locked state and an unlocked state, where the head is removable from the base in the unlocked state, and the locking system is suited to be actuated by a driver of the vehicle to switch between the locked and the unlocked state, and vice versa. A vehicle includes the at least one exterior rearview device.Type: GrantFiled: June 12, 2018Date of Patent: November 23, 2021Assignee: SMR Patents S.à.r.l.Inventor: Philipp Hottmann
-
Patent number: 11184643Abstract: A system and method for processing a video stream are provided. When coding or decoding a video stream a de-blocking filtering may be applied for reducing discontinuities caused by use of a block-based video coding. The de-blocking filtering is performed using a filter grid. The size of the filter grid is chosen adaptively based on the processing parameters. The adaptive size of the filtering grid is determined based on the number of samples used and modified in de-blocking filtering of an edge of a coding block. The filtering grid may be used both for vertical and horizontal edge filtering.Type: GrantFiled: August 5, 2019Date of Patent: November 23, 2021Assignee: Huawei Technologies Co., Ltd.Inventors: Anand Meher Kotra, Semih Esenlik, Zhijie Zhao
-
Patent number: 11166012Abstract: A three-dimensional data encoding method encodes a plurality of three-dimensional points, and includes: selecting one of two or more prediction modes for calculating a predicted value of an attribute information item of the first three-dimensional point, in accordance with attribute information items of one or more second three-dimensional points in the vicinity of a first three-dimensional point; calculating the predicted value by the selected prediction mode; calculating, as a prediction residual, a difference between a value of the attribute information item of the first three-dimensional point and the calculated predicted value; and generating a bit stream that includes the one prediction mode and the prediction residual.Type: GrantFiled: December 2, 2020Date of Patent: November 2, 2021Assignee: Panasonic Intellectual Property Corporation of AmericaInventor: Toshiyasu Sugio
-
Patent number: 11138713Abstract: A camera abnormality detecting device according to an embodiment includes an acquiring section and a notifying section. The acquiring section acquires, from an image photographed by a camera provided in a conveyance body to be capable of photographing an inside of a basket placed on a basket receiving section of the conveyance body, an image of a region where an upper edge of the basket is surmised to be reflected. The notifying section notifies, based on the image acquired by the acquiring section, whether an angle of view of the camera is blocked.Type: GrantFiled: July 25, 2019Date of Patent: October 5, 2021Assignee: TOSHIBA TEC KABUSHIKI KAISHAInventor: Atsushi Okamura
-
Patent number: 11106938Abstract: An image processing apparatus generates a normal image, when lighting correction of an image is performed using three-dimensional shape data. Three-dimensional shape data of a predetermined object is adjusted with a subject in position, based on a feature pattern detected in image data, and lighting processing for correcting a pixel value of the image data is performed based on the adjusted three-dimensional shape data, distance information of the subject, and a position of a virtual light source. When the three-dimensional shape data is adjusted with the image data in position, a region having a large irregularity in the three-dimensional shape data is preferentially adjusted in position.Type: GrantFiled: April 12, 2019Date of Patent: August 31, 2021Assignee: CANON KABUSHIKI KAISHAInventors: Yuichi Nakada, Shugo Higuchi
-
Patent number: 11089214Abstract: A system and method are provided for generating an output video, such as a video panorama, from a plurality of video streams representing different recordings of a scene. The plurality of video streams may be analyzed to identify at least one part of at least one of the plurality of video streams which is to be used in the output video, thereby identifying a contributing part of a video stream. Orchestration metadata may be generated identifying the contributing part. The orchestration metadata may be provided to a stream source from which the video stream originated to enable the stream source to selectively stream the contributing part of the video stream. Effectively, a selection of the stream's video data may be made to avoid or reduce unnecessary bandwidth usage.Type: GrantFiled: December 16, 2016Date of Patent: August 10, 2021Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Martin Prins