Patents Examined by Anner N Holder
  • Patent number: 11575889
    Abstract: A method of video processing is described. The method includes performing a conversion between a current video block of a video picture of a video and a coded representation of the video according to a buffer allocation rule, wherein the conversion uses an intra block copy (IBC) mode in which a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors, wherein the buffer allocation rule specifies that a virtual buffer allocated for the conversion using the IBC mode is greater than a minimum size of memory for storing a portion of the video picture searched for determining the block vectors.
    Type: Grant
    Filed: March 3, 2022
    Date of Patent: February 7, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu
  • Patent number: 11575887
    Abstract: A video processing method is provided to include determining, for a conversion between a current video block of a current picture of a video and a coded representation of the video, that use of a coding tool is disabled for the current video block due to use of a reference picture having a dimension different from a dimension of the current picture for coding of the current video block into the coded representation; and performing the conversion based on the determining.
    Type: Grant
    Filed: November 4, 2021
    Date of Patent: February 7, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11570443
    Abstract: A video signal processing method and apparatus for encoding or decoding a video signal is disclosed. More particularly, a video signal processing method and a video signal processing apparatus using the same are disclosed, wherein a method for processing a video signal comprises the steps of: obtaining a set of control point motion vectors for prediction of a current block; obtaining the motion vector of each sub-block of the current block using control point motion vectors of the set of control point motion vectors; obtaining a predictor of the each sub-block of the current block using the motion vectors of the each sub-block; obtaining a predictor of the current block by combining predictors of the each sub-block; and restoring the current block using the predictor of the current block.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: January 31, 2023
    Assignee: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
    Inventors: Geonjung Ko, Juhyung Son, Dongcheol Kim, Jinsam Kwak
  • Patent number: 11570444
    Abstract: A moving picture decoding apparatus, method, and medium for decoding a current block are provided. A first candidate is derived from a first motion vector that has been used to decode a first block. The first block is adjacent to the current block. A first index identifying a reference picture to be selected for decoding the current block is decoded. A second candidate having a second motion vector that includes a non-zero value is derived. The non-zero value is assigned to the reference picture. A selected candidate is selected from a plurality of candidates, including the first candidate and the second candidate. A second index identifying the selected candidate is decoded. The current block is decoded using the selected candidate. The second candidate includes the non-zero value of the reference picture, with the reference picture being selected from a plurality of referable reference pictures.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: January 31, 2023
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu
  • Patent number: 11563973
    Abstract: Methods, devices and systems for intra-block coding based decoding or encoding of video while using block vector signaling and/or merge candidates are disclosed. An example method for video processing includes performing a conversion between a video region of a video and a bitstream representation of the video, wherein the bitstream representation selectively includes motion vector difference (MVD) related syntax elements for an intra block copy (IBC) advanced motion vector prediction (AMVP) mode based on a maximum number of a first type of IBC candidates used during the conversion of the video region, wherein, when an IBC mode is applied, samples of the video region are predicted from other samples in a video picture corresponding to the video region.
    Type: Grant
    Filed: October 20, 2021
    Date of Patent: January 24, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Jizheng Xu, Kai Zhang, Hongbin Liu
  • Patent number: 11554755
    Abstract: A method for controlling a sensor assembly cleaning apparatus includes receiving sensor data from various vehicle sensors, determining a level of obscurement of the transparent surface, and determining whether the level of obscurement exceeds a threshold level. If the transparent surface is obscured beyond the threshold level, a control signal may be sent to the apparatus to initiate the ejection of pressurized air onto the transparent surface. Optionally, the method may further evaluate other parameters such as the vehicle velocity in relation to a threshold vehicle velocity prior to sending the control signal to ensure that the cleaning operation using pressurized air would not be superfluous in light of the vehicle velocity. In addition, a method for selectively activating the sensor assembly cleaning apparatus includes determining an activation schedule for the apparatus based on an arrangement of transparent surfaces and controlling the apparatus to operate based on the activation schedule.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: January 17, 2023
    Assignee: Pony AI Inc.
    Inventor: Anatolii Vitanov
  • Patent number: 11553185
    Abstract: The present invention discloses a method and apparatus for encoding or decoding a video signal. The method for processing a video signal according to the present invention uses a merging mode in which prediction information on a neighbor unit is used instead of transmitting prediction information on the present unit, so as to improve coding efficiency. In this case, the number of available candidate units for merging among the units in a predetermined position is determined, and information for the merging mode is acquired on the basis of the number of the available candidate units for merging. The unit to be merged is determined using the information for the merging mode, and prediction information on the unit to be merged is acquired. The prediction value for the present unit is acquired using the prediction information on the unit to be merged, and the present unit is restored using the acquired prediction value.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: January 10, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Seungwook Park, Joonyoung Park, Jungsun Kim, Younghee Choi, Yongjoon Jeon, Jaewon Sung, Byeongmoon Jeon, Jaehyun Lim
  • Patent number: 11551054
    Abstract: A convolutional neural network includes a front layer, a back layer, and a plurality of other layers that are connected between the front layer and the back layer. One of the other layers is a transition layer. A first precision is assigned to activations of neurons from the front layer back to the transition layer and a second precision is assigned to activations of the neurons from the transition layer back to the back layer. A third precision is assigned to weights of inputs to neurons from the front layer back to the transition layer and a fourth precision is assigned to weights of inputs to the neurons from the transition layer back to the back layer. In some embodiments the layers forward of the transition layer have a different convolutional kernel than the layers rearward of the transition layer.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: January 10, 2023
    Assignee: International Business Machines Corporation
    Inventors: Jungwook Choi, Swagath Venkataramani, Vijayalakshmi Srinivasan, Kailash Gopalakrishnan
  • Patent number: 11544866
    Abstract: Systems and techniques are provided for detecting gaze direction of subjects in an area of real space. The system receives a plurality of sequences of frames of corresponding fields of view in the real space. The system uses sequences of frames in a plurality of sequences of frames to identify locations of an identified subject and gaze directions of the subject in the area of real space over time. The system includes logic having access to a database identifying locations of items in the area of real space. The system identifies items in the area of real space matching the identified gaze directions of the identified subject.
    Type: Grant
    Filed: November 4, 2020
    Date of Patent: January 3, 2023
    Assignee: STANDARD COGNITION, CORP
    Inventors: Jordan E. Fisher, Michael S. Suswal, Warren Green
  • Patent number: 11546630
    Abstract: Video decoder and/or video encoder, configured to determine a set of search area location candidates in a reference picture of a video; match the set of search area location candidates with a current template area adjacent to a current block of a current picture to obtain a best matching search area location candidate; select, out of a search area positioned in the reference picture at the best matching search area location candidate, a set of one or more predictor blocks by matching the current template area against the search area; and predictively decode/encode the current block from/into a data stream based on the set of one or more predictor blocks.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: January 3, 2023
    Inventors: Gayathri Venugopal, Detlev Marpe, Thomas Wiegand
  • Patent number: 11539435
    Abstract: Techniques and examples pertaining to single channel line-of-sight (LOS) communication are described. The transmitting end of the LOS communication involves direct modulation of a light emitted from a light emitter. The receiving end of the LOS communication involves receiving a video stream of the light emitter emitting the light, wherein the video stream comprises a plurality of video frames that are continuous in time. The receiving end of the LOS communication also involves converting the video stream to a binary string comprising a plurality of binary bits. Each of the binary bits corresponds to a respective one of the plurality of video frames, and the binary string contains a repeated binary pattern representing a message being conveyed. The receiving end of the LOS communication also involves extracting the binary pattern from the binary string and then decoding the binary pattern to obtain the message.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: December 27, 2022
    Assignee: Ford Global Technologies, LLC
    Inventors: Aditya Singh, Weifeng Xiong, James Carthew
  • Patent number: 11527015
    Abstract: An improved method for coding video is provided that includes Virtual Reality (VR) sequences that enables more efficient encoding by organizing the VR sequence as a single 2D block structure. In the method, reference picture and subpicture lists are created and extended to account for coding of the VR sequence. To further improve coding efficiency, reference indexing can be provided for the temporal and spatial difference between a current VR picture block and the reference pictures and subpictures for the VR sequence. Further, because the reference subpictures for the VR sequence may not have the proper orientation once the VR sequence subpictures are organized into the VR sequence, reorientation of the reference subpictures is made so that the reference subpicture orientations match the current VR subpicture orientations.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: December 13, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Seungwook Hong, Limin Wang
  • Patent number: 11523119
    Abstract: According to embodiments of the present document, a prediction procedure may be performed for image/video coding, and the prediction procedure may include symmetric motion vector differences (SMVDs) and merge mode motion vector differences (MMVDs) according to an inter prediction. The inter prediction may be performed on the basis of reference pictures of a current picture, and types (e.g., a long term reference picture, a short term reference picture, etc.) of the reference pictures may be considered for the inter prediction. Therefore, performance and coding efficiency in the prediction procedure can be improved.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: December 6, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Naeri Park, Junghak Nam, Hyeongmoon Jang
  • Patent number: 11516496
    Abstract: The present invention is about an image encoding/decoding method and apparatus. According to present invention, a method of decoding an image, the method comprising, loading information of a neighboring block of a current block; decoding a current block using the loaded information of the neighboring block; and saving information of the current block that is decoded.
    Type: Grant
    Filed: March 21, 2019
    Date of Patent: November 29, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Sung Chang Lim, Jung Won Kang, Ha Hyun Lee, Jin Ho Lee, Hui Yong Kim
  • Patent number: 11509922
    Abstract: A computer system for the creation of subliminal image or watermarks where the apparent video is an “obvious” image and a subliminal or “clandestine” image or watermark is hidden within the data structure. The concept is envisioned for the cloaking of images, sound, video or like digitized non-coded information. The cloaked files may be intended for storage, transmission, or clandestine placement in a public file system. The watermark may be used for the subliminal marking of a source of a file, its creation, or for tagging copyrighted information.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: November 22, 2022
    Assignees: THE QUANTUM GROUP, INC.
    Inventors: Noel J. Guillama, Chester A. Heath
  • Patent number: 11509894
    Abstract: The present disclosure provides a method and apparatus for subband-coding a frequency conversion unit and a video encoding/decoding method a video encoding/decoding apparatus using the same. The method and the apparatus for subband-coding the frequency conversion unit include generating an encoding stream by splitting the frequency conversion unit into one or more frequency domains, generating frequency domain encoding information according to whether there is a non-zero frequency coefficient in each frequency domain, scanning the frequency coefficient of each frequency domain to generate a frequency domain frequency coefficient stream, and binarizing and encoding the frequency domain encoding information and the scanned frequency domain frequency coefficient stream.
    Type: Grant
    Filed: July 5, 2011
    Date of Patent: November 22, 2022
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jinhan Song, Jeongyeon Lim, Haekwang Kim, Joohee Moon, Yunglyul Lee, Jongki Han, Byeungwoo Jeon
  • Patent number: 11503329
    Abstract: A method and apparatus of Inter prediction for video coding are disclosed. According to one method, a sub-block motion vector prediction (MVP) mode is turned off for small size coding units (CUs). In another method, if the neighbouring reference block for a current coding unit (CU) is in a root CU region, the neighbouring reference block is not used to derive a Merge candidate or a modified neighbouring reference block on the shared boundary of the root CU is used to derive the Merge candidate for the current block. In yet another method, a shared sub-block Merge candidate list is derived for sub-CUs within a root CU region or an MER (Merge estimation region). If a neighbouring reference block is within the same MER as a current sub-CU, the neighbouring reference block is not used for deriving a candidate for the shared sub-CU Merge list.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: November 15, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Chun-Chia Chen, Chih-Wei Hsu, Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11496775
    Abstract: A method, computer program, and computer system is provided for compressing a neural network model. One or more coding tree units are identified corresponding to a multi-dimensional tensor associated with a neural network. A set of weight coefficients associated with the coding tree units is unified. A model of the neural network is compressed based on the unified set of weight coefficients.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: November 8, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 11490078
    Abstract: Video coding using neural network based inter-frame prediction is performed by generating a current reference frame by generating intermediate flows based on two input frames, performing backward warping of the input frames to generate reconstruction frames, and generating a fusion map and a residual map based on the input frames, the intermediate flows and the reconstruction frames. The video coding method further includes outputting an enhanced frame or a virtual reference picture by generating a feature map with different levels, based on the current reference frame, a first reference frame and a second reference frame, generating a predicted frame based on aligned features from the generated feature map by refining the current reference frame, the first reference frame, and the second reference frame, generating a final residual based on the predicted frame, and computing the enhanced frame as an output by adding the final residual to the current reference frame.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: November 1, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Zeqiang Li, Byeongdoo Choi, Wei Wang, Wei Jiang, Xiaozhong Xu, Shan Liu
  • Patent number: 11488381
    Abstract: A method of recording a state of an apheresis machine or a dialysis machine having a disposable component disposed thereon. The disposable component has tubing and a blood component bag. The disposable component is configured to be installed on the apheresis device or dialysis machine by a human operator. The method includes acquiring with a camera an image of a forward-facing external surface portion of the apheresis machine or dialysis machine and the tubing and the blood component bag of the disposable component. The image is acquired automatically without requiring user input. The method includes recording medical device information for the apheresis machine or dialysis machine comprising the image. The method includes generating a message comprising the image and transmitting the message comprising the image to a remote computer.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: November 1, 2022
    Assignee: FENWAL, INC.
    Inventors: James Darren Roxas, Brian Case, Kevin Krause, Kyungyoon Min, Witold Moskal, William Cork