Signal Formatting Patents (Class 348/43)
  • Patent number: 12210978
    Abstract: The present disclosure provides a point autoencoder including an encoder receiving a 3D point cloud and extracting a global feature and a decoder reconstructing the 3D point cloud from the global feature; a dual autoencoder including the point autoencoder; and a method for dimensional transformation of a point cloud using the dual autoencoder. According to the present disclosure, it is possible to extract features from an input point cloud using a Bias-Induced Decoding (BID) layer, perform reconstruction of a 3D point cloud from the corresponding feature information, and reconstruct a 3D point cloud by using only high-dimensional global features as an input. Also, the present disclosure reduces the amount of storage space used and reduces computational complexity than the conventional structure employing a fully connected layer.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: January 28, 2025
    Assignee: Research & Business Foundation Sungkyunkwan University
    Inventors: Suk Han Lee, Wencan Cheng
  • Patent number: 12212779
    Abstract: A method of processing an immersive video includes classifying view images into a basic image and an additional image, performing pruning with respect to view images by referring to a result of classification, generating atlases based on a result of pruning, generating a merged atlas by merging the atlases into one atlas, and generating configuration information of the merged atlas.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: January 28, 2025
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Jun Young Jeong, Kug Jin Yun, Gwang Soon Lee, Hong Chang Shin, Ho Min Eum
  • Patent number: 12211249
    Abstract: Provided are an image processing device, an image processing method, and a program for recognizing an object in a three-dimensional map, which do not require collecting learning data of the three-dimensional map and can perform high-speed processing with a small load. The image processing device includes an image acquiring section that sequentially acquires a two-dimensional input image for each frame; an object type recognition executing section that attaches, to each of pixels of the input image acquired for each frame, a label indicating a type of an object represented by the pixels; and a labeling section that executes three-dimensional position recognition of a subject represented in the input image to create a three-dimensional map, based on the input image sequentially input, and attaches, to each voxel included in the three-dimensional map, the label of the pixel corresponding to the voxel.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: January 28, 2025
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Tsutomu Horikawa, Daichi Ono, Hiroyuki Yabe
  • Patent number: 12205333
    Abstract: A method and technical equipment for encoding, where the method comprises at least receiving a video presentation frame, where the video presentation represents a three-dimensional data in the form of mesh data (810); separating from the mesh data information on vertices, wherein the information comprises at least connectivity data defining connections between vertices (820); determining parameters relating to said connectivity data (830); encoding the parameters to a first bitstream as a video component (840); and storing the encoded first bitstream for transmission to a rendering apparatus (850). In addition to encoding, also decoding is disclosed.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: January 21, 2025
    Assignee: Nokia Technologies Oy
    Inventors: Sebastian Schwarz, Kimmo Roimela, Lauri Ilola, Lukasz Kondrad
  • Patent number: 12192529
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video comprising one or more output layer sets according to a rule, wherein the rule specifies that a supplemental enhancement information (SEI) network abstraction layer (NAL) unit that includes a scalable-nested SEI message carrying picture timing information is not included due to use of a same picture timing in all output layer sets in the bitstream.
    Type: Grant
    Filed: December 9, 2022
    Date of Patent: January 7, 2025
    Assignee: Bytedance Inc.
    Inventor: Ye-kui Wang
  • Patent number: 12192509
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry that decodes a current block in a current picture with a subblock-based temporal motion vector prediction (SbTMVP) mode. A first collocated block in a first collocated picture is determined based on a first displacement vector candidate of the current block corresponding to a first SbTMVP candidate. The processing circuitry determines first motion information of a current template of the current block based on one or more pieces of motion information of the first collocated block or a neighboring block of the first collocated block. The processing circuitry determines one of a first reference template and a first subblock reference template in a first reference picture based on the first motion information and determines a first template matching cost based on the current template and the one of the first reference template and the first subblock reference template.
    Type: Grant
    Filed: November 10, 2022
    Date of Patent: January 7, 2025
    Assignee: Tencent America LLC
    Inventors: Lien-Fei Chen, Guichun Li, Xin Zhao, Shan Liu
  • Patent number: 12184909
    Abstract: There is provided a signal input unit to prevent or reduce an increase in memory hardware on a transmitter or a receiver of a serial digital signal, and to decrease the load on a CPU. The signal input unit receives as an input a video signal and a digital signal for transmission, the digital signal for transmission including a data packet with metadata associated with the video signal. The data writing unit extracts predetermined metadata from the digital signal for transmission on the basis of metadata-specifying information and writes the extracted metadata in an accumulating register. For example, the metadata-specifying information includes header information of the data packet with the predetermined metadata. For example, the header information includes classification information indicating a classification for the predetermined metadata and auxiliary information of the predetermined meta-information.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: December 31, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Keiichi Kimura, Koji Kamiya
  • Patent number: 12177410
    Abstract: A method for transmitting video, according to embodiments, comprises: a pre-processing step of processing video data; a step of encoding the video data; and/or a step of transmitting a bitstream including the video data. A method for receiving video, according to embodiments, comprises the steps of: receiving video data; decoding the video data; and/or rendering the video data.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: December 24, 2024
    Assignee: LG Electronics Inc.
    Inventors: Hyunmook Oh, Sejin Oh, Eunseok Ryu, Jongbeom Jeong, Dongmin Jang, Soonbin Lee
  • Patent number: 12177412
    Abstract: A tiled display device includes tiled display panels arranged in a first direction and a second direction crossing the first direction. Each of the tiled display panels include a display unit outputting a portion of a divided image and a lens array disposed on the display unit to refract the divided image. The tiled display device further includes movement members, or adjusters, connected to respective ones of the tiled display panels, and a processor configured to control the movement members. The movement members independently move the tiled display panels in a third direction crossing the first and second directions, respectively.
    Type: Grant
    Filed: January 8, 2024
    Date of Patent: December 24, 2024
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventor: Young Sang Ha
  • Patent number: 12167006
    Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: December 10, 2024
    Assignee: Alibaba Group Holding Limited
    Inventors: Yu-Chen Sun, Tsui-shan Chang, Jian Lou
  • Patent number: 12155850
    Abstract: Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from a data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space transformation, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.
    Type: Grant
    Filed: February 15, 2023
    Date of Patent: November 26, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Tung Nguyen, Ali Atef Ibrahim Khairat Abdelhamid, Detlev Marpe
  • Patent number: 12155808
    Abstract: The present disclosure relates to method and apparatus for the estimation of an accurate multiplane image from a set of posed images. The accuracy of an MPI representation is measured by the performance of the views generated by it through inverse homography sampling and alpha compositing. A variable number of posed images at a possibly different resolution representative of scenes with arbitrary geometry are used as input of the system. A first level of three modules, possibly trained based on deep learning methods, is built for extracting view and scene features and color scores. Numerous levels of the same three modules may be built and organized in a structure where a level deals with down-scaled version of the posed images.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: November 26, 2024
    Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
    Inventors: Bertrand Chupeau, Tomas Volker, Guillaume Boisson
  • Patent number: 12143635
    Abstract: An encoder, decoder, encoding method and decoding method for 3DoF+ video are disclosed. The encoding method comprises receiving (110) multi-view image or video data comprising a basic view and at least a first additional view of a scene. The method proceeds by identifying (220) pixels in the first additional view that need to be encoded because they contain scene-content that is not visible in the basic view. The first additional view is divided (230) into a plurality of first blocks of pixels. First blocks containing at least one of the identified pixels are retained (240); and first blocks that contain none of the identified pixels are discarded. The retained blocks are rearranged (250) so that they are contiguous in at least one dimension. A packed additional view is generated (260) from the rearranged first retained blocks and encoded (264).
    Type: Grant
    Filed: July 26, 2021
    Date of Patent: November 12, 2024
    Assignee: Koninklijke Philips N.V.
    Inventor: Wilhelmus Hendrikus Alfonsus Bruls
  • Patent number: 12141964
    Abstract: The present disclosure provides methods, systems, and devices for coregistering imaging data to form three-dimensional superimposed images of a biological target such as a wound, a tumor, or a surgical bed. A three-dimensional map can be generated by projecting infrared radiation at a target area, receiving reflected infrared radiation, and measuring depth of the target area. A three-dimensional white light image can be created from a captured two-dimensional white light image and the three-dimensional map. A three-dimensional fluorescence image can be created from a captured two-dimensional fluorescence image and the three-dimensional map. The three-dimensional white light image and the three-dimensional fluorescence image can be aligned using one or more fiducial markers to form a three-dimensional superimposed image. The superimposed image can be used to track wound healing and to excise cancerous tissues, for example, breast tumors. Images can be in the form of videos.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: November 12, 2024
    Assignee: UNIVERSITY HEALTH NETWORK
    Inventors: Ralph S. DaCosta, Danielle Dunham
  • Patent number: 12131530
    Abstract: A technique for geospatial tracking includes receiving live video from a first source, rendering a map that encompasses a geographical region imaged by the live video, and displaying the map along with the live video, thereby enabling a human user or computer to associate objects in the video with geographical features on the map. The technique further includes receiving geotagged content from a second source and displaying a representation of the geotagged content along with the video and the map.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: October 29, 2024
    Assignee: Overwatch Systems, Ltd.
    Inventors: Jonathan Michael Ehrlich, Hillel Steinberg
  • Patent number: 12125223
    Abstract: An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.
    Type: Grant
    Filed: January 27, 2022
    Date of Patent: October 22, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Benjamin Busam, Patrick Ruhkamp, Matthieu Hog, Yannick Verdie, Ales Leonardis, Gregory Slabaugh
  • Patent number: 12112442
    Abstract: Systems and methods for inserting supplemental content into presentations of two-dimensional video content are disclosed. Exemplary implementations may: obtain two-dimensional video content depicting a three-dimensional space; obtain supplemental content; obtain a model of the three-dimensional space defining the one or more visible physical features within the three-dimensional space; determine the camera position of the two-dimensional video content; identify a presentation location within the two-dimensional video content; determine integration information; modify the two-dimensional video content to include the supplemental content at the identified presentation locations in accordance with the integration information and/or perform other operations.
    Type: Grant
    Filed: May 23, 2023
    Date of Patent: October 8, 2024
    Assignee: 4D Sight, Inc.
    Inventor: Erhan Ciris
  • Patent number: 12102919
    Abstract: The present application provides a method for game object control in a game map, a mobile terminal and a computer readable storage medium. The method for game object control includes: constructing a game map; creating a random path in each map layer to connect the map units within each map layer; configuring an attribute threshold value for the each map layer, wherein an attribute threshold value of a subsequent map layer is greater than or equal to an attribute threshold value of a preceding map layer; controlling a game object to move along any map unit connected on the random path from the map starting point to the jump unit in any map layer, and granting the game object an attribute bonus with an attribute point when the game object falls into the any map unit; and freely adding the attribute bonus for the game object to improve an attribute, wherein a sum of the attribute point of the attribute bonus added is less than or equal to an attribute threshold value for a current map layer.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: October 1, 2024
    Assignee: Shanghai Lilith Technology Corporation
    Inventors: Chunhui Wu, Qiwei Wang
  • Patent number: 12096009
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more supplemental enhancement information, SEI, network abstraction layer (NAL) units according to a rule, wherein the rule specifies that, responsive to an SEI NAL unit including a non-scalable-nested SEI message of a first payload type, the SEI NAL unit is disallowed to include another SEI message of a second payload type.
    Type: Grant
    Filed: December 8, 2022
    Date of Patent: September 17, 2024
    Assignee: BYTEDANCE INC.
    Inventor: Ye-kui Wang
  • Patent number: 12096100
    Abstract: Provided are an image sensor with one or more image receivers for image combining, and an imaging system and method therefor. The image sensor includes an image sensor array to generate first image data for a first image; a receiver to receive, into the image sensor, second image data for a second image; an image combination circuit coupled to the image sensor array and the receiver to receive the first image data and the second image data and combine the first image data and the second image data into combined image data for a single combined image, according to one or more image combination criteria, and at least one of the first image data and the second image data; and a transmitter coupled to the image combination circuit to transmit the combined image data for the combined image from the image sensor.
    Type: Grant
    Filed: July 11, 2023
    Date of Patent: September 17, 2024
    Assignee: Cista System Corp.
    Inventors: Zhaojian Li, Jiangtao Pang
  • Patent number: 12095835
    Abstract: The present disclosure relates to a method for a smooth screen switch between image cloud streaming (ICS) of receiving a screen in an image mode and video cloud streaming (VCS) of receiving a screen in a video mode in a cloud streaming service.
    Type: Grant
    Filed: June 23, 2023
    Date of Patent: September 17, 2024
    Assignee: SK Planet Co., Ltd.
    Inventor: Eung Ju Lee
  • Patent number: 12075082
    Abstract: In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.
    Type: Grant
    Filed: November 21, 2022
    Date of Patent: August 27, 2024
    Assignee: GE Video Compression, LLC
    Inventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
  • Patent number: 12062136
    Abstract: The present invention relates to a display device comprising: a communication unit for communicating with a cloud server; an interface unit for obtaining an image of the periphery of a vehicle by means of a camera, and receiving sensing information collected from at least one sensor; an MR module for rendering MR information, comprising a virtual object, on the basis of the sensing information and map information received from the cloud server; and a processor extracting an image, corresponding to a lateral surface of a building around the vehicle, from the obtained image, generating a texture image corresponding to the lateral surface of the building from the extracted image and transmitting same to the cloud server, receiving, from the cloud server, map information comprising models of buildings to which building textures on the basis of texture images are mapped, and displaying MR information rendered on the basis of the map information on a display provided in the vehicle.
    Type: Grant
    Filed: July 12, 2022
    Date of Patent: August 13, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunghwan Choi, Yujung Jang, Kihyung Lee, Seungman Kim
  • Patent number: 12058372
    Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
    Type: Grant
    Filed: September 14, 2023
    Date of Patent: August 6, 2024
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
  • Patent number: 12058371
    Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
    Type: Grant
    Filed: September 14, 2023
    Date of Patent: August 6, 2024
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
  • Patent number: 12052441
    Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform parsing at least one video parameter set comprising at least one syntax element indicating whether at least one layer in the scalable bitstream is one of a dependent layer of the scalable bitstream and an independent layer of the scalable bitstream, determining a number of dependent layers, including the dependent layer, of the scalable bitstream based on a plurality of flags included in the VPS, decoding a picture in the dependent layer by parsing and interpreting an inter-layer reference picture list, and decoding a picture in an independent layer without parsing and interpreting the inter-layer reference picture list.
    Type: Grant
    Filed: July 5, 2022
    Date of Patent: July 30, 2024
    Assignee: Tencent America LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 12047591
    Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: July 23, 2024
    Assignee: Alibaba Group Holding Limited
    Inventors: Yu-Chen Sun, Tsui-shan Chang, Jian Lou
  • Patent number: 12038609
    Abstract: An optical sensor comprises foreoptics configured to receive an image signal, an image optic operable to focus the image signal, at least one focal plane array (FPA) configured to detect the image signal, and a jitter stabilization system. The jitter stabilization system can comprise a transmitter configured to transmit a jitter source signal to the foreoptics and a position sensor configured to receive a jitter return signal. The position sensor can be positioned at a shared focus with the at least one FPA. The optical sensor further comprises a diffraction grating operable to reflect and diffract at least a portion of the jitter source signal. The jitter return signal received at the position sensor comprises at least a portion of the reflected and diffracted jitter source signal.
    Type: Grant
    Filed: September 3, 2021
    Date of Patent: July 16, 2024
    Assignee: Raytheon Company
    Inventor: Lacy G. Cook
  • Patent number: 12033496
    Abstract: In some examples, a system detects an accident involving a first vehicle, where the detecting is based on an accident indication received by the service over a network from a second vehicle not involved in the accident, the second vehicle different from the first vehicle, and where the accident indication from the second vehicle is responsive to messages received by the second vehicle from other vehicles. In response to the detecting of the accident, the system verifies that the accident occurred by sending, from the service, queries to a roadside unit and a third vehicle, and receiving, at the service, responses to the queries from the roadside unit and the third vehicle, the responses containing event data collected by the roadside unit and the third vehicle of events in a vicinity of the accident.
    Type: Grant
    Filed: April 13, 2023
    Date of Patent: July 9, 2024
    Assignee: BlackBerry Limited
    Inventors: James Randolph Winter Lepp, Michael Peter Montemurro, Stephen McCann, Gordon Peter Young, Jasmin Mulaosmanovic
  • Patent number: 12034972
    Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
    Type: Grant
    Filed: September 14, 2023
    Date of Patent: July 9, 2024
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
  • Patent number: 12034927
    Abstract: An image is divided into rectangular regions each including at least one block row, and the image is divided into rectangular slices or slices to be processed in raster order. In a case where the image is divided into the rectangular slices, based on first information for specifying a rectangular region to be processed first and second information for specifying a rectangular region to be processed last, the rectangular regions in the rectangular slice is specified. Based on the number of blocks in a vertical direction in each of the specified rectangular regions, the number of pieces of information for specifying a start position of coded data of the block row in the rectangular slice is specified. A bitstream in which at least the pieces of information, the first and second information, and the coded data are multiplexed is generated.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: July 9, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventors: Koji Okawa, Masato Shima
  • Patent number: 12022357
    Abstract: A method includes causing background content to be displayed on a display device with a first virtual object and a second virtual object; causing augmented reality (AR) content to be rendered based on a location of an AR device relative to the display device; determining that the AR content is in front of the first virtual object in the scene when viewed through the AR device and rendering the background content with a cutout in the first virtual object when the first virtual object overlaps with the AR content; and determining that the AR content is behind the second virtual object in the scene when viewed through the AR device and rendering the AR content with a cutout in the AR content when the AR content overlaps with the second virtual object.
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: June 25, 2024
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: John Gaeta, Michael Koperwas, Nicholas Rasmussen
  • Patent number: 12022051
    Abstract: A method includes encoding a first message including first parameters for a first color transform that transforms a video signal into a first color-mapped video signal; encoding a second message including second parameters for a second color transform that transforms the video signal into a second color-mapped video signal; and encoding the video signal, the first message, and the second message in a video bitstream. A method includes decoding the video bitstream into the video signal, the first message including the first parameters, and the second message including the second parameters, and performing at least one of the following: displaying the video signal; transforming the video signal into the first color-mapped video signal by applying the first color transform and displaying the first color-mapped video signal; and transforming the video signal into the second color-mapped video signal by applying the second color transform and displaying the second color-mapped video signal.
    Type: Grant
    Filed: July 25, 2022
    Date of Patent: June 25, 2024
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Pierre Andrivon, Philippe Bordes, Emmanuel Jolly
  • Patent number: 12014484
    Abstract: The invention advances the ratio method of phosphor thermography using two machine vision cameras for full-field temperature measurements of a solid surface. As an example, algorithms from digital image correlation (DIC) can be used to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. A phosphor calibration sample fabricated using aerosol deposition can be used for in situ determination of the temperature-versus-intensity ratio relationship. The full calibration methodology and several improvements on two-color phosphor thermography open the door for full-field temperature measurements in dynamic tests with deforming test specimens.
    Type: Grant
    Filed: June 13, 2022
    Date of Patent: June 18, 2024
    Assignee: National Technology & Engineering Solutions of Sandia, LLC
    Inventors: Caroline Winters, Kathryn N. Gabet Hoffmeister, Elizabeth M. C. Jones, Amanda Jones, Jacob Thomas Mahaffey, Shannon Elizabeth Murray, Michael M. Montoya, Wendy Flores-Brito
  • Patent number: 11995835
    Abstract: A pixel-level object detection system that detects an object at a pixel level, includes: an imaging unit that acquires an inference image that is an image that captures a detection target; an area detection unit that detects an area including a detection target from the inference image; a detail detection unit that detects the detection target using only local information from the inference image; and a result integration processing unit that integrates an output of the area detection unit with an output of the detail detection unit to output a segmentation map indicating, as a probability map, which pixel in the image corresponds to the detection object.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: May 28, 2024
    Assignee: HITACHI SYSTEMS, LTD.
    Inventors: Yuki Inoue, Hiroto Nagayoshi, Masato Nakamura
  • Patent number: 11995793
    Abstract: The present invention provides a generation method for a 3D asteroid dynamic map and a portable terminal. The method comprises: obtaining a panorama image; identifying the panorama image and segmenting into a sky region, a human body region, and a ground region; calculating a panoramic depth map for the sky region, the human body region, and the ground region; respectively transforming the panorama image and the panoramic depth map to generate an asteroid image and an asteroid depth map; generating an asteroid view under a virtual viewpoint; and rendering to generate a 3D asteroid dynamic map. By automatically generating the asteroid view under the virtual viewpoint, and synthesizing and rendering same, the technical solution of the present invention generates the asteroid dynamic map having a 3D effect from the panorama image.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: May 28, 2024
    Assignee: ARASHI VISION INC.
    Inventors: Ruidong Gao, Wenjie Jiang, Li Zhu
  • Patent number: 11985353
    Abstract: A method and apparatus for a low complexity transform unit partitioning structure for High Efficiency Video Coding (HEVC). The method includes determining prediction unit size of a coding unit, and setting the size of transform unit size of Y, U and V according to the prediction unit size of the coding unit.
    Type: Grant
    Filed: May 25, 2022
    Date of Patent: May 14, 2024
    Assignee: Texas Instruments Incorporated
    Inventor: Minhua Zhou
  • Patent number: 11983393
    Abstract: An image processing method includes displaying a first screen on a display surface, the first screen including at least a part of a drawing area in which at least one object image drawn by a user is arranged, excluding an area in which at least a part of an object image included in the first screen is arranged from the drawing area when an operation of erasing the at least a part of the object is received, and displaying a reduced screen on the display surface when an operation is received, the reduced screen being obtained by reducing a whole of the drawing area into a size of the display surface.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: May 14, 2024
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Akio Tomotoshi, Toshiki Fujimori
  • Patent number: 11979587
    Abstract: This disclosure provides methods, devices, and systems for video coding. The present implementations more specifically relate to hybrid coding techniques that combine aspects of inter-frame coding with aspects of intra-frame coding. In some aspects, a video encoder may perform inter-frame coding in a weighted manner so that the coded video frames (also referred to as “residual frames”) may include contributions from the current video frame to be transmitted over a communication channel and also may include contributions from the previous video frame transmitted over the communication channel. More specifically, any pixel value (r(n)) in the residual frame can be expressed as a weighted combination of a respective pixel value (x(n)) in the current video frame and a co-located pixel value (x(n?1)) in the previous video frame, where r(n)=x(n)??·x(n?1) and where 0???1 is a scaling factor representing the degree of contribution by the previous video frame.
    Type: Grant
    Filed: October 5, 2022
    Date of Patent: May 7, 2024
    Assignee: Synaptics Incorporated
    Inventors: Maciej Sebastian Pedzisz, Timothy John Borer
  • Patent number: 11968372
    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.
    Type: Grant
    Filed: February 8, 2023
    Date of Patent: April 23, 2024
    Assignee: Avalon Holographics Inc.
    Inventors: Matthew Hamilton, Chuck Rumbolt, Donovan Benoit, Matthew Troke, Robert Lockyer
  • Patent number: 11968405
    Abstract: A method of video processing includes performing a conversion between a video including a picture and a bitstream of the video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that an indication of whether a first flag is signalled at a beginning of a picture header associated with the picture, wherein the first flag is indicative of whether the picture is an intra random access point (IRAP) picture or a gradual decoding refresh (GDR) picture.
    Type: Grant
    Filed: July 7, 2022
    Date of Patent: April 23, 2024
    Assignee: BYTEDANCE INC.
    Inventors: Ye-kui Wang, Li Zhang, Kai Zhang
  • Patent number: 11961246
    Abstract: Provided are a depth image processing method, a depth image processing apparatus, an electronic device and a readable storage medium. The method includes: (101) obtaining consecutive n depth image frames; (102) determining a trusted pixel and determining a smoothing factor corresponding to the trusted pixel; (103) determining a time similarity weight; (104) determining a content similarity; (105) determining a content similarity weight based on the content similarity and the smoothing factor; and (106) performing filtering processing on a depth value of the trusted pixel based on all time similarity weights and all content similarity weights.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: April 16, 2024
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP. LTD
    Inventor: Jian Kang
  • Patent number: 11956420
    Abstract: A method of decoding a coded video bitstream is provided. The method includes parsing a slice header of a current slice represented in the coded video bitstream. The slice header includes a reference picture list structure. The method also includes deriving, based on the reference picture list structure, a reference picture list of the current slice; and obtaining, based on the reference picture list, at least one reconstructed block of the current slice.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: April 9, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Ye-Kui Wang, FNU Hendry
  • Patent number: 11956411
    Abstract: An image signal processor includes a register and a disparity correction unit. The register stores disparity data obtained from a pattern image data that an image senor generates, and the image sensor includes a plurality of pixels, and each of the pixel includes at least a first photoelectric conversion element and a second photoelectric conversion element. The image sensor generates the pattern image data in response to a pattern image located at a first distance from the image sensor. The disparity correction unit corrects a disparity distortion of an image data based on the disparity data to generate a result image data, and the image senor generates the image data by capturing an object.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: April 9, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hee Kang, Young-Jun Song, Dong-Ki Min, Jong-Min You, Jee-Hong Lee, Seok-Jae Kang, Taek-Sun Kim, Joon-Hyuk Im
  • Patent number: 11956478
    Abstract: A method and apparatus for encoding a video stream using video point cloud coding, the decoding including obtaining an input point cloud; dividing the input point cloud into a plurality of chunks, including a first chunk including a first plurality of points and a second chunk including a second plurality of points; generating a first plurality of patches based on the first plurality of points; generating a second plurality of patches based on the second plurality of points; packing the first plurality of patches and the second plurality of patches into an image; and generating the video stream based on the image.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: April 9, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Arash Vosoughi, Sehoon Yea, Shan Liu
  • Patent number: 11956473
    Abstract: Video coding tools can be controlled by including syntax in a video bitstream that makes better use of video decoding resources. An encoder inserts syntax into a video bitstream to enable a decoder to parse the bitstream and easily control which tools combinations are enabled, which combinations are not permitted, and which tools are activated for various components in a multiple component bitstream, leading to potential parallelization of bitstream decoding.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: April 9, 2024
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Edouard Francois, Pierre Andrivon, Franck Galpin, Fabrice Leleannec, Michel Kerdranvat
  • Patent number: 11949845
    Abstract: During operation of a machine, an understanding of terrain features is critical. Accordingly, disclosed embodiments augment a video stream, captured by a camera mounted on the machine, with terrain information. In particular, an overlay is generated on at least one image frame. The overlay, which may comprise one or more semi-transparent bands, may cyclically recede from a foreground to a background of the image frame(s), cyclically advance from a background to a foreground of the image frame(s), or cyclically move horizontally across the image frame(s). The overlay may be colorized to illustrate the height of the terrain underneath the overlay.
    Type: Grant
    Filed: August 31, 2022
    Date of Patent: April 2, 2024
    Assignee: Caterpillar Inc.
    Inventors: Craig Allan Lehocky, Michael William Bridenbaugh, Brad Robert Van de Veer, Jeffrey K. Berry, Jeffrey J. Baker
  • Patent number: 11949889
    Abstract: At least one embodiment relates to a method for padding a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame. The method also comprises encoding a video stream including a time-interleaving of said encoded first and second images. There is also provided a method comprising decoding a video stream to provide a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame; and filtering pixel values of the second depth image by using pixel values of the first depth image.
    Type: Grant
    Filed: January 21, 2019
    Date of Patent: April 2, 2024
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Jean-Claude Chevet, Joan Llach Pinsach, Kangying Cai
  • Patent number: 11948685
    Abstract: Disclosed here is a method of generating a dental recommendation based on image processing. Further, the method may include receiving at least one patient data comprising at least one image from at least one patient device. Further, the method may include retrieving at least one dental dataset. Further, the method may include analyzing the at least one patient data and the at least one dental dataset. Further, the method may include generating at least one landmark based on the analyzing. Further, the method may include retrieving at least one dental reference dataset. Further, the method may include processing the at least one landmark and the at least one dental reference dataset, determining at least one dental recommendation based on the processing, transmitting the at least one dental recommendation to at least one external device and storing the at least one dental recommendation.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: April 2, 2024
    Inventor: Richard Ricci
  • Patent number: 11941744
    Abstract: Various methods are provided for generating motion vectors in the context of 3D computer-generated images. An example method includes generating, for each pixel of one or more objects to be rendered in a current frame, a 1-phase motion vector (MV1) and a 0-phase motion vector (MV0), each MV1 and MV0 having an associated depth value, to thereby form an MV1 texture and an MV0 texture; converting the MV1 texture to a set of MV1 blocks and converting the MV0 texture to a set of MV0 blocks; and outputting the set of MV1 blocks and the set of MV0 blocks for image processing.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: March 26, 2024
    Assignee: PIXELWORKS SEMICONDUCTOR TECHNOLOGY (SHANGHAI) CO. LTD.
    Inventors: Hongmin Zhang, Miao Sima, Zongming Han, Gongxian Liu, Junhua Chen, Guohua Cheng, Baochen Liu, Neil Woodall, Yue Ma, Huili Han