Signal Formatting Patents (Class 348/43)
-
Patent number: 12141964Abstract: The present disclosure provides methods, systems, and devices for coregistering imaging data to form three-dimensional superimposed images of a biological target such as a wound, a tumor, or a surgical bed. A three-dimensional map can be generated by projecting infrared radiation at a target area, receiving reflected infrared radiation, and measuring depth of the target area. A three-dimensional white light image can be created from a captured two-dimensional white light image and the three-dimensional map. A three-dimensional fluorescence image can be created from a captured two-dimensional fluorescence image and the three-dimensional map. The three-dimensional white light image and the three-dimensional fluorescence image can be aligned using one or more fiducial markers to form a three-dimensional superimposed image. The superimposed image can be used to track wound healing and to excise cancerous tissues, for example, breast tumors. Images can be in the form of videos.Type: GrantFiled: January 17, 2020Date of Patent: November 12, 2024Assignee: UNIVERSITY HEALTH NETWORKInventors: Ralph S. DaCosta, Danielle Dunham
-
Patent number: 12143635Abstract: An encoder, decoder, encoding method and decoding method for 3DoF+ video are disclosed. The encoding method comprises receiving (110) multi-view image or video data comprising a basic view and at least a first additional view of a scene. The method proceeds by identifying (220) pixels in the first additional view that need to be encoded because they contain scene-content that is not visible in the basic view. The first additional view is divided (230) into a plurality of first blocks of pixels. First blocks containing at least one of the identified pixels are retained (240); and first blocks that contain none of the identified pixels are discarded. The retained blocks are rearranged (250) so that they are contiguous in at least one dimension. A packed additional view is generated (260) from the rearranged first retained blocks and encoded (264).Type: GrantFiled: July 26, 2021Date of Patent: November 12, 2024Assignee: Koninklijke Philips N.V.Inventor: Wilhelmus Hendrikus Alfonsus Bruls
-
Patent number: 12131530Abstract: A technique for geospatial tracking includes receiving live video from a first source, rendering a map that encompasses a geographical region imaged by the live video, and displaying the map along with the live video, thereby enabling a human user or computer to associate objects in the video with geographical features on the map. The technique further includes receiving geotagged content from a second source and displaying a representation of the geotagged content along with the video and the map.Type: GrantFiled: July 9, 2021Date of Patent: October 29, 2024Assignee: Overwatch Systems, Ltd.Inventors: Jonathan Michael Ehrlich, Hillel Steinberg
-
Patent number: 12125223Abstract: An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.Type: GrantFiled: January 27, 2022Date of Patent: October 22, 2024Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Benjamin Busam, Patrick Ruhkamp, Matthieu Hog, Yannick Verdie, Ales Leonardis, Gregory Slabaugh
-
Patent number: 12112442Abstract: Systems and methods for inserting supplemental content into presentations of two-dimensional video content are disclosed. Exemplary implementations may: obtain two-dimensional video content depicting a three-dimensional space; obtain supplemental content; obtain a model of the three-dimensional space defining the one or more visible physical features within the three-dimensional space; determine the camera position of the two-dimensional video content; identify a presentation location within the two-dimensional video content; determine integration information; modify the two-dimensional video content to include the supplemental content at the identified presentation locations in accordance with the integration information and/or perform other operations.Type: GrantFiled: May 23, 2023Date of Patent: October 8, 2024Assignee: 4D Sight, Inc.Inventor: Erhan Ciris
-
Patent number: 12102919Abstract: The present application provides a method for game object control in a game map, a mobile terminal and a computer readable storage medium. The method for game object control includes: constructing a game map; creating a random path in each map layer to connect the map units within each map layer; configuring an attribute threshold value for the each map layer, wherein an attribute threshold value of a subsequent map layer is greater than or equal to an attribute threshold value of a preceding map layer; controlling a game object to move along any map unit connected on the random path from the map starting point to the jump unit in any map layer, and granting the game object an attribute bonus with an attribute point when the game object falls into the any map unit; and freely adding the attribute bonus for the game object to improve an attribute, wherein a sum of the attribute point of the attribute bonus added is less than or equal to an attribute threshold value for a current map layer.Type: GrantFiled: December 20, 2021Date of Patent: October 1, 2024Assignee: Shanghai Lilith Technology CorporationInventors: Chunhui Wu, Qiwei Wang
-
Patent number: 12096100Abstract: Provided are an image sensor with one or more image receivers for image combining, and an imaging system and method therefor. The image sensor includes an image sensor array to generate first image data for a first image; a receiver to receive, into the image sensor, second image data for a second image; an image combination circuit coupled to the image sensor array and the receiver to receive the first image data and the second image data and combine the first image data and the second image data into combined image data for a single combined image, according to one or more image combination criteria, and at least one of the first image data and the second image data; and a transmitter coupled to the image combination circuit to transmit the combined image data for the combined image from the image sensor.Type: GrantFiled: July 11, 2023Date of Patent: September 17, 2024Assignee: Cista System Corp.Inventors: Zhaojian Li, Jiangtao Pang
-
Patent number: 12096009Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more supplemental enhancement information, SEI, network abstraction layer (NAL) units according to a rule, wherein the rule specifies that, responsive to an SEI NAL unit including a non-scalable-nested SEI message of a first payload type, the SEI NAL unit is disallowed to include another SEI message of a second payload type.Type: GrantFiled: December 8, 2022Date of Patent: September 17, 2024Assignee: BYTEDANCE INC.Inventor: Ye-kui Wang
-
Patent number: 12095835Abstract: The present disclosure relates to a method for a smooth screen switch between image cloud streaming (ICS) of receiving a screen in an image mode and video cloud streaming (VCS) of receiving a screen in a video mode in a cloud streaming service.Type: GrantFiled: June 23, 2023Date of Patent: September 17, 2024Assignee: SK Planet Co., Ltd.Inventor: Eung Ju Lee
-
Patent number: 12075082Abstract: In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.Type: GrantFiled: November 21, 2022Date of Patent: August 27, 2024Assignee: GE Video Compression, LLCInventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
-
Patent number: 12062136Abstract: The present invention relates to a display device comprising: a communication unit for communicating with a cloud server; an interface unit for obtaining an image of the periphery of a vehicle by means of a camera, and receiving sensing information collected from at least one sensor; an MR module for rendering MR information, comprising a virtual object, on the basis of the sensing information and map information received from the cloud server; and a processor extracting an image, corresponding to a lateral surface of a building around the vehicle, from the obtained image, generating a texture image corresponding to the lateral surface of the building from the extracted image and transmitting same to the cloud server, receiving, from the cloud server, map information comprising models of buildings to which building textures on the basis of texture images are mapped, and displaying MR information rendered on the basis of the map information on a display provided in the vehicle.Type: GrantFiled: July 12, 2022Date of Patent: August 13, 2024Assignee: LG ELECTRONICS INC.Inventors: Sunghwan Choi, Yujung Jang, Kihyung Lee, Seungman Kim
-
Patent number: 12058371Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.Type: GrantFiled: September 14, 2023Date of Patent: August 6, 2024Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
-
Patent number: 12058372Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.Type: GrantFiled: September 14, 2023Date of Patent: August 6, 2024Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
-
Patent number: 12052441Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform parsing at least one video parameter set comprising at least one syntax element indicating whether at least one layer in the scalable bitstream is one of a dependent layer of the scalable bitstream and an independent layer of the scalable bitstream, determining a number of dependent layers, including the dependent layer, of the scalable bitstream based on a plurality of flags included in the VPS, decoding a picture in the dependent layer by parsing and interpreting an inter-layer reference picture list, and decoding a picture in an independent layer without parsing and interpreting the inter-layer reference picture list.Type: GrantFiled: July 5, 2022Date of Patent: July 30, 2024Assignee: Tencent America LLCInventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
-
Patent number: 12047591Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.Type: GrantFiled: July 9, 2019Date of Patent: July 23, 2024Assignee: Alibaba Group Holding LimitedInventors: Yu-Chen Sun, Tsui-shan Chang, Jian Lou
-
Patent number: 12038609Abstract: An optical sensor comprises foreoptics configured to receive an image signal, an image optic operable to focus the image signal, at least one focal plane array (FPA) configured to detect the image signal, and a jitter stabilization system. The jitter stabilization system can comprise a transmitter configured to transmit a jitter source signal to the foreoptics and a position sensor configured to receive a jitter return signal. The position sensor can be positioned at a shared focus with the at least one FPA. The optical sensor further comprises a diffraction grating operable to reflect and diffract at least a portion of the jitter source signal. The jitter return signal received at the position sensor comprises at least a portion of the reflected and diffracted jitter source signal.Type: GrantFiled: September 3, 2021Date of Patent: July 16, 2024Assignee: Raytheon CompanyInventor: Lacy G. Cook
-
Patent number: 12034927Abstract: An image is divided into rectangular regions each including at least one block row, and the image is divided into rectangular slices or slices to be processed in raster order. In a case where the image is divided into the rectangular slices, based on first information for specifying a rectangular region to be processed first and second information for specifying a rectangular region to be processed last, the rectangular regions in the rectangular slice is specified. Based on the number of blocks in a vertical direction in each of the specified rectangular regions, the number of pieces of information for specifying a start position of coded data of the block row in the rectangular slice is specified. A bitstream in which at least the pieces of information, the first and second information, and the coded data are multiplexed is generated.Type: GrantFiled: December 20, 2021Date of Patent: July 9, 2024Assignee: Canon Kabushiki KaishaInventors: Koji Okawa, Masato Shima
-
Patent number: 12034972Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.Type: GrantFiled: September 14, 2023Date of Patent: July 9, 2024Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
-
Patent number: 12033496Abstract: In some examples, a system detects an accident involving a first vehicle, where the detecting is based on an accident indication received by the service over a network from a second vehicle not involved in the accident, the second vehicle different from the first vehicle, and where the accident indication from the second vehicle is responsive to messages received by the second vehicle from other vehicles. In response to the detecting of the accident, the system verifies that the accident occurred by sending, from the service, queries to a roadside unit and a third vehicle, and receiving, at the service, responses to the queries from the roadside unit and the third vehicle, the responses containing event data collected by the roadside unit and the third vehicle of events in a vicinity of the accident.Type: GrantFiled: April 13, 2023Date of Patent: July 9, 2024Assignee: BlackBerry LimitedInventors: James Randolph Winter Lepp, Michael Peter Montemurro, Stephen McCann, Gordon Peter Young, Jasmin Mulaosmanovic
-
Patent number: 12022051Abstract: A method includes encoding a first message including first parameters for a first color transform that transforms a video signal into a first color-mapped video signal; encoding a second message including second parameters for a second color transform that transforms the video signal into a second color-mapped video signal; and encoding the video signal, the first message, and the second message in a video bitstream. A method includes decoding the video bitstream into the video signal, the first message including the first parameters, and the second message including the second parameters, and performing at least one of the following: displaying the video signal; transforming the video signal into the first color-mapped video signal by applying the first color transform and displaying the first color-mapped video signal; and transforming the video signal into the second color-mapped video signal by applying the second color transform and displaying the second color-mapped video signal.Type: GrantFiled: July 25, 2022Date of Patent: June 25, 2024Assignee: InterDigital VC Holdings, Inc.Inventors: Pierre Andrivon, Philippe Bordes, Emmanuel Jolly
-
Patent number: 12022357Abstract: A method includes causing background content to be displayed on a display device with a first virtual object and a second virtual object; causing augmented reality (AR) content to be rendered based on a location of an AR device relative to the display device; determining that the AR content is in front of the first virtual object in the scene when viewed through the AR device and rendering the background content with a cutout in the first virtual object when the first virtual object overlaps with the AR content; and determining that the AR content is behind the second virtual object in the scene when viewed through the AR device and rendering the AR content with a cutout in the AR content when the AR content overlaps with the second virtual object.Type: GrantFiled: September 10, 2021Date of Patent: June 25, 2024Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: John Gaeta, Michael Koperwas, Nicholas Rasmussen
-
Patent number: 12014484Abstract: The invention advances the ratio method of phosphor thermography using two machine vision cameras for full-field temperature measurements of a solid surface. As an example, algorithms from digital image correlation (DIC) can be used to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. A phosphor calibration sample fabricated using aerosol deposition can be used for in situ determination of the temperature-versus-intensity ratio relationship. The full calibration methodology and several improvements on two-color phosphor thermography open the door for full-field temperature measurements in dynamic tests with deforming test specimens.Type: GrantFiled: June 13, 2022Date of Patent: June 18, 2024Assignee: National Technology & Engineering Solutions of Sandia, LLCInventors: Caroline Winters, Kathryn N. Gabet Hoffmeister, Elizabeth M. C. Jones, Amanda Jones, Jacob Thomas Mahaffey, Shannon Elizabeth Murray, Michael M. Montoya, Wendy Flores-Brito
-
Patent number: 11995793Abstract: The present invention provides a generation method for a 3D asteroid dynamic map and a portable terminal. The method comprises: obtaining a panorama image; identifying the panorama image and segmenting into a sky region, a human body region, and a ground region; calculating a panoramic depth map for the sky region, the human body region, and the ground region; respectively transforming the panorama image and the panoramic depth map to generate an asteroid image and an asteroid depth map; generating an asteroid view under a virtual viewpoint; and rendering to generate a 3D asteroid dynamic map. By automatically generating the asteroid view under the virtual viewpoint, and synthesizing and rendering same, the technical solution of the present invention generates the asteroid dynamic map having a 3D effect from the panorama image.Type: GrantFiled: October 21, 2019Date of Patent: May 28, 2024Assignee: ARASHI VISION INC.Inventors: Ruidong Gao, Wenjie Jiang, Li Zhu
-
Patent number: 11995835Abstract: A pixel-level object detection system that detects an object at a pixel level, includes: an imaging unit that acquires an inference image that is an image that captures a detection target; an area detection unit that detects an area including a detection target from the inference image; a detail detection unit that detects the detection target using only local information from the inference image; and a result integration processing unit that integrates an output of the area detection unit with an output of the detail detection unit to output a segmentation map indicating, as a probability map, which pixel in the image corresponds to the detection object.Type: GrantFiled: April 14, 2021Date of Patent: May 28, 2024Assignee: HITACHI SYSTEMS, LTD.Inventors: Yuki Inoue, Hiroto Nagayoshi, Masato Nakamura
-
Patent number: 11983393Abstract: An image processing method includes displaying a first screen on a display surface, the first screen including at least a part of a drawing area in which at least one object image drawn by a user is arranged, excluding an area in which at least a part of an object image included in the first screen is arranged from the drawing area when an operation of erasing the at least a part of the object is received, and displaying a reduced screen on the display surface when an operation is received, the reduced screen being obtained by reducing a whole of the drawing area into a size of the display surface.Type: GrantFiled: July 1, 2022Date of Patent: May 14, 2024Assignee: SEIKO EPSON CORPORATIONInventors: Akio Tomotoshi, Toshiki Fujimori
-
Patent number: 11985353Abstract: A method and apparatus for a low complexity transform unit partitioning structure for High Efficiency Video Coding (HEVC). The method includes determining prediction unit size of a coding unit, and setting the size of transform unit size of Y, U and V according to the prediction unit size of the coding unit.Type: GrantFiled: May 25, 2022Date of Patent: May 14, 2024Assignee: Texas Instruments IncorporatedInventor: Minhua Zhou
-
Patent number: 11979587Abstract: This disclosure provides methods, devices, and systems for video coding. The present implementations more specifically relate to hybrid coding techniques that combine aspects of inter-frame coding with aspects of intra-frame coding. In some aspects, a video encoder may perform inter-frame coding in a weighted manner so that the coded video frames (also referred to as “residual frames”) may include contributions from the current video frame to be transmitted over a communication channel and also may include contributions from the previous video frame transmitted over the communication channel. More specifically, any pixel value (r(n)) in the residual frame can be expressed as a weighted combination of a respective pixel value (x(n)) in the current video frame and a co-located pixel value (x(n?1)) in the previous video frame, where r(n)=x(n)??·x(n?1) and where 0???1 is a scaling factor representing the degree of contribution by the previous video frame.Type: GrantFiled: October 5, 2022Date of Patent: May 7, 2024Assignee: Synaptics IncorporatedInventors: Maciej Sebastian Pedzisz, Timothy John Borer
-
Patent number: 11968372Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.Type: GrantFiled: February 8, 2023Date of Patent: April 23, 2024Assignee: Avalon Holographics Inc.Inventors: Matthew Hamilton, Chuck Rumbolt, Donovan Benoit, Matthew Troke, Robert Lockyer
-
Patent number: 11968405Abstract: A method of video processing includes performing a conversion between a video including a picture and a bitstream of the video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that an indication of whether a first flag is signalled at a beginning of a picture header associated with the picture, wherein the first flag is indicative of whether the picture is an intra random access point (IRAP) picture or a gradual decoding refresh (GDR) picture.Type: GrantFiled: July 7, 2022Date of Patent: April 23, 2024Assignee: BYTEDANCE INC.Inventors: Ye-kui Wang, Li Zhang, Kai Zhang
-
Patent number: 11961246Abstract: Provided are a depth image processing method, a depth image processing apparatus, an electronic device and a readable storage medium. The method includes: (101) obtaining consecutive n depth image frames; (102) determining a trusted pixel and determining a smoothing factor corresponding to the trusted pixel; (103) determining a time similarity weight; (104) determining a content similarity; (105) determining a content similarity weight based on the content similarity and the smoothing factor; and (106) performing filtering processing on a depth value of the trusted pixel based on all time similarity weights and all content similarity weights.Type: GrantFiled: December 10, 2021Date of Patent: April 16, 2024Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP. LTDInventor: Jian Kang
-
Patent number: 11956478Abstract: A method and apparatus for encoding a video stream using video point cloud coding, the decoding including obtaining an input point cloud; dividing the input point cloud into a plurality of chunks, including a first chunk including a first plurality of points and a second chunk including a second plurality of points; generating a first plurality of patches based on the first plurality of points; generating a second plurality of patches based on the second plurality of points; packing the first plurality of patches and the second plurality of patches into an image; and generating the video stream based on the image.Type: GrantFiled: January 2, 2020Date of Patent: April 9, 2024Assignee: TENCENT AMERICA LLCInventors: Arash Vosoughi, Sehoon Yea, Shan Liu
-
Patent number: 11956473Abstract: Video coding tools can be controlled by including syntax in a video bitstream that makes better use of video decoding resources. An encoder inserts syntax into a video bitstream to enable a decoder to parse the bitstream and easily control which tools combinations are enabled, which combinations are not permitted, and which tools are activated for various components in a multiple component bitstream, leading to potential parallelization of bitstream decoding.Type: GrantFiled: November 22, 2022Date of Patent: April 9, 2024Assignee: INTERDIGITAL VC HOLDINGS, INC.Inventors: Edouard Francois, Pierre Andrivon, Franck Galpin, Fabrice Leleannec, Michel Kerdranvat
-
Patent number: 11956420Abstract: A method of decoding a coded video bitstream is provided. The method includes parsing a slice header of a current slice represented in the coded video bitstream. The slice header includes a reference picture list structure. The method also includes deriving, based on the reference picture list structure, a reference picture list of the current slice; and obtaining, based on the reference picture list, at least one reconstructed block of the current slice.Type: GrantFiled: February 16, 2021Date of Patent: April 9, 2024Assignee: Huawei Technologies Co., Ltd.Inventors: Ye-Kui Wang, FNU Hendry
-
Patent number: 11956411Abstract: An image signal processor includes a register and a disparity correction unit. The register stores disparity data obtained from a pattern image data that an image senor generates, and the image sensor includes a plurality of pixels, and each of the pixel includes at least a first photoelectric conversion element and a second photoelectric conversion element. The image sensor generates the pattern image data in response to a pattern image located at a first distance from the image sensor. The disparity correction unit corrects a disparity distortion of an image data based on the disparity data to generate a result image data, and the image senor generates the image data by capturing an object.Type: GrantFiled: September 28, 2022Date of Patent: April 9, 2024Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Hee Kang, Young-Jun Song, Dong-Ki Min, Jong-Min You, Jee-Hong Lee, Seok-Jae Kang, Taek-Sun Kim, Joon-Hyuk Im
-
Patent number: 11948685Abstract: Disclosed here is a method of generating a dental recommendation based on image processing. Further, the method may include receiving at least one patient data comprising at least one image from at least one patient device. Further, the method may include retrieving at least one dental dataset. Further, the method may include analyzing the at least one patient data and the at least one dental dataset. Further, the method may include generating at least one landmark based on the analyzing. Further, the method may include retrieving at least one dental reference dataset. Further, the method may include processing the at least one landmark and the at least one dental reference dataset, determining at least one dental recommendation based on the processing, transmitting the at least one dental recommendation to at least one external device and storing the at least one dental recommendation.Type: GrantFiled: December 30, 2020Date of Patent: April 2, 2024Inventor: Richard Ricci
-
Patent number: 11949889Abstract: At least one embodiment relates to a method for padding a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame. The method also comprises encoding a video stream including a time-interleaving of said encoded first and second images. There is also provided a method comprising decoding a video stream to provide a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame; and filtering pixel values of the second depth image by using pixel values of the first depth image.Type: GrantFiled: January 21, 2019Date of Patent: April 2, 2024Assignee: InterDigital VC Holdings, Inc.Inventors: Jean-Claude Chevet, Joan Llach Pinsach, Kangying Cai
-
Patent number: 11949845Abstract: During operation of a machine, an understanding of terrain features is critical. Accordingly, disclosed embodiments augment a video stream, captured by a camera mounted on the machine, with terrain information. In particular, an overlay is generated on at least one image frame. The overlay, which may comprise one or more semi-transparent bands, may cyclically recede from a foreground to a background of the image frame(s), cyclically advance from a background to a foreground of the image frame(s), or cyclically move horizontally across the image frame(s). The overlay may be colorized to illustrate the height of the terrain underneath the overlay.Type: GrantFiled: August 31, 2022Date of Patent: April 2, 2024Assignee: Caterpillar Inc.Inventors: Craig Allan Lehocky, Michael William Bridenbaugh, Brad Robert Van de Veer, Jeffrey K. Berry, Jeffrey J. Baker
-
Patent number: 11941744Abstract: Various methods are provided for generating motion vectors in the context of 3D computer-generated images. An example method includes generating, for each pixel of one or more objects to be rendered in a current frame, a 1-phase motion vector (MV1) and a 0-phase motion vector (MV0), each MV1 and MV0 having an associated depth value, to thereby form an MV1 texture and an MV0 texture; converting the MV1 texture to a set of MV1 blocks and converting the MV0 texture to a set of MV0 blocks; and outputting the set of MV1 blocks and the set of MV0 blocks for image processing.Type: GrantFiled: March 23, 2022Date of Patent: March 26, 2024Assignee: PIXELWORKS SEMICONDUCTOR TECHNOLOGY (SHANGHAI) CO. LTD.Inventors: Hongmin Zhang, Miao Sima, Zongming Han, Gongxian Liu, Junhua Chen, Guohua Cheng, Baochen Liu, Neil Woodall, Yue Ma, Huili Han
-
Patent number: 11936913Abstract: Aspects of the disclosure provide a method, an apparatus, and non-transitory computer-readable storage medium for video decoding. The apparatus includes processing circuitry that is configured to decode a current picture based on a bitstream. The processing circuitry can determine, from a supplemental enhancement information (SEI) message, a first flag indicating whether a warping process is applied to the current decoded picture. Based on the first flag indicating that the warping process is applied to the current decoded picture, the processing circuitry can determine warping information of the warping process based on the SEI message. The processing circuitry can determine a warped picture from the current decoded picture based on the warping information.Type: GrantFiled: June 27, 2022Date of Patent: March 19, 2024Assignee: TENCENT AMERICA LLCInventors: Byeongdoo Choi, Stephan Wenger, Xiang Li, Shan Liu
-
Patent number: 11928845Abstract: An apparatus to facilitate real-time playback of point cloud sequence data is disclosed. The apparatus comprises one or more processors to receive point cloud data of a captured scene, decompose the point cloud data into a plurality of point cloud patches, wherein each point cloud patch is associated with an object in the scene and includes contextual information regarding the point cloud patch, encode each of the point cloud patches via a deep-learning based algorithm to generate encoded point cloud patches, receive a viewpoint selection from a client, assign a priority to data chunks within each encoded point cloud patch based on the viewpoint selection and the contextual information and transmit the data chunks to the client based on the assigned priority.Type: GrantFiled: November 16, 2021Date of Patent: March 12, 2024Assignee: Intel CorporationInventors: Fai Yeung, Wayne Cochran, Pratibha Pandhare
-
Patent number: 11917162Abstract: Aspects of the disclosure provide a method and an apparatus for video encoding. The apparatus includes processing circuitry configured to generate an initial feature representation from an input image to be encoded and perform an iterative update of values of a plurality of elements in the initial feature representation. The iterative update includes generate a coded representation corresponding to a final feature representation based on the final feature representation that has been updated from the initial feature representation by a number of iterations of the iterative update. A reconstructed image corresponding to the final feature representation is generated based on the coded representation. An encoded image corresponding to the final feature representation having updated values of the plurality of elements is generated. One of (i) a rate-distortion loss corresponding to the final feature representation or (ii) the number of iterations of the iterative update satisfies a pre-determined condition.Type: GrantFiled: April 26, 2022Date of Patent: February 27, 2024Assignee: TENCENT AMERICA LLCInventors: Ding Ding, Sheng Lin, Wei Jiang, Wei Wang, Shan Liu
-
Patent number: 11917184Abstract: Several techniques for video encoding and video decoding are described. An example method of processing video data includes performing a conversion between a video including one or more subpictures and a bitstream of the video according to a format rule, wherein the format rule specifies that a first syntax element in a scalable nesting supplemental enhancement information message in the bitstream is set to a particular value in response to the scalable nesting supplemental enhancement information message including one or more subpicture level information supplemental enhancement information messages, and wherein the particular value of the first syntax element indicates that the scalable nesting supplemental enhancement information message includes one or more scalable-nested supplemental enhancement information messages that apply to a specific output video layer set.Type: GrantFiled: December 7, 2022Date of Patent: February 27, 2024Assignee: BYTEDANCE INC.Inventor: Ye-kui Wang
-
Patent number: 11889065Abstract: A method of decoding an image can includes constructing an advanced motion vector predication (AMVP) candidate list using available motion vector candidates of a left motion vector candidate, an above motion vector candidate and a temporal motion vector candidate; selecting a motion vector predictor among motion vector candidates of the AMVP candidates list using an AMVP index, and generating a motion vector using the motion vector predictor and a differential motion vector, generating a prediction block using the motion vector and a reference picture index; inversely quantizing a quantized block using a quantization parameter to generate a transformed block and inversely transforming the transformed block to generate a residual block; and generating a reconstructed block using the prediction block and the residual block, in which the quantization parameter is generated per quantization unit, and a minimum size of the quantization unit is adjusted per picture.Type: GrantFiled: January 25, 2022Date of Patent: January 30, 2024Assignee: GENSQUARE LLCInventors: Soo Mi Oh, Moonock Yang
-
Patent number: 11876953Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.Type: GrantFiled: February 21, 2022Date of Patent: January 16, 2024Assignee: West Texas Technology Partners LLCInventors: Mario Kosmiskas, Nathan Abercrombie, Sleiman Itani
-
Patent number: 11875162Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, information related to an object to be simulated and rendered in the CGR environment is provided to the CGR platform, and a three-dimensional representation of the object is displayed in the CGR environment.Type: GrantFiled: June 21, 2022Date of Patent: January 16, 2024Assignee: Apple Inc.Inventors: Helmut Garstenauer, Martin Garstenauer, Edwin Iskandar, Timothy R. Oriol, Geoffrey Stahl, Cody J. White
-
Patent number: 11870971Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.Type: GrantFiled: November 12, 2021Date of Patent: January 9, 2024Assignee: West Texas Technology Partners, LLCInventors: Mario Kosmiskas, Nathan Abercrombie, Sleiman Itani
-
Patent number: 11861840Abstract: According to some embodiments, an imaging processing method for extracting a plurality of planar surfaces from a depth map includes computing a depth change indication map (DCI) from a depth map in accordance with a smoothness threshold. The imaging processing method further includes recursively extracting a plurality of planar region from the depth map, wherein the size of each planar region is dynamically adjusted according to the DCI. The imaging processing method further includes clustering the extracted planar regions into a plurality of groups in accordance with a distance function; and growing each group to generate pixel-wise segmentation results and inlier points statistics simultaneously.Type: GrantFiled: March 31, 2021Date of Patent: January 2, 2024Assignee: SHANGHAITECH UNIVERSITYInventors: Ziran Xing, Zhiru Shi, Yi Ma, Jingyi Yu
-
Patent number: 11863763Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.Type: GrantFiled: February 8, 2021Date of Patent: January 2, 2024Assignee: GE Video Compression, LLCInventors: Philipp Merkle, Christian Bartnik, Haricharan Lakshman, Detlev Marpe, Karsten Mueller, Thomas Wiegand, Gerhard Tech
-
Patent number: 11863750Abstract: According to the present invention, an adaptive scheme is applied to an image encoding apparatus that includes an inter-predictor, an intra-predictor, a transformer, a quantizer, an inverse quantizer, and an inverse transformer, wherein input images are classified into two or more different categories, and two or more modules from among the inter-predictor, the intra-predictor, the transformer, the quantizer, and the inverse quantizer are implemented to perform respective operations in different schemes according to the category to which an input image belongs. Thus, the invention has the advantage of efficiently encoding an image without the loss of important information as compared to a conventional image encoding apparatus which adopts a packaged scheme.Type: GrantFiled: June 27, 2022Date of Patent: January 2, 2024Assignee: Dolby Laboratories Licensing CorporationInventors: Jong Ki Han, Chan Won Seo, Kwang Hyun Choi
-
Patent number: 11863790Abstract: A method of decoding may be performed by at least one processor, and may comprise: receiving an entropy coded bitstream comprising compressed video data; generating one or more dequantized blocks, determining whether at least one of a height and a width of the one or more dequantized blocks is greater than or equal to a predefined threshold, and responsive to the at least one of the height or the width of the one or more dequantized blocks being greater than or equal to the predefined threshold, transform coding a dequantized block using a tuned line graph transform (LGT) core to perform direct matrix multiplications for each of the horizontal and vertical dimensions of the one or more dequantized blocks.Type: GrantFiled: January 10, 2022Date of Patent: January 2, 2024Assignee: TENCENT AMERICA LLCInventors: Madhu Peringassery Krishnan, Xin Zhao, Shan Liu