Patents Examined by Christopher S Kelley
  • Patent number: 11962912
    Abstract: An image processing system may comprise a global shutter camera, an illumination emitter, and a processing system comprising at least one processor and memory. The processing system may be configured to control the image processing system to: control the illumination emitter to illuminate a scene; control the global shutter camera to capture a sequence of images of the scene, wherein the captured sequence of images includes images that are captured without illumination of the scene by the illumination emitter and images that are captured while the scene is illuminated by the illumination emitter; and determine presence of an object in the scene based on comparison of the images captured without illumination of the scene and images captured with illumination of the scene.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: April 16, 2024
    Assignee: Aptiv Technologies AG
    Inventors: Morgan D. Murphy, Ronald M. Taylor
  • Patent number: 11949845
    Abstract: During operation of a machine, an understanding of terrain features is critical. Accordingly, disclosed embodiments augment a video stream, captured by a camera mounted on the machine, with terrain information. In particular, an overlay is generated on at least one image frame. The overlay, which may comprise one or more semi-transparent bands, may cyclically recede from a foreground to a background of the image frame(s), cyclically advance from a background to a foreground of the image frame(s), or cyclically move horizontally across the image frame(s). The overlay may be colorized to illustrate the height of the terrain underneath the overlay.
    Type: Grant
    Filed: August 31, 2022
    Date of Patent: April 2, 2024
    Assignee: Caterpillar Inc.
    Inventors: Craig Allan Lehocky, Michael William Bridenbaugh, Brad Robert Van de Veer, Jeffrey K. Berry, Jeffrey J. Baker
  • Patent number: 11949843
    Abstract: In some embodiments, a computer-implemented method includes capturing an image for each flash unit of an electronic device, each image being illuminated during the capturing of the image; obtaining a normalized image from one or more of the illuminated images; and using an illumination-based optimization framework to generate an enhanced three-dimensional (3D) depth image, the illumination-based optimization framework being based on the illuminated image. In some embodiments of the computer-implemented method, the illumination-based optimization framework incorporates the normalized image and 3D depth data associated with the captured image into the generation of the enhanced 3D depth image.
    Type: Grant
    Filed: May 28, 2022
    Date of Patent: April 2, 2024
    Assignee: Meta Platforms, Inc.
    Inventor: Shenchang Eric Chen
  • Patent number: 11949890
    Abstract: The present invention relates to a decoding method for a bit stream that supports a plurality of layers. The decoding method may include receiving information on a set of video parameters that includes information on the plurality of layers, and parsing the set of video parameters to grasp information on the layers in the bit stream.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: April 2, 2024
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jung Won Kang, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 11936898
    Abstract: A method of compressing a frame in an image compression and storage system includes mapping an original sample to a mapped sample based on a bit depth of the original sample and a maximum allowed error, determining a residue of the mapped sample based on a mapped previous reconstructed sample, applying a modulo addition to the residue to generate a biased residue, quantizing the biased residue based on the maximum allowed error to generate a quantized biased residue, and encoding a value corresponding to the quantized biased residue to generate an encoded value.
    Type: Grant
    Filed: October 7, 2022
    Date of Patent: March 19, 2024
    Assignee: Samsung Display Co., Ltd.
    Inventor: Vijayaraghavan Thirumalai
  • Patent number: 11935225
    Abstract: According to one embodiment, a processing device performs at least determination processing of determining a state of a weld by using a first image of at least a portion of a weld pool. The state includes a first state, and a second state that is more unstable than the first state. The determination processing determines the weld to be in the second state when ripples exist in the weld pool. The processing device corrects a condition of the weld when the weld is determined to be in the second state. The processing device does not correct the condition of the weld when the weld is determined to be in the first state.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: March 19, 2024
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Kohei Takeya, Tetsuo Sakai
  • Patent number: 11924392
    Abstract: The disclosure provides a method for mitigating 3D crosstalk and a 3D display. The method includes: detecting first and second eye positions of a user, and determining a viewing angle of the user and a rotation angle of a head of the user accordingly; estimating a first reference position and a first midpoint position between first and second eyes of the user based on the first and second eye positions of the user; obtaining a second reference position, and estimating a difference between the first and second reference positions; correcting the first midpoint position to a second midpoint position based on the rotation angle of the user and the difference; and determining a first pixel for projecting to the first eye and a second pixel for projecting to the second eye among the pixels of the 3D display based on the second midpoint position.
    Type: Grant
    Filed: January 19, 2022
    Date of Patent: March 5, 2024
    Assignee: Acer Incorporated
    Inventor: Chao-Shih Huang
  • Patent number: 11917170
    Abstract: The present invention relates to an image information decoding method. The decoding method includes receiving a bit stream including a Network Abstraction Layer (NAL) unit that includes information related to encoded image, and parsing a NAL unit header of the NAL unit. The NAL unit header may not include 1 bit flag information that represents whether a picture is a non-reference picture or a reference picture in the entire bit stream during encoding.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: February 27, 2024
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jung Won Kang, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 11910006
    Abstract: A method for encoding video data is provided that includes determining whether or not a parent coding unit of a coding unit of the video data was predicted in intra-prediction block copy (IntraBC) mode and, when it is determined that the parent coding unit was not predicted in IntraBC mode: computing activity of the coding unit, determining an IntraBC coding cost of the coding unit by computing the IntraBC coding cost of the coding unit using a two dimensional (2D) search when the activity of the coding unit is not than an activity threshold, and computing the IntraBC coding cost of the coding unit using a one dimensional (1D) search when the activity of the coding unit is less than the activity threshold, using the IntraBC coding cost to select an encoding mode from one of a plurality of encoding modes, encoding the coding unit using the selected encoding mode.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: February 20, 2024
    Assignee: Texas Instruments Incorporated
    Inventors: Do-Kyoung Kwon, Madhukar Budagavi
  • Patent number: 11902514
    Abstract: A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method may include based on a reference line index signaling a first reference line nearest to a coding unit, among a plurality of reference lines adjacent to the coding unit, applying intra smoothing on one or more first reference lines comprising the first reference line, among the plurality of reference lines, and based on the intra smoothing being applied on the one or more first reference lines, applying a position-dependent intra prediction combination (PDPC) on one or more third reference lines comprising the first reference line, among the plurality of reference lines, while preventing application of the PDPC on one or more fourth reference lines other than the one or more third reference lines, among the plurality of reference lines.
    Type: Grant
    Filed: June 10, 2022
    Date of Patent: February 13, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11902539
    Abstract: Embodiments of the present disclosure relate to a method, a device, and a computer program product for video compression. The method includes: segmenting, in response to one or more features of an object in a video having a periodic change, the video into a plurality of segments based on a cycle of the periodic change; and identifying focal regions in frames of the video that are associated with the object. The method further includes: compressing the video based on the plurality of segments and the focal regions. This solution provides a content-aware lightweight video compression solution that supports content-based video deduplication at multiple scales and breaks the spatio-temporal continuity constraint of video frames during compression, thus enabling more effective video compression.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: February 13, 2024
    Assignee: Dell Products L.P.
    Inventors: Tianxiang Chen, Sanping Li
  • Patent number: 11902570
    Abstract: Techniques related to reduction of artifacts in parallel block coding mode selection for video are discussed. Such techniques include, for blocks along a parallel processing split boundary of a video frame, coding mode selection that divides a block into sub-blocks, performs motion estimation for the sub-blocks with skip check disabled and using distortion and coefficient coding cost but exclusive of motion vector coding cost, and evaluates a skip check for the block using the sub-block motion vectors.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: February 13, 2024
    Assignee: Intel Corporation
    Inventors: Sergei Plotnikov, Jason Tanner
  • Patent number: 11884216
    Abstract: A vehicular display system includes an electronic control unit (ECU), a plurality of cameras including a driver-side rear corner camera and a passenger-side rear corner camera disposed at respective driver-side and passenger-side rear corner regions of the vehicle. The ECU includes an image processor operable to process image data captured by any of the plurality of cameras and generate video images. A video mirror display screen is disposed at an interior rearview mirror assembly of the vehicle and is operable to display video images provided by the ECU. Responsive to a triggering event, the ECU, via processing of image data captured by at least one of the driver-side and passenger-side rear corner cameras, generates cross-traffic view video images and provides the cross-traffic view video images to the video mirror display screen. The cross-traffic view video images are displayed in a split-screen format at the video mirror display screen.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: January 30, 2024
    Assignee: Magna Mirrors of America, Inc.
    Inventors: Nathan J. Pastoor, Peter J. Spencley, Jr.
  • Patent number: 11882260
    Abstract: Cost-effective, spatially representative image data is recording in a stereoscopic or photogrammetric image of an environment by a camera apparatus having three holographic-optical elements arranged as coupling regions at different positions on a carrier medium to capture the environment from different perspectives. Light from the environment is coupled by the coupling regions into the carrier medium which provides a light guide that transfers the light to an additional holographic-optical element which provides a decoupling region to decouple the light from the carrier medium. An image capture device captures the decoupled light and produces image data therefrom. A separating device produces the spatially representative image data from the image data by capturing the light incident on the coupling regions in a manner separated temporally or by color.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: January 23, 2024
    Assignee: AUDI AG
    Inventors: Markus Klug, Tobias Moll, Johannes Scheuchenpflug
  • Patent number: 11880992
    Abstract: An apparatus comprising an interface, a light projector and a processor. The interface may be configured to receive pixel data. The light projector may be configured to generate a structured light pattern. The processor may be configured to process the pixel data arranged as video frames comprising the structured light pattern, perform computer vision operations to detect a size of a face area of the video frames, determine a scale ratio in response to the size of the face area, extract the structured light pattern from the video frames, generate a downscaled structured light image and generate a depth map in response to the downscaled structured light image and a downscaled reference image. A downscale operation may be performed in response to the scale ratio to generate the downscaled structured light image. The scale ratio may enable the generation of the downscaled structured light image with sufficient depth pixels.
    Type: Grant
    Filed: March 15, 2022
    Date of Patent: January 23, 2024
    Assignee: Ambarella International LP
    Inventors: Jian Tang, Tao Liu, Jingyang Qiu
  • Patent number: 11872998
    Abstract: Methods and systems are disclosed for cross-validating a second sensor with a first sensor. Cross-validating the second sensor may include obtaining sensor readings from the first sensor and comparing the sensor readings from the first sensor with sensor readings obtained from the second sensor. In particular, the comparison of the sensor readings may include comparing state information about a vehicle detected by the first sensor and the second sensor. In addition, comparing the sensor readings may include obtaining a first image from the first sensor, obtaining a second image from the second sensor, and then comparing various characteristics of the images. One characteristic that may be compared are object labels applied to the vehicle detected by the first and second sensor. The first and second sensors may be different types of sensors.
    Type: Grant
    Filed: November 8, 2022
    Date of Patent: January 16, 2024
    Assignee: Waymo LLC
    Inventors: Jiajun Zhu, Dmitri A. Dolgov, Christopher Paul Urmson
  • Patent number: 11877046
    Abstract: An endoscope includes: an imaging controller configured to drive in a first operation mode for operating an imager in accordance with an input first clock signal or in a second operation mode for operating the imager in accordance with an input second clock signal different from the first clock signal; a switch configured to output, to the imaging controller, a switching signal for switching the previously set second operation mode to be driven by the imaging controller to the first operation mode; and a first generator configured to generate a first enable signal causing the switch to output the switching signal based on the first clock signal when the first clock signal is input from an external processing device, and output the generated first enable signal to the switch.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: January 16, 2024
    Assignee: OLYMPUS CORPORATION
    Inventor: Yasunori Matsui
  • Patent number: 11875573
    Abstract: An image processing system is configured to receive a first high resolution stream of images and a second lower resolution stream of images from image sources with substantially the same field of view. The system comprises a localizer component configured to provide a location for any object of interest independently of class within successive images of the second stream of images; a classifier configured to: receive one or more locations selectively provided by the localizer, identify a corresponding portion of an image acquired from the first stream at substantially the same time at which an image from the second stream in which an object of interest was identified and return a classification for the type of object within the identified portion of the image from the first stream; and a tracker configured to associate the classification with the location through acquisition of successive images in the second stream.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: January 16, 2024
    Inventors: Cosmin Toca, Bogdan Sandoi, Petronel Bigioi
  • Patent number: 11870969
    Abstract: An imaging apparatus includes a first camera, a second camera, a first imaging condition setting portion, and a second imaging condition setting portion. The first camera includes a color filter portion and a first light receiving portion receiving light transmitted through the color filter portion, and which captures a color imaged. The second camera includes a spectroscopic element to disperse light having a predetermined spectral wavelength from incident light and to change the spectral wavelength to four or more wavelengths, and a second light receiving portion to receive the light dispersed by the spectroscopic element and capture a spectroscopic image of each wavelength dispersed by the spectroscopic element; The first imaging condition setting portion sets a first imaging condition for the first camera. The second imaging condition setting portion sets a second imaging condition for the second camera based on the first imaging condition.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: January 9, 2024
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Teruyuki Nishimura
  • Patent number: 11871014
    Abstract: An electronic device for encoding a picture is described. The electronic device includes a processor and instructions stored in memory that are in electronic communication with the processor. The instructions are executable to encode a step-wise temporal sub-layer access (STSA) sample grouping. The instructions are further executable to send and/or store the STSA sample grouping.
    Type: Grant
    Filed: April 19, 2021
    Date of Patent: January 9, 2024
    Assignee: DOLBY INTERNATIONAL AB
    Inventor: Sachin G. Deshpande