Patents Examined by Shan E Elahi
  • Patent number: 10769957
    Abstract: This disclosure relates to systems and methods for vehicle guidance. Stereo images may be obtained at different times using a stereo image sensor. A depth image may be determined based on an earlier obtained pair of stereo images. The depth image may be refined based on predictions of an earlier stereo image and a later obtained stereo image. Depth information for an environment around a vehicle may be obtained. The depth information may characterize distances between the vehicle and the environment around the vehicle. A spherical depth map may be generated from the depth information. Maneuver controls for the vehicle may be provided based on the spherical depth map.
    Type: Grant
    Filed: March 21, 2019
    Date of Patent: September 8, 2020
    Assignee: GoPro, Inc.
    Inventors: Pascal Gohl, Sammy Omari
  • Patent number: 10771805
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In other embodiments, there is provided a method, an apparatus, a computer readable storage medium stored with code thereon for use by an apparatus, and a video encoder, for encoding a scalable bitstream, to provide indicating an encoding configuration, where only samples and syntax from intra coded pictures of base layer is used for coding the enhancement layer pictures. In other embodiments, there is provided an apparatus, a computer readable storage medium stored with code thereon for use by an apparatus, and a video decoder, for decoding a scalable bitstream, to receive indications of an encoding configuration, where only samples and syntax from intra coded pictures of base layer is used for coding the enhancement.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: September 8, 2020
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Kemal Ugur, Mehmet Oguz Bici, Miska Matias Hannuksela
  • Patent number: 10769813
    Abstract: A calibration apparatus and method are provided for a surround-view camera system having a plurality of cameras mounted to an object (e.g., a vehicle). A plurality of markers are arbitrarily placed around the object and configured to measure a plurality of distances between one another. The markers preferably include a rangefinder to measure distances. From at least one image from one or more cameras, a controller is configured to visually identify at least two markers which define a coordinate system. Based on the measured plurality of distances between markers and the visually identified markers, the controller generates calibration information as an output, preferably saved in the form of a look-up table, which will be retrieved and used when a display device generates a bird's-eye view for a viewer. Additionally, a marker that is part of the calibration apparatus is provided.
    Type: Grant
    Filed: August 28, 2018
    Date of Patent: September 8, 2020
    Assignee: Bendix Commercial Vehicle Systems, LLC
    Inventors: Andreas U. Kuehnle, Hans M. Molin, Travis G. Ramler, Jeffrey R. Coleman, Cathy L. Boon, Zheng Li
  • Patent number: 10769445
    Abstract: A device receives video data concerning a plurality of customers and a product in a plurality of physical retail locations. The device processes the video data and determines actions of the plurality of customers in relation to the product in the plurality of physical retail locations, by: determining, for a customer of the plurality of customers, an activity of the customer in relation to the product, and determining, for the customer, an eye gaze direction of the customer relative to the product. The device determines categories for the actions of the plurality of customers in relation to the product. The device generates a report that indicates one or more of the categories for the actions of the plurality of customers in relation to the product and sends the report to a client device to permit the client device to display the report.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: September 8, 2020
    Assignee: Capital One Services, LLC
    Inventors: Anh Truong, Kenneth Taylor, Vincent Pham, Fardin Abdi Taghi Abad, Jeremy Goodsitt, Austin Walters
  • Patent number: 10760907
    Abstract: A method for detecting a displacement of a mobile platform is provided. The method includes acquiring a first frame and a second frame using an imaging device that is coupled to the mobile platform, and obtaining rotation data using an inertial measurement unit (IMU) that is coupled to the mobile platform. The method also includes calculating a translation array based on the first frame, the second frame, and the rotation data. The method further includes determining the displacement of the mobile platform based on the translation array.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: September 1, 2020
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventor: Honghui Zhang
  • Patent number: 10761309
    Abstract: Disclosed is a laser scanning based microscope apparatus including a light source configured to output a laser signal, a scanning unit configured to scan a heating sample with a first laser signal corresponding to a portion of the output laser signal, and output an optical signal reflected from the sample by the scanning to a first detector, the first detector configured to generate a first electrical signal through the reflected optical signal, a second detector configured to generate a second electrical signal through a second laser signal corresponding to a remaining portion of the output laser signal, and a controller configured to acquire a thermal image of the sample by performing a frequency domain analysis based on the first electrical signal and a differential electrical signal.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: September 1, 2020
    Assignee: Korea Basic Science Institute
    Inventors: Dong Uk Kim, Ki Soo Chang
  • Patent number: 10757330
    Abstract: The invention relates to recording images with variable resolution for a driver assistance system (101) of a vehicle (100). The driver assistance system (101) comprises a camera (102). In the standard operation mode, the camera (103) is configured to iteratively switch between recording images of a first type and images of a second type with a higher resolution than the images of the first type. In this way, the images of the first type can be used for analyzing a near-range of the vehicle environment without requiring too much computing power. Moreover, the images of the second type have a sufficient resolution for analyzing a far-range of the vehicle environment.
    Type: Grant
    Filed: March 22, 2017
    Date of Patent: August 25, 2020
    Assignee: Conti Temic microelectronic GmbH
    Inventor: Mina Ashrafi
  • Patent number: 10757429
    Abstract: In a method of transcoding of a video bitstream by a transcoder arrangement, performing the steps of receiving (S10) a video bitstream with a predetermined input video format, receiving (S20) side information related to the video bitstream, the side information comprising at least one of mode or motion or in-loop filter information relating to at least one other predetermined video format for the video bitstream. Further, performing the steps of decoding (S40) the received side information to generate transcoding guiding information, and encoding (S50) a representation of the received video bitstream based at least on the generated transcoding guiding information, to provide a transcoded video bitstream with a predetermined output video format.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: August 25, 2020
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Kenneth Andersson, Thomas Rusert, Rickard Sjöberg
  • Patent number: 10757392
    Abstract: The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: August 25, 2020
    Assignee: LG Electronics Inc.
    Inventors: Soojin Hwang, Sejin Oh, Tung Chin Lee
  • Patent number: 10742952
    Abstract: A 3D reconstruction method is provided. Positioning signals are received by a signal receiver at a first and a second time spots to determine a HMD displacement vector and a HMD rotation amount. A first and a second images are retrieved by a first camera to determine a first camera rotation amount. A relative rotation amount and a relative displacement vector between the HMD and the first camera are calculated. A first camera displacement vector of the first camera is calculated according to the HMD displacement vector, the HMD rotation amount, the relative rotation amount and the relative displacement vector. Depth information of the first and the second image is obtained based on the first camera displacement vector and the first camera rotation amount. 3D reconstruction is performed according to images retrieved by the first camera and the depth information.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: August 11, 2020
    Assignee: HTC Corporation
    Inventors: Jun-Lin Guo, Yung-Chen Lin, Yan-Min Kuo
  • Patent number: 10739574
    Abstract: An illumination optical system includes: a beam splitter located near a conjugate position of a specimen and configured to split beams from a light source into a plurality of groups of beams having different splitting directions around an optical axis; a beam selector configured to select and transmit one group of beams from the plurality of groups of beams and that is rotatable with respect to the optical axis; and a ½ wavelength plate located near the beam selector and rotatable about the optical axis. The rotation angles of the ½ wavelength plate and of the beam selector about the optical axis are respectively set so that the polarization direction of the beam which has passed through the ½ wavelength plate is perpendicular to the splitting direction of the one group of beams that has been selected by the beam selector and split by the beam splitter.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: August 11, 2020
    Assignee: NIKON CORPORATION
    Inventor: Yumiko Ouchi
  • Patent number: 10743024
    Abstract: To achieve a reduction in the amount of coding taken in the use of an asymmetric partition and to implement efficient encoding/decoding processes exploiting the characteristics of the asymmetric partition. An image decoding device includes a motion compensation parameter derivation unit configured to derive a motion compensation parameter indicating either a uni-prediction scheme or a bi-prediction scheme. In a case that a prediction unit has a size less than or equal to a predetermined value, the motion compensation parameter derivation unit is configured to derive the motion compensation parameter by switching between the prediction schemes.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: August 11, 2020
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomoyuki Yamamoto, Tomohiro Ikai, Yukinobu Yasugi
  • Patent number: 10735734
    Abstract: Embodiments of the present invention provide an encoder including a quantization stage, an entropy encoder, a residual quantization stage and a coded signal former. The quantization stage is configured to quantize an input signal using a dead zone in order to obtain a plurality of quantized values. The entropy encoder is configured to encode the plurality of quantized values using an entropy encoding scheme in order to obtain a plurality of entropy encoded values. The residual quantization stage is configured to quantize a residual signal caused by the quantization stage, wherein the residual quantization stage is configured to determine at least one quantized residual value in dependence on the dead zone of the quantization stage. The coded signal former is configured to form a coded signal from the plurality of entropy encoded values and the at least one quantized residual value.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: August 4, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Guillaume Fuchs, Benjamin Schubert, Grzegorz Pietrzyk, Markus Multrus, Bernhard Grill
  • Patent number: 10735693
    Abstract: Sensor data is received. The sensor data includes event related data relating to at least one of scale of the event and occurrence location of the event from at least one of a number of sensors. At least one of the number of sensors is actuated, based on the sensor data and coverage information relating to imaging range which each of the sensors is able to image.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: August 4, 2020
    Assignee: NEC CORPORATION
    Inventors: Takeshi Arikuma, Masahiro Tani
  • Patent number: 10725281
    Abstract: An optical cap that protects a camera lens of the inspection assembly is disclosed herein. The disclosed optical cap for an inspection assembly may include an optically clear dome-shaped window element and a metal collar attached to the window element, the collar including means for securing the optical cap to said inspection assembly, wherein the collar is bonded to the window element by means of brazing or welding.
    Type: Grant
    Filed: January 19, 2017
    Date of Patent: July 28, 2020
    Assignee: E.V. OFFSHORE LIMITED
    Inventors: Jonathan Thursby, Shaun Peck
  • Patent number: 10715787
    Abstract: A depth imaging system and a control method thereof are provided. The depth imaging system includes a first imaging device, a second imaging device, a sliding base, a detecting module, an estimating module, a calculating module, and a control module. The first imaging device and the second imaging device are mounted on the sliding base. The detecting module detects a target region of the first image and the second image. The estimating module estimates an initial depth of the target region. The calculating module calculates a baseline corresponding to the initial depth. The control module controls the sliding base to adjust a relative distance between the first imaging device and the second imaging device. The calculating module generates an adjusted baseline according to the adjusted relative distance between the first imaging device and the second imaging device, such that the adjusted baseline is closer to the calculated baseline.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: July 14, 2020
    Assignee: ULSee Inc.
    Inventors: Adam Baumberg, Mark Middlebrook
  • Patent number: 10706270
    Abstract: An information provision device is disclosed. The information provision device comprises: cameras and a driver's seat microphone which detect the state of a user of a moving body, the user being located within a predetermined area including the moving body; an emotion engine which estimates emotions of the user based on the detection results from the cameras and the driver's seat microphone; and an image transmission unit which, when the emotion level of the user estimated by the emotion engine is increased by a predetermined level or higher, captures an image of the user through the driver's seat camera and transmits the captured image data of the user to a communication terminal of the user.
    Type: Grant
    Filed: June 22, 2017
    Date of Patent: July 7, 2020
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Shinichiro Goto, Tomoko Shintani, Hiromitsu Yuhara, Eisuke Soma
  • Patent number: 10708500
    Abstract: An information processing apparatus, including circuitry configured to transmit a start instruction to a first camera apparatus and a second camera apparatus. The start instruction causes the first camera apparatus to start incrementing a first counter and the second camera apparatus to start incrementing a second counter for a video recording time period. The circuitry receives, from the first camera apparatus, a first recording-start frame identifier that indicates a value of the first counter and a second recording-end frame identifier that indicates the value of the second counter. The circuitry receives, from the second camera apparatus, a first recording-start frame identifier that identifies a value of the second counter and a second recording-end frame identifier that identifies the value of the second counter.
    Type: Grant
    Filed: August 2, 2017
    Date of Patent: July 7, 2020
    Assignee: SONY CORPORATION
    Inventors: Tetsuo Kaneko, Yasuhiro Iizuka, Shinnosuke Usami, Kazuhiro Uchida, Shigeo Nakatsuka
  • Patent number: 10708552
    Abstract: Provided is a vehicle driving assistant device, including: a sensor module; a camera module which photographs images; and a control module which calculates a gradient value of a ground where a vehicle is located based on a first center axis value measured by the sensor module when a front side of the vehicle is located in a first direction after being mounted and a second center axis value measured by the sensor module when the front side of the vehicle is located in a second direction which is opposite to the first direction and determines an effective area for following an object in the image based on a center axis fixing error value of the sensor module calculated using at least one of the first and second center axis values and the gradient value.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: July 7, 2020
    Assignee: MOBILE APPLIANCE, INC.
    Inventors: Kyoung Hwan Cha, Jong Hoon Lim
  • Patent number: 10701381
    Abstract: Disclosed are a method and an apparatus for video decoding that support a plurality of layers. The method for video decoding includes acquiring information indicating whether tile information exists and acquiring the tile information based on the information indicating whether tile information exists.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: June 30, 2020
    Assignee: Electronics and Telecommunications Research Intitute
    Inventors: Jung Won Kang, Jin Ho Lee, Ha Hyun Lee, Jin Soo Choi, Jin Woong Kim