Combined Image Signal Generator And General Image Signal Processing Patents (Class 348/222.1)
  • Patent number: 11461980
    Abstract: A device including a storage medium storing instructions, and at least one processor configured to execute the stored instructions to perform operations is provided. The operations include displaying on a display screen an interactive scene containing an augmented reality element, receiving input to change display of the interactive scene, and receiving a request to simulate the capturing of image data representing the interactive scene. The operations further include determining a position of the augmented reality element relative to a region defined on the display screen, simulating the capturing of the image data representing the interactive scene, and providing, based on the determined position, an indication of whether the simulation has succeeded.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: October 4, 2022
    Assignee: Capital One Services, LLC
    Inventors: Staevan Duckworth, Daniel Martinez, William Hardin, Victoria Blacksher, Jonathan Castaneda, Stewart Youngblood
  • Patent number: 11463631
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an image. The method may include: receiving a first image including a face input by a user in an interactive scene; presenting the first image to the user; inputting the first image into a pre-trained generative adversarial network in a backend to obtain a second image output by the generative adversarial network; where the generative adversarial network uses face attribute information generated based on the input image as a constraint; and presenting the second image to the user in response to obtaining the second image output by the generative adversarial network in the backend.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: October 4, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Henan Zhang, Xin Li, Fu Li, Tianwei Lin, Hao Sun, Shilei Wen, Hongwu Zhang, Errui Ding
  • Patent number: 11462177
    Abstract: A display device includes a display panel having a plurality of sub-pixels to display an image; a data driver for supplying image data to the plurality of sub-pixels; a gate driver for supplying a gate signal to the plurality of sub-pixels; a controller configured to convert a driving frequency of each of the data driver and the gate driver in a high frame rate mode; and a gamma voltage generator for generating gamma voltages respectively based on each driving frequency, wherein the controller is configured to generate a horizontal synchronization signal based on the driving frequency in the high frame rate mode. Accordingly, even when the driving frequency conversion occurs, image quality levels corresponding to various driving frequencies respectively may be kept uniform by applying the same operation duration to the various driving frequencies.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: October 4, 2022
    Assignee: LG Display Co., Ltd.
    Inventors: Sangyun Han, Yeongseok Choe, Joonmo Yang
  • Patent number: 11457164
    Abstract: Provided is an image sensing device including a photoelectric element configured to receive a reset signal at a first end and connected to a sensing node at a second end, a reset transistor configured to reset a floating diffusion at a first voltage, a capacitor disposed between the floating diffusion and the sensing node, a driving transistor configured to generate a pixel signal from a charge generated by the photoelectric element based on a second voltage, and a selection transistor configured to provide the pixel signal to an external device, wherein while the selection transistor is turned on, the reset transistor is turned off at a first time point, and the sensing node is reset by the reset signal at a second time point that is later than the first time point.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: September 27, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Hyun Yong Jung
  • Patent number: 11454782
    Abstract: An imaging lens system includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens, sequentially disposed at intervals from an object side of the imaging lens system. A refractive index of each of the second lens, the third lens, the fourth lens, and the fifth lens is 1.6 or greater, and TTL/2IH<0.730, where TTL is a distance from an object side surface of the first lens to an imaging plane, and 2IH is a diagonal length of the imaging plane.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: September 27, 2022
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventors: Kil Soo Shin, Yong Joo Jo
  • Patent number: 11449971
    Abstract: Disclosed is an image fusion method and apparatus. The fusion method includes detecting first feature points of an object in a first image frame from the first image frame; transforming the first image frame based on the detected first feature points and predefined reference points to generate a transformed first image frame; detecting second feature points of the object in a second image frame from the second image frame; transforming the second image frame based on the detected second feature points and the predefined reference points to generate a transformed second image frame; and generating a combined image by combining the transformed first image frame and the transformed second image frame.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: September 20, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Minsu Ko, Seungju Han, Jaejoon Han, Jihye Kim, SungUn Park, Chang Kyu Choi
  • Patent number: 11450701
    Abstract: A photoelectric conversion apparatus includes a plurality of pixels each including a photoelectric conversion portion, a charge holding portion, a floating diffusion, and first and second transistors disposed in a common active region. The active region includes a partial region which includes a first region extending in a first direction, a second region connected to the first region and extending in a second direction, and a third region connected to the second region and extending in a third direction. In a planar view, the partial region of a first pixel is disposed between a gate of the first transistor of the first pixel and the charge holding portion of a second pixel, and between a gate of the second transistor of the first pixel and the charge holding portion of the second pixel. A light-shielding member is disposed in a region overlapping the partial region.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: September 20, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Masahiro Kobayashi, Hiroshi Sekine
  • Patent number: 11449701
    Abstract: A non-transitory computer readable medium storing an image processing program causes a computer to function as: a processing unit that performs image processing on an image; and a control unit that controls the processing unit to execute first processing on a target image of the first processing instructed by a user and controls the processing unit to execute second processing corresponding to the first processing on a similar image that is similar to the target image.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: September 20, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventor: Yuki Nakamori
  • Patent number: 11448768
    Abstract: The proposed method for operating a laser distance measuring device, in particular a hand-held laser distance measuring device, is based on a method in which laser radiation is emitted to a target point by means of an emitter unit, laser radiation reflected back from the target point is detected by a receiver unit with a detection surface, at least one image of at least one target environment of the target point is captured by at least one camera, and a representation of the image, overlaid with a marking of the target point, is displayed on a screen of the laser distance measuring device. According to the disclosure, a parallax error in the representation of the image, overlaid with a marking of the target point, is corrected according to an estimated distance to the target point. The disclosure also relates to a corresponding laser distance measuring device.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: September 20, 2022
    Assignee: Robert Bosch GmbH
    Inventors: Andreas Braun, Stefan Noe, Bernd Schmidtke
  • Patent number: 11450080
    Abstract: An image processing method and apparatus, and a storage medium are provided. The method includes: detecting a target object in a current video frame of a target video stream, to obtain a current detection region for the target object; adjusting the current detection region according to a historic detection region corresponding to the target object in a historic video frame of the target video stream, to obtain a determined current detection region; performing key point positioning on the target object based on the determined current detection region, to obtain a first set of key points; and performing stabilization on locations of the key points in the first set according to locations of key points in a second set corresponding to the target object in the historic video frame, to obtain current locations of a set of key points of the target object in the current video frame.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: September 20, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Weilong Peng, Xiaoyong Shen, Yilun Chen, Yanan Sun
  • Patent number: 11445106
    Abstract: An imaging apparatus comprising: an image sensor configured to capture an image of a subject to generate image data; an audio input device configured to receive an audio signal indicating sound to be collected during image capturing with the image sensor; a detector configured to detect a subject region which corresponds to the subject in the image data; a controller configured to control a sound collection area where a sound from the subject is collected for the audio signal; wherein when the detector detects a plurality of subject regions, the controller compares a size of a subject region of a focus target with a size of another subject regions among the plurality of subject regions, and determines whether or not a subject corresponding to each of the plurality of subject regions is a sound collection target based on a comparison result.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: September 13, 2022
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventor: Hiroki Kasugai
  • Patent number: 11438532
    Abstract: An image capturing apparatus includes an image capturing device capable of performing a plurality of charge accumulation operations within the same time period of a vertical synchronization signal. A follow-up control value and a first predicted control value which is more distant from a current control value than the follow-up control value in a direction of change are set based on a photometry result using the current control value. When at least one of proper differences between the follow-up control value and the first predicted control and respective photometric values obtained therewith is not larger than a predetermined allowable value, the photometric value associated therewith is determined as a proper exposure. The current control value is an initial value or one of the photometric values in a case where the proper differences are both larger than the predetermined allowable value.
    Type: Grant
    Filed: July 12, 2021
    Date of Patent: September 6, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Akari Hayashi
  • Patent number: 11436452
    Abstract: A method for processing video data comprising a plurality of image frames, the method comprising: obtaining a forward model and a backward model of the plurality of image frames; processing the forward model and the backward model to propagate at least one label in the region or patch to at least one other image frame of the video sequence, using a probabilistic method for estimating the label in the at least one other image frame in forward and backward correspondences, wherein, during the processing, a pixel having a most likely label with a probability lower than a threshold value is assigned a predetermined generic label; and generating a labelled result for any given image frame by applying an image label difference, based on label uncertainty between the forward and backward correspondences, to the given image frame.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: September 6, 2022
    Assignees: TOYOTA MOTOR EUROPE, CAMBRIDGE ENTERPRISE LIMITED
    Inventors: Patrick Sauer, Ignas Budvytis, Roberto Cipolla
  • Patent number: 11438537
    Abstract: An image pickup apparatus has a plurality of pixels each of which includes first and second photoelectric converters and is arranged in a matrix and connected to a column output line, a reading unit configured to perform a first reading operation that reads a signal of the first photoelectric converter to the column output line and a second reading operation that reads a signal obtained by mixing the signals of the first and second photoelectric converters to the column output line, a column circuit configured to be connected to the column output line, and a control unit configured to save power in at least some of the column circuits not used during the first reading operation from among the column circuits used in the second reading operation, during the first reading operation.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: September 6, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hideaki Sambonsugi
  • Patent number: 11437423
    Abstract: The present technology relates to an image sensor, a manufacturing method and an electronic device capable of preventing a ghost. In the image sensor, a plate-like transparent member larger than a sensor chip in size is affixed to a side of a pixel array unit of the sensor chip having the pixel array unit in which pixels that perform photoelectric conversion are arrayed. The present technology can be applied to a case of capturing an image by receiving light, regardless of whether the light is visible light or not.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: September 6, 2022
    Assignee: SONY CORPORATION
    Inventor: Taizo Takachi
  • Patent number: 11431887
    Abstract: Provided is an information processing device and a method that enable extraction of a desired object from a moving image with sound. The information processing device includes an image object detection unit that detects an image object on the basis of a moving image with sound, a sound object detection unit that detects a sound object on the basis of the moving image with sound, and a sound image object detection unit that detects a sound image object on the basis of a detection result of the image object and a detection result of the sound object.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: August 30, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventor: Naoya Takahashi
  • Patent number: 11430406
    Abstract: A system and method are provided to generate blended video and graphics using a blending domain. The system converts video from a first domain to a blending domain. The system converts graphics from a second domain to the blending domain and blends the video and graphics in the blending domain to generate a blended output.
    Type: Grant
    Filed: February 1, 2021
    Date of Patent: August 30, 2022
    Assignee: Avago Technologies International Sales Pte. Limited
    Inventors: David Chaohua Wu, Richard Hayden Wyman
  • Patent number: 11425319
    Abstract: In a solid-state imaging device, first electric charge is generated by at least two first photoelectric conversion elements in a first exposure period. At least two pieces of the first electric charge are added in a floating diffusion. A first memory stores a first pixel signal that is based on the first electric charge. Second electric charge is generated by at least one second photoelectric conversion element in a second exposure period. At least part of the second exposure period overlaps at least part of the first exposure period. The second electric charge is held in the floating diffusion. A second memory stores a second pixel signal that is based on the second electric charge.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: August 23, 2022
    Assignee: OLYMPUS CORPORATION
    Inventor: Yuichi Gomi
  • Patent number: 11425358
    Abstract: A system and method to capture the surface geometry a three-dimensional object in a scene using unsynchronized structured lighting is disclosed. The method and system includes a pattern projector configured and arranged to project a sequence of image patterns onto the scene at a pattern frame rate, a camera configured and arranged to capture a sequence of unsynchronized image patterns of the scene at an image capture rate, and a processor configured and arranged to synthesize a sequence of synchronized image frames from the unsynchronized image patterns of the scene. Each of the synchronized image frames corresponds to one image pattern of the sequence of image patterns.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: August 23, 2022
    Assignee: BROWN UNIVERSITY
    Inventors: Gabriel Taubin, Daniel Moreno, Fatih Calakli
  • Patent number: 11425314
    Abstract: In a method for suppression of reflections in at least one camera image of a camera of a motor vehicle, the camera generates the at least one camera image and thereby a polarization filter device dampens light incident from a surrounding field in regard to a predetermined polarization direction. An estimator device estimates a respective orientation of a respective surface normal of at least one surface on at least one environment object and an adjusting device determines a respective target polarization direction for the polarization filter device in dependence on the respective estimated orientation of the at least one surface normal, by which a respective representation of reflections at the respective surface is reduced in the at least one camera image, and generates a control signal according to the respectively determined target polarization direction, and the polarization filter device adjusts its polarization direction in dependence on the control signal.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: August 23, 2022
    Assignee: Audi AG
    Inventors: Marvin Raaijmakers, Stefan Krämer
  • Patent number: 11425300
    Abstract: According to various embodiments, an electronic device comprises a communication module, a memory, and a processor functionally connected with the communication module and the memory, wherein the processor may be configured to: receive a request for revision information corresponding to a first image from an external electronic device via the communication module; generate, on the basis of image recognition, first revision information by using a raw image corresponding to the first image; determine, on the basis of a comparison between the first image and the first revision information, whether a feature of the first revision information satisfies a predetermined condition or not; transmit, when the feature of the first revision information does not satisfy the predetermined condition, the first revision information to the external device to enable the external electronic device to generate a second image, that is, the revised first image by using the first revision information; generate, when the feature of
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: August 23, 2022
    Inventors: Nari Im, Ildo Kim, Jaegon Kim, Sangjin Lee, Yongju Lee, Changgwun Lee, Seunghye Chyung, Hyeyun Jung, Jiyoon Park, Jonghun Won
  • Patent number: 11425325
    Abstract: A driving apparatus that outputs a drive signal for driving, per row, a plurality of pixels arranged to form a plurality of rows, the driving apparatus comprising a plurality of row driving units arranged to correspond to the respective rows, wherein each of the row driving units includes: a memory unit that holds a signal for controlling the pixels in a corresponding row to be set to a charge accumulation state or a reset state; and a selection unit that selects whether to cause a state of the signal held in the memory unit to transition when a signal for readout from the pixels is input.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: August 23, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Taichi Kasugai, Atsushi Shimada
  • Patent number: 11423168
    Abstract: An electronic apparatus is provided, which includes a memory, a communicator, and a processor configured to receive a user command requesting sharing of content, search the content for a region which has security information, based on the received user command, extract an image corresponding to the security information from the found region, identify the security information in the image, and determine whether to change the image, based on the identified security information.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: August 23, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ho-jung Lee, Yong-sang Jeong
  • Patent number: 11418694
    Abstract: Disclosed is an electronic apparatus. The electronic apparatus includes: a camera; a first microphone; a second microphone; and a processor configured to: control the electronic apparatus to obtain first sound data through the first microphone, control the electronic apparatus to obtain second sound data through the second microphone, identify an object corresponding to the first sound data and the second sound data in image data obtained through the camera, obtain position information of the identified object from the image data, and change volume information of at least one of the first sound data or the second sound data based on the obtained position information.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: August 16, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yangwook Kim, Woohyun Nam, Seungho Lee
  • Patent number: 11417087
    Abstract: An image processing system may include a processor and an associated memory configured to store training data that includes training geospatial images. Each training geospatial image may include pixels. The processor may be configured to operate a training model to identify a given feature from each of the training geospatial images, and to iteratively generate a probability distribution function based upon a number of pixels corresponding to the given feature and also based upon a bias factor being reduced with each iteration.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: August 16, 2022
    Assignee: HARRIS GEOSPATIAL SOLUTIONS, INC.
    Inventors: Michael P. Deskevich, Robert A. Simon, Christopher R. Lees
  • Patent number: 11417364
    Abstract: A mobile image capture device is provided that can include an image capture system operable to capture image frames and be configured to: provide a live video stream for display in a viewfinder portion of a user interface that depicts at least a portion of a current field of view of the image capture system; store a video segment from the live video stream in a temporary image buffer that includes a plurality of image frames captured by the image capture system; receive a user input that is directed to the viewfinder portion of the user interface that requests a rewind operation; and, in response to such user input, perform the rewind operation in the viewfinder portion of the user interface with respect to the video segment in which at least two of the image frames of the video segment can be provided for display in the user interface in a reverse chronological order.
    Type: Grant
    Filed: October 9, 2018
    Date of Patent: August 16, 2022
    Assignee: GOOGLE LLC
    Inventors: Donald A. Barnett, David Karam, Anton Vayvod, Aaron Michael Donsbach
  • Patent number: 11415991
    Abstract: The present disclosure provides an image generating device configured to acquire an image captured by an imaging device to be installed in a water-surface movable body, place a virtual camera based on positional information and posture information, place additional display information as a 3D virtual reality object, place a virtual projection screen subdivided by a mesh distorted in the opposite direction of lens distortion in the captured image, convert vertexes of the virtual reality object and of the mesh faces by a vertex shader based on a position and a direction of the virtual camera into positions in a 2D virtual screen, place image pieces of the captured image to the corresponding mesh by a pixel shader based on the positions of the vertexes in the virtual screen, and generate a synthesized image where a graphic rendering the virtual reality object is synthesized with the captured image.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: August 16, 2022
    Assignee: Furuno Electric Co., Ltd.
    Inventor: Koji Nishiyama
  • Patent number: 11412150
    Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: August 9, 2022
    Assignee: GoPro, Inc.
    Inventors: Bruno César Douady-Pleven, Thomas Nicolas Emmanuel Veit, Guillaume Matthieu Guérin
  • Patent number: 11412151
    Abstract: A measurement unit measures a first generation time of a first vanishing point of a plurality of radially diverging motion vectors generated in a front image region and a second generation time of a second vanishing point of a plurality of converging motion vectors generated in the front image region within a predetermined period of time in a state in which an image rotation unit adjusts positions of the front image region and a rear image region in a circumferential direction. The image rotation unit keeps the positions of the front image region and the rear image region in the circumferential direction when the first generation time measured by the measurement unit is longer than the second generation time, and rotates the captured image to reverse the front image region and the rear image region when the first generation time is not longer than the second generation time.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: August 9, 2022
    Assignee: JVCKENWOOD CORPORATION
    Inventors: Toshitaka Murata, Takashi Himukashi, Yu Hojo
  • Patent number: 11408828
    Abstract: A system includes a plurality of modular subassemblies and a plate; wherein each modular subassembly comprises an enclosure and a plurality of optical components aligned to the enclosure, and each enclosure comprises a plurality of mounting structures; and wherein each modular subassembly is mechanically coupled to the plate by attachment of a mounting structure of the modular subassembly directly to a corresponding mounting structure located on the plate, such that by mechanically coupling each modular subassembly to the plate using the mounting structure of the modular subassembly and the corresponding mounting structure on the plate, adjacent modular subassemblies are aligned to each other upon such attachment, and wherein two of the modular subassemblies mechanically coupled to the plate are also attached to each other by mechanically coupling an alignment structure on one of the two modular subassemblies to a respective alignment structure on the other of the two modular subassemblies.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: August 9, 2022
    Assignee: ILLUMINA, INC.
    Inventors: Wenyi Feng, Simon Prince, Peter Clarke Newman, Dakota Watson, Stanley S. Hong, Marco A. Krumbuegel, Yinghua Sun, Andrew James Carson, Merek C. Siu
  • Patent number: 11402725
    Abstract: An assembly is disclosed. In an embodiment an assembly includes a light source configured to illuminate a field of view, a control circuit configured to operate the light source and a camera configured to record a scene in the field of view, wherein the light source comprises at least one semiconductor component having at least one semiconductor chip, wherein the semiconductor chip has an semiconductor layer sequence with an active region, wherein the semiconductor chip comprises the plurality of pixels, wherein the plurality of pixels are configured to generate radiation of the light source, wherein the control circuit has a memory configured to store operational data of the light source, wherein the control circuit is configured to operate the pixels on basis of the operational data, and wherein the arrangement is configured to perform an adaptation of at least a part of the operational data in the memory during operation of the arrangement.
    Type: Grant
    Filed: February 22, 2018
    Date of Patent: August 2, 2022
    Assignee: OSRAM OLED GMBH
    Inventors: Dominik Schulten, Michael Schumann, Dominik Scholz
  • Patent number: 11403781
    Abstract: An illustrative image processing system identifies an object depicted in an image captured by a camera. The image processing system locates, within the image, a set of calibration points corresponding to features of the object. Based on the set of calibration points, the image processing system performs a calibration operation with respect to the camera. Additionally, the image processing system generates model data based on the image. The model data is representative of a model of the object depicted in the image. Corresponding methods and systems are also disclosed.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: August 2, 2022
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Liang Luo, Elena Dotsenko, Tom Hsi Hao Shang
  • Patent number: 11405565
    Abstract: To provide an information processing device and an information processing method that can further shorten a time taken to perform processes related to an output of a captured image. Provided is an information processing device including a processing unit configured to process each piece of first data transferred with a first data density and second data transferred with a second data density that is different from the first data density based on pixel signals output from each of a plurality of pixels. The processing unit executes at least one of processing of outputting an image based on the first data and image-processing on the second data based on the first data.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: August 2, 2022
    Assignee: Sony Group Corporation
    Inventor: Kenzaburo Seki
  • Patent number: 11405557
    Abstract: A method for rolling shutter compensation for a camera sensor mounted on a moving vehicle includes estimating, based on a plurality of images of an object, a speed and a direction of movement of the vehicle; acquiring an additional image of the object having four corners; estimating a location of each of the four corners of the object in an image plane defined by the additional image; determining a corrected location in 3D space for each of the four corners of the object; determining a first compensated location for each of the four corners of the object in the image plane; determining a second compensated location for each of the four corners of the object in the image plane; and determining a difference between the first compensated locations of the four corners of the object and the second compensated locations of the four corners of the object.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: August 2, 2022
    Assignee: Locus Robotics Corp.
    Inventor: Changchun Li
  • Patent number: 11403589
    Abstract: Systems, media, and methods for collecting front-end information from a customer to establish a delivery/pickup location for delivery/pickup of a parcel by unmanned vehicles are provided. In some embodiments, a customer may be guided though a registration process that includes establishing release/retrieve zones for unmanned delivery/pickup. In some cases, release/retrieve zones may be determined using a map provided to the customer. Areas to establish release/retrieve zones may be suggested to the customer, or in some cases, the customer may suggest potential release/retrieve zones. It may be determined whether a release/retrieve zone is suitable based on customer configurations and consents. Some embodiments include establishing a release/retrieve zone using augmented reality. In some cases, customers may wish to designate off-limits areas, including no-fly zones, to prohibit certain unmanned vehicles from entering the off-limits areas.
    Type: Grant
    Filed: July 7, 2017
    Date of Patent: August 2, 2022
    Assignee: UNITED PARCEL SERVICE OF AMERICA, INC.
    Inventors: Jerome Ferguson, Jeffrey Cooper
  • Patent number: 11404461
    Abstract: A Complementary Metal Oxide Semiconductor, CMOS, device for radiation detection. The CMOS device includes a semiconductor diffusion layer having a photodetector region for receiving incident light, and a polysilicon layer having a patterned structure in a region at least partially overlapping the photodetector region. The structure includes a plurality of features being perforations extending through the polysilicon layer or columns of polysilicon, wherein the perforations are filled with, or the columns are surrounded by, a dielectric material.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: August 2, 2022
    Assignee: X-FAB SEMICONDUCTOR FOUNDRIES GMBH
    Inventor: Daniel Gäbler
  • Patent number: 11403499
    Abstract: Systems and methods for generating composite sets of data based on sensor data from different sensors are disclosed. Exemplary implementations may capture a color image including chromatic information; capture a depth image; generate inertial signals conveying values that are used to determine motion parameters; determine the motion parameters based on the inertial signals; generate a re-projected depth image as if the depth image had been captured at the same time as the color image, based on the interpolation of motion parameters; and generate a composite set of data based on different kinds of sensor data by combining information from the color image, the re-projected depth image, and one or more motion parameters.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: August 2, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventor: Georgios Evangelidis
  • Patent number: 11402609
    Abstract: Provided is an optical system and an imaging apparatus provided with the optical system. The optical system includes: a first lens having negative refractive power; a second lens having negative refractive power; a third lens having positive refractive power; and a fourth lens having positive refractive power, the first lens, the second lens, the third lens, and the fourth lens being disposed in this order from an object side. The optical system satisfies a predetermined condition relating to the focal length of the optical system and the distance on the optical axis between an exit pupil and an imaging plane in the optical system.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: August 2, 2022
    Assignee: TAMRON CO., LTD.
    Inventor: Masaki Sato
  • Patent number: 11405546
    Abstract: An image capturing apparatus includes an acquisition unit configured to acquire data concerning a captured image captured by an image capturing unit, a learning unit configured to learn a condition of an image that a user likes, based on supervised data, a control circuit configured to decide automatic image capturing by the image capturing unit based on the condition learned by the learning unit and to register, as the supervised data, data acquired by the acquisition unit for a captured image obtained by image capturing performed based on an instruction of the user, and data acquired by the acquisition unit for captured images for learning which are captured before and/or after the image capturing performed based on an instruction of the user.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: August 2, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hideki Kadoi
  • Patent number: 11403487
    Abstract: Implementations of the present specification provide an enhanced training method for an image recognition model. A predetermined quantity or predetermined proportion of samples are randomly selected from a first sample set as a seed sample for extension to obtain several extended samples. The extended sample is obtained by adding disturbance to an original image without changing an annotation result. In a sample extension process, disturbance values are arranged towards neighborhood in predetermined distribution with a reference pixel as a reference, so that real disturbance can be well simulated. Because the annotation result of the extended sample remains unchanged after the disturbance is added, an image recognition model trained by using the extended sample can well recognize a target recognition result of an original image, thereby improving robustness of the image recognition model.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: August 2, 2022
    Assignee: Alipay (Hangzhou) Information Technology Co., Ltd.
    Inventor: Wenhao Xu
  • Patent number: 11399191
    Abstract: Disclosed examples include at least one processor to: access frames captured at a first resolution by an image sensor; reduce ones of the frames to a second resolution lower than the first resolution, the ones of the frames at the second resolution interleaved with the frames at the first resolution in an interleaved video sequence; and buffer the interleaved video sequence; and a video encoder to: access the interleaved video sequence; and generate an encoded video sequence of frames at the first resolution by combining the frames of the interleaved video sequence.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: July 26, 2022
    Assignee: INTEL CORPORATION
    Inventors: Richmond Hicks, Jill M. Boyce
  • Patent number: 11399136
    Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: July 26, 2022
    Assignee: GoPro, Inc.
    Inventors: Thomas Nicolas Emmanuel Veit, Sylvain Leroy, Heng Zhang, Ingrid Cotoros
  • Patent number: 11398995
    Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: July 26, 2022
    Assignee: Snap Inc.
    Inventors: Grygoriy Kozhemiak, Victor Shaburov, Trevor Stephenson
  • Patent number: 11399132
    Abstract: An electronic apparatus connected to an image capture apparatus receives an image capture instruction for requesting the image capture apparatus to perform image capture processing, in response to a user operation. If the image capture instruction is received, the electronic apparatus performs control to display a first image recorded by the image capture apparatus performing the image capture processing according to a capture request based on the image capture instruction from the electronic apparatus on a screen without a second image recorded by the image capture apparatus automatically performing the image capture processing according to satisfying a predetermined condition for automatic capturing. If the image capture instruction is not received, the electronic apparatus performs control to display both the first image and the second image on the screen.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: July 26, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Araki Matsuda
  • Patent number: 11394886
    Abstract: An electronic device and a control method for an image capture device thereof are provided. The control method includes: setting an initial visual field; tracking an object in the initial visual field to obtain a first reference position; obtaining a reference visual field according to the first reference position; generating visual field adjusting information according to the initial visual field and the reference visual field; and adjusting, based on the visual field adjusting information, the reference visual field to obtain a target visual field according to a size of the object, where an area ratio between an area of the object and an area of the target visual field is larger than a ratio threshold, and the area ratio is smaller than 1.
    Type: Grant
    Filed: July 27, 2021
    Date of Patent: July 19, 2022
    Assignee: ASUSTeK COMPUTER INC.
    Inventors: Kuan-Yuan Chen, Sheng-Hsiung Chang, Chun-Hsiang Chang
  • Patent number: 11394878
    Abstract: An image capturing apparatus includes an image pickup device configured to output image data and at least one processor programmed to perform operations of a past history storage unit configured to store imaging information about each object, the imaging information including framing information about past imaging of each object, an acquisition unit configured to acquire object information based on the image data and a determination unit configured to determine a framing in execution of an imaging operation. The determination unit determines the framing in execution of the imaging operation according to past imaging information stored in the past history storage unit and the object information.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: July 19, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kensaku Mori
  • Patent number: 11388318
    Abstract: A monitoring device is provided in the disclosure, including a body, and a control circuit board, a camera component, a motion detection component and a power supply component. The control circuit board is electrically connected with the camera component, the motion detection component and the power supply component respectively, and the motion detection component is electrically connected with the power component. The control circuit board is awaken based on a detection result of the motion detection component, the control circuit board drives the camera component to make a camera shooting after being awaken, and power supplied by the power supply component to the awakened control circuit board and the camera component is a second power. A vertical angle of the camera component is adjusted by the manual adjustment mechanism, and a low power consumption mode can be realized by the motion detection component, thus saving resources.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: July 12, 2022
    Assignee: ShenZhen Shouli Intelligent Technology Co. LTD
    Inventor: Zheng Li
  • Patent number: 11388349
    Abstract: An imaging device including a pixel, and a controller that sets a sensitivity of the pixel according to an external signal, where the external signal includes sound, vibration or inclination.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: July 12, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Yoshiaki Satou, Yasuo Miyake, Yasunori Inoue, Tokuhiko Tamaki
  • Patent number: 11386695
    Abstract: An authentication device includes an illumination device, a camera, and a processor configured to obtain, by capturing by the camera, an image including a subject illuminated with light of the illumination device, extract a target region from the obtained image, and perform determination that processing related to authentication is not allowed when the target region includes a first part of a first luminance value having a difference not less than a threshold value from a second luminance value of a second part of the target region.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: July 12, 2022
    Assignee: FUJITSU LIMITED
    Inventors: Soichi Hama, Satoshi Maeda, Yukihiro Abiko
  • Patent number: RE49212
    Abstract: A digital image processing apparatus, and a controlling method thereof are provided. The digital image processing apparatus displaying first content and second content generated with respect to the first content includes: a sensing unit that senses a movement of the digital image processing apparatus; a movement detecting unit that determines a movement of the digital image processing apparatus based on a sensed signal from the sensing unit; and a display control unit that controls display of the first and second contents, wherein the display control unit controls a single reproduction of the first content or a simultaneous reproduction of the first and second contents based on the determination of the movement detecting unit. A user may easily and intuitively manage various contents by using the digital image processing apparatus.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: September 13, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: In-ra Jang