Unitary Image Formed By Compiling Sub-areas Of Same Scene (e.g., Array Of Cameras) Patents (Class 348/218.1)
  • Patent number: 11769311
    Abstract: Disclosed is an editing system for postprocessing three-dimensional (“3D”) image data to realistically recreate the effects associated with viewing or imaging a represented scene with different camera settings or lenses. The system receives an original image and an edit command with a camera setting or a camera lens. The system associates the selection to multiple image adjustments. The system performs a first of the multiple image adjustments on a first set of 3D image data from the original image in response to the first set of 3D image data satisfying specific positional or non-positional values defined for the first image adjustment, and performs a second of the multiple image adjustments on a second set of 3D image data from the original image in response to the second set of 3D image data satisfying the specific positional or non-positional values defined for the second image adjustment.
    Type: Grant
    Filed: February 23, 2023
    Date of Patent: September 26, 2023
    Assignee: Illuscio, Inc.
    Inventors: Max Good, Joseph Bogacz
  • Patent number: 11734798
    Abstract: Techniques related to generating a fine super resolution image from a low resolution image including a person wearing a predetermined uniform are discussed. Such techniques include applying a pretrained convolutional neural network to a stacked image including image channels from a coarse super resolution image, label data corresponding to the coarse super resolution image from available labels relevant to the uniform, and pose data corresponding to the person to determine the fine super resolution image.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: August 22, 2023
    Assignee: Intel Corporation
    Inventors: Yuri Shpalensky, Tzach Ashkenazi, Maria Bortman, Roland Mishaev
  • Patent number: 11736805
    Abstract: An image capture apparatus includes a photoelectric conversion unit, an acquisition unit, a first amplification unit, a second amplification unit, and an amplification factor control unit. The photoelectric conversion unit is configured to convert an optical image into an image signal. The acquisition unit is configured to acquire a value related to a correct exposure on a basis of the image signal converted from the optical image by the photoelectric conversion unit. The first amplification unit is configured to amplify the image signal with a first amplification factor. The second amplification unit is configured to amplify the image signal with a second amplification factor. The amplification factor control unit is configured to change the first amplification factor or the second amplification factor based on the value related to the correct exposure.
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: August 22, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yasuhiro Itoh
  • Patent number: 11729521
    Abstract: Systems and method are provided for generating an image of an environment of a vehicle. In one embodiment, a method includes: determining, by a processor, a first position of a plurality of positions within a first field of view; controlling, by the processor, a discrete scanning device based on the first position; capturing, by an imaging device, pixel data for a plurality of pixels within a second field of view associated with the first position, wherein the second field of view is within the first field of view; and combining, by the processor, the pixel data from the second field of view with pixel data captured from a third field of view associated with one of the plurality of positions to form image data depicting the environment of the vehicle.
    Type: Grant
    Filed: March 8, 2021
    Date of Patent: August 15, 2023
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Emanuel Mordechai, Tzvi Philipp
  • Patent number: 11715223
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Patent number: 11678059
    Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.
    Type: Grant
    Filed: April 20, 2022
    Date of Patent: June 13, 2023
    Assignee: Waymo LLC
    Inventors: Benjamin Frevert, Lucian Ion, Nirav Dharia
  • Patent number: 11668861
    Abstract: A polyhedron lens architecture is disposed in a virtual sphere. The virtual sphere has a horizontal plane, an upper hemisphere above the horizontal plane and a lower hemisphere below the horizontal plane. The polyhedron lens architecture has an upper half part above the horizontal plane, and a lower half part below the horizontal plane. The polyhedron lens architecture includes: multiple bases, which are respectively disposed on the upper half part and the lower half part; and multiple lenses respectively disposed on surfaces of the bases. Optical axes of the lenses intersect at a central point, which is located at the horizontal plane and is a structural center of the polyhedron lens architecture.
    Type: Grant
    Filed: July 2, 2020
    Date of Patent: June 6, 2023
    Assignee: ASPEED TECHNOLOGY INC.
    Inventors: Chung-Yen Lu, Hsin-Yu Chen, Bing-Chia Peng
  • Patent number: 11659282
    Abstract: Two image processing systems and an image processing method are provided. One of the image processing systems includes a first unit configured to output a portion of input image data, a second unit configured to transform a coordinate of input image data, and a third unit configured to output the image data processed by the first unit and the second unit as video data to be displayed on a display. The other one of the image processing system further includes a fourth unit configured to combine input image data of a plurality of images to output one piece of image data. The image processing method includes outputting a portion of input image data, transforming a coordinate of input image data, and outputting the image data as video data to be displayed on a display.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: May 23, 2023
    Assignee: RICOH COMPANY, LTD.
    Inventor: Makoto Morioka
  • Patent number: 11537321
    Abstract: Systems, apparatuses, and methods related to media type selection are described. Memory systems can include multiple types of memory media (e.g., volatile and/or non-volatile) and can write data to the memory media types. Data inputs can be written (e.g., stored) in a particular type of memory media based on characteristics (e.g., source, attributes, and/or information etc. included in the data). For instance, selection of a portion of data can be based on the quality of the data received. In an example, a method can include receiving, by a memory system of a mobile device that comprises a plurality of memory media types, data from the assigned image sensor of a plurality of image sensors of the mobile device; and selecting a portion of data from the received data based on one or more characteristics of the data that indicate a quality of an image or images represented by the portion of data.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: December 27, 2022
    Assignee: Micron Technology, Inc.
    Inventors: Bhumika Chhabra, Carla L. Christensen, Zahra Hosseinimakarem
  • Patent number: 11503193
    Abstract: Disclosed is an imaging module, including a housing, a moving element received in the housing, multiple lenses in contact with and fixed on the moving element, an image sensor provided at one side of the multiple lenses, and a drive mechanism connected to the housing and the moving element, wherein the drive mechanism is used for driving the moving element to move along the optical axis of the multiple lenses so that the multiple lenses focus on the image sensor for imaging. A camera assembly and an electronic device are further disclosed.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: November 15, 2022
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Gong Zhang
  • Patent number: 11470257
    Abstract: A dual-aperture zoom digital camera operable in both still and video modes. The camera includes Wide and Tele imaging sections with respective lens/sensor combinations and image signal processors and a camera controller operatively coupled to the Wide and Tele imaging sections. The Wide and Tele imaging sections provide respective image data. The controller is configured to combine in still mode at least some of the Wide and Tele image data to provide a fused output image from a particular point of view, and to provide without fusion continuous zoom video mode output images, each output image having a given output resolution, wherein the video mode output images are provided with a smooth transition when switching between a lower zoom factor (ZF) value and a higher ZF value or vice versa, and wherein at the lower ZF the output resolution is determined by the Wide sensor while at the higher ZF value the output resolution is determined by the Tele sensor.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: October 11, 2022
    Assignee: Corephotonics Ltd.
    Inventors: Gal Shabtay, Ephraim Goldenberg, Oded Gigushinski, Noy Cohen
  • Patent number: 11448886
    Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: September 20, 2022
    Assignee: Apple Inc.
    Inventors: Noah D. Bedard, Ricardo J. Motta, Emanuele Mandelli, Daniel R. Hennigan, Kathrin Berkner Cieslicki, Branko Petljanski, Brett D. Miller, Kenichi Saito
  • Patent number: 11450013
    Abstract: A method for acquiring a sample image set, includes: acquiring a plurality of frame images continuously shot for a shooting scene; determining, as a reference image, one frame of a plurality of frame images, and determining, as non-reference images, remaining ones of the plurality of frame images other than the one determined as the reference image; performing a format conversion on the reference image and the non-reference images to obtain a format-converted reference image and format-converted non-reference images, and performing a noise addition processing on the format-converted reference image and each non-reference image respectively; aligning each noise-added non-reference image with a noise-added reference image to obtain an aligned non-reference image; annotating the format-converted reference image with pixel information to obtain a non-noise-added reference image; and acquiring the sample image set, the sample image set including the aligned non-reference image, the noise-added reference image, and
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: September 20, 2022
    Assignee: Beijing Xiaomi Pinecone Electronics Co., Ltd.
    Inventors: Weihang Yuan, Jin Wang, Taolue Feng
  • Patent number: 11418751
    Abstract: A method of an electronic device including an image sensor that acquires an optical signal corresponding to an object and a controller that controls the image sensor, is provided. The method includes identifying a mode for generating an image corresponding to the object by using the optical signal, determining a setting of at least one image attribute to be used for generating the image at least based on the mode, generating image data by using pixel data corresponding to the optical signal at least based on the setting, and displaying the image corresponding to the object through a display functionally connected to the electronic device at least based on the image data.
    Type: Grant
    Filed: March 15, 2021
    Date of Patent: August 16, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa-Young Kang, Dong-Soo Kim, Moon-Soo Kim, Young-Kwon Yoon, Dong-Hoon Jang
  • Patent number: 11412136
    Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: August 9, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hamid R. Sheikh, Youngjun Yoo, John Seokjun Lee, Michael O. Polley
  • Patent number: 11412135
    Abstract: A bowl-shaped photographic stage and photographic system is provided that produces consistent diffused lighting of an object or subject that is virtually shadow free for obtaining rotational views of the object in a time efficient manner. The bowl-shaped photographic stage may be used with a camera array, or a single camera may be moved around the circumference of the photographic stage to obtain a series of images needed to form a rotational view of an object or subject. Alternatively, the bowl-shaped photographic stage may be rotated to pass by a single fixed camera to obtain a series of images needed to form a rotational view of an object or subject.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: August 9, 2022
    Assignee: OVAD CUSTOM STAGES, LLC
    Inventor: Davo Scheich
  • Patent number: 11398252
    Abstract: An audio processing apparatus includes an audio file recovery unit configured to recover an audio file related to a video file. With video data of the video file and audio data of the audio file recorded at different speed rates from each other, the audio file recovery unit recovers the audio file so that an end position of the audio data coincides with an end position of the video data in playback of the audio data and the video data at a speed rate.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: July 26, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hitoshi Mizutani
  • Patent number: 11388387
    Abstract: An imaging system includes first and second light source devices configured to irradiate a subject with lights having different wavelength bands, first and second imaging devices configured to image the subject, and first and second video processing devices configured to process an imaged video of the subject imaged by either of the corresponding imaging devices and to output the processed video to an output unit. The first and second light source devices alternately perform lighting in synchronization with a frame period of the imaged video or an integer multiple thereof based on a genlock signal. The first imaging device performs imaging in synchronization with the lighting of each of the first and second light source devices. The second imaging device performs imaging in synchronization with the lighting of each of the first and second light source devices.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: July 12, 2022
    Assignee: PANASONIC l-PRO SENSING SOLUTIONS CO., LTD.
    Inventors: Tetsushi Hirano, Yuji Kiniwa, Haruo Kogane
  • Patent number: 11375175
    Abstract: Using the techniques discussed herein, a set of images is captured by one or more array imagers (106). Each array imager includes multiple imagers configured in various manners. Each array imager captures multiple images of substantially a same scene at substantially a same time. The images captured by each array image are encoded by multiple processors (112, 114). Each processor can encode sets of images captured by a different array imager, or each processor can encode different sets of images captured by the same array imager. The encoding of the images is performed using various image-compression techniques so that the information that results from the encoding is smaller, in terms of storage size, than the uncompressed images.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: June 28, 2022
    Assignee: Google Technology Holdings LLC
    Inventors: John T. Bretscher, Randall S. Vaas
  • Patent number: 11363211
    Abstract: Provided are an image generation control device, an image generation control method, and an image generation control program that are capable of generating an image of an object to be imaged positioned in a vicinity of an imaging-hindering light source with high precision. In an image generation control device, based on luminance variation within a target area including the imaging-hindering light source and the object to be imaged, a calculation unit calculates an expected light-off period during which the imaging-hindering light source is turned off. An image-capturing control unit, by setting an exposure period of an image-capturing unit within the expected light-off period calculated by the calculation unit, makes the image-capturing unit capture an image including the target area within the expected light-off period.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: June 14, 2022
    Assignee: JVCKENWOOD CORPORATION
    Inventor: Hisashi Koiso
  • Patent number: 11350020
    Abstract: The present application provides a camera module array, comprising at least two camera modules, wherein at least one of the camera modules has a free-form lens sheet, and the free-form lens sheet performs active alignment according to an actual imaging result received by a photosensitive chip, so that a difference between an actual reference direction of the free-form lens sheet and a reference direction determined by an optical design is not greater than 0.05 degrees. The present application further provides a corresponding assembly method for camera module array. In the present application, a TTL of the camera modules can be reduced by means of the free-form lens sheet so as to, for example, make a TTL of a wide-angle module equal or approximately equal to a TTL of a telephoto module, so that a dual-camera module composed of the wide-angle module and the telephoto module is easily mounted in a terminal device such as a mobile phone.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: May 31, 2022
    Assignee: NINGBO SUNNY OPOTECH CO., LTD.
    Inventors: Takehiko Tanaka, Yinli Fang
  • Patent number: 11341607
    Abstract: An apparatus comprising a memory and one or more processing circuits is provided. The memory stores a blend table having blend weights. The processing circuits, for partitions of the blend table: determine whether a subset of the pixels associated with the partition includes pixels associated with seamlines defined in a three-dimensional surface representation of the scene. If none of the subset of the pixels are associated with the seamlines, the processing circuits populate a region of the virtual image corresponding to the partition with pixel values from an image captured by one of the plurality of image capture devices. If one or more of the subsets of the pixels is associated with the seamlines, the processing circuits populate the region of the virtual image associated with the partition with blended pixel values from two or more images captured by two or more of the plurality of image capture devices.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: May 24, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Martin Fritz Mueller, Shashank Dabral
  • Patent number: 11336830
    Abstract: Multi-cameras and in particular dual-cameras comprising a Wide camera comprising a Wide lens and a Wide image sensor, the Wide lens having a Wide effective focal length EFLW and a folded Tele camera comprising a Tele lens with a first optical axis, a Tele image sensor and an OPFE, wherein the Tele lens includes, from an object side to an image side, a first lens element group G1, a second lens element group G2 and a third lens element group G3, wherein at least two of the lens element groups are movable relative to the image sensor along the first optical axis to bring the Tele lens to two zoom states, wherein an effective focal length (EFL) of the Tele lens is changed from EFLT,min in one zoom state to EFLT,max in the other zoom state, wherein EFLTmin>1.5×EFLW and wherein EFLTmax>1.5×EFLTmin.
    Type: Grant
    Filed: January 1, 2020
    Date of Patent: May 17, 2022
    Assignee: Corephotonics Ltd.
    Inventors: Gal Shabtay, Ephraim Goldenberg, Roy Rudnick, Michael Dror, Gil Bachar, Emil Bronstein, Itay Yedid
  • Patent number: 11294395
    Abstract: An accompanying vehicle selection system includes: a first vehicle that is provided with a driver's seat; a plurality of second vehicles that have different functions from the first vehicle, and that are configured to travel in accompaniment with the first vehicle; and a control unit that is provided in the first vehicle, and that determines, based on input information, which vehicle from among the plurality of second vehicles is to travel in accompaniment with the first vehicle.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: April 5, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Yoshinori Yamada, Masaki Ito, Shotaro Inoue, Akihiro Muguruma, Michio Ikeda
  • Patent number: 11297229
    Abstract: A method of acquiring images includes moving, into a plurality of acquisition locations, of an acquisition device including at least one camera, and acquisition at each acquisition location of at least one image of a scene by the camera. Each acquisition location being chosen in such a manner that scenes viewed by the camera at two consecutive acquisition locations and corresponding images overlap, at least partially, and areal density of pixels assigned to at least one element of the corresponding scene, which is represented in the corresponding image by a high-resolution portion, is greater than 50% or greater than 80% of a target areal density, the areal density of pixels being defined as a ratio of the area of the element projected in a plane perpendicular to an optical axis of the camera over a quantity of pixels of the high-resolution portion.
    Type: Grant
    Filed: October 3, 2019
    Date of Patent: April 5, 2022
    Assignee: SOLETANCHE FREYSSINET
    Inventors: Guy Perazio, Jose Peral, Serge Valcke, Luc Chambaud
  • Patent number: 11295589
    Abstract: Provided is a surveillance system including a communication module configured to receive a plurality of pieces of image data obtained by a plurality of camera modules, receive a multiple image data request from a client terminal, and transmit a multiple image data response including multiple image data to the client terminal; and a processer configured to generate the multiple image data by scaling the plurality of pieces of image data in response to the multiple image data request and combining a plurality of pieces of scaled image data, wherein the plurality of camera modules share one internet protocol (IP) address.
    Type: Grant
    Filed: March 19, 2018
    Date of Patent: April 5, 2022
    Assignee: HANWHA TECHWIN CO., LTD.
    Inventors: Sung Bong Cho, Il Hwang Cha
  • Patent number: 11294374
    Abstract: One embodiment describes a control system in an automation system including a first portion located at a first vehicle, which includes a first autonomous module that autonomously controls operation of the first vehicle to perform operations in a first area based at least in part on a first target operation result while the first portion is in an autonomous mode; and a second portion located at a second vehicle, in which the second portion includes a second autonomous module that autonomously controls operation of the second vehicle to perform operations in a second area based at least in part on a second target operation result while the second portion is in the autonomous mode and a first command module that determines the first target operation result and the second target operation result based at least in part on a global plan that indicates a total target operation result.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: April 5, 2022
    Assignees: CNH Industrial America LLC, Autonomous Solutions, Inc.
    Inventors: Christopher A. Foster, John H. Posselius, Bret T. Turpin, Daniel J. Morwood
  • Patent number: 11297222
    Abstract: An image capture device includes: an image capture parameter determination unit configured to determine an exposure time when an image of a display device on which a display character is formed by a plurality of segment light emitters that flash on and off asynchronously at predetermined intervals is captured; a captured image acquisition unit configured to, in accordance with a number of captured images and image capture interval determined on the basis of the exposure time and a formation required period that is required for the display device to form the display character by sequentially turning on any one of the plurality of segment light emitters, acquire the determined number of captured images generated by capturing the image of the display device; and a composition unit configured to generate a composite image obtained by compositing the determined number of captured images.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: April 5, 2022
    Assignee: NEC CORPORATION
    Inventor: Masahito Sakai
  • Patent number: 11287875
    Abstract: The present disclosure relates to a communication technique, which is a convergence of IoT technology and 5G communication system for supporting higher data transmission rate beyond 4G system, and a system for same. The present invention can be applied to smart services (e.g. smart homes, smart buildings, smart cities, smart cars or connected cars, health care, digital education, retail businesses, security- and safety-related services and the like) on the basis of 5G communication technology and IoT-related technology. The present disclosure, in a screen control method for a virtual reality service in an electronic device, comprises the steps of: detecting a movement of a pointer on a screen while an application for a virtual reality service is being executed; analyzing the movement of the pointer on the basis of a preset screen display method; and changing and displaying the configuration of the screen in accordance with the analysis of the movement of the pointer.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: March 29, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yevgen Yakishyn, Oleksandra Peteichuk, Oleksandr Radomskyi, Oleksandr Shchur, Sun-Kyung Kim, Andriy Oliynyk
  • Patent number: 11288487
    Abstract: The invention relates to a method of a fingerprint sensing system of enabling cancelling out impairment data present in an image captured by a fingerprint sensor of the fingerprint sensing system, a method of a fingerprint sensing system of cancelling out impairment data present in an image captured by a fingerprint sensor of the fingerprint sensing system, and a fingerprint sensing system performing the methods.
    Type: Grant
    Filed: February 7, 2018
    Date of Patent: March 29, 2022
    Assignee: FINGERPRINT CARDS ANACATUM IP AB
    Inventors: Karl Lundahl, Erik Svensson, Morten Rolle Hansen
  • Patent number: 11288480
    Abstract: The present invention generally relates to a method for authenticating a finger of a user of an electronic device comprising a fingerprint sensor for sensing a fingerprint pattern, the method comprising the steps of: acquiring a candidate fingerprint image; determining, based on the candidate fingerprint image, a humidity level indication indicative of the humidity level of the finger; performing an authentication pre-process based on the humidity level indication; performing a fingerprint authentication process based on the pre-process to authenticate the user.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: March 29, 2022
    Assignee: FINGERPRINT CARDS ANACATUM IP AB
    Inventors: Kenneth Jonsson, David Tingdahl
  • Patent number: 11277579
    Abstract: An image sensor includes a pixel array configured to generate a plurality of pixel signals, an analog to digital converter circuit coupled to the pixel array and configured to generate respective digital codes responsive to respective ones of the pixel signals, a plurality of memories, respective ones of which are configured to store respective bits of the digital codes, a signal processing circuit coupled to a plurality of memories and configured to generate analog signals responsive to the stored bits, each of the analog signals corresponding to multiple ones of the stored bits, and a comparator circuit configured to compare the analog signals to respective ones of a plurality of reference signals to generate digital signals corresponding to the multiple ones of the stored bits. Related image processing systems and methods are also described.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: March 15, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Kwi Sung Yoo, Eun Young Jin
  • Patent number: 11276190
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: March 15, 2022
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Patent number: 11270464
    Abstract: Techniques in connection with a light field camera array are disclosed, involving obtaining a first image data from a first image camera included in the light field camera array for a first time, obtaining a second image data from the first image camera included in the light field camera array for a second time before the first time, obtaining a third image data from a second image camera included in the light field camera array at a different position than the first image camera and having a field of view overlapping a field of view of the first imaging camera, detecting an inconsistency in a view of a scene between the first image data and the second image data and/or the third image data, automatically attempting to generate, in response to the detection of the inconsistency, correction data for the first image camera to reduce or eliminate the detected inconsistency.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: March 8, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Ross Garrett Cutler
  • Patent number: 11262836
    Abstract: The present disclosure relates to a communication technique, which is a convergence of IoT technology and 5G communication system for supporting higher data transmission rate beyond 4G system, and a system for same. The present invention can be applied to smart services (e.g. smart homes, smart buildings, smart cities, smart cars or connected cars, health care, digital education, retail businesses, security- and safety-related services and the like) on the basis of 5G communication technology and IoT-related technology. The present disclosure, in a screen control method for a virtual reality service in an electronic device, comprises the steps of: detecting a movement of a pointer on a screen while an application for a virtual reality service is being executed; analyzing the movement of the pointer on the basis of a preset screen display method; and changing and displaying the configuration of the screen in accordance with the analysis of the movement of the pointer.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: March 1, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yevgen Yakishyn, Oleksandra Peteichuk, Oleksandr Radomskyi, Oleksandr Shchur, Sun-Kyung Kim, Andriy Oliynyk
  • Patent number: 11265467
    Abstract: The present disclosure provides an image capturing device that captures images of a first sensor that includes a first imaging modality, a second sensor that includes a first imaging modality and a third sensor that includes a second imaging modality. A controller connected with the first sensor, the second sensor and the third sensor, wherein the controller registers an image captured by the first sensor or the second sensor to an image captured by the third sensor.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: March 1, 2022
    Assignee: Unify Medical, Inc.
    Inventors: Yang Liu, Maziyar Askari Karchegani
  • Patent number: 11258949
    Abstract: An apparatus includes an input interface and a processor. The input interface may be configured to (i) receive a sequence of video frames of a targeted view of an environment and (ii) collect data samples from a gravity sensor (G-sensor) and a gyroscopic sensor. The processor may be configured to (i) detect axes transitions using the data samples from the gyroscopic sensor, (ii) perform, in real-time, electronic image stabilization, (iii) generate a computed horizon level based on the data samples from the G-sensor and the data samples from the gyroscopic sensor, (iv) perform, in real-time, a rotational offset compensation on stabilized captured image data of the sequence of video frames to maintain alignment of a respective horizon in each frame of the sequence of video frames with the computed horizon level, and (v) generate video analytics for the sequence of video frames using the compensated and stabilized captured image data.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: February 22, 2022
    Assignee: Ambarella International LP
    Inventor: Cheng-Yu Huang
  • Patent number: 11238251
    Abstract: There is provided in one embodiment an apparatus having an image sensor array. In one embodiment, the image sensor array can include monochrome pixels and color sensitive pixels. The monochrome pixels can be pixels without wavelength selective color filter elements. The color sensitive pixels can include wavelength selective color filter elements.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: February 1, 2022
    Assignee: Hand Held Products, Inc.
    Inventor: Ynjiun P. Wang
  • Patent number: 11232274
    Abstract: The invention relates to a method of a fingerprint sensing system of enabling suppressing impairment data present in an image captured by a fingerprint sensor of the fingerprint sensing system, and a fingerprint sensing system performing the method.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: January 25, 2022
    Assignee: FINGERPRINT CARDS ANACATUM IP AB
    Inventors: Morten Hansen, Michael Sass Hansen, Arne Husth
  • Patent number: 11227409
    Abstract: The disclosure relates to assessing operation of a camera. In one instance, a volume of space corresponding to a first vehicle in an environment of a second vehicle may be identified using sensor data generated by a LIDAR system of the second vehicle. An image captured by a camera of the second vehicle may be identified. The camera may have an overlapping field of view of the LIDAR system at a time when the sensor data was generated. An area of the image corresponding to the volume of space may be identified and processed in order to identify a vehicle light. The operation of the camera may be assessed based on the processing.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: January 18, 2022
    Assignee: Waymo LLC
    Inventors: Chen Wu, Carl Warren Craddock, Andreas Wendel
  • Patent number: 11210764
    Abstract: An apparatus for performing work on a substrate includes an image processing device acquiring multiple images captured at different positions by performing imaging multiple times after a camera has been moved by a moving device such that a reference mark of a circuit board is within a range inside a field of view of the camera, creating a super resolution image using multi-frame super resolution processing, and recognizing the reference mark. The image processing device performs candidate region search processing of processing the image captured initially to search for a region within the image including a portion that has a possibility of being the reference mark as a candidate region after completion of the initial imaging, performs multi-frame super resolution processing on the candidate region after completion of final image capturing, creates a super resolution image of the candidate region, and recognizes the reference mark.
    Type: Grant
    Filed: June 21, 2017
    Date of Patent: December 28, 2021
    Assignee: FUJI CORPORATION
    Inventors: Masafumi Amano, Hiroshi Oike, Kazuya Kotani
  • Patent number: 11212433
    Abstract: A method of an apparatus includes detecting a focusing state based on an output from a sensor, setting a step width of a focus position, and controlling to perform a plurality of times of image capturing based on a result of focus detection by the detecting and the set step width by the setting. In the setting, a step width from an in-focus position based on the result of focus detection by the detecting toward an infinity side is set to a value different from a step width from the in-focus position based on the result of focus detection by the detecting toward a closest side.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: December 28, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Toshiaki Ueguri
  • Patent number: 11212503
    Abstract: Techniques for aligning and stabilizing images generated by an integrated stereo camera pair with images generated by a detached camera are disclosed. A first image is generated using a first stereo camera; a second image is generated using a second stereo camera; and a third image is generated using the detached camera. A first rotation base matrix is computed between the third and first images, and a second rotation base matrix is computed between the third and second images. The third image is aligned to the first image using the first rotation base matrix, and the third image is aligned to the second image using the second rotation base matrix. A first overlaid image is generated by overlaying the third image onto the first image, and a second overlaid image is generated by overlaying the third image onto the second image. The two overlaid images are parallax corrected and displayed.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: December 28, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Christopher Douglas Edmonds, Raymond Kirk Price
  • Patent number: 11195263
    Abstract: A method and system for selecting an image acquisition device. The method may include obtaining a set of device parameter corresponding to at least one image acquisition device. Each device parameter may correspond to an image acquisition device. The device parameters may include a pixel size, and a focal length. The method may include, for each image acquisition device, determining one or more first evaluation values of a target region based at least on the device parameter of the image acquisition device. Each first evaluation value may correspond to a first installation parameter of the image acquisition device. The method may include designating the image acquisition device as a target image acquisition device in response to a determination that at least one first evaluation value is greater than or equal to an evaluation value threshold.
    Type: Grant
    Filed: February 2, 2021
    Date of Patent: December 7, 2021
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventor: Xiaocheng Liu
  • Patent number: 11196924
    Abstract: Methods, devices, and computer program products for managing a dual camera mode (DCM) are provided. The method obtains primary image data for a scene in a first field of view (FOV) of a first digital camera unit (DCU) and image-related information indicative of an attribute of interest (AOI) associated with the primary image data. A DCM status is determined based on the AOI. A secondary data capture operation is implemented at a second DCU based on the DCM status determined. The second DCU includes a second FOV that is different than the first FOV. The secondary data capture operation obtains secondary image data. The method manages storage of the primary image data and the secondary image data.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: December 7, 2021
    Assignee: LENOVO (SINGAPORE) PTE. LTD.
    Inventors: Russell Speight VanBlon, Nathan J. Peterson, John Carl Mese
  • Patent number: 11189009
    Abstract: The present invention is directed to providing an image processing apparatus and an image processing method capable of easily obtaining a combined image and a developed image in a case where a construction formed of a plurality of planes is divisionally imaged.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: November 30, 2021
    Assignee: FUJIFILM Corporation
    Inventor: Hiroaki Kikuchi
  • Patent number: 11188627
    Abstract: A method for fingerprint unlocking is provided. Multiple fingerprint images are obtained, by acquiring fingerprints through adjusting adjustment parameters of a fingerprint acquisition chip of a fingerprint recognition module, in response to detecting that the fingerprint recognition module is pressed. A target fingerprint image with the best image quality is determined from the multiple of fingerprint images. A terminal is unlocked when the target fingerprint image matches a preset fingerprint image successfully. A terminal is also provided.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: November 30, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Yibao Zhou
  • Patent number: 11190700
    Abstract: An image processing system may include a first image sensor, a second image sensor, and an image processing device. The image processing device may be configured to obtain a first image and a second image by respectively processing the first image data and the second image data. The image processing device may output an image based on the first image when a zoom factor of the output image is lower than a first reference value, generate a correction image by correcting locations of second reference coordinates of the second image based on first reference coordinates of the first image when the zoom factor of the output image is between the first reference value and the second reference value, and may output an image based on the second image when the zoom factor exceeds the second reference value.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: November 30, 2021
    Inventors: Dong-Jin Park, Jeehong Lee, Seongyeong Jeong, Duck-soo Kim
  • Patent number: 11170492
    Abstract: A method of performing a structure data operation includes providing input data including a processing structure and an input solid structure including a plurality of solid units, converting the input solid structure to an input boundary surface structure including attribute information on input boundary surfaces of the plurality of solid units, performing a structure data operation on the input boundary surface structure to generate an output boundary surface structure, and providing output data based on the output boundary surface structure. The structure data operation includes applying the processing structure to the input boundary surface structure.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: November 9, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sunghwan Jang, Jinha Kim
  • Patent number: 11158086
    Abstract: A camera calibration method, a camera calibration apparatus (300), an electronic device and a computer-readable storage medium are provided. The camera calibration method includes the following steps. At (202), a target infrared image and a Red/Green/Blue (RGB) image obtained by capturing the same scene by an infrared camera and an RGB camera are acquired when the image definition is lower than a definition threshold. At (204), feature points in the target infrared image are extracted to obtain a first feature point set, feature points in the RGB image are extracted to obtain a second feature point set, and the first feature point set and the second feature point set are subjected to matching. At (206), a transformation relation between a coordinate system of the infrared camera and a coordinate system of the RGB camera is acquired according to the matched feature points.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: October 26, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Ziqing Guo, Haitao Zhou, Kamwing Au, Xiao Tan