Combined Image Signal Generator And General Image Signal Processing Patents (Class 348/222.1)
  • Patent number: 11555894
    Abstract: The present disclosure relates to an adaptive, free-space optical system. The system may have a controller and a digital micromirror (DMM) array responsive to the controller. The digital micromirror may include a plurality of independently controllable micromirror elements forming a receiver for receiving optical signals from an environmental scene. At least two of the plurality of independently controllable micromirror elements are steerable in different directions to receive optical signals emanating from two or more locations within the environmental scene. A beam steering subsystem forms a portion of the micromirror array and is in communication with the controller for receiving control signals from the controller. A detector is used to receive an incoming free space optical signal imaged by at least one of the micromirror elements.
    Type: Grant
    Filed: March 12, 2020
    Date of Patent: January 17, 2023
    Assignees: Lawrence Livermore National Security, LLC, The Government of the United States, as represented by the Secretary of the Air Force
    Inventors: Robert Matthew Panas, Phillip Harris Paul, Harris J. Hall, Lavern A. Starman
  • Patent number: 11558600
    Abstract: Systems, devices, and methods disclosed herein may generate captured views and a plurality of intermediate views within a pixel disparity range, Td, the plurality of intermediate views being extrapolated from the captured views.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: January 17, 2023
    Assignee: Light Field Lab, Inc.
    Inventors: Jonathan Sean Karafin, Miller H. Schuck, Douglas J. McKnight, Mrityunjay Kumar, Wilhelm Taylor
  • Patent number: 11548162
    Abstract: In some examples, an autonomous robotic welding system comprises a workspace including a part having a seam, a sensor configured to capture multiple images within the workspace, a robot configured to lay weld along the seam, and a controller. The controller is configured to identify the seam on the part in the workspace based on the multiple images, plan a path for the robot to follow when welding the seam, the path including multiple different configurations of the robot, and instruct the robot to weld the seam according to the planned path.
    Type: Grant
    Filed: February 24, 2022
    Date of Patent: January 10, 2023
    Assignee: Path Robotics, Inc.
    Inventors: Alexander James Lonsberry, Andrew Gordon Lonsberry
  • Patent number: 11552117
    Abstract: An image sensing device is provided to include a pixel array including unit pixel blocks that are arranged in a first direction and a second direction crossing the first direction, each unit pixel block configured to generate pixel signals in response to incident light reflected from a target object. The unit pixel block includes normal first pixel configured to receive a portion of the incident light at a first arrival time and generate a first pixel signal in response to the incident light, and a second pixel configured to receive another portion of the incident light at a second arrival time and generate a second pixel signal in response to the incident light. The second arrival time is later than the first arrival time.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: January 10, 2023
    Assignee: SK hynix Inc.
    Inventors: Jong Eun Kim, Ho Young Kwak, Jong Chae Kim
  • Patent number: 11553136
    Abstract: In order to provide a subject tracking device capable of reducing erroneous tracking of a subject, the subject tracking device includes an image acquisition unit configured to sequentially acquire images, a tracking unit configured to track a subject which is detected from the images acquired by the image acquisition unit by comparison between images over a plurality of images which are sequentially acquired by the image acquisition unit, and a switching unit configured to switch a time for continuing tracking in the tracking unit in accordance with a type of the subject detected from the images.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: January 10, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yoshie Ito, Masato Sanno
  • Patent number: 11552789
    Abstract: The invention relates to a system for transmitting encoded information over radio channels and wired communication lines, including the Internet. The system includes a transmitting side and a receiving side each comprising various software/hardware modules for generating/displaying the output/received information of the transmitting side, cryptographic calculations of the transmitting side, service information of the transmitting side, a module for generating a set key of the transmitting side, a module for generating a computed key of the transmitting/receiving side, a module of transmitting side communication channel, macroblocks for blocking computer brute-force search including at least three software/hardware modules for information encoding/cryptographic transformations, a module for random numbers generation, and modules for a degree of the setting polynomial.
    Type: Grant
    Filed: January 11, 2021
    Date of Patent: January 10, 2023
    Inventor: Volodymyr Vasiliovich Khylenko
  • Patent number: 11544873
    Abstract: Image processing apparatus and image processing method are provided. The image processing apparatus may include an image sensor having a plurality of photodetectors and include a 3D image calculating module. The image sensor may be configured to generate a first set of input information at a first time/first location and a second set of input information at a second time/second location, where the first set of input information may be associated with a first weighting value, and the second set of input information may be associated with a second weighting value. The 3D image calculating module may be configured to generate output information based on the first and the second sets of input information and the first and the second weighting values, wherein at least one of the plurality of photodetectors includes germanium.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: January 3, 2023
    Assignee: ARTILUX, INC.
    Inventors: Shu-Lu Chen, Yu-Shiuan Li, Yun-Chung Na
  • Patent number: 11538191
    Abstract: A indicator is moved from a first position based on a line-of-sight input to a second position according to a moving operation performed on an operating member that receives a user operation different from the line-of-sight input, (a) calibration of an input position in accordance with the line of sight, on a basis of the first position and the second position, is not performed in a case where an instruction operation for executing specific processing at a position of the indicator is not performed, and (b) calibration of the input position in accordance with the line of sight is performed on a basis of the first position and the second position in a case where an instruction operation for executing the specific processing is performed in a state in which there is no additional moving operation, and a specific condition is satisfied.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: December 27, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Seiji Ogawa, Shin Murakami
  • Patent number: 11529043
    Abstract: A medical control device includes: a light source controller configured to modulate pulsed light by changing a crest value of a pulsed current and emit the pulsed light a plurality of times from the light source in one frame; an imaging controller configured to cause an image sensor to sequentially generate a pixel signal at a specific frame rate; and an image processor configured to use a pixel signal obtained by multiplying the pixel signal for specific one frame from each pixel of a specific horizontal line by a ratio of an amount of exposure of specific pulsed light made in the specific one frame to a total exposure amount obtained by adding each exposure amount of all of the pulsed lights exposing the specific horizontal line within the specific one frame including an illumination period of the specific pulsed light.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY OLYMPUS MEDICAL SOLUTIONS INC.
    Inventor: Ryohei Kagawa
  • Patent number: 11533459
    Abstract: A projector and a brightness adjusting method are provided. The projector includes a distance sensor configured to detect a distance between the projector and a projection plane, a light source configured to provide an illumination beam, a brightness controlling circuit configured to control the light source, and a processor coupled to the distance sensor, the light source, and the brightness controlling circuit. The processor calculates according to the distance to obtain an image size of a projected image on the projection plane. The processor obtains a current value corresponding to the image size according to a color table. The processor instructs the light source to adjust a luminous flux of the illumination beam according to the current value for generating a target brightness value of the projected image. When a brightness of the projected image is excessively large, a brightness of an image beam of the projector is automatically reduced.
    Type: Grant
    Filed: November 28, 2019
    Date of Patent: December 20, 2022
    Assignee: Coretronic Corporation
    Inventors: Yun-Lin Miao, Wen-Chang Chien
  • Patent number: 11531255
    Abstract: A projector includes a projector main body including an optical unit for generating an image light beam, and a projection optical device attached to a mounting part of the projector main body, and projecting the image light beam generated by the optical unit on a screen, a chassis of the projection optical device includes a camera attachment part to which a camera is attached, and an imaging range of the camera attached to the camera attachment part includes at least a part of a projection image projected by the projection optical device.
    Type: Grant
    Filed: November 27, 2020
    Date of Patent: December 20, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Shinji Kubota
  • Patent number: 11526675
    Abstract: The present invention relates to a method and system for verification scoring and automated fact checking. More particularly, the present invention relates to a combination of automated and assisted fact checking techniques to provide a verification score. According to a first aspect, there is a method of verifying input data, comprising the steps of: receiving one or more items of input data; determining one or more pieces of information to be verified from the or each item of input data; determining which of the one or more pieces of information are to be verified automatically and which of the one or more pieces of information require manual verification; determining an automated score indicative of the accuracy of the at least one piece of information which is to be verified automatically; and generating a combined verification score which gives a measure of confidence of the accuracy of the information which forms the or each item of input data.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: December 13, 2022
    Assignee: Factmata Ltd
    Inventor: Dhruv Ghulati
  • Patent number: 11528432
    Abstract: There is provided an imaging device including: an image processing unit; a face recognition processing unit; a storage unit; and a composition processing unit for generating composite data by a composition process so that persons photographed in each of a plurality of image data are included in one image data. The face recognition processing unit recognizes a first person by performing a face recognition process on first image data. When second image data obtained by photographing a second person at the different photographing timing of the first image data, with the same background as the first image data, is recorded in the storage unit, the composition processing unit generates composite data in which the first person and the second person are superimposed on the same background.
    Type: Grant
    Filed: October 12, 2021
    Date of Patent: December 13, 2022
    Assignee: MAXELL, LTD.
    Inventors: Masayuki Hirabayashi, Yasunobu Hashimoto, Hiroshi Shimizu
  • Patent number: 11528400
    Abstract: An image-processing unit for an electronic device is disclosed. The image-processing unit may include a digital signal processor (DSP), a first control interface configured for receiving an AP-instruction from an application processor (AP) external to the image-processing unit, and a second control interface configured for transmitting an intermediary-instruction generated by DSP based on the AP-instruction. The image-processing unit may further include a first data interface configured for receiving sensor-data generated in response to the intermediary-instruction by a sensor external to the image-processing unit, and a second data interface configured for bi-directionally transmitting intermediary-data to the AP or receiving AP-data from the AP, wherein the intermediary-data is generated by the DSP based on the sensor-data.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: December 13, 2022
    Assignee: FUZHOU ROCKCHIP ELECTRONICS CO., LTD.
    Inventors: Huan Jian, Ning Luo, Shanxu Zhang, Jiang Han, Shengqin Zhang, Shuai Zhang, Yongle Lai
  • Patent number: 11528435
    Abstract: The disclosure is directed to an image dehazing method and an image dehazing apparatus using the same method. In an aspect, the disclosure is directed to an image dehazing method, and the method would include not limited to: receiving an input image; dehazing the image by a dehazing module to output a dehazed RGB image; recovering image brightness of the dehazed RGB image by a high dynamic range (HDR) module to output an HDR image; and removing reflection of the HDR image by a ReflectNet inference model, wherein the ReflectNet inference model uses a deep learning architecture.
    Type: Grant
    Filed: December 25, 2020
    Date of Patent: December 13, 2022
    Assignee: Industrial Technology Research Institute
    Inventors: Peter Chondro, De-Qin Gao
  • Patent number: 11521537
    Abstract: To enable better color and in particular color saturation control for HDR image handling systems which need to do luminance dynamic range conversion, e.g.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: December 6, 2022
    Assignee: Koninklijke Philips N.V.
    Inventors: Johannes Yzebrand Tichelaar, Mark Jozef Willem Mertens, Johannes Gerardus Rijk Van Mourik
  • Patent number: 11521411
    Abstract: A system and method for providing multi-camera 3D body part labeling and performance metrics includes receiving 2D image data and 3D depth data from a plurality image capture units (ICUs) each indicative of a scene viewed by the ICUs, the scene having at least one person, each ICU viewing the person from a different viewing position, determining 3D location data and visibility confidence level for the body parts from each ICU, using the 2D image data and the 3D depth data from each ICU, transforming the 3D location data for the body parts from each ICU to a common reference frame for body parts having at least a predetermined visibility confidence level, averaging the transformed, visible 3D body part locations from each ICU, and determining a performance metric of at least one of the body parts using the averaged 3D body part locations. The person may be a player in a sports scene.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: December 6, 2022
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Jayadas Devassy, Peter Walsh
  • Patent number: 11521303
    Abstract: A method and device are provided for inpainting image. An electronic device can be used for: determining an inpainting region of the image, wherein the inpainting region includes a defective region; obtaining original texture information of the inpainting region; determining inpainting pixel blocks and backup pixel blocks, wherein the inpainting pixel blocks include inpainting pixels and first type pixels; inpainting all inpainting pixels of the inpainting pixel blocks based on the backup pixel blocks; and superimposing the original texture information in the inpainting region.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: December 6, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventor: Wenyu Qin
  • Patent number: 11514713
    Abstract: The disclosure pertains to techniques for image processing. One such technique comprises a method for image selection, comprising: obtaining a sequence of images, detecting a first face in one or more images of the sequence of images, determining a first location for the detected first face in each of the images having the detected first face, generating a heat map based on the first location of the detected first face in each of the images of the sequences of images, determining a face quality score for the detected first face for each of the one or more images having the detected first face, determining a peak face quality score for the detected first face based in part on the face quality score and the generated heat map, and selecting a first image of the sequence of images, corresponding with the peak face quality score for the detected first face.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: November 29, 2022
    Assignee: Apple Inc.
    Inventors: Abhishek Singh, Vinay Sharma
  • Patent number: 11514314
    Abstract: An approach for altering alter training data and training process associated with a neural network to emulate environmental noise and operational instrument error by using the concepts of shots to sample within a squeezed space model, wherein shots are an uncertainty index that is the average of all shots from a sampling, is disclosed. The approach leverages a squeeze theorem to create a squeezed space model based on the regression of the upper and lower bound associated with the environmental noise and instrument error. The approach calculates an average noise index based on the squeezed space model, wherein the index is used to alter the training data and process.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: November 29, 2022
    Assignee: International Business Machines Corporation
    Inventors: Aaron K. Baughman, Gary William Reiss, Shikhar Kwatra, Qiqing Christine Ouyang
  • Patent number: 11515343
    Abstract: Designs of image sensors including a plurality of first gild structures arranged in row and column directions of a pixel array of imaging pixels and structured to separate the imaging pixels from one another, each of the first grid structures including an air to provide optical isolation between two adjacent imaging pixels and a plurality of second grid structures respectively disposed at each intersection between the row direction and the column direction in which the first grid structures are arranged.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: November 29, 2022
    Assignee: SK hynix In.
    Inventors: Yun Hui Yang, Sung Hoon Jeon
  • Patent number: 11506863
    Abstract: An accessory includes: a detection terminal; a first power supply terminal through which a first power supply voltage is supplied; a first ground terminal used as a ground potential; a second power supply terminal through which a second power supply voltage is supplied; a second ground terminal used as a ground potential; a ready terminal used to indicate whether or not communication is allowed; a first data terminal that receives a first data signal; a second data terminal that outputs a second data signal; a clock terminal that outputs a clock signal; and a third data terminal that outputs a third data signal, wherein: the first ground terminal, the second power supply terminal, and the second ground terminal are positioned between the first power supply terminal and the ready terminal; and the first data terminal and the second data terminal are positioned between the ready terminal and the clock terminal.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: November 22, 2022
    Assignee: NIKON CORPORATION
    Inventor: Takayuki Funaoka
  • Patent number: 11508141
    Abstract: A method to reconstruct an environment is provided. The method makes available to a wide variety of XR applications fresh and accurate 3D reconstruction data of environments with low processing time and low usage of computational resources and storage spaces. The 3D reconstruction data are structured in a way to be efficiently shared between users for multi-user experiences. The method includes obtaining plane segments of an environment, identifying surface planes of the environment by, for example, filtering and grouping the plane segments or ad hoc selection of the plane segments by a user, and inferring corner points of the environment based on the surface planes. The corner points are used to build a 3D representation of the environment when an XR application requires.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: November 22, 2022
    Assignee: Magic Leap, Inc.
    Inventor: Benjamin Joseph Uscinski
  • Patent number: 11509823
    Abstract: An imaging element incorporates a reading portion that reads out captured image data at a first frame rate, a storage portion that stores the image data, a processing portion that processes the image data, and an output portion that outputs the processed image data at a second frame rate lower than the first frame rate. The reading portion reads out the image data of each of a plurality of frames in parallel. The storage portion stores, in parallel, each image data read out in parallel by the reading portion. The processing portion performs generation processing of generating output image data of one frame using the image data of each of the plurality of frames stored in the storage portion.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: November 22, 2022
    Assignee: FUJIFILM CORPORATION
    Inventors: Tomoyuki Kawai, Ryo Hasegawa, Hitoshi Sakurabu, Makoto Kobayashi
  • Patent number: 11509813
    Abstract: Provided is an image processing device that can accurately detect a target object, even when a high-distortion lens is used. According to the present invention, a camera 100 captures images in accordance with a synchronization signal Sig1, a camera 101 captures images in accordance with a synchronization signal Sig2, an area of interest setting unit 1033 sets an area of interest that represents a region to which attention is to be paid, a phase difference setting unit 1034 sets a shift .DELTA.t (a phase difference) for synchronization signal Sig1 and synchronization signal Sig2 that synchronizes the imaging timing of camera 100 and camera 101 with respect to the area of interest in the images captured by camera 100 and a region of the images captured by camera 101 that corresponds to the area of interest, and a synchronization signal generation unit 102 generates synchronization signal Sig1 and synchronization signal Sig2 on the basis of the shift .DELTA.t.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: November 22, 2022
    Assignee: Hitachi Astemo, Ltd.
    Inventors: Haruki Matono, Yoshiyuki Mutou
  • Patent number: 11508059
    Abstract: This application disclosures a method and system for detecting a centerline of a vessel. The method may include obtaining image data, wherein the image data may include vessel data; selecting two endpoints of the vessel based on the vessel data; transforming the image data to generate a transformed image based on at least one image transformation function; and determining a path of the centerline of the vessel connecting the first endpoint of the vessel and the second endpoint of the vessel to obtain the centerline of the vessel based on the transformed image. The two endpoints of the vessel may include a first endpoint of the vessel and a second endpoint of the vessel.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: November 22, 2022
    Assignee: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
    Inventors: Xiaodong Wang, Yufei Mao
  • Patent number: 11500921
    Abstract: The present disclosure provides an image acquisition method, image acquisition device, electronic device, and computer-readable storage medium. The method includes: acquiring an image retrieval text input by a user and a screen display status of an image display device; determining retrieval intention information and a retrieval keyword according to the image retrieval text, wherein the retrieval intention information comprises information reflecting the user's retrieval intention, and the retrieval keyword comprises a keyword used to retrieve images; acquiring at least one candidate image according to the retrieval intention information and the retrieval keyword; and selecting a target image from the at least one candidate image according to the screen display status.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: November 15, 2022
    Assignee: Beijing BOE Technology Development Co., Ltd.
    Inventors: Bingqian Wang, Jianbo Han
  • Patent number: 11503201
    Abstract: The present technology relates to a focus detection device and method and a program by which an accurate image shift amount can be detected. A calculation unit performs calculation based on learning on the basis of a received light amount distribution of an A pixel group having a first property for phase difference detection and a received light amount distribution of a B pixel group having a second property different from the first property and outputs defocus amount related information relating to a defocus amount. The present technology can be applied to an imaging apparatus that performs focus detection by a phase difference detection method.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: November 15, 2022
    Assignee: SONY CORPORATION
    Inventor: Yoshitaka Miyatani
  • Patent number: 11496652
    Abstract: An electronic apparatus provided with a display unit configured to display image data, comprises a synchronization control unit that generates a synchronization signal based on a display rate of the display unit, and an image processing unit that operates in accordance with an operating clock and execute image processing on image data to be displayed on the display unit at a display rate synchronized with the synchronization signal. The operating clock is not changed when the synchronization control unit changes a period of the synchronization signal in accordance with a change in a display rate of the display unit.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: November 8, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Hidetoshi Onuma, Koichi Gunji, Yasushi Ito, Manabu Umeyama
  • Patent number: 11494906
    Abstract: An object detection device for detecting a target object from an image, includes: a first detection unit configured to detect a plurality of candidate regions in which the target object exists from the image; a region integration unit configured to determine one or more integrated regions based on the plurality of candidate regions detected by the first detection unit; a selection unit configured to select at least a part of the integrated regions; and a second detection unit configured to detect the target object from the selected integrated region using a detection algorithm different from a detection algorithm used by the first detection unit.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: November 8, 2022
    Assignee: OMRON Corporation
    Inventors: Shun Sakai, Masahiko Ogawa
  • Patent number: 11490071
    Abstract: Provided is a method for three-dimensional imaging a plant in an indoor agricultural environment having an ambient light power spectrum that differs from a power spectrum of natural outdoor light. The method comprises directing a spatially separated stereo pair of cameras at a scene including the plant, illuminating the scene with a non-uniform pattern provided by a light projector utilizing light in a frequency band having a lower than average ambient intensity in the indoor agricultural environment, filtering light entering image sensors of each of the cameras with filters which selectively pass light in the frequency band utilized by the light projector, capturing an image of the scene with each of the cameras to obtain first and second camera images, and generating a depth map including a depth value corresponding to each pixel in the first camera image.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: November 1, 2022
    Assignee: AppHarvest Technology, Inc.
    Inventors: Ryan R. Knopf, Joshua Aaron Lessing, Michele Pratusevich, Jason A. Chrisos, Shreyas Aditya
  • Patent number: 11489996
    Abstract: A wireless earpiece camera apparatus for handsfree camera operation during video calls includes a housing having a housing front side, a housing back side, a housing left side, a housing right side, a housing top side, and a housing bottom side. A microcontroller is coupled within the housing. A speaker is coupled within the housing and is in operational communication with the microcontroller. A plurality of controls is coupled to the housing. The plurality of controls is in operational communication with the microcontroller. A camera is coupled to the housing and is flush mounted with the housing front side. The camera is in operational communication with the microcontroller. A Bluetooth transceiver is coupled within the housing. The Bluetooth transceiver is in operational communication with the microcontroller and is in wireless communication with a smartphone.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: November 1, 2022
    Inventor: Johnny Burton
  • Patent number: 11490007
    Abstract: An image capturing apparatus includes an image pickup device configured to output image data, and at least one processor programmed to perform the operations of following units: a calculation unit configured to calculate an evaluation value used to determine whether to perform an image capturing operation for recording the image data; a setting unit configured to set a threshold value used to determine whether to perform an image capturing operation for recording the image data; a determination unit configured to make a determination as to whether to control execution of an image capturing operation using the evaluation value and the threshold value; and a storing unit configured to store image capturing history information obtained from execution of an image capturing operation based on the determination made by the determination unit, wherein the setting unit sets the threshold value based on the image capturing history information.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: November 1, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Shigeo Ogawa
  • Patent number: 11481625
    Abstract: There is provided an apparatus comprising at least one processing core, at least one memory including computer program code, at least one memory and the computer program code being configured to, with at least one processing core, cause the apparatus at least to obtain, from a first sequential input (102), a first output from a first recurrent neural network, the first sequential input being of a first modality, obtain, from a second sequential input (103), a second output from a second recurrent neural network, the second sequential input being of a second modality, and process the first output and the second output to obtain a correlation of the first and second sequential inputs.
    Type: Grant
    Filed: August 4, 2017
    Date of Patent: October 25, 2022
    Assignee: Nokia Technologies Oy
    Inventor: Meng Wang
  • Patent number: 11478922
    Abstract: A robot teaching device includes: an image acquisition device configured to acquire, as a moving image, a distance image representing distance information of an imaging object, or a two-dimensional image of the imaging object; a trajectory detection section configured to detect a movement trajectory of an operator's hand depicted as the imaging object in the moving image by using the moving image; an identification section configured to identify whether the detected movement trajectory represents a linear movement or a rotational movement; and a command generation section configured to output a command for translating a predetermined movable part of the robot based on the movement trajectory when the movement trajectory is identified as representing a linear movement, and to output a command for rotating the predetermined movable part based on the movement trajectory when the movement trajectory is identified as representing a rotational movement.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: October 25, 2022
    Assignee: FANUC CORPORATION
    Inventor: Keisuke Nagano
  • Patent number: 11483509
    Abstract: There is provided an imaging device including a pixel array section including pixel units two-dimensionally arranged in a matrix pattern, each pixel unit including a photoelectric converter, and a plurality of column signal lines disposed according to a first column of the pixel units. The imaging device further includes an analog to digital converter that is shared by the plurality of column signal lines.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Atsumi Niwa, Yosuke Ueno, Shimon Teshima, Daijiro Anai, Yoshinobu Furusawa, Taishin Yoshida, Takahiro Uchimura, Eiji Hirata
  • Patent number: 11481884
    Abstract: Techniques for image quality enhancement for autonomous vehicle remote operations are disclosed herein. An image processing system of an autonomous vehicle can obtain images captured by at least two different cameras and stitch the images together to create a combined image. The image processing system can apply region blurring to a portion of the combined image to create an enhanced combined image, e.g., to blur regions/objects determined to be less import (or unimportant) for the remote operations. The image processing system can encode pixel areas of the enhanced combined image using a corresponding quality setting for respective pixel areas to create encoded image files, e.g., based on complexity levels of the respective pixel areas. The image processing system can transmit the encoded image files to a remote operations system associated with the autonomous vehicle for remote operations support.
    Type: Grant
    Filed: February 11, 2021
    Date of Patent: October 25, 2022
    Assignee: NURO, INC.
    Inventors: Yichao (Roger) Shen, Alexandr Bakhturin, Chenjie Luo, Albert Meixner, Ian Zhou, Hubert Hua Kian Teo, William Paul Maddern
  • Patent number: 11483504
    Abstract: A method for converting an image format applied to an RGB-IR image sensor includes: (Step 1) acquiring an RGB-IR image in digital form; (Step 2) selecting a pixel of the RGB-IR image as a center pixel and selecting a pixel unit with the center pixel at the center; (Step 3) interpolating the center pixel to obtain missing color components of the center pixel; (Step 4) repeating blocks (S2) and (S3) for interpolating each pixel of the RGB-IR image to obtain the missing color component of each pixel; and (Step 5) outputting an image after the interpolation process.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: October 25, 2022
    Assignee: TRIPLE WIN TECHNOLOGY(SHENZHEN) CO.LTD.
    Inventor: Nai-Cyun Ke
  • Patent number: 11483508
    Abstract: In an imaging apparatus, each of a plurality of pixels has a first semiconductor area having a first conductivity type, a floating diffusion area, and a transfer gate positioned between the first semiconductor area and the floating diffusion area. In a part of the plurality of pixels, a partial area of the first semiconductor area receives a potential supplied from a contact. The part of the plurality of pixels further has a second semiconductor area having a second conductivity type positioned between the partial area and the transfer gate in a planar view.
    Type: Grant
    Filed: July 2, 2020
    Date of Patent: October 25, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoichi Wada
  • Patent number: 11482018
    Abstract: A number-of-occupants detection system (1) includes an image correction unit (120) that generates a corrected image based on an image generated by an imaging unit (110) that images a vehicle traveling on a road having a plurality of lanes by executing correction processing on the image for reducing blurring of a subject captured in the image using a parameter according to a position where the vehicle travels, and a count unit (130) that counts the number of occupants of the vehicle using the corrected image generated by the image correction unit (120).
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: October 25, 2022
    Assignees: NEC CORPORATION, NEC Solution Innovators, Ltd.
    Inventors: Haruyuki Hayashi, Michihiko Yusa, Noboru Nakajima
  • Patent number: 11483455
    Abstract: A protective connector having a good connection reliability includes a main body, a plurality of conductive circuits embedded in the main body, two first conductive blocks formed on the main body, and two second conductive blocks formed on the main body and opposite to the two first conductive blocks. The two first conductive blocks and the two second conductive blocks are electrically connected to one of the plurality of conductive circuits, respectively. The disclosure further relates to a lens module.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: October 25, 2022
    Assignee: TRIPLE WIN TECHNOLOGY (SHENZHEN) CO. LTD.
    Inventor: Wei Zhang
  • Patent number: 11477366
    Abstract: A method for operating a messaging system for sending modifiable videos including a self-image of a user is provided. The method includes providing a face outline to assist with taking the self-image. Instructions relating to a light level, a facial expression, a face position, and a face size may be provided to the user. A smile measurement is displayed to enable the user to adjust the current smile level to a target smile level. A stock video may be created using an actor wearing a mask and facing a video camera. The mask is a marker for insertion of the self-image. The stock video is uploaded to a database of stock videos and, after selection by a user, is combined with a self-image to form a personalized video.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: October 18, 2022
    Assignee: Snap Inc.
    Inventors: Jeremy Voss, Dallin Dyer
  • Patent number: 11470235
    Abstract: Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: October 11, 2022
    Assignee: Corephotonics Ltd.
    Inventors: Gal Shabtay, Noy Cohen, Nadav Geva, Oded Gigushinski, Ephraim Goldenberg
  • Patent number: 11468546
    Abstract: A processor performing postprocessing obtains an input image containing both bright and dark regions. The processor obtains a threshold between a first pixel value of the virtual production display and a second pixel value of the virtual production display. The processor modifies the region according to predetermined steps producing a pattern unlikely to occur within the input image, where the pattern corresponds to a difference between the original pixel value and the threshold. The processor can replace the region of the input image with the pattern to obtain a modified image. The virtual production display can present the modified image. A processor performing postprocessing detects the pattern within the modified image displayed on the virtual production display. The processor calculates the original pixel value of the region by reversing the predetermined steps. The processor replaces the pattern in the modified image with the original pixel value.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: October 11, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11470294
    Abstract: The disclosure can provide a method for converting an image, an apparatus for converting an image, an electronic device, and a storage medium. The method includes: obtaining an image in RAW format; obtaining a semantic analysis result of the image in RAW format by inputting the image in RAW format into a pre-trained first network model; the first network model being obtained by training based on a labeled training sample corresponding to each of a plurality of first training samples, the first training sample being a sample image in RAW format, and the labeled training sample being a sample image in RAW format obtained by labeling a semantic analysis result on the corresponding first training sample; and determining an image in RGB (Red-Green-Blue) format corresponding to the image in RAW format based on the semantic analysis result of the image in RAW format.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: October 11, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Wenbo Zhang, Hongmin Xu, Wen Zheng
  • Patent number: 11470258
    Abstract: An image processing apparatus includes processing circuitry configured to: divide an input image into a plurality of areas to correspond to predetermined categories, using information of the image; set different image processing parameters for the divided areas corresponding to the predetermined categories, respectively; perform image processing on the divided areas using the image processing parameters corresponding to the divided areas; and combine the divided areas on which the image processing has been performed to form an image.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: October 11, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventors: Masashi Miyata, Masakazu Terauchi
  • Patent number: 11465283
    Abstract: A method of protecting humans in an environment of a moving machine is provided that comprises the environment being monitored by means of a protective device that is configured to detect one or more kinematic parameters of a respective object located in the environment and controlling the moving machine in dependence on detected kinematic parameters of the respective object to initiate a protective measure. The protective equipment here detects the polarization properties and a movement modulation of the respective object in dependence on which the respective object is classified with respect to whether the respective object is a human. In particular only when the respective object was classified as a human, the protective equipment controls the moving machine to initiate the protective measure in dependence on detected kinematic parameters of this respective object.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: October 11, 2022
    Assignee: SICK AG
    Inventors: Oliver Prinz, Christoph Hofmann
  • Patent number: 11468587
    Abstract: A method for reconstructing a downsampled depth map includes receiving, at an electronic device, image data to be presented on a display of the electronic device at a first resolution, wherein the image data includes a color image and the downsampled depth map associated with the color image. The method further includes generating a high resolution depth map by calculating, for each point making up the first resolution, a depth value based on a normalized pose difference across a neighborhood of points for the point, a normalized color texture difference across the neighborhood of points for the point, and a normalized spatial difference across the neighborhood of points. Still further, the method includes outputting, on the display, a reprojected image at the first resolution based on the color image and the high resolution depth map. The downsampled depth map is at a resolution less than the first resolution.
    Type: Grant
    Filed: November 9, 2020
    Date of Patent: October 11, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Christopher A. Peri, Yingen Xiong
  • Patent number: 11468675
    Abstract: Systems, methods, and computer storage media are described herein for identifying objects within video content. Utilizing an image recognition technique (e.g., a previously trained neural network) an object may be detected within a subset of the video frames of a scene of the video content. Metadata may be generated comprising a set of object attributes (e.g., an object image, a URL from which the item may be procured, etc.) associated with the object detected within the subset of video frames. A request for object identification may subsequently be received while a user is watching the video content. A run time of the request may be utilized to retrieve and display one or more object attributes (e.g., an object image with an embedded hyperlink) corresponding to an object appearing in the scene.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: October 11, 2022
    Assignee: Amazon Technologies, Inc.
    Inventor: Vaibhav Agarwal
  • Patent number: RE49256
    Abstract: A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: October 18, 2022
    Assignee: Corephotonics Ltd.
    Inventors: Gal Shabtay, Noy Cohen, Oded Gigushinski, Ephraim Goldenberg