Means For Inserting A Foreground Image In A Background Image, I.e., Inlay, Outlay (epo) Patents (Class 348/E5.058)
  • Patent number: 11972517
    Abstract: Provided are an method for generating an animation and apparatus, an electronic device, and a computer-readable storage medium. The method for generating an animation comprises: determining a background image and a first foreground image of an original image (S110); respectively rotating, scaling and translating the first foreground image and a first 2D sticker image to obtain a second foreground image and a second 2D sticker image, wherein the first 2D sticker image is generated in advance on the basis of a predetermined coverage manner and according to the original image (S120); mixing the second foreground image with the background image to obtain a first mixed image (S130); and mixing the first mixed image with the second 2D sticker image to generate an animation of the original image (S140).
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: April 30, 2024
    Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
    Inventors: Qiuhan Huang, Yan Li
  • Patent number: 11951608
    Abstract: A three-dimensional measuring device, comprising an arm having a free end provided with an interface body and a handle enabling an operator to point the measuring member at a zone of the object that is to be measured. The handle is secured to a fastener base having an end portion that includes a slideway extending transversely relative to the longitudinal direction of the handle in order to co-operate with a slideway of the interface body, the interface body and the end portion of the fastener support having both complementary abutment means so as to define a mutual engagement position of the slideways and also complementary locking means that oppose disengagement of the slideways, the complementary locking means including a control lever that is hinged to the end portion of the fastener base between an activation position for activating the locking means and an inactivation position for inactivating the locking means.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: April 9, 2024
    Assignee: HEXAGON METROLOGY SAS
    Inventors: Laurent Desforges, Thibault Duportal, Denis Roux, Jean-Luc Famechon, Wes Inglis
  • Patent number: 11846500
    Abstract: A three-dimensional depth measuring method using a structured light camera comprising a first projector, a second projector, and an optical sensor, according to the present disclosure, comprises: a step in which a first light pattern is projected by the first projector; a step in which a second light pattern is projected by the second projector; a step of filtering, by a color filter, a third light pattern in which the first light pattern and the second light pattern reflected from an object overlap, so as to separate the third light pattern into a first filtered pattern and a second filtered pattern; a step of localizing the first filtered pattern and classifying first feature points of the first filtered pattern; a step of localizing the second filtered pattern and classifying second feature points of the second filtered pattern; and a step of obtaining position information of the object on the basis of the first feature points and the second feature points.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: December 19, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kostiantyn Morozov, Oleksandr Klimenkov, Dmytro Vavdiiuk, Ivan Safonov, Andrii But, Andrii Sukhariev, Ruslan Iermolenko, Serhii Iliukhin, Yaroslav Lavrenyuk
  • Patent number: 11808607
    Abstract: A ranging apparatus capable of suppressing reduction of ranging accuracy at a long distance end of a distance measurement range, thereby making it possible to perform high-accuracy ranging over a wide distance range. An image pickup device receives light fluxes from a fixed focus optical system. A distance information acquisition unit acquires distance information of an object based on image signals from the image pickup device. This section acquires the distance information based on parallax between a first image based on a light flux having passed a first region of an exit pupil, and a second image based on a light flux having passed a second region of the exit pupil. The optical system is configured such that parallax of an object existing at a predetermined distance is smaller than parallax of an object existing at a shorter distance than the predetermined distance.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: November 7, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Akinari Takagi, Kazuya Nobayashi
  • Patent number: 11637971
    Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
    Type: Grant
    Filed: August 13, 2021
    Date of Patent: April 25, 2023
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig
  • Patent number: 11527076
    Abstract: A method, apparatus, and system for determining a low-height obstacle based on outputs of a LIDAR device in an autonomous vehicle is disclosed. A point cloud comprising a plurality of points is generated based on outputs of a LIDAR device. For each point within a first number of lowest rings of points, a neighboring point in a same ring to a first direction is determined, and a first and a second coordinate values-related differences are determined. A first, a second, a third, and a fourth quantities are determined based on the first and second differences. In response to determining that the first, the second, the third, and the fourth quantities satisfy a predetermined condition, a low-height obstacle is determined based on the points within the first number of lowest rings of points. Operations of an autonomous vehicle are controlled based at least in part on the determined low-height obstacle.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: December 13, 2022
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD
    Inventors: Xiang Liu, Shuang Zhang, Fan Zhu
  • Patent number: 11515030
    Abstract: An artificial agent based cognitive operating room system and a method thereof providing automated assistance for a surgical procedure are disclosed. Data related to the surgical procedure from multiple data sources is fused based on a current context. The data includes medical images of a patient acquired using one or more medical imaging modalities. Real-time quantification of patient measurements based on the data from the multiple data sources is performed based on the current context. Short-term predictions in the surgical procedure are forecasted based on the current context, the fused data, and the real-time quantification of the patient measurements. Suggestions for next steps in the surgical procedure and relevant information in the fused data are determined based on the current context and the short-term predictions. The suggestions for the next steps and the relevant information in the fused data are presented to an operator.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: November 29, 2022
    Assignee: Siemens Healthcare GmbH
    Inventors: Tommaso Mansi, Ankur Kapoor, Thomas Pheiffer, Vincent Ordy, Dorin Comaniciu
  • Patent number: 11509833
    Abstract: A system includes an illumination source, a camera arranged to detect illumination from the illumination source, and a computer communicatively coupled to the illumination source and the camera. The computer is programmed to detect an object in image data from the camera, identify landmarks of the object in the image data, determine a distance from the camera to the object based on a pixel distance between the landmarks in the image data, and adjust a brightness of the illumination source based on the distance.
    Type: Grant
    Filed: March 4, 2021
    Date of Patent: November 22, 2022
    Assignee: FORD GLOBAL TECHNOLOGIES, LLC
    Inventors: Ryan Edwin Hanson, Ali Hassani
  • Patent number: 11496661
    Abstract: The present disclosure relates to an image processing apparatus, an image processing method, and a program that permit acquisition of a more natural-looking synthesized image. A first captured image depicting a first subject is separated into a foreground area and a background area. The first subject appears in the foreground area. The background area is an area other than the area where the first subject appears. Also, a blended image is generated to be displayed on a live view, in which the blended image is obtained by blending the foreground area and the background area of the first captured image with an output image that is output when a second subject is captured. Then, a synthesized image is generated by superimposing the foreground area of the first captured image on the second captured image depicting the second subject with reference to the blended image in such a manner that the backgrounds are substantially identical. The present technology is applicable, for example, to an imaging apparatus.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: November 8, 2022
    Assignee: SONY CORPORATION
    Inventors: Shihhao Wen, Kazuhiko Nishibori
  • Patent number: 11400860
    Abstract: A image detection and classification system for a vehicle includes a first display, a second display, an image capturing unit for capturing an image and displaying the image on at least one of the first display and the second display, and an image processing unit configured to process the captured image to improve a clarity of the captured image in response to the captured image having an obstruction value exceeding a threshold obstruction value. A method for operation of the image detection and classification system is also described.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: August 2, 2022
    Assignee: SMR Patents S.à.r.l.
    Inventors: Firas Mualla, Andreas Herrmann
  • Patent number: 11109037
    Abstract: A prediction set determining section selects a prediction set from a prediction set group including a plurality of prediction sets having different combinations of prediction modes corresponding to different prediction directions. Further, a prediction mode determining section selects a prediction mode from the prediction set thus selected. An entropy encoding section encodes the prediction set thus selected, the prediction mode thus selected, and residual data between an input image and a predicted image formed on the basis of the prediction set and the prediction mode. This allows an image encoding device to carry out predictions from more various angles, thereby improving prediction efficiency.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: August 31, 2021
    Assignee: Velos Media, LLC
    Inventors: Takeshi Tsukuba, Yasuaki Tokumo
  • Patent number: 10802580
    Abstract: A method of operating a virtual image generation system comprises allowing an end user to interact with a three-dimensional environment comprising at least one virtual object, presenting a stimulus to the end user in the context of the three-dimensional environment, sensing at least one biometric parameter of the end user in response to the presentation of the stimulus to the end user, generating biometric data for each of the sensed biometric parameter(s), determining if the end user is in at least one specific emotional state based on the biometric data for the each of the sensed biometric parameter(s), and performing an action discernible to the end user to facilitate a current objective at least partially based on if it is determined that the end user is in the specific emotional state(s).
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: October 13, 2020
    Assignee: Magic Leap, Inc.
    Inventors: George Alistair Sanger, Samuel A. Miller, Graeme John Devine
  • Patent number: 10690495
    Abstract: A ranging apparatus capable of suppressing reduction of ranging accuracy at a long distance end of a distance measurement range, thereby making it possible to perform high-accuracy ranging over a wide distance range. An image pickup device receives light fluxes from a fixed focus optical system. A distance information acquisition unit acquires distance information of an object based on image signals from the image pickup device. This section acquires the distance information based on parallax between a first image based on a light flux having passed a first region of an exit pupil, and a second image based on a light flux having passed a second region of the exit pupil. The optical system is configured such that parallax of an object existing at a predetermined distance is smaller than parallax of an object existing at a shorter distance than the predetermined distance.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: June 23, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Akinari Takagi, Kazuya Nobayashi
  • Patent number: 10616455
    Abstract: The object photographing system using spiral rail according to one embodiment of the present invention comprises a spiral rail in which an object is disposed in an inner space, at least one photographing unit movably mounted along the spiral rail for photographing the object, and a control system for controlling the position and operation of the at least one camera; since it is possible to photograph an object in various directions and at various angles with only a small number of cameras without having to arrange a large number of cameras surrounding the subject, the cost of constructing the imaging system can be minimized, the power consumption is reduced, and the imaging system can be easily managed.
    Type: Grant
    Filed: February 8, 2018
    Date of Patent: April 7, 2020
    Assignee: WEAROBO, INC.
    Inventor: Joo Hyuk Jung
  • Patent number: 10540540
    Abstract: At least some example embodiments disclose a device and a method for determining a landmark of an image. The device may compare, to a key landmark set as a reference landmark, a first candidate landmark detected from a region of interest (ROI) of an input image and a second candidate landmark tracked from a previous frame, and determine a landmark similar to the key landmark to be a final landmark.
    Type: Grant
    Filed: October 14, 2015
    Date of Patent: January 21, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seonmin Rhee, Jungbae Kim, Youngkyoo Hwang, Jaejoon Han
  • Patent number: 10540004
    Abstract: A method of operating a virtual image generation system comprises allowing an end user to interact with a three-dimensional environment comprising at least one virtual object, presenting a stimulus to the end user in the context of the three-dimensional environment, sensing at least one biometric parameter of the end user in response to the presentation of the stimulus to the end user, generating biometric data for each of the sensed biometric parameter(s), determining if the end user is in at least one specific emotional state based on the biometric data for the each of the sensed biometric parameter(s), and performing an action discernible to the end user to facilitate a current objective at least partially based on if it is determined that the end user is in the specific emotional state(s).
    Type: Grant
    Filed: July 20, 2017
    Date of Patent: January 21, 2020
    Assignee: Magic Leap, Inc.
    Inventors: George Alistair Sanger, Samuel A. Miller, Graeme John Devine
  • Patent number: 10469831
    Abstract: A system may almost instantly capturing high-resolution geometry and reflectance data of a portion of a human subject. The system may include multiple cameras, each oriented to controllably capture an image of the portion of the human subject from a different location in space; multiple lights, each oriented to controllably illuminate the portion of the human subject from a location in space significantly different than the location in space of the other lights; and a controller. The controller may divide the cameras into subgroups with each subgroup of cameras containing at least one camera and with each camera belonging to only one of the subgroups; cause each subgroup of cameras to sequentially capture a single image of the portion of the human subject; and cause at least one of the lights to light while each subgroup of cameras captures a single image of the portion of the human subject.
    Type: Grant
    Filed: March 6, 2015
    Date of Patent: November 5, 2019
    Assignee: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Paul E. Debevec, Graham Leslie Fyffe
  • Patent number: 10458781
    Abstract: A sample shape measuring method includes a step of preparing illumination light passing through a predetermined illumination region, a step of applying the illumination light to a sample, and a predetermined processing step. The predetermined illumination region is set such that the illumination light is applied to part of inside of a pupil and outside of the pupil, a light intensity of the illumination light incident on the predetermined illumination region differs between a center and a periphery. The predetermined processing step includes a step of receiving light transmitted through the observation optical system, a step of obtaining a quantity of light of the received light, a step of calculating a difference or a ratio between the quantity of light and a reference quantity of light, and a step of calculating an amount of tilt in a surface of the sample from the difference or the ratio.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: October 29, 2019
    Assignee: OLYMPUS CORPORATION
    Inventors: Mayumi Odaira, Yoshimasa Suzuki, Kazuo Kajitani, Hisashi Ode
  • Patent number: 10458784
    Abstract: 3D coordinates at first selected measurement points of a measurement object are determined using a first measurement arrangement. Surface normals at second selected measurement points of the measurement object are determined using a second measurement arrangement. Using the 3D coordinates and the surface normals, at least one of dimensional or geometric characteristics of the measurement object are determined. The second measurement arrangement includes a number of light sources and a first camera which is directed to the measurement object. A calibration data set represents individual direction dependent radiation patterns of the light sources. The surface normals are determined using the calibration data set and the 3D coordinates at the first selected measurement points.
    Type: Grant
    Filed: August 16, 2018
    Date of Patent: October 29, 2019
    Assignee: CARL ZEISS INDUSTRIELLE MESSTECHNIK GMBH
    Inventors: Franz-Georg Ulmer, Christian Hoerr
  • Patent number: 10039986
    Abstract: A game apparatus is provided which has a convenience where another function, such as photo taken by a camera, can be used while playing a game by causing a game program and another program to work together. The game apparatus increases interest of the game by relating a result of execution of the other program to the contents of the game. For example, when a camera icon displayed on a display is selected by an operation of a touch panel, a program for controlling a camera function launches, and an image can be captured at an arbitrary timing. The captured image is converted according to a predetermined condition. The converted image is displayed on a display screen and image data is stored in a flash memory.
    Type: Grant
    Filed: June 6, 2017
    Date of Patent: August 7, 2018
    Assignee: KABUSHIKI KAISHA SQAURE ENIX
    Inventors: Takashi Tokita, Masayoshi Soken
  • Patent number: 9984309
    Abstract: The embodiments relate to classifying and grouping images. Primary images and secondary images are created and stored. A preliminary relationship between the primary and secondary images is established. The primary image is compared with the secondary image to produce a relevance score. The relevance score is converted to a secondary image assignment, which includes selectively assigning the secondary image to a first group based on the relevance score.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: May 29, 2018
    Assignee: International Business Machines Corporation
    Inventors: Mahesh P. Bhat, Paul F. Gerver, Lennard G. Streat, Cameron J. Young
  • Patent number: 9955140
    Abstract: An initial candidate foreground region is identified within an infrared image that includes pixels exhibiting infrared intensity values within a pre-defined range. A depth of surfaces within the initial candidate foreground region is estimated based on infrared intensity values the pixels of the initial candidate foreground region. The initial candidate foreground region is expanded to an expanded candidate foreground region based on a body-model estimate. The body model estimate is seeded with one or more of the initial candidate foreground region, the depth of surfaces, and/or a face of a human subject identified by facial recognition. Each pixel of the infrared image is identified as either a foreground pixel or a background pixel based on a distance of that pixel relative to the expanded candidate foreground region. Pixels identified as background pixels may be modified within a corresponding visible light image.
    Type: Grant
    Filed: March 11, 2015
    Date of Patent: April 24, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Christoph Rhemann, Emad Barsoum, Yao Shen, Simon P. Stachniak, Shahram Izadi
  • Patent number: 9881424
    Abstract: Embodiments of the present invention relates to the technical field of augmented reality. A virtual reality display method includes: acquiring a real scene picture; retrieving from the real scene picture a target image having the same shape and color with a sample image, and extracting the space coordinates of the target image; and shielding off or highlighting the target image according to the space coordinates. From the perspective of subtraction and on the basis of a real scene, the virtual reality display method and system according to the embodiment of the present invention achieve the effect of shielding off or weakening interference information of the real scene and highlighting the real subject of interest by means of shielding off or highlighting.
    Type: Grant
    Filed: December 18, 2015
    Date of Patent: January 30, 2018
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Naifu Wu, Bei Niu, Wei Wei, Tao Wang, Kun Wu, Chia-Chiang Lin, Chunmiao Zhou
  • Patent number: 9571785
    Abstract: A system and method for fine-grained privacy control of image and video recordings uses a model-based approach to solve privacy issues. The method includes steps of: receiving a digital capture of a subject bound by privacy constraints; receiving information regarding the subject, the environment, and the privacy constraints; using the information to generate a model image of the subject within the environment; associating a disposition tag with an appearance of the subject in the model image; and comparing the model image with the digital capture to determine coordinates in the recording where a privacy control action, such as a blocking action, should be applied.
    Type: Grant
    Filed: April 11, 2014
    Date of Patent: February 14, 2017
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Robert G Farrell, James R Kozloski, Clifford A Pickover
  • Patent number: 9462195
    Abstract: A system for processing video and/or audio signals is suggested. The system comprises a control unit and a processing unit. The control unit and the processing unit are communicatively connected for exchanging digital data in a packetized format. The proposed system allows splitting the processing ability of a big vision mixer into smaller sub units without losing real-time processing behavior. In addition to that a method of processing video and/or audio signals is suggested. The method utilizes a control unit and a plurality of processing units, which are communicatively connected for exchanging digital data in a packetized format. The method comprises the steps of receiving video signals at the processing units; sending video signals from the processing units; sending command signals from the control unit to one or several processing units; and scheduling the execution of command signals received in the processing units to compensate for signal latencies and processing latencies.
    Type: Grant
    Filed: July 1, 2013
    Date of Patent: October 4, 2016
    Assignee: SCALABLE VIDEO SYSTEMS GMBH
    Inventor: Alfred Krug
  • Patent number: 9451119
    Abstract: An apparatus and a method for photographing an image in an electronic device having a camera are disclosed. The electronic device may include an image sensor, an image signal processor configured to process an image obtained by the image sensor, an audio processing unit configured to process a sound received from a microphone, a storage unit configured to store data, and a control unit configured to implement the method. The method may include recording for a set period of time, a series of images and a series of sounds using the image sensor and the microphone when a sound photographing mode is active, selecting a particular sound from the series of sounds having a high correlation with a particular image from the series of images, and synthesizing the particular sound with the particular image and store in the storage unit the synthesized particular sound with the particular image.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: September 20, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kihuk Lee, Hyunjung Kim, Myungjung Lee
  • Patent number: 9430780
    Abstract: A communication service method wherein a user ID is registered at server. Video data from the user's terminal is transmitted to the server. The user selects the setting of whether image data is used with that video data; and the user's selected setting is stored at the server with the user ID. When the stored setting indicates that image data is used, the video data and the image data are transmitted from the server to one or more other terminals.
    Type: Grant
    Filed: October 17, 2013
    Date of Patent: August 30, 2016
    Assignee: SONY CORPORATION
    Inventors: Motoki Nakade, Jun Tanaka, Yoshito Shiraishi, Etsuo Kuroda
  • Patent number: 9007531
    Abstract: Methods and apparatus for expanding a field of view of an image during a video communication session. In some embodiments, a method includes transmitting a first video image having a first field of view during the video telecommunication session. The methods and apparatus further capturing a first set of background images, at least some of which are combined to form a first composite background image having a second field of view that is greater than the first field of view. Further, superimposing at least a portion of the first video image over the first composite background image to form a second video image having a same field of view as the first composite background image and transmitting the second video image during the video telecommunication session.
    Type: Grant
    Filed: August 28, 2013
    Date of Patent: April 14, 2015
    Assignee: Vonage Network LLC
    Inventors: Ido Mintz, Itay Bianco, Baruch Sterman, Sagie Machlin, Tzahi Efrati
  • Patent number: 8849063
    Abstract: A method of providing a video content formed of a plurality of successive video frames is disclosed. The method includes: extracting a visual feature from an image of each of subject frames which are all or some of the plurality of video frames; and selecting one of a plurality of candidate overlay insertion regions which are pre-assigned on each of the subject frames at different positions for allowing an additional content as a content overlay to be overlaid on the subject frames for display, as a final overlay insertion region, based on distances of the plurality of candidate overlay insertion regions from the extracted feature.
    Type: Grant
    Filed: June 24, 2011
    Date of Patent: September 30, 2014
    Assignee: KDDI Corporation
    Inventors: Tomohiko Takahashi, Masaru Sugano, Shigeyuki Sakazawa
  • Patent number: 8396296
    Abstract: A method comprises segmenting a foreground and a background of an image; and extracting one or more features from the foreground and the background to recognize a brand image. The features comprises one or more from a group comprising a foreground area, coordinates of a foreground centeroid, a foreground symmetry, a connected property, a spatial moment of the foreground, a normalized center moment of the foreground, a background area, variations of the background in red, green and blue color channels, a ratio of the foreground area and the background, an entropy of the image, an edge density of the image.
    Type: Grant
    Filed: December 31, 2007
    Date of Patent: March 12, 2013
    Assignee: Intel Corporation
    Inventors: Wei Hu, Jinqiao Wang
  • Patent number: 8306333
    Abstract: A method for achieving segmentation of a picture according to one aspect of the present invention comprises: determining a first foreground of a picture based on a predetermined mask; applying Gaussian Mixture Models with weighted data (GMM-WD) to the first foreground to generate a second foreground; determining a first background of the picture based on the second foreground; applying the GMM-WD to the first background to generate a second background; and determining an unknown region based on the second background and the second foreground.
    Type: Grant
    Filed: December 17, 2009
    Date of Patent: November 6, 2012
    Assignee: National Tsing Hua University
    Inventors: Shang Hong Lai, I Ting Tsai, Szu Hao Huang
  • Patent number: 7602990
    Abstract: A method extracts an alpha matte from images acquired of a scene by cameras. A depth plane is selected for a foreground in the scene. A trimap is determined from a set of images acquired of the scene. An epipolar plane image is constructed from the set of images and the trimap, the epipolar plane image including scan lines. Variances of intensities are measured along the scan lines in the epipolar image, and an alpha matte is extracted according to the variances.
    Type: Grant
    Filed: September 29, 2005
    Date of Patent: October 13, 2009
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Wojciech Matusik, Shmuel Avidan