Multiple Distinct Images (e.g., Splitscreen) Patents (Class 348/588)
  • Patent number: 11948315
    Abstract: In various examples, two or more cameras in an automotive surround view system generate two or more input images to be stitched, or combined, into a single stitched image. In an embodiment, to improve the quality of a stitched image, a feedback module calculates two or more scores representing errors between the stitched image and one or more input images. If a computed score indicates structural errors in the stitched image, the feedback module calculates and applies one or more geometric transforms to apply to the one or more input images. If a computed score indicates color errors in the stitched image, the feedback module calculates and applies one or more photometric transforms to apply to the one or more input images.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: April 2, 2024
    Assignee: NVIDIA Corporation
    Inventors: Yuzhuo Ren, Niranjan Avadhanam
  • Patent number: 11876994
    Abstract: A method of encapsulating an encoded bitstream representing one or more images includes providing description of images and/or sub-image picture, providing composed picture description, and outputting the bitstream. The description of images and/or sub-image pictures identifying portions of the bitstream representing the images and/or sub-images of the one or more images is provided. The composed picture description of at least one composed picture formed by one or more images and/or sub-image pictures also is provided. The bitstream, together with the composed picture description, is output as an encapsulated data file.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: January 16, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventors: Franck Denoual, Frederic Maze, Cyril Concolato, Jean Le Feuvre
  • Patent number: 11870785
    Abstract: A computerized system providing parental supervision of child consumers of digital media, comprising an electronic repository of digital content; user interface for children, adults, digital content providers and guidance providers where digital content providers may upload digital content items into the repository and guidance providers may provide guidance objects for adults which are specific for subsets of children end-users being defined in terms of metadata, and for specific spots within, or portions of, specific items in the digital contents items; and logic including a central processor and configured to control interactions of the user interfaces with the processor and between various end-users at least partly depending on the category of each end-user wherein the logic presents overlaid digital content item/s to child C, including generating the overlaid item by selecting guidance object G specific to subset to which C belongs, and integrating G into the digital content as an overlay.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: January 9, 2024
    Assignee: GOOGALE (2009) LTD.
    Inventors: Nir Michalowitz, Iris Yam
  • Patent number: 11870547
    Abstract: A system and method provide an enhanced listening experience for a user of a radio receiver or other device that receives broadcast or streamed content having a plurality of program channels. The method and system buffer designated channels at the receiver and, when switching among channels, play back the buffered designated channels during reception from a selected point therein depending on the channel or other criteria. When switching to a different channel during reception, a user is able to hear content in a buffered program channel with music from the start of a song, for example, whereas content in a channel with news, talk radio, or live sports is played back from live reception, even though the content segments are transmitted at different start times relative to their selected times for playback following a channel change. User controls allow navigation among buffered designated channels during reception.
    Type: Grant
    Filed: April 11, 2022
    Date of Patent: January 9, 2024
    Assignee: Sirius XM Radio Inc.
    Inventors: Stuart Anderson Cox, Paul D. Marko
  • Patent number: 11728914
    Abstract: To enable extraction of an area related to a sponsor credit from a video including the sponsor credit of a television broadcast or the like without generating learning data for each form of various kinds of sponsor credits. A detection device (10) according to the present invention includes a detection unit (19) that associates a still image including a prescribed character or figure from a preliminary video or a still image not including the prescribed character or figure with a sound signal including the prescribed sound acquired from the preliminary video so as to detect a desired scene as an area that includes at least one of the prescribed character or figure and the prescribed sound from the target video.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: August 15, 2023
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Yasunori Oishi, Takahito Kawanishi, Kunio Kashino
  • Patent number: 11721117
    Abstract: An image of a check is captured by an imaging device and a digital image of the check on a replacement background may be created. The check may be placed on any background while the image of the check is being captured. The replacement background replaces, in the digital image, the background that the check is placed on while its image is being captured. The replacement background may comprise a predetermined image or color(s). The image of the check and the replacement background may be provided into a digital image file that may be transmitted to an institution system for deposit of the check into an account.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: August 8, 2023
    Assignee: UNITED SERVICES AUTOMOBILE ASSOCIATION (USAA)
    Inventor: Teddy Joseph Edmund Voutour
  • Patent number: 11678953
    Abstract: A method includes receiving first intraoral scan data comprising a first depiction of a dental site comprising a preparation tooth; generating a virtual three-dimensional (3D) model of the dental site using the first intraoral scan data; processing at least one of the first intraoral scan data or data from the virtual 3D model to identify a margin line of the preparation tooth, wherein at least a portion of the margin line is unclear; outputting instructions to generate second intraoral scan data of the dental site depicting the portion of the margin line that is unclear; receiving the second intraoral scan data; and updating the virtual 3D model of the dental site using the second intraoral scan data, wherein the portion of the margin line that was unclear in the virtual 3D model is replaced with information from the second intraoral scan data.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: June 20, 2023
    Assignee: Align Technology, Inc.
    Inventors: Avi Kopelman, Michael Sabina
  • Patent number: 11601694
    Abstract: A system stores a plurality of data models, each data model being configured to sort datasets based on a set of criteria unique to the data model. The system further identifies a plurality of content streams on a plurality of content streaming platforms. The system then executes each data model of the plurality of data models on each content stream of the plurality of content streams to generate a labeled content file of each content stream of the plurality of content streams.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: March 7, 2023
    Assignee: CASTLE GLOBAL, INC.
    Inventors: Dmitriy Karpman, Kevin Guo, Ryan Weber
  • Patent number: 11589741
    Abstract: An endoscope assembly has an endoscope, having an optical waveguide and having an image guide, wherein the image guide is configured to be uninterrupted up to its proximal end and has an image guide interface at its proximal end for optical connection to an image capturing unit, an illumination unit having a light source and having an optical waveguide interface for optical connection of the light source to an optical waveguide, and an image capturing unit having an image sensor and having an image guide interface for optical connection of the image sensor to an image guide.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: February 28, 2023
    Assignee: SCHÖLLY FIBEROPTIC GMBH
    Inventors: Stefan Schröer, Matthias Kühn, Johannes Bourbon, Lutz Labusch, Michael Schwärzle
  • Patent number: 11386576
    Abstract: An image processing apparatus that tracks a target object by estimating a position of the target object on each of a plurality of images. A first estimating unit estimates the position of the target object in at least one of images. A second estimating unit estimates the position of the target object in at least one of images, wherein estimating accuracy of the position of the target object in the second estimating process is lower than the estimating accuracy in the first estimation process. A correcting unit corrects the position of the target object estimated by the second estimation process on a second image, based on the position of the target object estimated by the first estimation process on a first image. The second image is an image captured at a different time from the first image.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: July 12, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koichi Magai
  • Patent number: 11202680
    Abstract: A method comprises segmenting first modality image data representing a model of one or more passageways within a patient; generating a first set of points based on the segmented image data; registering the first set of points to a second set of points obtained by a second modality by: determining a set of matches between the first and second sets of points, and discarding a first subset of the set of matches based on a heuristic to generate a modified set of matches by ignoring an associated set of matches between the first and second sets of points when computing a corrective motion for the second set of points—an ignored match is included in a second subset of the set of matches when computing a second corrective motion for the second set of points; and displaying a visual representation of the passageways based on the modified set of matches.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: December 21, 2021
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Caitlin Q. Donhowe, Tao Zhao, Vincent Duindam, Timothy D. Soper
  • Patent number: 11082638
    Abstract: A live streaming system communicatively connected to a first camera, where the first camera captures an original image. The live streaming system includes a controller and an electronic device. The controller can send a prompt signal via the image captured by the first camera. The electronic device communicates with the controller and the first camera, and includes a processor and a network interface device. The processor recognizes the prompt signal in the captured image, and in response thereto, processes the original image to generate a synthesized image; it further analyzes the prompt signal to determine the location of the synthesized image. The network interface device is electrically connected to the processor and live streams the synthesized image.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: August 3, 2021
    Assignee: ATEN International Co., Ltd.
    Inventors: Li-Ying Wang, Yu-Ting Wang, Chia-Chih Chen, Hsiang-Jui Yu
  • Patent number: 11076095
    Abstract: A computer-implemented method for a multiple imager imaging system is disclosed. The method comprises capturing regular images; capturing depth sensor images; and performing a depth-based alignment operation to adjust factory alignment parameters based on depth sensor information.
    Type: Grant
    Filed: May 24, 2013
    Date of Patent: July 27, 2021
    Assignee: Altia Systems Inc.
    Inventor: Jason Daniel Tanner
  • Patent number: 10986308
    Abstract: Embodiments of the present invention are directed towards reframing videos from one aspect ratio to another aspect ratio while maintaining visibility of regions of interest. A set of regions of interest are determined in frames in a video with a first aspect ratio. The set of regions of interest can be used to estimate an initial camera path. An optimal camera path is determined by leveraging the identified regions of interest using the initial camera path. Sub crops with a second aspect ratio different from the first aspect ratio of the video are identified. The sub crops are placed as designated using the optimal camera path to generate a cropped video with the second aspect ratio.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: April 20, 2021
    Assignee: Adobe Inc.
    Inventors: Nicolas Huynh Thien, William Marino, Oliver Wang, Nico Alexander Becherer, Allison Breanne Walke
  • Patent number: 10855967
    Abstract: An image processing apparatus includes an obtaining unit configured to obtain identification information for identifying a restriction area which is set in a three-dimensional coordinate system, the restriction area being an area in which display of a virtual object inserted in a virtual viewpoint image based on captured images obtained by a plurality of cameras that capture images in different angles and viewpoint information corresponding to a specification of a virtual viewpoint is restricted, wherein the virtual object is not included in the captured images obtained by the plurality of cameras, and a control unit configured to restrict the display of the virtual object in the virtual viewpoint image so that the display of the virtual object being in the restriction area, which is identified by the identification information obtained by the obtaining unit, is restricted.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: December 1, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Michio Aizawa
  • Patent number: 10733954
    Abstract: A display control device for outputting display data to frame buffers includes an input for receiving portions of the display data, different portions being in raw form and in compressed form. A data controller determines, for each received portion, whether it is in compressed form or raw form and controls the received portion to move along a first, bypass, path if it is determined that the received portion of display data is in raw form and to control the received portion of display data to move along a second path to a decompression engine if it is determined that the received portion of display data is in compressed form. The decompression engine decompresses the particular portion of compressed display data and forwards a corresponding portion of decompressed display data along a third path, the portions of data from the first and third paths then being output to the frame buffers.
    Type: Grant
    Filed: March 15, 2016
    Date of Patent: August 4, 2020
    Assignee: DISPLAYLINK (UK) LIMITED
    Inventors: Paul James, Jonathan Jeacocke
  • Patent number: 10616547
    Abstract: A pixel projection component for projecting a multi-vantage point light-field includes a distal layer with a plurality of apertures disposed therein, each of the plurality of apertures traversing the distal layer between a convex outer surface and a concave inner surface, and an intermediate layer comprising a plurality of light guides, the intermediate layer being mechanically coupled to the distal layer such that a proximal end of each light guide of the plurality of light guides is oriented to accept light transmissions from a corresponding light source and a distal end of each light guide is oriented to transmit the light transmission through a corresponding aperture of the plurality of apertures, such that the light is directed to targeted vantage points corresponding to the corresponding aperture, and causing different light transmissions to be transmitted to different vantage points.
    Type: Grant
    Filed: February 14, 2019
    Date of Patent: April 7, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Steven M. Chapman, Joseph Popp, Steven Kosakura, James Bumgardner, Mehul Patel
  • Patent number: 10603136
    Abstract: A method includes receiving first intraoral scan data of an intraoral site, the first intraoral scan data having been generated at a first time, receiving second intraoral scan data of the intraoral site, the second intraoral scan data having been generated at a second time that is later than the first time, and analyzing the second intraoral scan data of the intraoral site relative to the first intraoral scan data of the intraoral site. The method further includes identifying an area of interest (AOI) based on the analyzing and removing data for the AOI from at least one of the first intraoral scan data, the second intraoral scan data, or a three-dimensional (3D) model of the intraoral site generated from the first intraoral scan data and the second intraoral scan data.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: March 31, 2020
    Assignee: Align Technology, Inc.
    Inventors: Avi Kopelman, Michael Sabina
  • Patent number: 10586099
    Abstract: An apparatus obtains first transformation information, such as a first transformation matrix, to be used for coordinate transformation between a coordinate system in an overall image prepared beforehand and a coordinate system in a first captured image, by comparing a feature point extracted from the overall image and a feature point extracted from the first captured image. In a case where the first transformation information is updated, the apparatus generates a partial image from the overall image based on an image-taking position of a just preceding image, and compares a feature point extracted from the partial image with a feature point extracted from a captured image to be used for updating of the first transformation information, and accordingly obtains transformation information for updating. The apparatus updates the first transformation information by using the obtained transformation information for updating. Thus, accuracy of tracking processing is improved.
    Type: Grant
    Filed: June 21, 2018
    Date of Patent: March 10, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Mitsuo Kimura
  • Patent number: 10489922
    Abstract: The present technology relates to an information processing apparatus, an information processing method, and a program that can improve the estimation accuracy of a motion amount of an object. A cross-correlation analysis unit performs a cross-correlation analysis between a first image and a second image obtained by capturing the same object as an object of the first image before the first image, a first motion estimation unit estimates a first motion amount corresponding to a motion blur in the first image, and a second motion estimation unit estimates a second motion amount different from the first motion amount between the first image and the second image on the basis of a result of the cross-correlation analysis and an estimation result of the first motion amount. The present technology can be applied to, for example, an apparatus for measuring a pulse.
    Type: Grant
    Filed: March 16, 2016
    Date of Patent: November 26, 2019
    Assignee: Sony Corporation
    Inventors: Takanori Ishikawa, Yasuhide Hyodo, Kazunari Yoshifuji
  • Patent number: 10484579
    Abstract: According to some embodiments, a studio video feed, including a studio subject, may be received from a studio video camera. A remote video feed, including a remote subject, may be received from a remote video camera. The remote video feed may include, for example, the remote subject positioned in from of a solid-colored background. The remote subject may be overlaid into the studio video feed to produce a composite video signal, and at least one of the studio video feed and the remote video feed may be automatically adjusted to create an impression that the studio subject and the remote subject occupy a shared physical space.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: November 19, 2019
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Michael F. Gay, Anthony Bailey
  • Patent number: 10452945
    Abstract: The present disclosure can obtain a high-quality composite image by determining a suitable boundary when input images are sequentially stitched together to generate the composite image. An image generating apparatus 1 generates a composite image by stitching sequentially input images together. A difference value calculating section 15 calculates difference values by using the pixel values of a reference image and the pixel values of a target image that partly overlap the reference image. The difference values represent the relative relationship between the reference image and the target image. A boundary determining section 16 determines a boundary for stitching the reference image and the target image together by using the difference values calculated by the difference value calculating section 15. Then, an image compositing section 18 generates the composite image by stitching the reference image and the target image together based on the boundary determined by the boundary determining section 16.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: October 22, 2019
    Assignee: Morpho, Inc.
    Inventors: Masaki Hiraga, Shun Hirai, Shogo Sawai, Ryo Ono
  • Patent number: 10430149
    Abstract: An image display device includes: a storing section configured to store associating information that associates information indicating one or more providing sources of image data with each of one or more display areas set within a display screen; an obtaining section configured to obtain image data from a providing source corresponding to each of one or more display areas on the basis of the associating information stored in the storing section; a forming section configured to form display image data of a display image to be displayed on the display screen on the basis of the image data being obtained by said obtaining section for each of one or more display areas; and a display processing section configured to display the display image corresponding to the display image data formed by the forming section on the display screen.
    Type: Grant
    Filed: February 12, 2015
    Date of Patent: October 1, 2019
    Assignee: Sony Corporation
    Inventors: Ikuya Sano, Kazuto Nishizawa, Iori Nishiuchi
  • Patent number: 10349014
    Abstract: A system includes a ground segment and a monitoring system displaying first thread view for a first channel and displaying a second thread view for a second channel.
    Type: Grant
    Filed: February 10, 2015
    Date of Patent: July 9, 2019
    Assignee: The DIRECTV Group, Inc.
    Inventor: Eduardo Barroso
  • Patent number: 10334204
    Abstract: An example news production system includes a scheduling system, a composite display, and a camera. The scheduling system accesses a news program schedule that specifies a sequence of actions to be performed by the news production system. The scheduling system reads entries from the news program schedule, identifies actions associated with each, and sends signals to cause the actions to be performed. The news production system may cause the composite display to render video content in accordance with a specified layout. A camera can capture video of a field of view that includes at least a portion of the composite display while the specified video content is rendered thereon. The news production system may also cause an output video stream to be based, at least in part, on the captured video.
    Type: Grant
    Filed: February 3, 2017
    Date of Patent: June 25, 2019
    Assignee: Tribune Broadcasting Company, LLC
    Inventor: Hank J. Hundemer
  • Patent number: 10327045
    Abstract: The disclosure relates to an image processing method and image processing device for a monitoring system including multiple camera devices, and a monitoring system. The image processing method includes: extracting a key frame from a video acquired by each of the plurality of camera devices; for each of the extracted key frames, determining a neighbor camera device having monitor area adjacent to the monitor area of the key frame, and acquiring from the neighbor camera device a corresponding video frame which is simultaneous to the key frame; blending the key frame extracted from each of the camera devices and the corresponding video frame to generate a panorama key frame; and generating a sequence formed by panorama key frames for the key frames as a video abstract of the monitoring system.
    Type: Grant
    Filed: May 11, 2015
    Date of Patent: June 18, 2019
    Assignee: SONY CORPORATION
    Inventors: Liang Li, Deng Zhang, Kun Liu, Xiong Yin
  • Patent number: 10319333
    Abstract: In a graphics system, pixels may be provided to a graphics display at a pixel clock rate corresponding to an actual refresh rate nearest to and lower than a desired/target refresh rate. A number of additional pixels may be provided with the pixels for each image frame. The number is based at least on the actual refresh rate, target refresh rate, and a pixel-resolution of the image frame, such that providing pixels of an image frame and the number of additional pixels for each image frame at the pixel clock rate results in an effective refresh rate matching the target refresh rate. The additional pixels may be provided by adding one or more pixels at the end of each horizontal line of the image frame, or by adding an extra partial line in the vertical blanking interval. The additional pixels are not displayed and do not adversely affect normal operation.
    Type: Grant
    Filed: September 26, 2012
    Date of Patent: June 11, 2019
    Assignee: Apple Inc.
    Inventor: Brijesh Tripathi
  • Patent number: 10276210
    Abstract: Methods, systems, and computer program products for generating revised videos. The method includes, for example, receiving, by one or more processor, first video data of an environment having at least one projection on a screen from a first point of view, and generating, by the one or more processor, revised video data of the environment having the at least one projection on the screen from the first point of view based on the first video data, the revised video data comprising a plurality of frames with the at least one projection on the screen disposed in the first area relative to the environment in a plurality of frames being revised based on data for projecting the at least one projection on the screen in the first video data.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: April 30, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Anthony L. Cole, Thomas J. Davison, Daniel Del Piccolo, Daniel Lane, James S. Luke, Martine M. Pulvenis
  • Patent number: 10268032
    Abstract: Exemplary embodiments of the present invention relate generally to the fields for indicating a location on an image in a multi-viewer display. In particular embodiments, the multi-viewer display may be a multi-viewer microscope.
    Type: Grant
    Filed: July 7, 2017
    Date of Patent: April 23, 2019
    Assignee: The Board of Regents of the University of Texas System
    Inventor: Diego H Castrillon
  • Patent number: 10262186
    Abstract: There is provided a method for authenticating a fingerprint. The method includes receiving an inputted fingerprint image; selecting a plurality of comparison target pixels from pixels in the inputted fingerprint image and selecting a plurality of comparison reference pixels from pixels in a pre-stored registered fingerprint image; and determining a similarity of an overlapping area where the inputted fingerprint image overlaps the registered fingerprint image whenever a matching arrangement of each of the comparison target pixels is made with respect to each of the comparison reference pixels. The method further includes, whenever it is determined that the overlapping area is similar, comparing the inputted fingerprint image and the registered fingerprint image within the overlapping area to calculate a correlation score with respect to the overlapping area and authenticating the inputted fingerprint image based on the calculated correlation score.
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: April 16, 2019
    Assignee: SUPREMA INC.
    Inventors: Kideok Lee, Hochul Shin, Hyeonchang Lee, Jong Man Lee, Bong Seop Song, Jae Won Lee
  • Patent number: 10237459
    Abstract: In a system for determining liveness of an image presented for authentication, a reference signal is rendered on a display, and a reflection of the rendered signal from a target is analyzed to determine liveness thereof. The analysis includes spatially and/or temporally band pass filtering the reflected signal, and determining RGB values for each frame in the reflected signal and/or each pixel in one or more frames of the reflected signal. Frame level and/or pixel-by-pixel correlations between the determined RGB values and the rendered signal are computed, and a determination of whether an image presented is live or fake is made using either or both correlations.
    Type: Grant
    Filed: April 25, 2016
    Date of Patent: March 19, 2019
    Assignee: EyeVerify Inc.
    Inventor: David Hirvonen
  • Patent number: 10217257
    Abstract: Devices, systems and methods are disclosed for determining if an image is displayed using multiple pages of content and loading and displaying the multiple pages in a single context. Bordering pixels may be compared between a first page and a second page to determine if the pixels match above a threshold. If they match above a threshold, the first page and the second page may be aligned, stitched together and displayed in a shared context, allowing a user to pan and zoom between the first page and the second page without interruption, margins, page breaks or the like. The first page and/or the second page may be compared to additional pages of content and each of the additional pages of content is included in the shared context if matching above the threshold.
    Type: Grant
    Filed: March 17, 2015
    Date of Patent: February 26, 2019
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Sudhir Kumar
  • Patent number: 10216762
    Abstract: Similar medical images having a predetermined similarity to a region of interest in a medical image to be interpreted are received from a case search system. A display screen on which the received similar medical images are displayed is displayed on a display. The display screen includes display frames within which similar medical images are displayed. In response to an instruction for enlarging the similar medical images, corresponding regions of interest in the similar medical images are enlarged and displayed with the sizes of the display frames maintained unchanged on the display screen. In response to an instruction for causing a selected similar medical image among the enlarged and displayed similar medical images to move within a corresponding display frame, the other unselected similar medical image(s) is caused to move within a corresponding display frame synchronously with the movement of the selected similar medical image in the same movement direction.
    Type: Grant
    Filed: May 27, 2015
    Date of Patent: February 26, 2019
    Assignee: Panasonic Corporation
    Inventors: Kazuki Kozuka, Kazutoyo Takata, Kenji Kondo, Hirohiko Kimura, Toyohiko Sakai
  • Patent number: 10136054
    Abstract: An image processing device includes an input unit, a selection unit, a matching unit, an estimation unit and a merging unit. The input unit sequentially inputs images. The selection unit selects a reference image from among the input images. The matching unit calculates a correspondence relationship between a feature point of the reference image and a feature point of a target image. The estimation unit estimates an equation that causes a coordinate system of the reference image to correspond to a coordinate system of the target image using positional information of a pair of the feature points whose correspondence relationship has been calculated by the matching unit by regarding a motion between the reference image and the target image as only a rotational motion of the imaging element. The merging unit merges the input image and the target image to generate the composite image based on the equation.
    Type: Grant
    Filed: October 24, 2012
    Date of Patent: November 20, 2018
    Assignee: Morpho, Inc.
    Inventors: Shogo Sawai, Masaki Hiraga, Takeshi Miura
  • Patent number: 9906807
    Abstract: A method of encapsulating an encoded bitstream representing one or more images includes providing description of images and/or sub-image picture, providing composed picture description, and outputting the bitstream. The description of images and/or sub-image pictures identifying portions of the bitstream representing the images and/or sub-images of the one or more images is provided. The composed picture description of at least one composed picture formed by one or more images and/or sub-image pictures also is provided. The bitstream, together with the composed picture description, is output as an encapsulated data file.
    Type: Grant
    Filed: October 12, 2015
    Date of Patent: February 27, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventors: Franck Denoual, Frederic Maze, Cyril Concolato, Jean Le Feuvre
  • Patent number: 9870755
    Abstract: Implementations relate to prioritized display of visual content in computer presentations. In some implementations, a computer-executed method includes obtaining first visual content and second visual content associated with the first visual content, where the first and second visual content include a plurality of pixels. The method provides a display of a computer presentation by a display device, where the first visual content is displayed in a presentation area of the computer presentation. The method determines that a first presentation priority of at least a portion of the first visual content is reduced based on a determination that less than a threshold amount of the at least a portion of the first visual content has changed. In response to determining that the first presentation priority is reduced, the method improves a visibility of a display of the second visual content in the computer presentation.
    Type: Grant
    Filed: May 22, 2015
    Date of Patent: January 16, 2018
    Assignee: Google LLC
    Inventors: Xiaohui Chen, Nathan Cordeiro
  • Patent number: 9852348
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, to generate a scannable document. In one aspect, a method includes receiving a scan request, wherein the scan request includes a plurality of text images; for each text image of the plurality of text images: rectifying the text image to generate a text image with parallel image lines, generating a plurality of word bounding boxes that enclose one or more connected components in the text image, wherein each word bounding box is associated with a respective word, and generating, for each respective word in the text image, a plurality of points that represent the respective word; combining the plurality of text images to form a single text document; and providing the combined image as a scannable document.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: December 26, 2017
    Assignee: Google LLC
    Inventors: Krishnendu Chaudhury, Lu Chen, David Petrou, Blaise Aguera-Arcas
  • Patent number: 9799139
    Abstract: Methods and devices for acquiring, and aligning, an image with a textured three-dimensional (3D) model are described. In one implementation, aligning can include rendering an image in the 3D model at an estimated pose and then aligning the acquired image with the rendered image. In another implementation, aligning can include projecting the acquired image onto the 3D model at an estimated pose and then aligning the projected acquired image with the textured 3D model. In still another embodiment, aligning can include projecting the acquired image onto the textured 3D model, rendering a first image in the original 3D model and a second image in the 3D model onto which the acquired image has been projected, and then aligning the first and second images.
    Type: Grant
    Filed: September 18, 2013
    Date of Patent: October 24, 2017
    Assignee: Apple Inc.
    Inventors: Andreas Maximilian Sievert, Viktor Kolbe
  • Patent number: 9721182
    Abstract: A method, system and computer program product for encoding an image is provided. The image that needs to be represented is represented in the form of a Gaussian pyramid which is a scale-space representation of the image and includes several pyramid images. The feature points in the pyramid images are identified and a specified number of feature points are selected. The orientations of the selected feature points are obtained by using a set of orientation calculating algorithms. A patch is extracted around the feature point in the pyramid images based on the orientations of the feature point and the sampling factor of the pyramid image. The boundary patches in the pyramid images are extracted by padding the pyramid images with extra pixels. The feature vectors of the extracted patches are defined. These feature vectors are normalized so that the components in the feature vectors are less than a threshold.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: August 1, 2017
    Assignee: A9.com, Inc.
    Inventors: Mark A. Ruzon, Raghavan Manmatha, Donald Tanguay
  • Patent number: 9681046
    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: June 13, 2017
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Scott Patrick Campbell
  • Patent number: 9665764
    Abstract: A mobile terminal and controlling method thereof are disclosed, which facilitates a terminal to be used in further consideration of user's convenience. The present invention includes a display, a memory configured to store at least one image fragment, a 1st camera, and a controller, if the 1st camera is activated, displaying a preview screen of an image received from the 1st camera, the controller controlling the display to display a prescribed one of the stored at least one image fragment on a prescribed region of the preview screen. Accordingly, when a photo is taken using a terminal, a photo-taker can be included in the taken photo in a manner of being synthesized with the corresponding photo.
    Type: Grant
    Filed: December 12, 2014
    Date of Patent: May 30, 2017
    Assignee: LG ELECTRONICS INC.
    Inventor: Seungcheon Baek
  • Patent number: 9633460
    Abstract: A method implemented in an image editing device comprises determining a source region in a source image and determining a target region in a target image. At least one image characteristic of each of the source region and a region outside the target region is analyzed. The content in the source region is adjusted according to the at least one image characteristic of the source region and the at least one image characteristic of the region outside the target region. The adjusted content from the source region is inserted into the target region.
    Type: Grant
    Filed: December 23, 2013
    Date of Patent: April 25, 2017
    Assignee: CYBERLINK CORP.
    Inventors: Hao-Ping Hung, Pei-Ying Lu
  • Patent number: 9589540
    Abstract: A battery operated device, having a display with two or more available refresh rates, has its refresh rate selected so as to match the video frame rate of video data played back on the display. This selection is made by coordinating the resources in the device that are used to process the video from its reception through to its display.
    Type: Grant
    Filed: December 5, 2011
    Date of Patent: March 7, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yongjun Wu, Shyam Sadhwani, Naveen Thumpudi, Stephen Estrop, Glenn Evans
  • Patent number: 9565358
    Abstract: Apparatus for scanning and recognizing characters comprises: an optical sensor for capturing images, which optical sensor carries out continuous shooting of the scanned characters to obtain an image frame sequence containing the scanned characters, and the content of an image frame partly overlaps content of the previous image frame in the sequence; and a control module for processing the images and recognizing the characters. The control module divides the image frames in the image frame sequence into groups of image frames including reference frames, skip frames and predictive frames according to the overlapping contents, and combines the standard frames and the predictive frames into a panorama image, taking a group of image frames as a unit, and carries out character recognition after performing skew correction based on the panorama image, to obtain the character codes of the scanned characters. The skip frames can be skipped directly, increasing the splicing speed.
    Type: Grant
    Filed: December 27, 2011
    Date of Patent: February 7, 2017
    Assignee: HANWANG TECHNOLOGY CO., LTD.
    Inventor: Yongbin Li
  • Patent number: 9530076
    Abstract: A method, system and computer program product for encoding an image is provided. The image that needs to be represented is represented in the form of a Gaussian pyramid which is a scale-space representation of the image and includes several pyramid images. The feature points in the pyramid images are identified and a specified number of feature points are selected. The orientations of the selected feature points are obtained by using a set of orientation calculating algorithms. A patch is extracted around the feature point in the pyramid images based on the orientations of the feature point and the sampling factor of the pyramid image. The boundary patches in the pyramid images are extracted by padding the pyramid images with extra pixels. The feature vectors of the extracted patches are defined. These feature vectors are normalized so that the components in the feature vectors are less than a threshold.
    Type: Grant
    Filed: February 16, 2015
    Date of Patent: December 27, 2016
    Assignee: A9.com, Inc.
    Inventors: Mark A. Ruzon, Raghavan Manmatha, Donald Tanguay
  • Patent number: 9531952
    Abstract: Aspects of this disclosure relate to generating a composite image of an image of and another image that has a wider field of view. After an image is selected, the visual features in the image may be identified. Several images, such as panoramas, which have wider fields of view than an image captured by a camera, may be selected according to a comparison of the visual features in the image and the visual features of the larger images. The image may be aligned with each of the larger images, and at least one of these smaller-larger image pairs may be generated as a composite image.
    Type: Grant
    Filed: March 27, 2015
    Date of Patent: December 27, 2016
    Assignee: Google Inc.
    Inventors: Keith Noah Snavely, Pierre Georgel, Steven Maxwell Seitz
  • Patent number: 9466109
    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: October 11, 2016
    Assignee: GoPro, Inc.
    Inventors: Balineedu Chowdary Adsumilli, Scott Patrick Campbell
  • Patent number: 9462295
    Abstract: The invention relates to manipulation of sub-pictures (303) in a picture such as a mosaic screen (301). An apparatus comprises a sub-picture generator (105) connected to a mosaic screen generator (107), which generates the mosaic screen (301) from the sub-pictures. The mosaic screen (301) is by a video compressor (111) divided into uncompressed picture blocks such that each block only comprise video data from one sub-picture. The picture blocks are compressed using a block compression scheme such as MPEG-2. The apparatus further comprises a video manipulation processor (113), which manipulates the sub-pictures by manipulating the association between control data in the video signal and the compressed picture blocks. The video data of the compressed picture blocks are not affected whereby de-compression and new compression is avoided.
    Type: Grant
    Filed: September 19, 2003
    Date of Patent: October 4, 2016
    Assignee: ENTROPIC COMMUNICATIONS, LLC
    Inventors: Onno Eerenberg, Eric Gijsbers, Ewout Brandsma
  • Patent number: 9433860
    Abstract: An example game system causes an image, based on an operation performed on a terminal apparatus including a display section, to be displayed on a stationary display apparatus separate from the terminal apparatus, and also causes an image based on an operation performed on a controller to be displayed on the display apparatus. Further, in the game system, an image based on the operation performed on the terminal apparatus is displayed on the display section of the terminal apparatus. In this case, when displayed on the stationary display apparatus, the image based on the operation performed on the controller is displayed so as to be larger than the image based on the operation performed on the terminal apparatus.
    Type: Grant
    Filed: October 15, 2012
    Date of Patent: September 6, 2016
    Assignee: NINTENDO CO., LTD.
    Inventor: Hiromasa Shikata
  • Patent number: 9396569
    Abstract: There is disclosed a method for seamlessly replacing areas in a digital image with corresponding data from temporally close digital images depicting substantially the same scene. The method uses localized image registration error minimization over a fixed preliminary boundary. A least cost closed path which constitutes a boundary for the area to be replaced is calculated using dynamic programming. The replacement area is blended such that image data information from one image is seamlessly replaced with image data information from another image.
    Type: Grant
    Filed: September 26, 2013
    Date of Patent: July 19, 2016
    Assignee: Mobile Imaging in Sweden AB
    Inventors: Alexander Lindskog, Gustaf Pettersson, Ulf Holmstedt, Johan Windmark, Sami Niemi