Foreground/background Insertion Patents (Class 348/586)
  • Patent number: 11141557
    Abstract: Provided is an information processing apparatus comprising: a first obtaining unit configured to obtain viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on the basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses; a second obtaining unit configured to obtain condition information indicating a condition associated with the amount of change of a background in the virtual viewpoint video; a determination unit configured to determine whether the viewpoint information obtained by the first obtaining unit satisfies the condition indicated by the condition information obtained by the second obtaining unit; and an output unit configured to output information according to the result of the determination by the determination unit.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: October 12, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoshiko Iida
  • Patent number: 11113833
    Abstract: An object detection system includes a depth image detector and a moving object extractor. The depth image detector detects a depth image from an external environment. The moving object extractor extracts a moving object desired to be extracted from the depth image. The moving object extractor registers in advance the depth image in a memory as a background while the moving object to be extracted does not exist, and extracts only a pixel whose current depth is present on a nearer side than a depth of the background as a candidate for a pixel corresponding to the moving object to be extracted.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: September 7, 2021
    Assignee: KONICA MINOLTA, INC.
    Inventor: Shunsuke Takamura
  • Patent number: 11083552
    Abstract: The invention pertains to a method for realistic visualization of a 3D virtual dental model (1) in a 2D image (20) of a face, the method comprising estimating or assuming a lighting situation in the image of the face, determining boundaries of an inner mouth region in the image, computing, based on the boundaries of the inner mouth region, on a 3D face geometry and on the lighting situation, a shadowing in the inner mouth region, computing a lighting of the dental model (1) based at least on the computed shadowing, and visualizing the dental model (1) and the 2D image (20), wherein at least the inner mouth region in the image is overlaid with a visualization (21) of the dental model having the computed lighting.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: August 10, 2021
    Assignee: Ivoclar Vivadent AG
    Inventors: Marcel Lancelle, Roland Mörzinger, Nicolas Degen, Gabor Sörös, Bartolovic Nemanja
  • Patent number: 11081143
    Abstract: Methods, systems, computer readable media, and apparatuses for providing enhanced content are presented. Data including a first program, a first caption stream associated with the first program, and a second caption stream associated with the first program may be received. The second caption stream may be extracted from the data, and a second program may be encoded with the second caption stream. The first program may be transmitted with the first caption stream including first captions and may include first content configured to be played back at a first speed. In response to receiving an instruction to change play back speed, the second program may be transmitted with the second caption stream. The second program may include the first content configured to be played back at a second speed different from the first speed, and the second caption stream may include second captions different from the first captions.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: August 3, 2021
    Assignee: TiVo Corporation
    Inventor: Ross Gilson
  • Patent number: 11074742
    Abstract: An image processing apparatus 200 includes: a first saturation information obtaining unit 306 configured to obtain saturation of a frame image; a second saturation information obtaining unit 309 configured to obtain saturation of a background image; and a threshold value determining unit 311 configured to determine a threshold value, which is used for checking a difference in color information, for each pixel, based on the saturation obtained by each of the first saturation information obtaining unit 306 and the second saturation information obtaining unit 309. A hue foreground area estimating unit 312 is configured to estimate a foreground area by use of the threshold value determined by the threshold value determining unit 311 as well as color information of the frame image and color information of the background image.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: July 27, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Akihiro Matsushita, Kiwamu Kobayashi
  • Patent number: 10977852
    Abstract: Disclosed are a VR playing method, a VR playing device, and a VR playing system. When using a media playing device for playing, a 3D spherical object is first created in the development environment, and then a new texture material is built and shader options are created for the texture material. After selecting shading for the texture material, a multimedia panoramic material is acquired from the media playing device or an external storage device, and then the texture material and the multimedia panoramic material are loaded onto the surface of the 3D spherical object. Finally, a virtual camera module is arranged at the center of the 3D spherical object. The angle of the virtual camera is controlled to pick up content of the multimedia panoramic material to play on the media playing device.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: April 13, 2021
    Assignee: SHENZHEN SKYWORTH-RGB ELECTRONICS CO., LTD.
    Inventors: Fan Yang, Ying Liu, Yongqiang He, Bojun Li
  • Patent number: 10915991
    Abstract: Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: February 9, 2021
    Assignee: ADOBE INC.
    Inventors: Sylvain Paris, Sohrab Amirghodsi, Aliakbar Darabi, Elya Shechtman
  • Patent number: 10867406
    Abstract: An unmanned aerial vehicle calibration method and system based on a color 3D calibration object. The method comprises: placing a color chequerboard 3D calibration object in a scene to be photographed; using an unmanned aerial vehicle to photograph images of the color chequerboard 3D calibration object from at least three different orientations; using a vanishing point theory to linearly solve the internal parameters of a camera of the unmanned aerial vehicle according to the photographed images of the color chequerboard 3D calibration object; and using a coordinate projection transformation method to determine a geometric constraint relationship between a spatial position and the images of the camera of the unmanned aerial vehicle according to the internal parameters of the camera of the unmanned aerial vehicle.
    Type: Grant
    Filed: September 19, 2017
    Date of Patent: December 15, 2020
    Assignee: SUN YAT-SEN UNIVERSITY
    Inventors: Xiying Li, Sijia Chen
  • Patent number: 10818093
    Abstract: The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: October 27, 2020
    Assignee: TIFF'S TREATS HOLDINGS, INC.
    Inventors: Leon Chen, Brian Keffer, Jocelyn Seever, Greg Tamargo
  • Patent number: 10796195
    Abstract: Embodiments provide for perceptual data association from at least a first and a second sensor disposed at different positions in an environment, in respective series of local scene graphs that identify characteristics of objects in the environment that are updated asynchronously and merging the series of local scene graphs to form a coherent image of the environment from multiple perspectives.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: October 6, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Jeremie A. Papon, Kyle G. Freeman
  • Patent number: 10789689
    Abstract: Disclosed is an apparatus comprising a processing device and a method for color correction of an image in a processing device, the method comprising: obtaining an image; determining a Laplacian matrix of the image; obtaining a first region of the image, the first region being indicative of a part of the image to be color corrected; obtaining a second region of the image; obtaining a first recoloring image based on the second region; determining a first corrected region of a first corrected image based on the Laplacian matrix and the first recoloring image; and obtaining and outputting a corrected image based on the first corrected region of the first corrected image.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: September 29, 2020
    Assignee: ALTOSTRATUS CAPITAL LLC
    Inventors: Toke Jansen, Jacob Schack Vestergaard
  • Patent number: 10692221
    Abstract: A digital medium environment is described to automatically generate a trimap and segment a digital image, independent of any user intervention. An image processing system receives an image and a low-resolution mask for the image, which provides a probability map indicating a likelihood that a pixel in the image mask corresponds to a foreground object in the image. The image processing system analyzes the image to identify content in the image's foreground and background portions, and adaptively generates a trimap for the image based on differences between the identified foreground and background content. By identifying content of the image prior to generating the trimap, the techniques described herein can be applied to a wide range of images, such as images where foreground content is visually similar to background content, and vice versa. Thus, the image processing system can automatically generate trimaps for images having diverse visual characteristics.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: June 23, 2020
    Assignee: Adobe Inc.
    Inventors: I-Ming Pao, Zhe Lin
  • Patent number: 10607105
    Abstract: Embodiments provide for perceptual data association received from at least a first and a second sensor disposed at different positions in an environment, in respective time series of local scene graphs that identify several characteristics of at least one object in the environment that are updated different rates; merging, at an output rate, characteristics for each given object from the several time series of local scene graphs that are updated at the output rate; merging, at the output rate, characteristics for each given object from the time series of local scene graphs that are updated at rates other than the output rate; and outputting, at the output rate, a time series of global scene graphs including the merged characteristics.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: March 31, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Jeremie A. Papon, Kyle G. Freeman
  • Patent number: 10346988
    Abstract: Provided is a method for generating a foreground in a foreground generating apparatus, the method including: extracting a plurality of foregrounds by applying a plurality of background models to an image, the plurality of background models having different ranges of a pixel variance value; generating an intersection foreground based on an intersection region among the extracted plurality of foregrounds; generating a union foreground based on a union region among the extracted plurality of foregrounds; and generating a final foreground based on the intersection foreground and the union foreground.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: July 9, 2019
    Assignees: SAMSUNG SDS CO., LTD., INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
    Inventors: Bo Ram Kim, Dae Yong Park, Sun Hee Hwang, Min Song Ki, Kwang Yong Lim, Hye Ran Byun, Seung Jun Lee, Sung Woo Kim, Yoon Seong Kang
  • Patent number: 10270965
    Abstract: A system comprising a computer-readable storage medium storing at least one program and a computer-implemented method for facilitating automatic-guided image capturing and presentation are presented. In some embodiments, the method includes capturing an image of an item, removing automatically a background of the image frame, performing manual mask editing, generating an item listing, inferring item information from the image frame and automatically applying the inferred item information to an item listing form, and presenting an item listing in an augmented reality environment.
    Type: Grant
    Filed: November 28, 2016
    Date of Patent: April 23, 2019
    Assignee: eBay Inc.
    Inventors: Robinson Piramuthu, Wen Zheng
  • Patent number: 10255681
    Abstract: Methods and systems are provided for generating mattes for input images. A neural network system can be trained where the training includes training a first neural network that generates mattes for input images where the input images are synthetic composite images. Such a neural network system can further be trained where the training includes training a second neural network that generates refined mattes from the mattes produced by the first neural network. Such a trained neural network system can be used to input an image and trimap pair for which the trained system will output a matte. Such a matte can be used to extract an object from the input image. Upon extracting the object, a user can manipulate the object, for example, to composite the object onto a new background.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: April 9, 2019
    Assignee: Adobe Inc.
    Inventors: Brian Lynn Price, Stephen Schiller, Scott Cohen, Ning Xu
  • Patent number: 10235571
    Abstract: The present invention provides a method for video matting via sparse and low-rank representation, which firstly selects frames which represent video characteristics in input video as keyframes, then trains a dictionary according to known pixels in the keyframes, next obtains a reconstruction coefficient satisfying the restriction of low-rank, sparse and non-negative according to the dictionary, and sets the non-local relationship matrix between each pixel in the input video according to the reconstruction coefficient, meanwhile sets the Laplace matrix between multiple frames, obtains a video alpha matte of the input video, according to ? values of the known pixels of the input video and ? values of sample points in the dictionary, the non-local relationship matrix and the Laplace matrix; and finally extracts a foreground object in the input video according to the video alpha matte, therefore improving quality of the extracted foreground object.
    Type: Grant
    Filed: June 14, 2016
    Date of Patent: March 19, 2019
    Assignee: BEIHANG UNIVERSITY
    Inventors: Xiaowu Chen, Dongqing Zou, Guangying Cao, Xiaogang Wang
  • Patent number: 10225568
    Abstract: Restoring an image is achieved by restoring a block by executing at least one first restoring function and at least one second restoring function. The first restoring function may be implemented using software, and the second restoring function may be implemented using hardware. By assigning restoring functions to be either first restoring functions or second restoring functions, even an image having high resolution can be restored and reproduced in real-time.
    Type: Grant
    Filed: November 13, 2015
    Date of Patent: March 5, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Doo-hyun Kim, Hyun-Sang Park, Si-hwa Lee, Do-hyung Kim
  • Patent number: 10097892
    Abstract: A content generation device (CGD), includes an opaque writing capture device (WCD), and an image capture device (ICD) and a mirror/antireflective pane with 45 degree beamsplitters. The ICD captures image content of a user performing drawing and/or writing on an opaque WCD, when the user is located external to the CGD and in front of the opaque WCD, and the capturing of the image content occurs from within the CGD and behind the opaque WCD. The opaque WCD concurrently captures user generated content corresponding to the drawing and/or writing. The CGD synchronously merges the image content and the user generated content to generate merged content and presents the merged content from within the CGD so that the presented merged content is viewable by the user through the opaque WCD. The CGD communicates the merged content to a multicast network operator for publication via one or more networks.
    Type: Grant
    Filed: January 23, 2015
    Date of Patent: October 9, 2018
    Assignee: TURNER BROADCASTING SYSTEM, INC.
    Inventors: Paul James Dobesh, Justin Raymond Williams
  • Patent number: 10091264
    Abstract: Technologies for streaming device role reversal include a source computing device and a destination computing device coupled via a communication channel. The source computing device and destination computing device are each configured to support role reversal. In other words, the source computing device and the destination computing device are each capable of switching between receiving and transmitting digital media content over the established communication channel. The source computing device is configured to initiate the role reversal, pause transmit functionality of the source computing device, and enable receive functionality of the source computing device. The destination computing device is configured to receive a role reversal indication from the source computing device, locally process the content, transmit a content stream to the source computing device, and display the content stream on an output device of the source computing device. Other embodiments are described and claimed herein.
    Type: Grant
    Filed: December 26, 2015
    Date of Patent: October 2, 2018
    Assignee: Intel Corporation
    Inventors: Karthik Veeramani, Rajneesh Chowdhury, Ujwal Paidipathi, Brian E. Rogers, Aslam Padath Peedikayil Abdul Rahim
  • Patent number: 10049435
    Abstract: Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: August 14, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: Sylvain Paris, Sohrab Amirghodsi, Aliakbar Darabi, Elya Shechtman
  • Patent number: 10044945
    Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: August 7, 2018
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: John Robert Oetting
  • Patent number: 10033565
    Abstract: This disclosure describes methods, apparatus, and systems related to a low peak-to-average power ratio (PAPR) long training field (LTF) sequences system. A device may determine a wireless communication channel with a first device in accordance with a wireless communication standard, the wireless communication channel having one or more streams. The device may determine one or more common sequences between the one or more streams. The device may generate a high efficiency preamble in accordance with a high efficiency communication standard. The device may generate one or more LTF sequences included in the preamble based on the one or more common sequences and one or more codes. The device may cause to send the high efficiency preamble over the wireless communication channel.
    Type: Grant
    Filed: December 26, 2015
    Date of Patent: July 24, 2018
    Assignee: Intel Corporation
    Inventors: Qinghua Li, Xiaogang Chen, Yuan Zhu, Robert Stacey
  • Patent number: 10002459
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire a bitmap image in which each of contained pixels has an alpha value indicating opacity of this pixel, and a rendering unit configured to render the bitmap image. The rendering unit is configured to, when rendering the bitmap image, refrain from performing alpha blending on a pixel contained in the bitmap image that has a specific alpha value and perform the alpha blending on a pixel contained in the bitmap image that has a different alpha value from the specific alpha value.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: June 19, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hirokazu Tokumoto
  • Patent number: 9979922
    Abstract: A display device (2) includes a processor (13) that outputs drawing data and a timing controller (11) that outputs the drawing data input from the processor according to horizontal synchronization and vertical synchronization. When a still image region where drawing data has not been updated compared with a previous frame and a moving image region where drawing data has been updated compared with a previous frame are included in one frame, the processor transmits data update information, which is for specifying the position of the moving image region or a line including the moving image region, to the timing controller temporally earlier than drawing data of the line including the moving image region. The timing controller performs processing for lowering the frame rate of the still image region or processing for thinning out some of image lines of the still image region based on the data update information.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: May 22, 2018
    Assignee: CEREBREX, INC.
    Inventors: Kenzo Konishi, Shinya Suzuki, Seisuke Morioka, Masahiro Kato
  • Patent number: 9948935
    Abstract: An image decoding apparatus includes a request unit that requests an image transmission apparatus to transmit an image, a transmission unit that transmits range information indicating a range which is a partial range of the image and which is selected in accordance with a user operation to the image transmission apparatus, a receiving unit that, while the partial range of the image is selected, receives, from the image transmission apparatus, the entirety of the image when the image belongs to a first type and a portion of the image when the image belongs to a second type, by receiving one or more tiles, which corresponds to the partial range of the image and outside which a reference to is prohibited in inter-picture prediction, among a plurality of tiles included in the image, and a decoding unit that decodes the received entirety or portion of the image.
    Type: Grant
    Filed: January 22, 2015
    Date of Patent: April 17, 2018
    Assignee: PANASONIC CORPORATION
    Inventors: Kengo Terada, Hisao Sasai, Tadamasa Toma, Noritaka Iguchi, Yui Koashi
  • Patent number: 9894255
    Abstract: A method and a system for depth selective segmentation of an object are provided. The method comprises the following steps. An image is captured in an invisible domain of the optical spectrum by illuminating a scene of interest under an illumination corresponding to said invisible domain of the optical spectrum by an invisible light illumination unit. A binary mask is obtained from the image according to a threshold. Part of the image is eliminated by applying the binary mask to the image, and resulting in another image. The threshold is changed and another binary mask is obtained. The latest obtained binary mask is applied to the latest captured image. The step of changing of the threshold, the step of obtaining a mask and the step of applying the latest obtained binary mask on the latest captured image are performed at least once.
    Type: Grant
    Filed: May 29, 2014
    Date of Patent: February 13, 2018
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Ludovic Angot, Chun-Te Wu, Wei-Yi Lee
  • Patent number: 9888188
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: February 6, 2018
    Assignee: International Business Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9872005
    Abstract: A moving image reproducing apparatus and a moving image controller are provided. The moving image reproducing apparatus includes a moving image data storer which stores moving image data including a target object having a transparency, at least one of a shade and a gloss on the target object, and a background image. The moving image controller fetches the moving image data from the moving image data storer, disposes an area having a color whose setting is changeable behind the moving image data, synthesizes the moving image data and the area, and sets the color of the area corresponding to the transparency as a color of the target object.
    Type: Grant
    Filed: January 21, 2014
    Date of Patent: January 16, 2018
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Takayuki Tsukitani, Kyoichi Masutomi
  • Patent number: 9813671
    Abstract: A telecommunications system including a network; a plurality of user devices coupled to the network; a multipoint control unit coupled to the network and configured to supervise multipoint conferencing among the plurality of user devices, the multipoint control unit including a presentation mixer, the presentation mixer configured to remove one or more backgrounds from a presentation and mix a live video feed into the presentation as a substitute background; and a screen for displaying a resulting mixed presentation such that a full area of the screen is used to display the mixed presentation. In some embodiments, the presentation mixer is further configured to adjust a level of transparency of the substitute background.
    Type: Grant
    Filed: February 4, 2008
    Date of Patent: November 7, 2017
    Assignee: Unify GmbH & Co. KG
    Inventors: Rami Caspi, William J. Beyda
  • Patent number: 9767586
    Abstract: A method for operating an image processing device coupled to a color camera and a depth camera is provided. The method includes receiving a color image of a 3-dimensional scene from a color camera, receiving a depth map of the 3-dimensional scene from a depth camera, generating an aligned 3-dimensional face mesh from a plurality of color images received from the color camera indicating movement of a subject's head within the 3-dimensional scene and form the depth map, determining a head region based the depth map, segmenting the head region into a plurality of facial sections based on both the color image, depth map, and the aligned 3-dimensional face mesh, and overlaying the plurality of facial sections on the color image.
    Type: Grant
    Filed: November 25, 2014
    Date of Patent: September 19, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Lin Liang, Christian F. Huitema, Matthew Adam Simari, Sean Eron Anderson
  • Patent number: 9741144
    Abstract: A healing component that heals foreground pixels with background pixels is provided. In some embodiments, the healing component is programmed or otherwise configured to respond to a single healing request by identifying a plurality of regions within a selected area and healing each region of the plurality of regions independently of other regions.
    Type: Grant
    Filed: November 9, 2015
    Date of Patent: August 22, 2017
    Assignee: Adobe Systems Incorporated
    Inventors: Sylvain Paris, Sohrab Amirghodsi, Elya Shechtman
  • Patent number: 9740916
    Abstract: Disclosed herein are systems and methods for persona identification using combined probability maps. An embodiment takes the form of a method that includes obtaining at least one frame of pixel data; processing the at least one frame of pixel data to generate a hair-identification probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based at least in part on the generated hair-identification probability map.
    Type: Grant
    Filed: August 8, 2016
    Date of Patent: August 22, 2017
    Assignee: Personify Inc.
    Inventors: Dennis Lin, Glenn Francisco, Quang Nguyen, Long Dang
  • Patent number: 9724597
    Abstract: An image capture device includes: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to identify and track an illuminated object in the interactive environment.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: August 8, 2017
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Anton Mikhailov, Richard Marks, Eric Larsen
  • Patent number: 9652046
    Abstract: The present invention is directed to a video display and user control for the video display. In the preferred embodiment, multiple video feeds are combined into a single video display, where one feed, preferably live, includes an object which is used by a computer to select a second and display a second feed, wherein the location and orientation of the second feed changes based on the location and orientation of the object in the first feed. At least a portion of the display gives the appearance of depth, such as through use of superimposed animation. The live image is controlled by the user's movement, causing at least a part of the display to move in concert with the user's motion, thereby creating an enhanced three dimensional effect for a superimposed display.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: May 16, 2017
    Inventor: David Elmekies
  • Patent number: 9613597
    Abstract: An image compositing apparatus of the present invention includes first overlay image processing circuitry that stores the position and size of an area in which a first overlay image is displayed and, according thereto, changes the position and size of the first overlay image, second overlay image processing circuitry that processes a second overlay image similarly to the first overlay image processing circuitry, a circuit for detecting the absence of base image that decides the presence or absence of a base image, and a chromakey decision circuitry that decides a chromakey color portion of the base image. In a case where the circuit for detecting the absence of base image decides the absence of a base image, the image compositing apparatus outputs the first and second overlay images processed by the first overlay image processing circuitry and the second overlay image processing circuitry, respectively.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: April 4, 2017
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Masatsugu Yamamoto
  • Patent number: 9609305
    Abstract: Depth information can be used to assist with image processing functionality, such as various calibration approaches to determine and correct for misalignments between cameras. In at least some embodiments, depth information obtained from stereo imaging or distance sensing, for example, can be used to segment an image or frame of video into at least a foreground object and a background object. Once the foreground and background object has been determined, information about that objects can be used to determine a mapping, and once a subsequent stereoscopic image is captured using the cameras, the mapping can be applied to each image to account for misalignment effects due to a misaligned stereo camera pair before providing the stereoscopic image for display.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: March 28, 2017
    Assignee: Amazon Technologies, Inc.
    Inventor: Sharadh Ramaswamy
  • Patent number: 9594943
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: March 14, 2017
    Assignee: International Busines Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9570046
    Abstract: An approach is provided for rendering content based on chunks and layers. A request is received to render content at a device. One or more layers of the content are determined. One or more patterns are determined corresponding to one or more of the layers. One or more chunks are determined based, at least in part, on the one or more patterns. At least one of the layers and corresponding one or more chunks are determined to be rendered separately from the other layers.
    Type: Grant
    Filed: September 13, 2010
    Date of Patent: February 14, 2017
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Noam Rosenthal, Timo Tapani Vitikainen
  • Patent number: 9571815
    Abstract: A method for processing a 3D image signal and an image display device for implementing the method are provided. The 3D image signal processing method is implemented by the 3D image display device. Although an image signal transmission side transmits information to be included in a plurality of image signals, while omitting a portion of the information, a receiver can synthesize the transmitted information to reproduce an image. The device restores at least one image from a broadcast signal, and additionally generates an image at a virtual camera view from the restored image and displays it three-dimensionally. To this end, the image display device receives a broadcast signal and obtains at least one set of camera parameters from signaling information. Then, the image display device generates a virtual view image according to the camera parameters, and formats the virtual view image and the broadcast image included in the broadcast signal three-dimensionally.
    Type: Grant
    Filed: August 19, 2009
    Date of Patent: February 14, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Jeong-Hyu Yang, Jong-Yeul Suh
  • Patent number: 9549101
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: January 17, 2017
    Assignee: International Business Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9542644
    Abstract: Methods and apparatus are provided for training a neural device having an artificial nervous system by modulating at least one training parameter during the training. One example method for training a neural device having an artificial nervous system generally includes observing the neural device in a training environment and modulating at least one training parameter based at least in part on the observing. For example, the training apparatus described herein may modify the neural device's internal learning mechanisms (e.g., spike rate, learning rate, neuromodulators, sensor sensitivity, etc.) and/or the training environment's stimuli (e.g., move a flame closer to the device, make the scene darker, etc.). In this manner, the speed with which the neural device is trained (i.e., the training rate) may be significantly increased compared to conventional neural device training systems.
    Type: Grant
    Filed: November 13, 2013
    Date of Patent: January 10, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Michael-David Nakayoshi Canoy, Yinyin Liu, Anthony Sarah, Adrienne Milner
  • Patent number: 9530044
    Abstract: A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.
    Type: Grant
    Filed: July 21, 2015
    Date of Patent: December 27, 2016
    Assignee: THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
    Inventors: Quang H Nguyen, Minh N Do, Sanjay J. Patel, Daniel P. Dabbelt, Dennis J. Lin
  • Patent number: 9483856
    Abstract: A display controller comprising a blending stage and a blending controller. The blending stage is provided for blending multiple image layers into one display output image and comprises a plurality of input channels for receiving pixel data for the multiple image layers. The blending stage further comprises multiple blenders for combining the pixel data received by at least two input channels of the plurality of input channels. The blending controller is coupled to the blending stage for controlling operation of the blending stage. The blending stage further comprises a controllable switch for coupling an output of at least one blender of the multiple blenders to a display output of the blending stage for regular on-the-fly blending or to an offline blending memory for storing a result of an offline blending task.
    Type: Grant
    Filed: April 20, 2012
    Date of Patent: November 1, 2016
    Assignee: FREESCALE SEMICONDUCTOR, INC.
    Inventors: Michael Staudenmaier, Vincent Aubineau, Davor Bogavac
  • Patent number: 9462284
    Abstract: A method for produces a video data stream for an expansion signal, wherein a base signal represents a first video quality degree and the expansion and base signals jointly represent a second video quality. Only second syntax elements of the expansion signal which are not describable by the first syntax element of the base signal are taken into account during encoding, the coding mode of a video encoding method which is encodable by all syntax elements is selected by means of statistical method, said second syntax elements are not representable by one or several first syntax elements and the method brings about to the production of the shortest video data stream for said second syntax elements. A decoding method for restoring the expansion signal from the video data stream, encoding and coding devices are also disclosed.
    Type: Grant
    Filed: November 8, 2005
    Date of Patent: October 4, 2016
    Assignee: SIEMENS AKTIENGESELLSCHAFT
    Inventors: Peter Amon, Jürgen Pandel
  • Patent number: 9414016
    Abstract: Disclosed herein are systems and methods for extracting person image data comprising: obtaining at least one frame of pixel data and corresponding image depth data; processing the at least one frame of pixel data and the image depth data with a plurality of persona identification modules to generate a corresponding plurality of persona probability maps; combining the plurality of persona probability maps to obtain an aggregate persona probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based on the aggregate persona probability map.
    Type: Grant
    Filed: December 31, 2013
    Date of Patent: August 9, 2016
    Assignee: PERSONIFY, INC.
    Inventors: Dennis Lin, Glenn Francisco, Quang Nguyen, Long Dang
  • Patent number: 9210377
    Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.
    Type: Grant
    Filed: October 30, 2013
    Date of Patent: December 8, 2015
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventor: John Robert Oetting
  • Patent number: 9160938
    Abstract: A virtual three-dimensional presentation in accordance with the present invention includes three stereoscopic layers, a stereoscopic background layer, a stereoscopic video insert layer, and a stereoscopic three-dimensional foreground layer. A surface, the Z-sphere, is defined in the virtual three-dimensional space of the three-dimensional scene with reference to the aim point, the distance between the cameras, and the distance from the camera of the video scene, of a virtual stereoscopic camera looking at the three-dimensional scene being created. The separation of the virtual stereoscopic camera lens and distance to the aim point are set based on the stereoscopic cameras that are creating the video insert layer. The stereoscopic three-dimensional foreground layer scene may include a key which defines the transparency of objects in the foreground layer.
    Type: Grant
    Filed: April 12, 2011
    Date of Patent: October 13, 2015
    Assignee: WSI Corporation
    Inventors: John S. Moore, Victor W. Marsh, Richard T. Daly
  • Patent number: 9106908
    Abstract: Generally, this disclosure provides methods and systems for real-time video communication with three dimensional perception image rendering through generated parallax effects based on identification, segmentation and tracking of foreground and background layers of an image. The system may include an image segmentation module configured to segment a current local video frame into a local foreground layer and a local background layer and to generate a local foreground mask based on an estimated boundary between the local foreground layer and the local background layer; a face tracking module configured to track a position of a local user's face; a background layer estimation module configured to estimate a remote background layer; and an image rendering module configured to render a 3D perception image based on the estimated remote background layer, the current remote video frame and the remote foreground mask.
    Type: Grant
    Filed: July 30, 2012
    Date of Patent: August 11, 2015
    Assignee: Intel Corporation
    Inventors: Yi Wu, Wei Sun, Michael M. Chu, Ermal Dreshaj, Philip Muse, Lucas B. Ainsworth, Garth Shoemaker, Igor V. Kozintsev
  • Patent number: 9083850
    Abstract: Methods and systems for video blurring in a secure environment are described. In one embodiment, the method includes receiving video at a video visitation device in a secure environment, adjusting a depth of field parameter for the video, such that an image of a first object at a first distance from the video visitation device is in focus and an image of a second object at a second distance from the video visitation device is blurred, and providing the video to a viewing device located outside of the secure environment.
    Type: Grant
    Filed: June 29, 2013
    Date of Patent: July 14, 2015
    Assignee: Securus Technologies, Inc.
    Inventor: Joseph Higgs