Foreground/background Insertion Patents (Class 348/586)
  • Patent number: 10796195
    Abstract: Embodiments provide for perceptual data association from at least a first and a second sensor disposed at different positions in an environment, in respective series of local scene graphs that identify characteristics of objects in the environment that are updated asynchronously and merging the series of local scene graphs to form a coherent image of the environment from multiple perspectives.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: October 6, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Jeremie A. Papon, Kyle G. Freeman
  • Patent number: 10789689
    Abstract: Disclosed is an apparatus comprising a processing device and a method for color correction of an image in a processing device, the method comprising: obtaining an image; determining a Laplacian matrix of the image; obtaining a first region of the image, the first region being indicative of a part of the image to be color corrected; obtaining a second region of the image; obtaining a first recoloring image based on the second region; determining a first corrected region of a first corrected image based on the Laplacian matrix and the first recoloring image; and obtaining and outputting a corrected image based on the first corrected region of the first corrected image.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: September 29, 2020
    Assignee: ALTOSTRATUS CAPITAL LLC
    Inventors: Toke Jansen, Jacob Schack Vestergaard
  • Patent number: 10692221
    Abstract: A digital medium environment is described to automatically generate a trimap and segment a digital image, independent of any user intervention. An image processing system receives an image and a low-resolution mask for the image, which provides a probability map indicating a likelihood that a pixel in the image mask corresponds to a foreground object in the image. The image processing system analyzes the image to identify content in the image's foreground and background portions, and adaptively generates a trimap for the image based on differences between the identified foreground and background content. By identifying content of the image prior to generating the trimap, the techniques described herein can be applied to a wide range of images, such as images where foreground content is visually similar to background content, and vice versa. Thus, the image processing system can automatically generate trimaps for images having diverse visual characteristics.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: June 23, 2020
    Assignee: Adobe Inc.
    Inventors: I-Ming Pao, Zhe Lin
  • Patent number: 10607105
    Abstract: Embodiments provide for perceptual data association received from at least a first and a second sensor disposed at different positions in an environment, in respective time series of local scene graphs that identify several characteristics of at least one object in the environment that are updated different rates; merging, at an output rate, characteristics for each given object from the several time series of local scene graphs that are updated at the output rate; merging, at the output rate, characteristics for each given object from the time series of local scene graphs that are updated at rates other than the output rate; and outputting, at the output rate, a time series of global scene graphs including the merged characteristics.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: March 31, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Jeremie A. Papon, Kyle G. Freeman
  • Patent number: 10346988
    Abstract: Provided is a method for generating a foreground in a foreground generating apparatus, the method including: extracting a plurality of foregrounds by applying a plurality of background models to an image, the plurality of background models having different ranges of a pixel variance value; generating an intersection foreground based on an intersection region among the extracted plurality of foregrounds; generating a union foreground based on a union region among the extracted plurality of foregrounds; and generating a final foreground based on the intersection foreground and the union foreground.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: July 9, 2019
    Assignees: SAMSUNG SDS CO., LTD., INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
    Inventors: Bo Ram Kim, Dae Yong Park, Sun Hee Hwang, Min Song Ki, Kwang Yong Lim, Hye Ran Byun, Seung Jun Lee, Sung Woo Kim, Yoon Seong Kang
  • Patent number: 10270965
    Abstract: A system comprising a computer-readable storage medium storing at least one program and a computer-implemented method for facilitating automatic-guided image capturing and presentation are presented. In some embodiments, the method includes capturing an image of an item, removing automatically a background of the image frame, performing manual mask editing, generating an item listing, inferring item information from the image frame and automatically applying the inferred item information to an item listing form, and presenting an item listing in an augmented reality environment.
    Type: Grant
    Filed: November 28, 2016
    Date of Patent: April 23, 2019
    Assignee: eBay Inc.
    Inventors: Robinson Piramuthu, Wen Zheng
  • Patent number: 10255681
    Abstract: Methods and systems are provided for generating mattes for input images. A neural network system can be trained where the training includes training a first neural network that generates mattes for input images where the input images are synthetic composite images. Such a neural network system can further be trained where the training includes training a second neural network that generates refined mattes from the mattes produced by the first neural network. Such a trained neural network system can be used to input an image and trimap pair for which the trained system will output a matte. Such a matte can be used to extract an object from the input image. Upon extracting the object, a user can manipulate the object, for example, to composite the object onto a new background.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: April 9, 2019
    Assignee: Adobe Inc.
    Inventors: Brian Lynn Price, Stephen Schiller, Scott Cohen, Ning Xu
  • Patent number: 10235571
    Abstract: The present invention provides a method for video matting via sparse and low-rank representation, which firstly selects frames which represent video characteristics in input video as keyframes, then trains a dictionary according to known pixels in the keyframes, next obtains a reconstruction coefficient satisfying the restriction of low-rank, sparse and non-negative according to the dictionary, and sets the non-local relationship matrix between each pixel in the input video according to the reconstruction coefficient, meanwhile sets the Laplace matrix between multiple frames, obtains a video alpha matte of the input video, according to ? values of the known pixels of the input video and ? values of sample points in the dictionary, the non-local relationship matrix and the Laplace matrix; and finally extracts a foreground object in the input video according to the video alpha matte, therefore improving quality of the extracted foreground object.
    Type: Grant
    Filed: June 14, 2016
    Date of Patent: March 19, 2019
    Assignee: BEIHANG UNIVERSITY
    Inventors: Xiaowu Chen, Dongqing Zou, Guangying Cao, Xiaogang Wang
  • Patent number: 10225568
    Abstract: Restoring an image is achieved by restoring a block by executing at least one first restoring function and at least one second restoring function. The first restoring function may be implemented using software, and the second restoring function may be implemented using hardware. By assigning restoring functions to be either first restoring functions or second restoring functions, even an image having high resolution can be restored and reproduced in real-time.
    Type: Grant
    Filed: November 13, 2015
    Date of Patent: March 5, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Doo-hyun Kim, Hyun-Sang Park, Si-hwa Lee, Do-hyung Kim
  • Patent number: 10097892
    Abstract: A content generation device (CGD), includes an opaque writing capture device (WCD), and an image capture device (ICD) and a mirror/antireflective pane with 45 degree beamsplitters. The ICD captures image content of a user performing drawing and/or writing on an opaque WCD, when the user is located external to the CGD and in front of the opaque WCD, and the capturing of the image content occurs from within the CGD and behind the opaque WCD. The opaque WCD concurrently captures user generated content corresponding to the drawing and/or writing. The CGD synchronously merges the image content and the user generated content to generate merged content and presents the merged content from within the CGD so that the presented merged content is viewable by the user through the opaque WCD. The CGD communicates the merged content to a multicast network operator for publication via one or more networks.
    Type: Grant
    Filed: January 23, 2015
    Date of Patent: October 9, 2018
    Assignee: TURNER BROADCASTING SYSTEM, INC.
    Inventors: Paul James Dobesh, Justin Raymond Williams
  • Patent number: 10091264
    Abstract: Technologies for streaming device role reversal include a source computing device and a destination computing device coupled via a communication channel. The source computing device and destination computing device are each configured to support role reversal. In other words, the source computing device and the destination computing device are each capable of switching between receiving and transmitting digital media content over the established communication channel. The source computing device is configured to initiate the role reversal, pause transmit functionality of the source computing device, and enable receive functionality of the source computing device. The destination computing device is configured to receive a role reversal indication from the source computing device, locally process the content, transmit a content stream to the source computing device, and display the content stream on an output device of the source computing device. Other embodiments are described and claimed herein.
    Type: Grant
    Filed: December 26, 2015
    Date of Patent: October 2, 2018
    Assignee: Intel Corporation
    Inventors: Karthik Veeramani, Rajneesh Chowdhury, Ujwal Paidipathi, Brian E. Rogers, Aslam Padath Peedikayil Abdul Rahim
  • Patent number: 10049435
    Abstract: Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: August 14, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: Sylvain Paris, Sohrab Amirghodsi, Aliakbar Darabi, Elya Shechtman
  • Patent number: 10044945
    Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: August 7, 2018
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: John Robert Oetting
  • Patent number: 10033565
    Abstract: This disclosure describes methods, apparatus, and systems related to a low peak-to-average power ratio (PAPR) long training field (LTF) sequences system. A device may determine a wireless communication channel with a first device in accordance with a wireless communication standard, the wireless communication channel having one or more streams. The device may determine one or more common sequences between the one or more streams. The device may generate a high efficiency preamble in accordance with a high efficiency communication standard. The device may generate one or more LTF sequences included in the preamble based on the one or more common sequences and one or more codes. The device may cause to send the high efficiency preamble over the wireless communication channel.
    Type: Grant
    Filed: December 26, 2015
    Date of Patent: July 24, 2018
    Assignee: Intel Corporation
    Inventors: Qinghua Li, Xiaogang Chen, Yuan Zhu, Robert Stacey
  • Patent number: 10002459
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire a bitmap image in which each of contained pixels has an alpha value indicating opacity of this pixel, and a rendering unit configured to render the bitmap image. The rendering unit is configured to, when rendering the bitmap image, refrain from performing alpha blending on a pixel contained in the bitmap image that has a specific alpha value and perform the alpha blending on a pixel contained in the bitmap image that has a different alpha value from the specific alpha value.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: June 19, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hirokazu Tokumoto
  • Patent number: 9979922
    Abstract: A display device (2) includes a processor (13) that outputs drawing data and a timing controller (11) that outputs the drawing data input from the processor according to horizontal synchronization and vertical synchronization. When a still image region where drawing data has not been updated compared with a previous frame and a moving image region where drawing data has been updated compared with a previous frame are included in one frame, the processor transmits data update information, which is for specifying the position of the moving image region or a line including the moving image region, to the timing controller temporally earlier than drawing data of the line including the moving image region. The timing controller performs processing for lowering the frame rate of the still image region or processing for thinning out some of image lines of the still image region based on the data update information.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: May 22, 2018
    Assignee: CEREBREX, INC.
    Inventors: Kenzo Konishi, Shinya Suzuki, Seisuke Morioka, Masahiro Kato
  • Patent number: 9948935
    Abstract: An image decoding apparatus includes a request unit that requests an image transmission apparatus to transmit an image, a transmission unit that transmits range information indicating a range which is a partial range of the image and which is selected in accordance with a user operation to the image transmission apparatus, a receiving unit that, while the partial range of the image is selected, receives, from the image transmission apparatus, the entirety of the image when the image belongs to a first type and a portion of the image when the image belongs to a second type, by receiving one or more tiles, which corresponds to the partial range of the image and outside which a reference to is prohibited in inter-picture prediction, among a plurality of tiles included in the image, and a decoding unit that decodes the received entirety or portion of the image.
    Type: Grant
    Filed: January 22, 2015
    Date of Patent: April 17, 2018
    Assignee: PANASONIC CORPORATION
    Inventors: Kengo Terada, Hisao Sasai, Tadamasa Toma, Noritaka Iguchi, Yui Koashi
  • Patent number: 9894255
    Abstract: A method and a system for depth selective segmentation of an object are provided. The method comprises the following steps. An image is captured in an invisible domain of the optical spectrum by illuminating a scene of interest under an illumination corresponding to said invisible domain of the optical spectrum by an invisible light illumination unit. A binary mask is obtained from the image according to a threshold. Part of the image is eliminated by applying the binary mask to the image, and resulting in another image. The threshold is changed and another binary mask is obtained. The latest obtained binary mask is applied to the latest captured image. The step of changing of the threshold, the step of obtaining a mask and the step of applying the latest obtained binary mask on the latest captured image are performed at least once.
    Type: Grant
    Filed: May 29, 2014
    Date of Patent: February 13, 2018
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Ludovic Angot, Chun-Te Wu, Wei-Yi Lee
  • Patent number: 9888188
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: February 6, 2018
    Assignee: International Business Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9872005
    Abstract: A moving image reproducing apparatus and a moving image controller are provided. The moving image reproducing apparatus includes a moving image data storer which stores moving image data including a target object having a transparency, at least one of a shade and a gloss on the target object, and a background image. The moving image controller fetches the moving image data from the moving image data storer, disposes an area having a color whose setting is changeable behind the moving image data, synthesizes the moving image data and the area, and sets the color of the area corresponding to the transparency as a color of the target object.
    Type: Grant
    Filed: January 21, 2014
    Date of Patent: January 16, 2018
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Takayuki Tsukitani, Kyoichi Masutomi
  • Patent number: 9813671
    Abstract: A telecommunications system including a network; a plurality of user devices coupled to the network; a multipoint control unit coupled to the network and configured to supervise multipoint conferencing among the plurality of user devices, the multipoint control unit including a presentation mixer, the presentation mixer configured to remove one or more backgrounds from a presentation and mix a live video feed into the presentation as a substitute background; and a screen for displaying a resulting mixed presentation such that a full area of the screen is used to display the mixed presentation. In some embodiments, the presentation mixer is further configured to adjust a level of transparency of the substitute background.
    Type: Grant
    Filed: February 4, 2008
    Date of Patent: November 7, 2017
    Assignee: Unify GmbH & Co. KG
    Inventors: Rami Caspi, William J. Beyda
  • Patent number: 9767586
    Abstract: A method for operating an image processing device coupled to a color camera and a depth camera is provided. The method includes receiving a color image of a 3-dimensional scene from a color camera, receiving a depth map of the 3-dimensional scene from a depth camera, generating an aligned 3-dimensional face mesh from a plurality of color images received from the color camera indicating movement of a subject's head within the 3-dimensional scene and form the depth map, determining a head region based the depth map, segmenting the head region into a plurality of facial sections based on both the color image, depth map, and the aligned 3-dimensional face mesh, and overlaying the plurality of facial sections on the color image.
    Type: Grant
    Filed: November 25, 2014
    Date of Patent: September 19, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Lin Liang, Christian F. Huitema, Matthew Adam Simari, Sean Eron Anderson
  • Patent number: 9741144
    Abstract: A healing component that heals foreground pixels with background pixels is provided. In some embodiments, the healing component is programmed or otherwise configured to respond to a single healing request by identifying a plurality of regions within a selected area and healing each region of the plurality of regions independently of other regions.
    Type: Grant
    Filed: November 9, 2015
    Date of Patent: August 22, 2017
    Assignee: Adobe Systems Incorporated
    Inventors: Sylvain Paris, Sohrab Amirghodsi, Elya Shechtman
  • Patent number: 9740916
    Abstract: Disclosed herein are systems and methods for persona identification using combined probability maps. An embodiment takes the form of a method that includes obtaining at least one frame of pixel data; processing the at least one frame of pixel data to generate a hair-identification probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based at least in part on the generated hair-identification probability map.
    Type: Grant
    Filed: August 8, 2016
    Date of Patent: August 22, 2017
    Assignee: Personify Inc.
    Inventors: Dennis Lin, Glenn Francisco, Quang Nguyen, Long Dang
  • Patent number: 9724597
    Abstract: An image capture device includes: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to identify and track an illuminated object in the interactive environment.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: August 8, 2017
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Anton Mikhailov, Richard Marks, Eric Larsen
  • Patent number: 9652046
    Abstract: The present invention is directed to a video display and user control for the video display. In the preferred embodiment, multiple video feeds are combined into a single video display, where one feed, preferably live, includes an object which is used by a computer to select a second and display a second feed, wherein the location and orientation of the second feed changes based on the location and orientation of the object in the first feed. At least a portion of the display gives the appearance of depth, such as through use of superimposed animation. The live image is controlled by the user's movement, causing at least a part of the display to move in concert with the user's motion, thereby creating an enhanced three dimensional effect for a superimposed display.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: May 16, 2017
    Inventor: David Elmekies
  • Patent number: 9613597
    Abstract: An image compositing apparatus of the present invention includes first overlay image processing circuitry that stores the position and size of an area in which a first overlay image is displayed and, according thereto, changes the position and size of the first overlay image, second overlay image processing circuitry that processes a second overlay image similarly to the first overlay image processing circuitry, a circuit for detecting the absence of base image that decides the presence or absence of a base image, and a chromakey decision circuitry that decides a chromakey color portion of the base image. In a case where the circuit for detecting the absence of base image decides the absence of a base image, the image compositing apparatus outputs the first and second overlay images processed by the first overlay image processing circuitry and the second overlay image processing circuitry, respectively.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: April 4, 2017
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Masatsugu Yamamoto
  • Patent number: 9609305
    Abstract: Depth information can be used to assist with image processing functionality, such as various calibration approaches to determine and correct for misalignments between cameras. In at least some embodiments, depth information obtained from stereo imaging or distance sensing, for example, can be used to segment an image or frame of video into at least a foreground object and a background object. Once the foreground and background object has been determined, information about that objects can be used to determine a mapping, and once a subsequent stereoscopic image is captured using the cameras, the mapping can be applied to each image to account for misalignment effects due to a misaligned stereo camera pair before providing the stereoscopic image for display.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: March 28, 2017
    Assignee: Amazon Technologies, Inc.
    Inventor: Sharadh Ramaswamy
  • Patent number: 9594943
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: March 14, 2017
    Assignee: International Busines Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9571815
    Abstract: A method for processing a 3D image signal and an image display device for implementing the method are provided. The 3D image signal processing method is implemented by the 3D image display device. Although an image signal transmission side transmits information to be included in a plurality of image signals, while omitting a portion of the information, a receiver can synthesize the transmitted information to reproduce an image. The device restores at least one image from a broadcast signal, and additionally generates an image at a virtual camera view from the restored image and displays it three-dimensionally. To this end, the image display device receives a broadcast signal and obtains at least one set of camera parameters from signaling information. Then, the image display device generates a virtual view image according to the camera parameters, and formats the virtual view image and the broadcast image included in the broadcast signal three-dimensionally.
    Type: Grant
    Filed: August 19, 2009
    Date of Patent: February 14, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Jeong-Hyu Yang, Jong-Yeul Suh
  • Patent number: 9570046
    Abstract: An approach is provided for rendering content based on chunks and layers. A request is received to render content at a device. One or more layers of the content are determined. One or more patterns are determined corresponding to one or more of the layers. One or more chunks are determined based, at least in part, on the one or more patterns. At least one of the layers and corresponding one or more chunks are determined to be rendered separately from the other layers.
    Type: Grant
    Filed: September 13, 2010
    Date of Patent: February 14, 2017
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Noam Rosenthal, Timo Tapani Vitikainen
  • Patent number: 9549101
    Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: January 17, 2017
    Assignee: International Business Machines Corporation
    Inventor: Alister J. Brain
  • Patent number: 9542644
    Abstract: Methods and apparatus are provided for training a neural device having an artificial nervous system by modulating at least one training parameter during the training. One example method for training a neural device having an artificial nervous system generally includes observing the neural device in a training environment and modulating at least one training parameter based at least in part on the observing. For example, the training apparatus described herein may modify the neural device's internal learning mechanisms (e.g., spike rate, learning rate, neuromodulators, sensor sensitivity, etc.) and/or the training environment's stimuli (e.g., move a flame closer to the device, make the scene darker, etc.). In this manner, the speed with which the neural device is trained (i.e., the training rate) may be significantly increased compared to conventional neural device training systems.
    Type: Grant
    Filed: November 13, 2013
    Date of Patent: January 10, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Michael-David Nakayoshi Canoy, Yinyin Liu, Anthony Sarah, Adrienne Milner
  • Patent number: 9530044
    Abstract: A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.
    Type: Grant
    Filed: July 21, 2015
    Date of Patent: December 27, 2016
    Assignee: THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
    Inventors: Quang H Nguyen, Minh N Do, Sanjay J. Patel, Daniel P. Dabbelt, Dennis J. Lin
  • Patent number: 9483856
    Abstract: A display controller comprising a blending stage and a blending controller. The blending stage is provided for blending multiple image layers into one display output image and comprises a plurality of input channels for receiving pixel data for the multiple image layers. The blending stage further comprises multiple blenders for combining the pixel data received by at least two input channels of the plurality of input channels. The blending controller is coupled to the blending stage for controlling operation of the blending stage. The blending stage further comprises a controllable switch for coupling an output of at least one blender of the multiple blenders to a display output of the blending stage for regular on-the-fly blending or to an offline blending memory for storing a result of an offline blending task.
    Type: Grant
    Filed: April 20, 2012
    Date of Patent: November 1, 2016
    Assignee: FREESCALE SEMICONDUCTOR, INC.
    Inventors: Michael Staudenmaier, Vincent Aubineau, Davor Bogavac
  • Patent number: 9462284
    Abstract: A method for produces a video data stream for an expansion signal, wherein a base signal represents a first video quality degree and the expansion and base signals jointly represent a second video quality. Only second syntax elements of the expansion signal which are not describable by the first syntax element of the base signal are taken into account during encoding, the coding mode of a video encoding method which is encodable by all syntax elements is selected by means of statistical method, said second syntax elements are not representable by one or several first syntax elements and the method brings about to the production of the shortest video data stream for said second syntax elements. A decoding method for restoring the expansion signal from the video data stream, encoding and coding devices are also disclosed.
    Type: Grant
    Filed: November 8, 2005
    Date of Patent: October 4, 2016
    Assignee: SIEMENS AKTIENGESELLSCHAFT
    Inventors: Peter Amon, Jürgen Pandel
  • Patent number: 9414016
    Abstract: Disclosed herein are systems and methods for extracting person image data comprising: obtaining at least one frame of pixel data and corresponding image depth data; processing the at least one frame of pixel data and the image depth data with a plurality of persona identification modules to generate a corresponding plurality of persona probability maps; combining the plurality of persona probability maps to obtain an aggregate persona probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based on the aggregate persona probability map.
    Type: Grant
    Filed: December 31, 2013
    Date of Patent: August 9, 2016
    Assignee: PERSONIFY, INC.
    Inventors: Dennis Lin, Glenn Francisco, Quang Nguyen, Long Dang
  • Patent number: 9210377
    Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.
    Type: Grant
    Filed: October 30, 2013
    Date of Patent: December 8, 2015
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventor: John Robert Oetting
  • Patent number: 9160938
    Abstract: A virtual three-dimensional presentation in accordance with the present invention includes three stereoscopic layers, a stereoscopic background layer, a stereoscopic video insert layer, and a stereoscopic three-dimensional foreground layer. A surface, the Z-sphere, is defined in the virtual three-dimensional space of the three-dimensional scene with reference to the aim point, the distance between the cameras, and the distance from the camera of the video scene, of a virtual stereoscopic camera looking at the three-dimensional scene being created. The separation of the virtual stereoscopic camera lens and distance to the aim point are set based on the stereoscopic cameras that are creating the video insert layer. The stereoscopic three-dimensional foreground layer scene may include a key which defines the transparency of objects in the foreground layer.
    Type: Grant
    Filed: April 12, 2011
    Date of Patent: October 13, 2015
    Assignee: WSI Corporation
    Inventors: John S. Moore, Victor W. Marsh, Richard T. Daly
  • Patent number: 9106908
    Abstract: Generally, this disclosure provides methods and systems for real-time video communication with three dimensional perception image rendering through generated parallax effects based on identification, segmentation and tracking of foreground and background layers of an image. The system may include an image segmentation module configured to segment a current local video frame into a local foreground layer and a local background layer and to generate a local foreground mask based on an estimated boundary between the local foreground layer and the local background layer; a face tracking module configured to track a position of a local user's face; a background layer estimation module configured to estimate a remote background layer; and an image rendering module configured to render a 3D perception image based on the estimated remote background layer, the current remote video frame and the remote foreground mask.
    Type: Grant
    Filed: July 30, 2012
    Date of Patent: August 11, 2015
    Assignee: Intel Corporation
    Inventors: Yi Wu, Wei Sun, Michael M. Chu, Ermal Dreshaj, Philip Muse, Lucas B. Ainsworth, Garth Shoemaker, Igor V. Kozintsev
  • Patent number: 9083850
    Abstract: Methods and systems for video blurring in a secure environment are described. In one embodiment, the method includes receiving video at a video visitation device in a secure environment, adjusting a depth of field parameter for the video, such that an image of a first object at a first distance from the video visitation device is in focus and an image of a second object at a second distance from the video visitation device is blurred, and providing the video to a viewing device located outside of the secure environment.
    Type: Grant
    Filed: June 29, 2013
    Date of Patent: July 14, 2015
    Assignee: Securus Technologies, Inc.
    Inventor: Joseph Higgs
  • Patent number: 9024966
    Abstract: A display system combines a graphic plane and a video overlay plane using color keys in the graphics plane. By time-averaging patterns of color keys in successive frames of the graphics plane, individual pixels of the graphics plane can be made to appear partially transparent. Using this technique, regions in the graphics plane (e.g., a menu) can be partially transparent with respect to the video overlay, and aliasing can be reduced by making selected pixels in the graphics plane partially transparent.
    Type: Grant
    Filed: September 7, 2007
    Date of Patent: May 5, 2015
    Assignee: QUALCOMM Incorporated
    Inventor: Pieter van der Meulen
  • Patent number: 9016872
    Abstract: A projector that modulates light emitted from a light source and projects the modulated image light on a projection surface, the projector including: an object detection unit for determining the position of an object that blocks projection of the image light; a distance detection unit for determining the distance to the object; and a projection control unit for determining an avoidance area where the object prevents the image light from reaching the projection surface based on the position of the object determined by the object detection unit and the distance to the object determined by the distance detection unit and projecting the image light in an area other than the avoidance area.
    Type: Grant
    Filed: January 22, 2013
    Date of Patent: April 28, 2015
    Assignee: Seiko Epson Corporation
    Inventor: Tadanori Aruga
  • Patent number: 8988609
    Abstract: A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.
    Type: Grant
    Filed: February 7, 2014
    Date of Patent: March 24, 2015
    Assignee: Sony Computer Entertainment America LLC
    Inventor: Gary M. Zalewski
  • Patent number: 8953048
    Abstract: The present invention ensures the visibility of a character or a drawing displayed on a screen. The illuminance of one or more partial areas forming a display unit is measured, and a video display position is set to an area except for the partial area where the illuminance is a reference value or more.
    Type: Grant
    Filed: December 3, 2010
    Date of Patent: February 10, 2015
    Assignee: Canon Kabushiki Kaisha
    Inventor: Takeshi Furukawa
  • Patent number: 8866970
    Abstract: A method for embedding an image in a video sequence for a mobile terminal. Preferably, the mobile terminal is a tablet or smartphone. The method comprises the steps of choosing an image to be embedded, reading the video sequence, displaying a frame, and determining the presence of an embedding zone in the frame. The embedding zone having been previously identified or deduced according to a predefined algorithm. The method further comprises the step of applying a deformation to the image to be embedded such that the image to be embedded coincides with the form of the embedding zone. The image combining the frame and the image to be embedded is displayed/disposed in place of the embedding zone.
    Type: Grant
    Filed: December 17, 2012
    Date of Patent: October 21, 2014
    Assignee: Phonitive
    Inventor: Guillaume Lemoine
  • Patent number: 8860803
    Abstract: Stage props, such as consumer products, in legacy program content are replaced with dynamically replaceable assets. Such assets can be used for advertising purposes in that images of different products and services can be inserted therein and are changeable via a network. Such assets may be created by identifying props in the content for replacement, and determining location and visual effects information for each identified prop. The content may be played back by broadcasting the content and reference information designating parameters for inserting the assets into the content. Replacement images, such as images of products, may be obtained via a network. The visual appearance of each replacement image may be modified using visual effects information so the inserted objects appear natural as if they were part of the original scene.
    Type: Grant
    Filed: September 13, 2013
    Date of Patent: October 14, 2014
    Assignee: Sony Computer Entertainment America LLC
    Inventors: Gary Zalewski, Riley R. Russell
  • Patent number: 8833948
    Abstract: It is a task to provide a mobile electronic device with high operability and high safety. The mobile electronic device includes an image projector that projects an image, a detector that detects a specific change in an irradiation area of light irradiated from the image projector or in a predetermined area including the irradiation area, and a control unit that controls the operation of the image projector. The task is solved in such a manner that when the detector detects the specific change, the control unit causes the image projector to stop emission of light therefrom, or to reduce an amount of light emitted therefrom.
    Type: Grant
    Filed: February 25, 2010
    Date of Patent: September 16, 2014
    Assignee: Kyocera Corporation
    Inventors: Masashi Osaka, Yasuhiro Ueno, Yasushi Kitamura, Seiji Horii, Jouji Yoshikawa, Tomoko Asano, Hiroki Itou, Youji Yamada
  • Patent number: 8837842
    Abstract: Multi-mode decoding and encoding of texture blocks are disclosed wherein in a default decoding and encoding mode all bits of a codeword sequence are available as payload bits for representing texel values of the texels in the texture block. In an auxiliary encoding and decoding mode one less bit of the codeword sequence is available as payload bits. The auxiliary mode is employed as a complement to the default mode and will be used to process those texture blocks, which the default mode handles poorly.
    Type: Grant
    Filed: June 18, 2013
    Date of Patent: September 16, 2014
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventor: Jacob Ström
  • Patent number: 8830293
    Abstract: Techniques are described herein for combining video frames of two or more real-time video streams into combined video frames of a combined real-time video stream for continuous presence. Video frames of at least two real-time video streams are combined into combined video frames of a combined video stream. The combined video stream is supplied to a video display for displaying the combined video stream. Each video stream includes video frames with subject and background images. The subject images of corresponding video frames of the first and second video streams are combined into a combined video frame of a combined video stream such that the subject image of the first video stream is positioned in an anterior portion of the combined frame and the subject image of the second video stream is positioned in a posterior portion of the combined frame.
    Type: Grant
    Filed: May 26, 2009
    Date of Patent: September 9, 2014
    Assignee: Cisco Technology, Inc.
    Inventors: J. William Mauchly, Richard Thayer Wales