Patents by Inventor Chuen-Chien Lee

Chuen-Chien Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11816795
    Abstract: The photo-video based spatial-temporal volumetric capture system more efficiently, produces high frame rate and high resolution 4D dynamic human videos, without a need for 2 separate 3D and 4D scanner systems, by combining a set of high frame rate machine vision video cameras with a set of high resolution photography cameras. It reduces a need for manual CG works, by temporally up-sampling shape and texture resolution of 4D scanned video data from a temporally sparse set of higher resolution 3D scanned keyframes that are reconstructed both by using machine vision cameras and photography cameras. Unlike typical performance capture system that uses single static template model at initialization (e.g. A or pose), the photo-video based spatial-temporal volumetric capture system stores multiple keyframes of high resolution 3D template models for robust and dynamic shape and texture refinement of 4D scanned video sequence.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: November 14, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Kenji Tashiro, Chuen-Chien Lee, Qing Zhang
  • Publication number: 20220044478
    Abstract: The photo-video based spatial-temporal volumetric capture system more efficiently, produces high frame rate and high resolution 4D dynamic human videos, without a need for 2 separate 3D and 4D scanner systems, by combining a set of high frame rate machine vision video cameras with a set of high resolution photography cameras. It reduces a need for manual CG works, by temporally up-sampling shape and texture resolution of 4D scanned video data from a temporally sparse set of higher resolution 3D scanned keyframes that are reconstructed both by using machine vision cameras and photography cameras. Unlike typical performance capture system that uses single static template model at initialization (e.g. A or pose), the photo-video based spatial-temporal volumetric capture system stores multiple keyframes of high resolution 3D template models for robust and dynamic shape and texture refinement of 4D scanned video sequence.
    Type: Application
    Filed: December 20, 2019
    Publication date: February 10, 2022
    Inventors: Kenji Tashiro, Chuen-Chien Lee, Qing Zhang
  • Patent number: 10416667
    Abstract: Various aspects of a system and method for utilization of multiple-camera network to capture static and/or motion scenes are disclosed herein. The system comprises a plurality of unmanned aerial vehicles (UAVs). Each of the plurality of UAVs is associated with an imaging device configured to capture a plurality of images. A first UAV of the plurality of UAVs comprises a first imaging device configured to capture a first set of images of one or more static and/or moving objects. The first UAV is configured to receive focal lens information, current location and current orientation from one or more imaging devices. A target location and a target orientation of each of the one or more imaging devices are determined. Control information is communicated to the one or more other UAVs to modify the current location and current orientation to the determined target location and orientation of each of the one or more imaging devices.
    Type: Grant
    Filed: February 3, 2016
    Date of Patent: September 17, 2019
    Assignee: SONY CORPORATION
    Inventors: Alexander Berestov, Ming-Chang Liu, Chuen-Chien Lee
  • Publication number: 20170220037
    Abstract: Various aspects of a system and method for utilization of multiple-camera network to capture static and/or motion scenes are disclosed herein. The system comprises a plurality of unmanned aerial vehicles (UAVs). Each of the plurality of UAVs is associated with an imaging device configured to capture a plurality of images. A first UAV of the plurality of UAVs comprises a first imaging device configured to capture a first set of images of one or more static and/or moving objects. The first UAV is configured to receive focal lens information, current location and current orientation from one or more imaging devices. A target location and a target orientation of each of the one or more imaging devices are determined. Control information is communicated to the one or more other UAVs to modify the current location and current orientation to the determined target location and orientation of each of the one or more imaging devices.
    Type: Application
    Filed: February 3, 2016
    Publication date: August 3, 2017
    Inventors: ALEXANDER BERESTOV, MING-CHANG LIU, CHUEN-CHIEN LEE
  • Patent number: 9420158
    Abstract: A system for implementing and utilizing a lens array in an electronic device includes a sensor array coupled to the electronic device for capturing image data corresponding to a photographic target. The lens array includes a plurality of lenses that each has a different respective principal focal length to transmit reflected light from the photographic target to the sensor array. The sensor array captures a set of MFP images that each corresponds with a respective one of the lenses in the MFP lens array. The electronic device may further include an image processor that performs one or more digital signal processing procedures on the captured MFP images to thereby generate a rendered final image.
    Type: Grant
    Filed: January 29, 2013
    Date of Patent: August 16, 2016
    Assignee: SONY CORPORATION
    Inventors: Alexander Berestov, Chuen-Chien Lee, Hans Masli, Ali Tabatabai
  • Patent number: 9307134
    Abstract: A Depth Map (DM) is able to be utilized for many parameter settings involving cameras, camcorders and other devices. Setting parameters on the imaging device includes zoom setting, aperture setting and shutter speed setting.
    Type: Grant
    Filed: March 25, 2011
    Date of Patent: April 5, 2016
    Assignee: Sony Corporation
    Inventors: Florian Ciurea, Gazi Ali, Alexander Berestov, Chuen-Chien Lee
  • Patent number: 9210468
    Abstract: A system and method for effectively implementing a stroboscopic visual effect with a television device includes a strobe engine that analyzes video data to create a sequence of stroboscopic images based upon motion information from the video data. The television utilizes a display manager to present the stroboscopic images and the video data on a display device during a strobe display mode. A processor device of the television typically controls the operations of the strobe engine and the display manager to implement the stroboscopic visual effect.
    Type: Grant
    Filed: March 22, 2011
    Date of Patent: December 8, 2015
    Assignee: Sony Corporation
    Inventors: Ming-Chang Liu, Kuang-Man Huang, Chuen-Chien Lee
  • Patent number: 8861836
    Abstract: A method for converting a 2D image into a 3D image includes receiving the 2D image; determining whether the received 2D image is a portrait, wherein the portrait can be a face portrait or a non-face portrait; if the received 2D image is determined to be a portrait, creating a disparity between a left eye image and a right eye image based on a local gradient and a spatial location; generating the 3D image based on the created disparity; and outputting the generated 3D image.
    Type: Grant
    Filed: January 14, 2011
    Date of Patent: October 14, 2014
    Assignee: Sony Corporation
    Inventors: Jianing Wei, Alexander Berestov, Chuen-Chien Lee, Xue Tu, Xiaoling Wang
  • Patent number: 8847781
    Abstract: A method for operating a building management system includes: identifying a movement-pattern from a sensed attribute at a first sensor; determining a behavior-pattern at the first sensor when the movement-pattern matches a template-pattern; transmitting the behavior-pattern and the sensed attribute from the first sensor to a second sensor; and tracking the sensed attribute at the second sensor for displaying on a device.
    Type: Grant
    Filed: March 28, 2012
    Date of Patent: September 30, 2014
    Assignee: Sony Corporation
    Inventors: Hans Masli, Chuen-Chien Lee, Alexander Berestov, Tomofumi Okuda, Jeremy Saltzman
  • Patent number: 8824821
    Abstract: Method and apparatus for performing visual effects rendering on an image are described. User specifications are processed for at least one visual effect for the image. Scene analysis information associated with the image may be accessed, wherein the scene analysis information is based on the user specifications and indicates at least one pixel of the image for coupling with the at least one visual effect. The at least one pixel is accentuated using depth map information, wherein dimensions for the at least one pixel are determined in response to corresponding depth values of the at least one pixel. An output image is generated having at least one visual effect.
    Type: Grant
    Filed: March 28, 2011
    Date of Patent: September 2, 2014
    Assignee: Sony Corporation
    Inventors: Gazi Ali, Alexander Berestov, Chuen-Chien Lee
  • Publication number: 20140016016
    Abstract: A system for implementing and utilizing a lens array in an electronic device includes a sensor array coupled to the electronic device for capturing image data corresponding to a photographic target. The lens array includes a plurality of lenses that each has a different respective principal focal length to transmit reflected light from the photographic target to the sensor array. The sensor array captures a set of MFP images that each corresponds with a respective one of the lenses in the MFP lens array. The electronic device may further include an image processor that performs one or more digital signal processing procedures on the captured MFP images to thereby generate a rendered final image.
    Type: Application
    Filed: January 29, 2013
    Publication date: January 16, 2014
    Inventors: Alexander Berestov, Chuen-Chien Lee, Hans Masli, Ali Tabatabai
  • Publication number: 20130257626
    Abstract: A method for operating a building management system includes: identifying a movement-pattern from a sensed attribute at a first sensor; determining a behavior-pattern at the first sensor when the movement-pattern matches a template-pattern; transmitting the behavior-pattern and the sensed attribute from the first sensor to a second sensor; and tracking the sensed attribute at the second sensor for displaying on a device.
    Type: Application
    Filed: March 28, 2012
    Publication date: October 3, 2013
    Applicant: Sony Corporation
    Inventors: Hans Masli, Chuen-Chien Lee, Alexander Berestov, Tomofumi Okuda, Jeremy Saltzman
  • Publication number: 20130262654
    Abstract: A method for operating a resource management system includes: identifying a total-usage status of a resource currently being supplied; calculating a current production amount of supplying the resource using the total-usage status; calculating an assessment structure directly reflecting the current production amount; adjusting the assessment structure for modifying behavior associated with the current consumption of the resource.
    Type: Application
    Filed: March 28, 2012
    Publication date: October 3, 2013
    Inventors: Hans Masli, Chuen-Chien Lee, Alexander Berestov, Tomofumi Okuda, Jeremy Saltzman
  • Patent number: 8488901
    Abstract: A video input signal is analyzed to detect image content and image properties, wherein detecting the image content includes automatically deriving image features. A content group is determined for the video input signal based on the detected image content, the content group including predefined image properties. The image properties of the video input signal are adjusted based on a difference between the detected image properties and the predefined image properties.
    Type: Grant
    Filed: September 28, 2007
    Date of Patent: July 16, 2013
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventors: Alexander Berestov, Chuen-Chien Lee
  • Publication number: 20120249836
    Abstract: Method and apparatus for performing visual effects rendering on an image are described. User specifications are processed for at least one visual effect for the image. Scene analysis information associated with the image may be accessed, wherein the scene analysis information is based on the user specifications and indicates at least one pixel of the image for coupling with the at least one visual effect. The at least one pixel is accentuated using depth map information, wherein dimensions for the at least one pixel are determined in response to corresponding depth values of the at least one pixel. An output image is generated having at least one visual effect.
    Type: Application
    Filed: March 28, 2011
    Publication date: October 4, 2012
    Applicant: SONY CORPORATION
    Inventors: GAZI ALI, ALEXANDER BERESTOV, CHUEN-CHIEN LEE
  • Publication number: 20120242779
    Abstract: A system and method for effectively implementing a stroboscopic visual effect with a television device includes a strobe engine that analyzes video data to create a sequence of stroboscopic images based upon motion information from the video data. The television utilizes a display manager to present the stroboscopic images and the video data on a display device during a strobe display mode. A processor device of the television typically controls the operations of the strobe engine and the display manager to implement the stroboscopic visual effect.
    Type: Application
    Filed: March 22, 2011
    Publication date: September 27, 2012
    Inventors: Ming-Chang Liu, Kuang-Man Huang, Chuen-Chien Lee
  • Publication number: 20120242796
    Abstract: A Depth Map (DM) is able to be utilized for many parameter settings involving cameras, camcorders and other devices. Setting parameters on the imaging device includes zoom setting, aperture setting and shutter speed setting.
    Type: Application
    Filed: March 25, 2011
    Publication date: September 27, 2012
    Applicant: SONY CORPORATION
    Inventors: Florian Ciurea, Gazi Ali, Alexander Berestov, Chuen-Chien Lee
  • Patent number: 8259208
    Abstract: A camera and method which selectively applies image content adjustments to elements contained in the image material. By way of example, the method involves registration of user touch screen input and determination of the arbitrary extent of a specific element in the captured image material at the location at which touch input was registered. Once selected, the element can be highlighted on the display, and additional user input may be optionally input to control what type of adjustment is to be applied. Then the element within the captured image material is processed to apply automatic, or user-selected, adjustments to the content of said element in relation to the remainder of the captured image. The adjustments to the image element may comprise any conventional forms of image editing, such as saturation, white balance, exposure, sizing, noise reduction, sharpening, blurring, deleting and so forth.
    Type: Grant
    Filed: April 15, 2008
    Date of Patent: September 4, 2012
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventors: Florian Ciurea, Alexander Berestov, Chuen-Chien Lee
  • Publication number: 20120183202
    Abstract: A method for converting a 2D image into a 3D image includes receiving the 2D image; determining whether the received 2D image is a portrait, wherein the portrait can be a face portrait or a non-face portrait; if the received 2D image is determined to be a portrait, creating a disparity between a left eye image and a right eye image based on a local gradient and a spatial location; generating the 3D image based on the created disparity; and outputting the generated 3D image.
    Type: Application
    Filed: January 14, 2011
    Publication date: July 19, 2012
    Inventors: Jianing Wei, Alexander Berestov, Chuen-Chien Lee, Xue Tu, Xiaoling Wang
  • Publication number: 20120105581
    Abstract: Converting two dimensional images to three dimensional images using Global Positioning System (GPS) data and Digital Surface Models (DSMs) is described herein. DSMs and GPS data are used to position a virtual camera. The distance between the virtual camera to the DSM is used to reconstruct a depth map. The depth map and two dimensional image are used to render a three dimensional image.
    Type: Application
    Filed: October 29, 2010
    Publication date: May 3, 2012
    Applicant: SONY CORPORATION
    Inventors: Alexander Berestov, Chuen-Chien Lee