Patents by Inventor Aljosa Smolic

Aljosa Smolic has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11348267
    Abstract: The method comprising providing a plurality of images of a scene captured by a plurality of image capturing devices (101); providing silhouette information of at least one object in the scene (102); generating a point cloud for the scene in 3D space using the plurality of images (103); extracting an object point cloud from the generated point cloud, the object point cloud being a point cloud associated with the at least one object in the scene (104); estimating a 3D shape volume of the at least one object from the silhouette information (105); and combining the object point cloud and the shape volume of the at least one object to generate a three-dimensional model (106). An apparatus for generating a 3D model, and a computer readable medium for generating the 3D model.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: May 31, 2022
    Assignee: The Provost, Fellows, Foundation Scholars, and the Other Members of Board, of the College of the Holy and Undivided Trinity of Queen Elizabeth, Near Dublin Trinity Collge Dublin
    Inventors: Aljosa Smolic, Rafael Pages, Jan Ondrej, Konstantinos Amplianitis, David Monaghan
  • Publication number: 20200320727
    Abstract: The method comprising providing a plurality of images of a scene captured by a plurality of image capturing devices (101); providing silhouette information of at least one object in the scene (102); generating a point cloud for the scene in 3D space using the plurality of images (103); extracting an object point cloud from the generated point cloud, the object point cloud being a point cloud associated with the at least one object in the scene (104); estimating a 3D shape volume of the at least one object from the silhouette information (105); and combining the object point cloud and the shape volume of the at least one object to generate a three-dimensional model (106). An apparatus for generating a 3D model, and a computer readable medium for generating the 3D model.
    Type: Application
    Filed: December 20, 2018
    Publication date: October 8, 2020
    Inventors: Aljosa Smolic, Rafael Pages, Jan Ondrej, Konstantinos Amplianitis, David Monaghan
  • Patent number: 10757391
    Abstract: Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: August 25, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Aljosa Smolic, Nikolce Stefanoski
  • Patent number: 10740397
    Abstract: Disclosed is a system for linking transmedia content subsets. A memory stores a plurality of transmedia content data items and associated linking data, which define time-ordered content links between the transmedia content data items. The transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a transmedia content model that represents the transmedia content data items as nodes and the content links between the transmedia content data items as edges in one or more time-varying graphs. A processor is configured to associate the transmedia content data items with the time-ordered content links and store the linking data in the memory. It assigns the transmedia content data items to nodes of a graph structure, assign the time-ordered content links to edges of the graph structure, and store them in the transmedia content model.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: August 11, 2020
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Aljosa Smolic, Miquel Angel Farre Guiu, Nikolce Stefanoski, Markus Gross, Adriano Galati
  • Patent number: 10735628
    Abstract: The disclosure describes a high dynamic range video coding pipeline that may reduce color artifacts and improve compression efficiency. The disclosed pipeline separates the luminance component from the chrominance components of an input signal (e.g., an RGB source video) and applies a scaling of the chrominance components before encoding, thereby reducing perceivable color artifacts while maintaining luminance quality.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: August 4, 2020
    Assignee: Disney Enterprises, Inc.
    Inventors: Samir Mahmalat, Tunc Aydin, Aljosa Smolic
  • Publication number: 20200053252
    Abstract: The disclosure describes a high dynamic range video coding pipeline that may reduce color artifacts and improve compression efficiency. The disclosed pipeline separates the luminance component from the chrominance components of an input signal (e.g., an RGB source video) and applies a scaling of the chrominance components before encoding, thereby reducing perceivable color artifacts while maintaining luminance quality.
    Type: Application
    Filed: August 27, 2019
    Publication date: February 13, 2020
    Applicant: Disney Enterprises, Inc.
    Inventors: Samir Mahmalat, Tunc Aydin, Aljosa Smolic
  • Patent number: 10462334
    Abstract: The disclosure describes a high dynamic range video coding pipeline that may reduce color artifacts and improve compression efficiency. The disclosed pipeline separates the luminance component from the chrominance components of an input signal (e.g., an RGB source video) and applies a scaling of the chrominance components before encoding, thereby reducing perceivable color artifacts while maintaining luminance quality.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: October 29, 2019
    Assignee: Disney Enterprises, Inc.
    Inventors: Samir Mahmalat, Tunc Ozan Aydin, Aljosa Smolic
  • Patent number: 10257526
    Abstract: A video coding pipeline is provided that can accommodate high dynamic range (HDR) and wide color gamut (WCG) content at a fixed bitrate. The video coding pipeline relies on separate chromaticity and luminance-specific transforms in order to process image content. Image content may be converted into a nearly perceptually uniform color space for coding in constant luminance. Moreover, chromaticity transforms are utilized which reduce coding errors in the chroma components (at the fixed bitrate) by enlarging the distribution of code words for compression.
    Type: Grant
    Filed: September 22, 2015
    Date of Patent: April 9, 2019
    Assignee: Disney Enterprises, Inc.
    Inventors: Daniel Luginbuhl, Tunc Ozan Aydin, Aljosa Smolic, Nikolce Stefanoski
  • Patent number: 10121254
    Abstract: Methods and systems described herein detect object boundaries of videos. A window around the pixel may be followed in adjacent image frames of the image frame to determine object boundaries. Inconsistencies in image patches over a temporal window are detected, and each pixel of the image frame of a video is assigned an object boundary probability. The pixel may belong to a texture edge if the window content does not change throughout the adjacent image frames, or the pixel may belong to an object boundary if the window content changes. A probability value indicating the likelihood of the pixel belonging to an object boundary is determined based on the window content change and is assigned to the corresponding pixel.
    Type: Grant
    Filed: August 29, 2013
    Date of Patent: November 6, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Oliver Wang, Aljosa Smolic
  • Publication number: 20180309975
    Abstract: Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.
    Type: Application
    Filed: June 25, 2018
    Publication date: October 25, 2018
    Inventors: Aljosa SMOLIC, Nikolce STEFANOSKI
  • Patent number: 10037615
    Abstract: This disclosure related to systems and methods of palette-based color editing. A set of principle colors may be identified from among individual colors of individual pixels of an image. Color distributions about the individual principle colors may be determined. An individual color distribution may include a homogenous range of colors that may vary with respect to an individual principle color. Pixels may be associated with one or more pixel groups based on correspondences between individual colors of the individual pixels and individual colors included in the individual color distributions corresponding to the individual pixel groups. Color editing may be effectuated by modifying colors of pixels in a given group independently from other colors of other pixels in other groups.
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: July 31, 2018
    Assignees: Disney Enterprises, Inc., ETH ZURICH
    Inventors: Yagiz Aksoy, Tunc Ozan Aydin, Marc Pollefeys, Aljosa Smolic
  • Patent number: 10033983
    Abstract: Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: July 24, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Aljosa Smolic, Nikolce Stefanoski
  • Patent number: 9997134
    Abstract: Methods and systems for calibrating devices reproducing high dimensional data, such as calibrating High Dynamic Range (HDR) displays that reproduce chromatic data. Methods include mapping input data into calibrated data using calibration information retrieved from spatial data structures that encode a calibration function. The calibration function may be represented by any multidimensional scattered data interpolation methods such as Thin-Plate Splines. To efficiently represent and access the calibration information in runtime, the calibration function is recursively sampled based on guidance dataset. In an embodiment, an HDR display may be adaptively calibrated using a dynamic color guidance dataset and dynamic spatial data structures.
    Type: Grant
    Filed: February 2, 2015
    Date of Patent: June 12, 2018
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Aljosa Smolic, Nikolce Stefanoski, Tunc Ozan Aydin, Jing Liu, Anselm Grundhofer
  • Publication number: 20180131841
    Abstract: The disclosure describes a high dynamic range video coding pipeline that may reduce color artifacts and improve compression efficiency. The disclosed pipeline separates the luminance component from the chrominance components of an input signal (e.g., an RGB source video) and applies a scaling of the chrominance components before encoding, thereby reducing perceivable color artifacts while maintaining luminance quality.
    Type: Application
    Filed: March 14, 2017
    Publication date: May 10, 2018
    Applicant: Disney Enterprises, Inc.
    Inventors: SAMIR MAHMALAT, TUNC OZAN AYDIN, ALJOSA SMOLIC
  • Publication number: 20180089330
    Abstract: There is provided a system for linking transmedia content subsets. A memory stores a plurality of transmedia content data items and associated linking data which define time-ordered content links between the plurality of transmedia content data items. The plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a transmedia content model that represents the transmedia content data items as nodes and the content links between the transmedia content data items as edges in one or more time-varying graphs. A processor is configured to associate the transmedia content data items with the time-ordered content links and store the linking data in the memory. It assigns the transmedia content data items to nodes of a graph structure, assign the time-ordered content links to edges of the graph structure and store them in the transmedia content model.
    Type: Application
    Filed: September 26, 2016
    Publication date: March 29, 2018
    Applicants: DISNEY ENTERPRISES, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Aljosa Smolic, Miquel Angel Farre Guiu, Nikolce Stefanoski, Markus Gross, Adriano Galati
  • Publication number: 20180005409
    Abstract: This disclosure related to systems and methods of palette-based color editing. A set of principle colors may be identified from among individual colors of individual pixels of an image. Color distributions about the individual principle colors may be determined. An individual color distribution may include a homogenous range of colors that may vary with respect to an individual principle color. Pixels may be associated with one or more pixel groups based on correspondences between individual colors of the individual pixels and individual colors included in the individual color distributions corresponding to the individual pixel groups. Color editing may be effectuated by modifying colors of pixels in a given group independently from other colors of other pixels in other groups.
    Type: Application
    Filed: July 1, 2016
    Publication date: January 4, 2018
    Inventors: Yagiz Aksoy, Tunc Ozan Aydin, Marc Pollefeys, Aljosa Smolic
  • Publication number: 20170142402
    Abstract: Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.
    Type: Application
    Filed: January 26, 2017
    Publication date: May 18, 2017
    Inventors: Aljosa SMOLIC, Nikolce STEFANOSKI
  • Publication number: 20160323556
    Abstract: A video coding pipeline is provided that can accommodate high dynamic range (HDR) and wide color gamut (WCG) content at a fixed bitrate. The video coding pipeline relies on separate chromaticity and luminance-specific transforms in order to process image content. Image content may be converted into a nearly perceptually uniform color space for coding in constant luminance. Moreover, chromaticity transforms are utilized which reduce coding errors in the chroma components (at the fixed bitrate) by enlarging the distribution of code words for compression.
    Type: Application
    Filed: September 22, 2015
    Publication date: November 3, 2016
    Inventors: DANIEL LUGINBUHL, TUNC OZAN AYDIN, ALJOSA SMOLIC, NIKOLCE STEFANOSKI
  • Publication number: 20160225342
    Abstract: Methods and systems for calibrating devices reproducing high dimensional data, such as calibrating High Dynamic Range (HDR) displays that reproduce chromatic data. Methods include mapping input data into calibrated data using calibration information retrieved from spatial data structures that encode a calibration function. The calibration function may be represented by any multidimensional scattered data interpolation methods such as Thin-Plate Splines. To efficiently represent and access the calibration information in runtime, the calibration function is recursively sampled based on guidance dataset. In an embodiment, an HDR display may be adaptively calibrated using a dynamic color guidance dataset and dynamic spatial data structures.
    Type: Application
    Filed: February 2, 2015
    Publication date: August 4, 2016
    Inventors: Aljosa SMOLIC, Nikolce STEFANOSKI, Tunc Ozan AYDIN, Jing LlU, Anselm GRUNDHOFER
  • Patent number: 9214040
    Abstract: An intermediate view synthesis apparatus for synthesizing an intermediate view image from a first image corresponding to a first view and a second image corresponding to a second view different from the first view, the first and second images including depth information, wherein the second image being is divided-up into a non-boundary portion, and a foreground/background boundary region, wherein the intermediate view synthesis apparatus is configured to project and merge the first image and the second image into the intermediate view to obtain an intermediate view image, with treating the foreground/background boundary region subordinated relative to the non-boundary portion. A multi-view data signal extraction apparatus for extracting a multiview data signal from a multi-view representation including a first image corresponding to a first view and a second image corresponding to a second view being different from the first view is also described, the first and second images including depth information.
    Type: Grant
    Filed: April 1, 2011
    Date of Patent: December 15, 2015
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Aljosa Smolic, Karsten Mueller, Kristina Dix