Abstract: One variation of a method for augmenting surfaces in a space includes: at a projection system, recording a sequence of scans of the space; aggregating the sequence of scans into a projector-domain image of the space; detecting a set of objects in the projector-domain image; identifying an object, in the set of objects, as of a first type; detecting a surface proximal the object in the projector-domain image; defining an association between the surface and a content source based on the first type of the object; based on the association, warping visual content output by the content source according to a profile of the surface extracted from the projector-domain image; actuating a projector assembly in the projection system to locate the surface in the field of view of a light projector in the projection system; and projecting the visual content, via the light projector, toward the surface.
Type:
Grant
Filed:
January 29, 2020
Date of Patent:
February 8, 2022
Assignee:
Lightform, Inc.
Inventors:
Rajinder Sodhi, Brett Jones, Kevin Karsch, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck
Abstract: One variation of method includes: serving setup frames to a projector facing a scene; at a peripheral control module comprising a camera facing the scene, recording a set of images during projection of corresponding setup frames onto the scene by the projector and a baseline image depicting the scene in the field of view of the camera; calculating a pixel correspondence map based on the set of images and the setup frames; transforming the baseline image into a corrected color image—depicting the scene in the field of view of the camera—based on the pixel correspondence map; linking visual assets to discrete regions in the corrected color image; generating augmented reality frames depicting the visual assets aligned with these discrete regions; and serving the augmented reality frames to the projector to cast depictions of the visual assets onto surfaces, in the scene, corresponding to these discrete regions.
Type:
Grant
Filed:
September 28, 2018
Date of Patent:
August 6, 2019
Assignee:
Lightform, Inc.
Inventors:
Kevin Karsch, Rajinder Sodhi, Brett Jones, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny, Ehsan Noursalehi, Derek Nedelman, Laura LaPerche, Brittany Factura
Abstract: One variation of method includes: serving setup frames to a projector facing a scene; at a peripheral control module comprising a camera facing the scene, recording a set of images during projection of corresponding setup frames onto the scene by the projector and a baseline image depicting the scene in the field of view of the camera; calculating a pixel correspondence map based on the set of images and the setup frames; transforming the baseline image into a corrected color image—depicting the scene in the field of view of the camera—based on the pixel correspondence map; linking visual assets to discrete regions in the corrected color image; generating augmented reality frames depicting the visual assets aligned with these discrete regions; and serving the augmented reality frames to the projector to cast depictions of the visual assets onto surfaces, in the scene, corresponding to these discrete regions.
Type:
Grant
Filed:
May 11, 2020
Date of Patent:
September 27, 2022
Assignee:
Lightform, Inc.
Inventors:
Kevin Karsch, Rajinder Sodhi, Brett Jones, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny, Ehsan Noursalehi, Derek Nedelman, Laura LaPerche, Brittany Factura
Abstract: One variation of a method for augmenting surfaces within spaces with projected light includes: at a projector system during a first time period, projecting visual content onto nearby surfaces via a light projector integrated into the projector system and capturing a first scan of nearby surfaces, illuminated by the light projector, via an optical sensor integrated into the projector system; identifying a first space occupied by the projector system during the first time period based on features detected in the first scan; selecting a first augmented content source, from a first set of augmented content sources affiliated with the first space, associated with a first surface in the first space; articulating the light projector to locate the first surface in a field of view of the light projector; accessing a frame from the first augmented content source; and projecting the frame onto the first surface via the light projector.
Type:
Grant
Filed:
September 10, 2020
Date of Patent:
January 11, 2022
Assignee:
Lightform, Inc.
Inventors:
Rajinder Sodhi, Brett Jones, Kevin Karsch, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny
Abstract: One variation of a method for augmenting surfaces within spaces with projected light includes: at a projector system during a first time period, projecting visual content onto nearby surfaces via a light projector integrated into the projector system and capturing a first scan of nearby surfaces, illuminated by the light projector, via an optical sensor integrated into the projector system; identifying a first space occupied by the projector system during the first time period based on features detected in the first scan; selecting a first augmented content source, from a first set of augmented content sources affiliated with the first space, associated with a first surface in the first space; articulating the light projector to locate the first surface in a field of view of the light projector; accessing a frame from the first augmented content source; and projecting the frame onto the first surface via the light projector.
Type:
Grant
Filed:
December 2, 2019
Date of Patent:
October 13, 2020
Assignee:
Lightform, Inc.
Inventors:
Rajinder Sodhi, Brett Jones, Kevin Karsch, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny
Abstract: One variation of method includes: serving setup frames to a projector facing a scene; at a peripheral control module comprising a camera facing the scene, recording a set of images during projection of corresponding setup frames onto the scene by the projector and a baseline image depicting the scene in the field of view of the camera; calculating a pixel correspondence map based on the set of images and the setup frames; transforming the baseline image into a corrected color image—depicting the scene in the field of view of the camera—based on the pixel correspondence map; linking visual assets to discrete regions in the corrected color image; generating augmented reality frames depicting the visual assets aligned with these discrete regions; and serving the augmented reality frames to the projector to cast depictions of the visual assets onto surfaces, in the scene, corresponding to these discrete regions.
Type:
Grant
Filed:
June 20, 2019
Date of Patent:
June 23, 2020
Assignee:
Lightform, Inc.
Inventors:
Kevin Karsch, Rajinder Sodhi, Brett Jones, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny, Ehsan Noursalehi, Derek Nedelman, Laura LaPerche, Brittany Factura