Patents by Inventor Matthew Kammerait
Matthew Kammerait has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230408832Abstract: A system and method for generating a virtual content to a physical object is described. The system accesses a video that was captured by a camera. The video depicts a user performing a physical operation in relation to a physical object. The system determines metadata identifying positions of the camera relative to the physical object during the capturing of the video, identifies feature points of the physical object in the video, and retrieves a virtual object based on the feature points of the physical object. The system generates virtual content based on the video, the metadata, and the virtual object, and stores the object identifier and the virtual content relationally in a data storage that stores multiple sets of virtual content associated with multiple physical objects and their corresponding object identifiers.Type: ApplicationFiled: August 30, 2023Publication date: December 21, 2023Inventors: Brian Mullins, Matthew Kammerait
-
Patent number: 11747634Abstract: A system and method for generating a virtual content to a physical object is described. A processor includes an augmented reality application. The augmented reality application creates virtual content at the head mounted device, and associates the virtual content with predefined conditions based on data from sensors embedded in the head mounted device at a time of creation of the virtual content. The virtual content is displayed in a display of the head mounted device in response to sensor data satisfying the predefined conditions.Type: GrantFiled: September 23, 2021Date of Patent: September 5, 2023Assignee: Meta Platforms Technologies, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 11150482Abstract: A system and method for generating a virtual content to a physical object is described. A processor includes an augmented reality application. The augmented reality application creates virtual content at the head mounted device, and associates the virtual content with predefined conditions based on data from sensors embedded in the head mounted device at a time of creation of the virtual content. The virtual content is displayed in a display of the head mounted device in response to sensor data satisfying the predefined conditions.Type: GrantFiled: February 15, 2016Date of Patent: October 19, 2021Assignee: FACEBOOK TECHNOLOGIES, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 10198869Abstract: A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.Type: GrantFiled: April 17, 2017Date of Patent: February 5, 2019Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
-
Patent number: 10110883Abstract: A device can determine a distance to an object. The device can use the determined distance to vary a focal length of a first adjustable element so that the first adjustable element directs light from the object into a first waveguide and onto a detector, and forms an image of the object at the detector. The device can produce an image, such as augmented content, on a panel. The device can direct light from the panel into a second waveguide. The device can use the determined distance to vary a focal length of a second adjustable element so that the second adjustable element directs light out of the second waveguide and forms a virtual image of the panel in a plane coincident with the object. The device can operate as an augmented reality headset. The adjustable elements can be phase modulators, or acoustically responsive material with surface acoustic wave transducers.Type: GrantFiled: September 30, 2016Date of Patent: October 23, 2018Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9984508Abstract: A system and method for measuring depth using an optical radar system are described. The system includes an optical radar, a camera, a display, and a processor. The optical radar emits a signal towards an object. The processor identifies an object depicted in an image captured with the camera. The processor generates the signal with a non-repeating pattern of amplitude and frequency, and computes a depth of the object based on a difference in phase angle between the signal emitted from the optical radar and a return signal received at the optical radar. The depth includes a distance between the optical radar and the object. The processor generates AR content based on the identified object and adjusts a characteristic of the AR content in the display based on the computed depth of the object.Type: GrantFiled: May 19, 2016Date of Patent: May 29, 2018Assignee: Micron Technology, Inc.Inventors: Brian Mullins, Matthew Kammerait, Mark Anthony Sararu
-
Patent number: 9978174Abstract: An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.Type: GrantFiled: December 29, 2016Date of Patent: May 22, 2018Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
-
Patent number: 9934754Abstract: A system and method for generating a dynamic sensor array for an augmented reality system is described. A head mounted device includes one or more sensors, an augmented reality (AR) application, and a sensor array module. The sensor array module identifies available sensors from other head mounted devices that are geographically located within a predefined area. A dynamic sensor array is formed based on the available sensors and the one or more sensors. The dynamic sensor array is updated based on an operational status of the available sensors and the one or more sensors. The AR application generates AR content based on data from the dynamic sensor array. A display of the head mounted device displays the AR content.Type: GrantFiled: September 30, 2015Date of Patent: April 3, 2018Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9864910Abstract: A head mounted device (HMD) includes a transparent display, sensors to generate sensor data, and a processor. The processor identifies a threat condition based on a threat pattern and the sensor data, and generates a warning notification in response to the identified threat condition. The threat pattern includes preconfigured thresholds for the sensor data. The HMD displays AR content comprising the warning notification in the transparent display.Type: GrantFiled: March 2, 2017Date of Patent: January 9, 2018Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9844119Abstract: A head mounted device includes a helmet, an ambient light sensor, a pupil dimension sensor, a lighting element, and a dynamic lighting system. The ambient light sensor is disposed in an outside surface of the helmet and measures ambient light outside the helmet. The pupil dimension sensor is disposed in a housing of the helmet and measures a size of a pupil of a wearer of the helmet. The lighting element is disposed in the outside surface of the helmet. The dynamic lighting system controls the lighting element and adjusts an intensity of the lighting element based on the ambient light and the pupil size of the wearer of the helmet.Type: GrantFiled: February 9, 2016Date of Patent: December 12, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9830395Abstract: A system and method for spatial data processing are described. Path bundle data packages from a viewing device are accessed and processed. The path bundle data packages identify a user interaction of the viewing device with an augmented reality content relative to and based on a physical object captured by the viewing device. The path bundle data packages are generated based on the sensor data using a data model comprising a data header and a data payload. The data header comprises a contextual header having data identifying the viewing device and a user of the viewing device. A path header having data identifies the path of the interaction with the augmented reality content. A sensor header having data identifies the plurality of sensors. The data payload comprises dynamically sized sampling data from the sensor data. The path bundle data packages are normalized and aggregated. Analytics computation is performed on the normalized and aggregated path bundle data packages.Type: GrantFiled: August 15, 2014Date of Patent: November 28, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, Jr.
-
Patent number: 9799142Abstract: A system and method for spatial data collection are described. Sensor data related to a position and an orientation of a device are generated over time using sensors of the device. Augmented reality content is generated based on a physical object captured by the device. A path bundle data package identifying a user interaction of the device with the augmented reality content relative to the physical object is generated. The user interaction identifies a spatial path of an interaction with the augmented reality content. The path bundle data package is generated based on the sensor data using a data model comprising a data header and a data payload. The data header comprises a contextual header having data identifying the device and a user of the device. A path header includes data identifying the path of the interaction with the augmented reality content. A sensor header includes data identifying the sensors. The data payload comprises dynamically sized sampling data from the sensor data.Type: GrantFiled: August 15, 2014Date of Patent: October 24, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, Jr.
-
Patent number: 9799143Abstract: A system and method for spatial data visualization are described. An analytics computation of users' interactions with an augmented reality content is performed based on a physical object captured by a viewing device. The analytics computation comprises a computation of geometric paths of the users' interactions with the augmented reality content. A display of a visualization of the analytics computation is displayed based on the computation of the geometric paths of the users' interactions with the augmented reality content.Type: GrantFiled: August 15, 2014Date of Patent: October 24, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, Jr.
-
Publication number: 20170255450Abstract: A system and method for a mixed reality, spatial, cooperative programming language is described. A sensor of a device detects a first physical object and a second physical object. An augmented reality application identifies the first and second physical objects and a physical state of the first and second physical objects, generates a programming logic associated with the identification and physical state of the first and second physical objects, generates augmented or virtual reality information related to the programming logic, and displays the augmented or virtual reality information in the display.Type: ApplicationFiled: March 4, 2016Publication date: September 7, 2017Inventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9727977Abstract: A system and method for sampling-based color extraction for augmented reality are described. A viewing device includes an optical sensor to capture an image of a real-world object. A color extraction software divides the captured image into multiple regions or recognizes pre-defined regions and identifies a color value for each region. A color-based augmented reality effect module retrieves a virtual content based on the color values for the regions, and delivers the virtual content in the viewing device.Type: GrantFiled: December 29, 2014Date of Patent: August 8, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Mark Sararu, Andrew Krage
-
Publication number: 20170221271Abstract: A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.Type: ApplicationFiled: April 17, 2017Publication date: August 3, 2017Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
-
Publication number: 20170193705Abstract: An augmented reality device includes one or more sensors for imaging and/or detecting an environment and a transparent display for displaying virtual objects. The augmented reality device monitors various biometric attributes of a user and determines the user's location within the environment. The augmented reality device determines a virtual path from the user's location to a selected destination within the environment using the monitored biometric attributes as one or more constraints in the pathfinding determination. The determined virtual path is displayed on the transparent display as a virtual object such that it appears overlaid on the user's environment. The augmented reality device monitors the user as he or she traverses the virtual path through the environment, and updates the virtual path in response to changes in one or more of the user's monitored biometric attributes.Type: ApplicationFiled: December 30, 2016Publication date: July 6, 2017Inventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, JR.
-
Publication number: 20170177941Abstract: A head mounted device (HMD) includes a transparent display, sensors to generate sensor data, and a processor. The processor identifies a threat condition based on a threat pattern and the sensor data, and generates a warning notification in response to the identified threat condition. The threat pattern includes preconfigured thresholds for the sensor data. The HMD displays AR content comprising the warning notification in the transparent display.Type: ApplicationFiled: March 2, 2017Publication date: June 22, 2017Inventors: Brian Mullins, Matthew Kammerait
-
Patent number: 9665985Abstract: A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.Type: GrantFiled: August 15, 2014Date of Patent: May 30, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
-
Patent number: 9659381Abstract: A system and method for real-time texture mapping for an augmented reality system are described. A viewing device includes an optical sensor to capture an image of a real-world object. A texture extraction module extracts a texture of the image of the real-world object. A recognition module identifies the real-world object based on the captured image. A texture mapping module retrieves a virtual object corresponding to the identified real-world object, maps the texture to the virtual object, dynamically updates the texture to the virtual object in real time, and generates a visualization of the virtual object in a display of the viewing device.Type: GrantFiled: January 26, 2015Date of Patent: May 23, 2017Assignee: DAQRI, LLCInventors: Brian Mullins, Matthew Kammerait, Mark Anthony Sararu, Andrew Thomas Krage, Gregory Khachaturyan