Patents by Inventor Brian Mullins

Brian Mullins has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • PATH VISUALIZATION FOR MOTION PLANNING
    Publication number: 20170193705
    Abstract: An augmented reality device includes one or more sensors for imaging and/or detecting an environment and a transparent display for displaying virtual objects. The augmented reality device monitors various biometric attributes of a user and determines the user's location within the environment. The augmented reality device determines a virtual path from the user's location to a selected destination within the environment using the monitored biometric attributes as one or more constraints in the pathfinding determination. The determined virtual path is displayed on the transparent display as a virtual object such that it appears overlaid on the user's environment. The augmented reality device monitors the user as he or she traverses the virtual path through the environment, and updates the virtual path in response to changes in one or more of the user's monitored biometric attributes.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 6, 2017
    Inventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, JR.
  • THREAT IDENTIFICATION SYSTEM
    Publication number: 20170177941
    Abstract: A head mounted device (HMD) includes a transparent display, sensors to generate sensor data, and a processor. The processor identifies a threat condition based on a threat pattern and the sensor data, and generates a warning notification in response to the identified threat condition. The threat pattern includes preconfigured thresholds for the sensor data. The HMD displays AR content comprising the warning notification in the transparent display.
    Type: Application
    Filed: March 2, 2017
    Publication date: June 22, 2017
    Inventors: Brian Mullins, Matthew Kammerait
  • SYSTEM AND METHOD FOR TOOL MAPPING
    Publication number: 20170169561
    Abstract: A server receives datasets from mobile devices. Each dataset identifies a task selected in an augmented reality application of a corresponding mobile device and an identification of a tool detected at the corresponding mobile device. The server identifies tools present and absent at a dedicated tool board and compares an identification of the tools present and absent at the dedicated tool board with the tools detected at the mobile devices and the tasks identified at the mobile devices to generate a tool inventory and a tool compliance. The server generates an augmented reality content dataset for each mobile device to identify at least one of a missing tool, an incorrect tool, and a valid tool based on the tool compliance.
    Type: Application
    Filed: December 11, 2015
    Publication date: June 15, 2017
    Applicant: DAQRI, LLC
    Inventor: Brian Mullins
  • CONTEXTUAL LOCAL IMAGE RECOGNITION DATASET
    Publication number: 20170169619
    Abstract: A contextual local image recognition module of a device retrieves a primary content dataset from a server and then generates and updates a contextual content dataset based on an image captured with the device. The device stores the primary content dataset and the contextual content dataset. The primary content dataset comprises a first set of images and corresponding virtual object models. The contextual content dataset comprises a second set of images and corresponding virtual object models retrieved from the server.
    Type: Application
    Filed: February 27, 2017
    Publication date: June 15, 2017
    Inventor: Brian Mullins
  • Content creation tool
    Patent number: 9679416
    Abstract: A server for content creation is described. A content creation tool of the server receives, from a first device, a content identifier of a physical object, a virtual object content, and a selection of a template corresponding to an interactive feature for the virtual object content. The content creation tool generates a content dataset based on the content identifier of the physical object, the virtual object content, and the selected template.
    Type: Grant
    Filed: February 11, 2016
    Date of Patent: June 13, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Offloading augmented reality processing
    Patent number: 9672660
    Abstract: A system and method for offloading augmented reality processing is described. A first sensor of a server generates a first set of sensor data corresponding to a location and an orientation of a display device. The server receives a request from the display device to offload a combination of at least one of a tracking process and a rendering process from the display device. The server generates offloaded processed data based on a combination of at least one of the first set of sensor data and a second set of sensor data. The second set of sensor data is generated by a second sensor at the display device. The server streams the offloaded processed data to the display device.
    Type: Grant
    Filed: February 11, 2016
    Date of Patent: June 6, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Remote expert system
    Patent number: 9665985
    Abstract: A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.
    Type: Grant
    Filed: August 15, 2014
    Date of Patent: May 30, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
  • Real time texture mapping for augmented reality system
    Patent number: 9659381
    Abstract: A system and method for real-time texture mapping for an augmented reality system are described. A viewing device includes an optical sensor to capture an image of a real-world object. A texture extraction module extracts a texture of the image of the real-world object. A recognition module identifies the real-world object based on the captured image. A texture mapping module retrieves a virtual object corresponding to the identified real-world object, maps the texture to the virtual object, dynamically updates the texture to the virtual object in real time, and generates a visualization of the virtual object in a display of the viewing device.
    Type: Grant
    Filed: January 26, 2015
    Date of Patent: May 23, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Mark Anthony Sararu, Andrew Thomas Krage, Gregory Khachaturyan
  • Visual gestures for a head mounted device
    Patent number: 9652047
    Abstract: Visual gestures in a display device allow a user to select and activate features in a display of the display device. A sensor of the display device tracks an eye gaze of a user directed at a display of the display device. A visual gesture module identifies a predefined trigger zone in the display. A virtual object application displays a virtual object in the display based on the eye gaze of the user and the predefined trigger zone.
    Type: Grant
    Filed: February 24, 2016
    Date of Patent: May 16, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus, Sterling Crispin, Lucas Kazansky
  • Data manipulation based on real world object manipulation
    Patent number: 9639984
    Abstract: A system and method for data manipulation based on real world object manipulation is described. A device captures an image of a physical object. The image is communicated via a network to a remote server. The remote server includes virtual object data associated with the image and a communication notification for a user of the computing device. The device receives the virtual object data and displays the virtual image in a virtual landscape using the virtual object data. In response to relative movement between the computing device and the physical object caused by the user, the virtual image is modified.
    Type: Grant
    Filed: June 3, 2013
    Date of Patent: May 2, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • REMOTE SENSOR ACCESS AND QUEUING
    Publication number: 20170109923
    Abstract: An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.
    Type: Application
    Filed: December 29, 2016
    Publication date: April 20, 2017
    Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
  • Visualization of physical characteristics in augmented reality
    Patent number: 9626801
    Abstract: A system and method for visualization of physical characteristics are described. A sensor coupled to an object generates live data. Physical characteristics of the object are computed using the live data. A visualization of the physical characteristics of the object is generated and communicated to a viewing device configured to capture an image of the object. The viewing device augments the image of the object with the visualization of the physical characteristics of the object.
    Type: Grant
    Filed: December 31, 2013
    Date of Patent: April 18, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Retractable display for head mounted device
    Patent number: 9625724
    Abstract: A head mounted device includes a helmet with a guide, a lens frame, at least one display surface mounted to the lens frame. The guide extends from a cavity of the helmet. The lens frame is moveably connected to the guide and moves along an axis of the guide between a first position within the cavity of the helmet and a second position outside the cavity of the helmet. The display surface is transparent and configured to display augmented reality content.
    Type: Grant
    Filed: September 4, 2014
    Date of Patent: April 18, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus, Timotheos Leahy, Christopher Michaels Garcia
  • VISUALIZATION OF PHYSICAL INTERACTIONS IN AUGMENTED REALITY
    Publication number: 20170103581
    Abstract: An imaging device of a device captures an image. The device identifies a first and second object in the image, determines physical properties of the first and second object, generates a model of a predicted interaction between the first and second object based on the physical properties of the first and second object, identifies an area in the image based on the model of the predicted interaction between the first and second object, and augments the image at the area in a display of the device.
    Type: Application
    Filed: December 22, 2016
    Publication date: April 13, 2017
    Inventors: Brian Mullins, Matthew Kammerait, Christopher Broaddus
  • Threat identification system
    Patent number: 9619712
    Abstract: A head mounted device (HMD) includes a transparent display, sensors to generate sensor data, and a processor. The processor identifies a threat condition based on a threat pattern and the sensor data, and generates a warning notification in response to the identified threat condition. The threat pattern includes preconfigured thresholds for the sensor data. The HMD displays AR content comprising the warning notification in the transparent display.
    Type: Grant
    Filed: May 18, 2016
    Date of Patent: April 11, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait
  • WEIGHT-BASED DOSING SYRINGE
    Publication number: 20170095615
    Abstract: A system includes a syringe barrel, a syringe plunger, and an annular collar. The syringe barrel has a longitudinal axis aligned axially between a discharge end and a cylinder end. The syringe plunger has a cap disposed on a first end, a piston disposed on a second end and configured for disposition in a bore of the barrel, and has a body disposed between the first end and the second end. The body has an external thread on a first surface and the body has a visible calibration indication aligned axially. The annular collar has at least one interrupted internal thread segment on an interior surface. The collar has elasticity such that in a first state, the internal thread is configured to engage the external thread and in a second state, in which a compressive force is exerted on opposing sides of the collar, the internal thread is disengaged from the external thread.
    Type: Application
    Filed: September 30, 2016
    Publication date: April 6, 2017
    Inventors: Gwenyth Anne Fischer, Laura-Lee Farrell Brown, Brian Mullins, Braden Jeffery Eliason, Alan Lloyd Carlson
  • Contextual local image recognition dataset
    Patent number: 9613462
    Abstract: A contextual local image recognition module of a device retrieves a primary content dataset from a server and then generates and updates a contextual content dataset based on an image captured with the device. The device stores the primary content dataset and the contextual content dataset. The primary content dataset comprises a first set of images and corresponding virtual object models. The contextual content dataset comprises a second set of images and corresponding virtual object models retrieved from the server.
    Type: Grant
    Filed: June 23, 2015
    Date of Patent: April 4, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • REAL-TIME BIOMETRIC DETECTION OF OSCILLATORY PHENOMENA AND VOLTAGE EVENTS
    Publication number: 20170086695
    Abstract: A system and method for identifying changes in a state or activity is described. A real-time event monitoring application, implemented in a hardware processor, computes features over varying sampling periods, which are stored in cascading buffers. The various sampling periods enable determination of trends of a computed feature, comparison of the trends of the computed feature with trends of other features, normalization of the computed feature based on the same or different features at the same or different time scales, scaling of the normalized computed feature relative to other features at the same or different time scale, and identification of a change in state or activity based on a scaled normalized computed feature.
    Type: Application
    Filed: September 30, 2015
    Publication date: March 30, 2017
    Applicant: DAQRI, LLC
    Inventors: Brian Mullins, Teresa Ann Nick, Laura Berman, Arye Barnehama, Eric Douglas Lundquist
  • DYNAMIC SENSOR ARRAY FOR AUGMENTED REALITY SYSTEM
    Publication number: 20170092220
    Abstract: A system and method for generating a dynamic sensor array for an augmented reality system is described. A head mounted device includes one or more sensors, an augmented reality (AR) application, and a sensor array module. The sensor array module identifies available sensors from other head mounted devices that are geographically located within a predefined area. A dynamic sensor array is formed based on the available sensors and the one or more sensors. The dynamic sensor array is updated based on an operational status of the available sensors and the one or more sensors. The AR application generates AR content based on data from the dynamic sensor array. A display of the head mounted device displays the AR content.
    Type: Application
    Filed: September 30, 2015
    Publication date: March 30, 2017
    Applicant: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait
  • BIDIRECTIONAL HOLOGRAPHIC LENS
    Publication number: 20170094265
    Abstract: A device can determine a distance to an object. The device can use the determined distance to vary a focal length of a first adjustable element so that the first adjustable element directs light from the object into a first waveguide and onto a detector, and forms an image of the object at the detector. The device can produce an image, such as augmented content, on a panel. The device can direct light from the panel into a second waveguide. The device can use the determined distance to vary a focal length of a second adjustable element so that the second adjustable element directs light out of the second waveguide and forms a virtual image of the panel in a plane coincident with the object. The device can operate as an augmented reality headset. The adjustable elements can be phase modulators, or acoustically responsive material with surface acoustic wave transducers.
    Type: Application
    Filed: September 30, 2016
    Publication date: March 30, 2017
    Inventors: Brian Mullins, Matthew Kammerait