Patents by Inventor Mark Billinghurst

Mark Billinghurst has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10550549
    Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller. The controller is programmed to store a three-dimensional model of underground features of terrain, capture an implement image comprising the implement and terrain, generate a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, overlay a virtual trench on the superimposed image to generate an augmented reality overlay image, generate the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: February 4, 2020
    Assignee: Caterpillar Trimble Control Technologies LLC
    Inventors: Peter France, Gun Lee, Mark Billinghurst
  • Publication number: 20190249398
    Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller. The controller is programmed to store a three-dimensional model of underground features of terrain, capture an implement image comprising the implement and terrain, generate a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, overlay a virtual trench on the superimposed image to generate an augmented reality overlay image, generate the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.
    Type: Application
    Filed: April 5, 2019
    Publication date: August 15, 2019
    Applicant: Caterpillar Trimble Control Technologies LLC
    Inventors: Peter France, Gun Lee, Mark Billinghurst
  • Patent number: 10301798
    Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller including an image generator. The controller is programmed to store a three-dimensional model of underground features of the terrain, capture an implement image comprising the implement and terrain, generate through the image generator a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, generate a virtual trench based on the position of the implement, overlay the virtual trench on the superimposed image to generate an augmented reality overlay image comprising the virtual trench and the superimposed portions of the implement image and the three-dimensional model of underground features, generate through the image generator the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: May 28, 2019
    Assignee: Caterpillar Trimble Control Technologies LLC
    Inventors: Peter France, Gun Lee, Mark Billinghurst
  • Publication number: 20180251961
    Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller including an image generator. The controller is programmed to store a three-dimensional model of underground features of the terrain, capture an implement image comprising the implement and terrain, generate through the image generator a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, generate a virtual trench based on the position of the implement, overlay the virtual trench on the superimposed image to generate an augmented reality overlay image comprising the virtual trench and the superimposed portions of the implement image and the three-dimensional model of underground features, generate through the image generator the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.
    Type: Application
    Filed: March 2, 2018
    Publication date: September 6, 2018
    Applicant: Caterpillar Trimble Control Technologies LLC
    Inventors: Peter France, Gun Lee, Mark Billinghurst
  • Patent number: 9829873
    Abstract: A method, data presenting device and computer program product are provided for assisting a remote user. The data presenting device includes a communication interface, a camera having a field of view in which images are captured, a projector having a presentation area in which presentation items may be presented, and a control unit which receives field of view control commands a command to project a presentation item in the presentation area, controls the field of view of the camera and controls the projector to project the presentation item in the presentation area, wherein the control of the projection in the presentation area is made independently of the control of the field of view.
    Type: Grant
    Filed: May 9, 2014
    Date of Patent: November 28, 2017
    Assignee: ABB SCHWEIZ AG
    Inventors: Fredrik Alfredsson, Elina Vartiainen, Jonas Brönmark, Tony Tsai, Matthew Tait, Mark Billinghurst
  • Patent number: 9628772
    Abstract: A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.
    Type: Grant
    Filed: June 27, 2013
    Date of Patent: April 18, 2017
    Assignee: ABB SCHWEIZ AG
    Inventors: Fredrik Alfredsson, Elina Vartiainen, Jonas Brönmark, Tony Tsai, Mark Billinghurst, Matthew Tait
  • Publication number: 20160127712
    Abstract: A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.
    Type: Application
    Filed: June 27, 2013
    Publication date: May 5, 2016
    Applicant: ABB Technology Ltd
    Inventors: Fredrik ALFREDSSON, Elina VARTIAINEN, Jonas BRÖNMARK, Tony TSAI, Mark BILLINGHURST, Matthew TAIT
  • Publication number: 20160103437
    Abstract: A method, data presenting device and computer program product are provided for assisting a remote user. The data presenting device includes a communication interface, a camera having a field of view in which images are captured, a projector having a presentation area in which presentation items may be presented, and a control unit which receives field of view control commands a command to project a presentation item in the presentation area, controls the field of view of the camera and controls the projector to project the presentation item in the presentation area, wherein the control of the projection in the presentation area is made independently of the control of the field of view.
    Type: Application
    Filed: May 9, 2014
    Publication date: April 14, 2016
    Applicant: ABB TECHNOLOGY LTD
    Inventors: Fredrik ALFREDSSON, Elina VARTIAINEN, Jonas BRÖNMARK, Tony TSAI, Matthew TAIT, Mark BILLINGHURST
  • Publication number: 20150035746
    Abstract: A user interface device (105) comprising a camera (110, 205) that captures an image of a user's (115) face and fingers (125) and a processor (210, 230) that determines the spatial location of the user's (115) farcical features (120) and fingers (125) using the captured image, in which the processor (210, 230) further determines where on a screen (130) of the user interface device (105) the user (115) is viewing and in which the processor (210, 230) monitors the user's (115) facial features (120) and fingers (125) for indications of manipulation of on-screen content of the user interface device (105).
    Type: Application
    Filed: December 27, 2011
    Publication date: February 5, 2015
    Inventors: Andy Cockburn, Mark Billinghurst, Dinesh Mandalapu