Patents by Inventor Mark Billinghurst
Mark Billinghurst has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10550549Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller. The controller is programmed to store a three-dimensional model of underground features of terrain, capture an implement image comprising the implement and terrain, generate a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, overlay a virtual trench on the superimposed image to generate an augmented reality overlay image, generate the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.Type: GrantFiled: April 5, 2019Date of Patent: February 4, 2020Assignee: Caterpillar Trimble Control Technologies LLCInventors: Peter France, Gun Lee, Mark Billinghurst
-
Publication number: 20190249398Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller. The controller is programmed to store a three-dimensional model of underground features of terrain, capture an implement image comprising the implement and terrain, generate a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, overlay a virtual trench on the superimposed image to generate an augmented reality overlay image, generate the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.Type: ApplicationFiled: April 5, 2019Publication date: August 15, 2019Applicant: Caterpillar Trimble Control Technologies LLCInventors: Peter France, Gun Lee, Mark Billinghurst
-
Patent number: 10301798Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller including an image generator. The controller is programmed to store a three-dimensional model of underground features of the terrain, capture an implement image comprising the implement and terrain, generate through the image generator a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, generate a virtual trench based on the position of the implement, overlay the virtual trench on the superimposed image to generate an augmented reality overlay image comprising the virtual trench and the superimposed portions of the implement image and the three-dimensional model of underground features, generate through the image generator the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.Type: GrantFiled: March 2, 2018Date of Patent: May 28, 2019Assignee: Caterpillar Trimble Control Technologies LLCInventors: Peter France, Gun Lee, Mark Billinghurst
-
Publication number: 20180251961Abstract: A material moving machine including an implement, a camera, an augmented display, and a controller including an image generator. The controller is programmed to store a three-dimensional model of underground features of the terrain, capture an implement image comprising the implement and terrain, generate through the image generator a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, generate a virtual trench based on the position of the implement, overlay the virtual trench on the superimposed image to generate an augmented reality overlay image comprising the virtual trench and the superimposed portions of the implement image and the three-dimensional model of underground features, generate through the image generator the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.Type: ApplicationFiled: March 2, 2018Publication date: September 6, 2018Applicant: Caterpillar Trimble Control Technologies LLCInventors: Peter France, Gun Lee, Mark Billinghurst
-
Patent number: 9829873Abstract: A method, data presenting device and computer program product are provided for assisting a remote user. The data presenting device includes a communication interface, a camera having a field of view in which images are captured, a projector having a presentation area in which presentation items may be presented, and a control unit which receives field of view control commands a command to project a presentation item in the presentation area, controls the field of view of the camera and controls the projector to project the presentation item in the presentation area, wherein the control of the projection in the presentation area is made independently of the control of the field of view.Type: GrantFiled: May 9, 2014Date of Patent: November 28, 2017Assignee: ABB SCHWEIZ AGInventors: Fredrik Alfredsson, Elina Vartiainen, Jonas Brönmark, Tony Tsai, Matthew Tait, Mark Billinghurst
-
Patent number: 9628772Abstract: A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.Type: GrantFiled: June 27, 2013Date of Patent: April 18, 2017Assignee: ABB SCHWEIZ AGInventors: Fredrik Alfredsson, Elina Vartiainen, Jonas Brönmark, Tony Tsai, Mark Billinghurst, Matthew Tait
-
Publication number: 20160127712Abstract: A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.Type: ApplicationFiled: June 27, 2013Publication date: May 5, 2016Applicant: ABB Technology LtdInventors: Fredrik ALFREDSSON, Elina VARTIAINEN, Jonas BRÖNMARK, Tony TSAI, Mark BILLINGHURST, Matthew TAIT
-
Publication number: 20160103437Abstract: A method, data presenting device and computer program product are provided for assisting a remote user. The data presenting device includes a communication interface, a camera having a field of view in which images are captured, a projector having a presentation area in which presentation items may be presented, and a control unit which receives field of view control commands a command to project a presentation item in the presentation area, controls the field of view of the camera and controls the projector to project the presentation item in the presentation area, wherein the control of the projection in the presentation area is made independently of the control of the field of view.Type: ApplicationFiled: May 9, 2014Publication date: April 14, 2016Applicant: ABB TECHNOLOGY LTDInventors: Fredrik ALFREDSSON, Elina VARTIAINEN, Jonas BRÖNMARK, Tony TSAI, Matthew TAIT, Mark BILLINGHURST
-
Publication number: 20150035746Abstract: A user interface device (105) comprising a camera (110, 205) that captures an image of a user's (115) face and fingers (125) and a processor (210, 230) that determines the spatial location of the user's (115) farcical features (120) and fingers (125) using the captured image, in which the processor (210, 230) further determines where on a screen (130) of the user interface device (105) the user (115) is viewing and in which the processor (210, 230) monitors the user's (115) facial features (120) and fingers (125) for indications of manipulation of on-screen content of the user interface device (105).Type: ApplicationFiled: December 27, 2011Publication date: February 5, 2015Inventors: Andy Cockburn, Mark Billinghurst, Dinesh Mandalapu