Patents by Inventor Ben Sugden
Ben Sugden has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10955914Abstract: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.Type: GrantFiled: June 6, 2019Date of Patent: March 23, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Aaron Burns, Ben Sugden, Laura Massey, Tom Salter
-
Patent number: 10649212Abstract: An HMD device is configured to vertically adjust the ground plane of a rendered virtual reality environment that has varying elevations to match the flat real world floor so that the device user can move around to navigate and explore the environment and always be properly located on the virtual ground and not be above it or underneath it. Rather than continuously adjust the virtual reality ground plane, which can introduce cognitive dissonance discomfort to the user, when the user is not engaged in some form of locomotion (e.g., walking), the HMD device establishes a threshold radius around the user within which virtual ground plane adjustment is not performed. The user can make movements within the threshold radius without the HMD device shifting the virtual terrain. When the user moves past the threshold radius, the device will perform an adjustment as needed to match the ground plane of the virtual reality environment to the real world floor.Type: GrantFiled: August 17, 2017Date of Patent: May 12, 2020Assignee: Microsoft Technology Licensing LLCInventors: Aaron Burns, Ben Sugden, Laura Massey, Alexandre Da Veiga, Tom Salter, Greg Alt
-
Patent number: 10451875Abstract: A head mounted display (HMD) device is configured with a sensor package that enables head tracking to determine the device user's proximity to virtual objects in a mixed reality or virtual reality environment. A fade volume including concentrically-arranged volumetric shells is placed around the user including a near shell that is closest to the user, and a far shell that is farthest from the user. When a virtual object is beyond the far shell, the HMD device renders the object with full opacity (i.e., with no transparency). As the user moves towards a virtual object and it intersects the far shell, its opacity begins to fade out with increasing transparency to reveal the background behind it. The transparency of the virtual object increases as the object gets closer to the near shell and the object becomes fully transparent when the near shell reaches it so that the background becomes fully visible.Type: GrantFiled: May 27, 2015Date of Patent: October 22, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Jeff Sutherland, Ben Sugden, Tom Salter
-
Publication number: 20190286231Abstract: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.Type: ApplicationFiled: June 6, 2019Publication date: September 19, 2019Inventors: Aaron BURNS, Ben SUGDEN, Laura MASSEY, Tom SALTER
-
Patent number: 10416760Abstract: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.Type: GrantFiled: April 27, 2015Date of Patent: September 17, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Aaron Burns, Ben Sugden, Laura Massey, Tom Salter
-
Patent number: 10379347Abstract: A head mounted display (HMD) device is configured with a sensor package that enables head tracking to determine the device user's proximity to virtual objects in a mixed reality or virtual reality environment. A fade volume including concentrically-arranged volumetric shells is placed around the user including a near shell that is closest to the user, and a far shell that is farthest from the user. When a virtual object is beyond the far shell, the HMD device renders the object with full opacity (i.e., with no transparency). As the user moves towards a virtual object and it intersects the far shell, its opacity begins to fade out with increasing transparency to reveal the background behind it. The transparency of the virtual object increases as the object gets closer to the near shell and the object becomes fully transparent when the near shell reaches it so that the background becomes fully visible.Type: GrantFiled: May 27, 2015Date of Patent: August 13, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Jeff Sutherland, Ben Sugden, Tom Salter
-
Patent number: 10338676Abstract: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.Type: GrantFiled: April 27, 2015Date of Patent: July 2, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Aaron Burns, Ben Sugden, Laura Massey, Tom Salter
-
Patent number: 10311638Abstract: An HMD device with a see-through display and depth sensing capability is configured to selectively dim or fade out a display of a virtual reality environment to enable a user to see the real world without obstruction by the virtual world when a distance between the user and a real world object is determined to be less than a threshold distance. The current height of the user's head (i.e., the distance from head to ground) may be utilized when performing the dimming/fading so that different threshold distances can be used depending on whether the user is standing or seated.Type: GrantFiled: January 20, 2015Date of Patent: June 4, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexandre Da Veiga, Ben Sugden, Laura Massey
-
Patent number: 10096168Abstract: An application running on a computing platform that employs three-dimensional (3D) modeling is extended using a virtual viewport into which 3D holograms are rendered by a mixed-reality head mounted display (HMD) device. The HMD device user can position the viewport to be rendered next to a real world 2D monitor and use it as a natural extension of the 3D modeling application. For example, the user can interact with modeled objects in mixed-reality and move objects between the monitor and the viewport. The 3D modeling application and HMD device are configured to exchange scene data for modeled objects (such as geometry, lighting, rotation, scale) and user interface parameters (such as mouse and keyboard inputs). The HMD device implements head tracking to determine where the user is looking so that user inputs are appropriately directed to the monitor or viewport.Type: GrantFiled: December 13, 2017Date of Patent: October 9, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexandre Da Veiga, Ben Sugden, Jon Christen
-
Patent number: 10083540Abstract: A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.Type: GrantFiled: January 23, 2017Date of Patent: September 25, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ben Sugden, Darren Bennett, Brian Mount, Sebastian Sylvan, Arthur Tomlin, Ryan Hastings, Daniel McCulloch, Kevin Geisner, Robert Crocco, Jr.
-
Patent number: 10055888Abstract: A computing system and method for producing and consuming metadata within multi-dimensional data is provided. The computing system comprising a see-through display, a sensor system, and a processor configured to: in a recording phase, generate an annotation at a location in a three dimensional environment, receive, via the sensor system, a stream of telemetry data recording movement of a first user in the three dimensional environment, receive a message to be recorded from the first user, and store, in memory as annotation data for the annotation, the stream of telemetry data and the message, and in a playback phase, display a visual indicator of the annotation at the location, receive a selection of the visual indicator by a second user, display a simulacrum superimposed onto the three dimensional environment and animated according to the telemetry data, and present the message via the animated simulacrum.Type: GrantFiled: April 28, 2015Date of Patent: August 21, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Jonathan Christen, John Charles Howard, Marcus Tanner, Ben Sugden, Robert C. Memmott, Kenneth Charles Ouellette, Alex Kipman, Todd Alan Omotani, James T. Reichert, Jr.
-
Publication number: 20180101994Abstract: An application running on a computing platform that employs three-dimensional (3D) modeling is extended using a virtual viewport into which 3D holograms are rendered by a mixed-reality head mounted display (HMD) device. The HMD device user can position the viewport to be rendered next to a real world 2D monitor and use it as a natural extension of the 3D modeling application. For example, the user can interact with modeled objects in mixed-reality and move objects between the monitor and the viewport. The 3D modeling application and HMD device are configured to exchange scene data for modeled objects (such as geometry, lighting, rotation, scale) and user interface parameters (such as mouse and keyboard inputs). The HMD device implements head tracking to determine where the user is looking so that user inputs are appropriately directed to the monitor or viewport.Type: ApplicationFiled: December 13, 2017Publication date: April 12, 2018Inventors: Alexandre DA VEIGA, Ben SUGDEN, Jon CHRISTEN
-
Patent number: 9904055Abstract: An HMD device is configured to check the placement of newly introduced objects in a virtual reality environment such as interactive elements like menus, widgets, and notifications to confirm that the objects are significantly present within the user's field of view. If the intended original placement would locate the object outside the field of view, the HMD device relocates the object so that a portion of the object is viewable at the edge of the HMD display closest to its original placement. Such smart placement of virtual objects enables the user to readily discover new objects when they are introduced into the virtual reality environment, and then interact with the objects within a range of motions and/or head positions that is comfortable to support a more optimal interaction and user experience.Type: GrantFiled: February 3, 2015Date of Patent: February 27, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Aaron Burns, Ben Sugden, Tom Salter
-
Patent number: 9865089Abstract: An HMD device renders a virtual reality environment in which areas of the real world are masked out so that real world objects such as computer monitors, doors, people, faces, and the like appear visible to the device user and no holographic or virtual reality content is rendered over the visible objects. The HMD device includes a sensor package to support application of surface reconstruction techniques to dynamically detect edges and surfaces of the real world objects and keep objects visible on the display as the user changes position or head pose or when the real world objects move or their positions are changed. The HMD device can expose controls to enable the user to select which real world objects are visible in the virtual reality environment.Type: GrantFiled: April 16, 2015Date of Patent: January 9, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Aaron Burns, Tom Salter, Ben Sugden, Jeff Sutherland
-
Publication number: 20180003982Abstract: An HMD device is configured to vertically adjust the ground plane of a rendered virtual reality environment that has varying elevations to match the flat real world floor so that the device user can move around to navigate and explore the environment and always be properly located on the virtual ground and not be above it or underneath it. Rather than continuously adjust the virtual reality ground plane, which can introduce cognitive dissonance discomfort to the user, when the user is not engaged in some form of locomotion (e.g., walking), the HMD device establishes a threshold radius around the user within which virtual ground plane adjustment is not performed. The user can make movements within the threshold radius without the HMD device shifting the virtual terrain. When the user moves past the threshold radius, the device will perform an adjustment as needed to match the ground plane of the virtual reality environment to the real world floor.Type: ApplicationFiled: August 17, 2017Publication date: January 4, 2018Inventors: Aaron Burns, Ben Sugden, Laura Massey, Alexandre Da Veiga, Tom Salter, Greg Alt
-
Patent number: 9858720Abstract: An application running on a computing platform that employs three-dimensional (3D) modeling is extended using a virtual viewport into which 3D holograms are rendered by a mixed-reality head mounted display (HMD) device. The HMD device user can position the viewport to be rendered next to a real world 2D monitor and use it as a natural extension of the 3D modeling application. For example, the user can interact with modeled objects in mixed-reality and move objects between the monitor and the viewport. The 3D modeling application and HMD device are configured to exchange scene data for modeled objects (such as geometry, lighting, rotation, scale) and user interface parameters (such as mouse and keyboard inputs). The HMD device implements head tracking to determine where the user is looking so that user inputs are appropriately directed to the monitor or viewport.Type: GrantFiled: April 16, 2015Date of Patent: January 2, 2018Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexandre da Veiga, Ben Sugden, Jon Christen
-
Patent number: 9851787Abstract: A system and related methods for a resource management in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. A resource management program is configured to operate a selected sensor in a default power mode to achieve a selected fidelity. The program receives user-related information from one or more of the sensors, and determines whether target information is detected. Where target information is detected, the program adjusts the selected sensor to operate in a reduced power mode that uses less power than the default power mode.Type: GrantFiled: November 29, 2012Date of Patent: December 26, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Stephen Latta, Jedd Anthony Perry, Rod G. Fleck, Jack Clevenger, Frederik Schaffalitzky, Drew Steedly, Daniel McCulloch, Ian McIntyre, Alexandru Balan, Ben Sugden, Ryan Hastings, Brian Mount
-
Patent number: 9836889Abstract: Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.Type: GrantFiled: March 1, 2017Date of Patent: December 5, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ben Sugden, John Clavin, Ben Vaught, Stephen Latta, Kathryn Stone Perez, Daniel McCulloch, Jason Scott, Wei Zhang, Darren Bennett, Ryan Hastings, Arthur Tomlin, Kevin Geisner
-
Patent number: 9766460Abstract: An HMD device is configured to vertically adjust the ground plane of a rendered virtual reality environment that has varying elevations to match the flat real world floor so that the device user can move around to navigate and explore the environment and always be properly located on the virtual ground and not be above it or underneath it. Rather than continuously adjust the virtual reality ground plane, which can introduce cognitive dissonance discomfort to the user, when the user is not engaged in some form of locomotion (e.g., walking), the HMD device establishes a threshold radius around the user within which virtual ground plane adjustment is not performed. The user can make movements within the threshold radius without the HMD device shifting the virtual terrain. When the user moves past the threshold radius, the device will perform an adjustment as needed to match the ground plane of the virtual reality environment to the real world floor.Type: GrantFiled: February 2, 2015Date of Patent: September 19, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Aaron Burns, Ben Sugden, Laura Massey, Alexandre Da Veiga, Tom Salter, Greg Alt
-
Patent number: 9761057Abstract: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.Type: GrantFiled: November 21, 2016Date of Patent: September 12, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Thomas George Salter, Ben Sugden, Daniel Deptford, Robert Crocco, Jr., Brian Keane, Laura Massey, Alex Kipman, Peter Tobias Kinnebrew, Nicholas Kamuda, Zachary Quarles, Michael Scavezze, Ryan Hastings, Cameron Brown, Tony Ambrus, Jason Scott, John Bevis, Jamie B. Kirschenbaum, Nicholas Gervase Fajt, Michael Klucher, Relja Markovic, Stephen Latta, Daniel McCulloch