Patents by Inventor David Lui
David Lui has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250383750Abstract: In some embodiments, a computer system snaps a virtual object to a surface within a three-dimensional environment when one or more criteria are met. In some embodiments, a computer system displays a representation of a respective type of virtual object with one or more values for one or more visual characteristics in a three-dimensional environment.Type: ApplicationFiled: May 29, 2025Publication date: December 18, 2025Inventors: David LUI, Ian A. MCCALL, Shuai SONG, Jonathan RAVASZ, Giancarlo YERKES, Jay MOON, Stephen O. LEMAY
-
Publication number: 20250371793Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.Type: ApplicationFiled: August 22, 2025Publication date: December 4, 2025Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-ming Chen, Shuai Song
-
Patent number: 12423907Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.Type: GrantFiled: June 27, 2022Date of Patent: September 23, 2025Assignee: APPLE INC.Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-Ming Chen, Shuai Song
-
METHODS FOR SHARING CONTENT AND INTERACTING WITH PHYSICAL DEVICES IN A THREE-DIMENSIONAL ENVIRONMENT
Publication number: 20250278907Abstract: In some embodiments, a computer system displays a user interface element corresponding to content shared with the computer system for interacting with the shared content in the three-dimensional environment. In some embodiments, a computer system displays one or more virtual control elements in a three-dimensional environment that are selectable to cause one or more corresponding operations involving a physical device to be performed.Type: ApplicationFiled: May 19, 2025Publication date: September 4, 2025Inventors: Lorena S. PAZMINO, Vitalii KRAMAR, Jonathan R. DASCOLA, Zoey C. TAYLOR, Alejandro A. RODRIGUEZ, David LUI -
Publication number: 20250209720Abstract: Some techniques are described herein for conditionally rendering assets. In some examples, such techniques include a computer system receiving a request to render an asset and, in response, measuring performance of the computer system to determine whether to initiate rendering of the asset. For example, the computer system can measure the performance by rendering another asset that is less complex and/or resource intensive as the asset so to estimate a result of rendering the asset. Other techniques are described herein for rendering assets in different manners. In some examples such techniques include a computer system receiving a request to render an asset and, in response, rendering the asset in different manners depending on one or more aspects of the file and one or more current performance measurements of the computer system. Other techniques are described herein for rendering a 3D model based on current performance measurements of a computer system.Type: ApplicationFiled: March 17, 2025Publication date: June 26, 2025Inventors: Xiao Jin YU, David LUI, Matthew STOLL, Rikky Roy KOGANTI, Harlan B. HASKINS, Andrew P. RICHARDSON
-
Publication number: 20240404168Abstract: Some techniques are described herein for conditionally rendering assets. In some examples, such techniques include a computer system receiving a request to render an asset and, in response, measuring performance of the computer system to determine whether to initiate rendering of the asset. For example, the computer system can measure the performance by rendering another asset that is less complex and/or resource intensive as the asset so to estimate a result of rendering the asset. Other techniques are described herein for rendering assets in different manners. In some examples such techniques include a computer system receiving a request to render an asset and, in response, rendering the asset in different manners depending on one or more aspects of the file and one or more current performance measurements of the computer system. Other techniques are described herein for rendering a 3D model based on current performance measurements of a computer system.Type: ApplicationFiled: April 23, 2024Publication date: December 5, 2024Inventors: Xiao Jin YU, David LUI, Matthew STOLL, Rikky Roy KOGANTI, Harlan B. HASKINS, Andrew P. RICHARDSON, Abhinay ASHUTOSH
-
Publication number: 20240394967Abstract: Techniques are disclosed for rendering graphical content, e.g., in an extended reality (XR) environment, that provide for a creator (or recipient) of a 3D object markup file, e.g., a user operating an electronic device configured to be aware of the structure and organization of the 3D object markup file's format, to: create a 3D object markup file; reproduce a 3D object for display, along with its corresponding markup information; toggle the markup information on or off for display; and/or make further updates to such markup information with complete reproduction fidelity and accuracy. Techniques herein also provide for the sharing of 3D object markup files (including any persistent markup information) with other users, e.g., asynchronously or in real-time, allowing for collaboration in the process of marking up virtual 3D objects. The 3D object markup file may also be exported, such that the markups are no longer editable or toggleable for display.Type: ApplicationFiled: September 21, 2022Publication date: November 28, 2024Inventors: David M. Schattel, Arun Rakesh Yoganandan, Christopher L. Nolet, David Lui, Reza Abbasian
-
Publication number: 20240386641Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.Type: ApplicationFiled: July 22, 2024Publication date: November 21, 2024Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
-
Patent number: 12079945Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.Type: GrantFiled: June 15, 2023Date of Patent: September 3, 2024Assignee: Apple Inc.Inventors: David Lui, Hon-Ming Chen, Shuai Song, Xiao Jin Yu
-
Patent number: 12079910Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.Type: GrantFiled: January 5, 2022Date of Patent: September 3, 2024Assignee: APPLE INC.Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
-
Publication number: 20240290046Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.Type: ApplicationFiled: March 1, 2024Publication date: August 29, 2024Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui
-
Patent number: 11922584Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.Type: GrantFiled: October 1, 2021Date of Patent: March 5, 2024Assignee: APPLE INC.Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui
-
Publication number: 20230326154Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.Type: ApplicationFiled: June 15, 2023Publication date: October 12, 2023Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
-
Patent number: 11715271Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.Type: GrantFiled: May 11, 2022Date of Patent: August 1, 2023Assignee: Apple Inc.Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
-
Publication number: 20230065077Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.Type: ApplicationFiled: June 27, 2022Publication date: March 2, 2023Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-ming Chen, Shuai Song
-
Publication number: 20220270331Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.Type: ApplicationFiled: May 11, 2022Publication date: August 25, 2022Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
-
Patent number: 11393164Abstract: In one embodiment, a method of generating a 3D object is performed by a device including a processor, non-transitory memory, and one or more input devices. The method includes receiving, via one or more input devices, a user input selecting a file representing two-dimensional (2D) content and having a file type. The method includes receiving, via the one or more input devices, a user input requesting generation of a three-dimensional (3D) object based on the file. The method includes generating, based on the file type, a 3D object representing the 2D content.Type: GrantFiled: May 6, 2019Date of Patent: July 19, 2022Assignee: APPLE INC.Inventors: Tyler Casella, David Lui, Xiao Jin Yu, Kyle Ellington Fisher
-
Patent number: 11354869Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.Type: GrantFiled: March 17, 2021Date of Patent: June 7, 2022Assignee: Apple Inc.Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
-
Publication number: 20220130089Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.Type: ApplicationFiled: January 5, 2022Publication date: April 28, 2022Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
-
Publication number: 20220058882Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.Type: ApplicationFiled: October 1, 2021Publication date: February 24, 2022Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui