Patents by Inventor David Lui

David Lui has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250383750
    Abstract: In some embodiments, a computer system snaps a virtual object to a surface within a three-dimensional environment when one or more criteria are met. In some embodiments, a computer system displays a representation of a respective type of virtual object with one or more values for one or more visual characteristics in a three-dimensional environment.
    Type: Application
    Filed: May 29, 2025
    Publication date: December 18, 2025
    Inventors: David LUI, Ian A. MCCALL, Shuai SONG, Jonathan RAVASZ, Giancarlo YERKES, Jay MOON, Stephen O. LEMAY
  • Publication number: 20250371793
    Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.
    Type: Application
    Filed: August 22, 2025
    Publication date: December 4, 2025
    Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-ming Chen, Shuai Song
  • Patent number: 12423907
    Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.
    Type: Grant
    Filed: June 27, 2022
    Date of Patent: September 23, 2025
    Assignee: APPLE INC.
    Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-Ming Chen, Shuai Song
  • Publication number: 20250278907
    Abstract: In some embodiments, a computer system displays a user interface element corresponding to content shared with the computer system for interacting with the shared content in the three-dimensional environment. In some embodiments, a computer system displays one or more virtual control elements in a three-dimensional environment that are selectable to cause one or more corresponding operations involving a physical device to be performed.
    Type: Application
    Filed: May 19, 2025
    Publication date: September 4, 2025
    Inventors: Lorena S. PAZMINO, Vitalii KRAMAR, Jonathan R. DASCOLA, Zoey C. TAYLOR, Alejandro A. RODRIGUEZ, David LUI
  • Publication number: 20250209720
    Abstract: Some techniques are described herein for conditionally rendering assets. In some examples, such techniques include a computer system receiving a request to render an asset and, in response, measuring performance of the computer system to determine whether to initiate rendering of the asset. For example, the computer system can measure the performance by rendering another asset that is less complex and/or resource intensive as the asset so to estimate a result of rendering the asset. Other techniques are described herein for rendering assets in different manners. In some examples such techniques include a computer system receiving a request to render an asset and, in response, rendering the asset in different manners depending on one or more aspects of the file and one or more current performance measurements of the computer system. Other techniques are described herein for rendering a 3D model based on current performance measurements of a computer system.
    Type: Application
    Filed: March 17, 2025
    Publication date: June 26, 2025
    Inventors: Xiao Jin YU, David LUI, Matthew STOLL, Rikky Roy KOGANTI, Harlan B. HASKINS, Andrew P. RICHARDSON
  • Publication number: 20240404168
    Abstract: Some techniques are described herein for conditionally rendering assets. In some examples, such techniques include a computer system receiving a request to render an asset and, in response, measuring performance of the computer system to determine whether to initiate rendering of the asset. For example, the computer system can measure the performance by rendering another asset that is less complex and/or resource intensive as the asset so to estimate a result of rendering the asset. Other techniques are described herein for rendering assets in different manners. In some examples such techniques include a computer system receiving a request to render an asset and, in response, rendering the asset in different manners depending on one or more aspects of the file and one or more current performance measurements of the computer system. Other techniques are described herein for rendering a 3D model based on current performance measurements of a computer system.
    Type: Application
    Filed: April 23, 2024
    Publication date: December 5, 2024
    Inventors: Xiao Jin YU, David LUI, Matthew STOLL, Rikky Roy KOGANTI, Harlan B. HASKINS, Andrew P. RICHARDSON, Abhinay ASHUTOSH
  • Publication number: 20240394967
    Abstract: Techniques are disclosed for rendering graphical content, e.g., in an extended reality (XR) environment, that provide for a creator (or recipient) of a 3D object markup file, e.g., a user operating an electronic device configured to be aware of the structure and organization of the 3D object markup file's format, to: create a 3D object markup file; reproduce a 3D object for display, along with its corresponding markup information; toggle the markup information on or off for display; and/or make further updates to such markup information with complete reproduction fidelity and accuracy. Techniques herein also provide for the sharing of 3D object markup files (including any persistent markup information) with other users, e.g., asynchronously or in real-time, allowing for collaboration in the process of marking up virtual 3D objects. The 3D object markup file may also be exported, such that the markups are no longer editable or toggleable for display.
    Type: Application
    Filed: September 21, 2022
    Publication date: November 28, 2024
    Inventors: David M. Schattel, Arun Rakesh Yoganandan, Christopher L. Nolet, David Lui, Reza Abbasian
  • Publication number: 20240386641
    Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.
    Type: Application
    Filed: July 22, 2024
    Publication date: November 21, 2024
    Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
  • Patent number: 12079945
    Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.
    Type: Grant
    Filed: June 15, 2023
    Date of Patent: September 3, 2024
    Assignee: Apple Inc.
    Inventors: David Lui, Hon-Ming Chen, Shuai Song, Xiao Jin Yu
  • Patent number: 12079910
    Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: September 3, 2024
    Assignee: APPLE INC.
    Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
  • Publication number: 20240290046
    Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.
    Type: Application
    Filed: March 1, 2024
    Publication date: August 29, 2024
    Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui
  • Patent number: 11922584
    Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: March 5, 2024
    Assignee: APPLE INC.
    Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui
  • Publication number: 20230326154
    Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.
    Type: Application
    Filed: June 15, 2023
    Publication date: October 12, 2023
    Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
  • Patent number: 11715271
    Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.
    Type: Grant
    Filed: May 11, 2022
    Date of Patent: August 1, 2023
    Assignee: Apple Inc.
    Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
  • Publication number: 20230065077
    Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.
    Type: Application
    Filed: June 27, 2022
    Publication date: March 2, 2023
    Inventors: David Lui, Xiao Jin Yu, Tyler L. Casella, Hon-ming Chen, Shuai Song
  • Publication number: 20220270331
    Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.
    Type: Application
    Filed: May 11, 2022
    Publication date: August 25, 2022
    Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
  • Patent number: 11393164
    Abstract: In one embodiment, a method of generating a 3D object is performed by a device including a processor, non-transitory memory, and one or more input devices. The method includes receiving, via one or more input devices, a user input selecting a file representing two-dimensional (2D) content and having a file type. The method includes receiving, via the one or more input devices, a user input requesting generation of a three-dimensional (3D) object based on the file. The method includes generating, based on the file type, a 3D object representing the 2D content.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: July 19, 2022
    Assignee: APPLE INC.
    Inventors: Tyler Casella, David Lui, Xiao Jin Yu, Kyle Ellington Fisher
  • Patent number: 11354869
    Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: June 7, 2022
    Assignee: Apple Inc.
    Inventors: David Lui, Hon-ming Chen, Shuai Song, Xiao Jin Yu
  • Publication number: 20220130089
    Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.
    Type: Application
    Filed: January 5, 2022
    Publication date: April 28, 2022
    Inventors: Tyler Casella, David Lui, Norman Nuo Wang, Xiao Jin Yu
  • Publication number: 20220058882
    Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.
    Type: Application
    Filed: October 1, 2021
    Publication date: February 24, 2022
    Inventors: Grant R. Paul, Giancarlo Yerkes, Nicolas V. Scapel, David Lui