Patents by Inventor JOSEPH A. MALIA

JOSEPH A. MALIA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11416134
    Abstract: The present disclosure generally relates to user interfaces for altering visual media. In some embodiments, user interfaces capturing visual media (e.g., via a synthetic depth-of-field effect), playing back visual media (e.g., via a synthetic depth-of-field effect), editing visual media (e.g., that has a synthetic depth-of-field effect applied), and/or managing media capture.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: August 16, 2022
    Assignee: Apple Inc.
    Inventors: Behkish J. Manzari, Graham R. Clarke, Toke Jansen, Joseph A. Malia, Andre Souza Dos Santos, William A. Sorrentino, III, Saumitro Dasgupta, Wayne Loofbourrow, Seyyedhossein Mousavi, Jens Jacob Pallisgaard, Paul Thomas Schneider, Joshua Blake Shagam, Piotr J. Stanczyk, Hjalte Wedel Vildhoej
  • Publication number: 20220244838
    Abstract: The present disclosure generally relates to using avatars and image data for enhanced user interactions. In some examples, user status dependent avatars are generated and displayed with a message associated with the user status. In some examples, a device captures image information to scan an object to create a 3D model of the object. The device determines an algorithm for the 3D model based on the capture image information and provides visual feedback on additional image data that is needed for the algorithm to build the 3D model. In some examples, an application's operation on a device is restricted based on whether an authorized user is identified as using the device based on captured image data.
    Type: Application
    Filed: April 20, 2022
    Publication date: August 4, 2022
    Inventors: Marek BEREZA, Adi BERENSON, Jeffrey Traer BERNSTEIN, Lukas Robert Tom GIRLING, Mark HAUENSTEIN, Amir HOFFNUNG, William D. LINDMEIER, Joseph A. MALIA, Julian MISSIG
  • Publication number: 20220239842
    Abstract: While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.
    Type: Application
    Filed: April 8, 2022
    Publication date: July 28, 2022
    Inventors: Joseph A. Malia, Mark K. Hauenstein, Praveen Sharma, Matan Stauber, Julian K. Missig, Jeffrey T. Bernstein, Lukas Robert Tom Girling, Matthaeus Krenn
  • Patent number: 11393258
    Abstract: An electronic device performs techniques related generally to implementing biometric authentication. In some examples, a device provides user interfaces for a biometric enrollment process tutorial. In some examples, a device provides user interfaces for aligning a biometric feature for enrollment. In some examples, a device provides user interfaces for enrolling a biometric feature. In some examples, a device provides user interfaces for providing hints during a biometric enrollment process. In some examples, a device provides user interfaces for application-based biometric authentication. In some examples, a device provides user interfaces for autofilling biometrically secured fields. In some examples, a device provides user interfaces for unlocking a device using biometric authentication. In some examples, a device provides user interfaces for retrying biometric authentication. In some examples, a device provides user interfaces for managing transfers using biometric authentication.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: July 19, 2022
    Assignee: Apple Inc.
    Inventors: Marcel Van Os, Peter D. Anton, Arian Behzadi, Jeffrey Traer Bernstein, Lynne Devine, Alan C. Dye, Christopher Patrick Foss, Bradley W. Griffin, Jonathan P. Ive, Joseph A. Malia, Pedro Mari, Daamun Mohseni, Jean-Pierre Mouilleseaux, Camille Moussette, Daniel Trent Preston, Praveen Sharma, Hugo Verweij, Giancarlo Yerkes
  • Patent number: 11350026
    Abstract: The present disclosure generally relates to user interfaces for altering visual media. In some embodiments, user interfaces capturing visual media (e.g., via a synthetic depth-of-field effect), playing back visual media (e.g., via a synthetic depth-of-field effect), editing visual media (e.g., that has a synthetic depth-of-field effect applied), and/or managing media capture.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: May 31, 2022
    Assignee: Apple Inc.
    Inventors: Behkish J. Manzari, Graham R. Clarke, Toke Jansen, Joseph A. Malia, Andre Souza Dos Santos, William A. Sorrentino, III, Wayne Loofbourrow, Seyyedhossein Mousavi, Agnes Nemeth, Jens Jacob Pallisgaard, Paul Thomas Schneider, Joshua Blake Shagam, Piotr J. Stanczyk
  • Patent number: 11321857
    Abstract: The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: May 3, 2022
    Assignee: Apple Inc.
    Inventors: Matan Stauber, Amir Hoffnung, Matthaeus Krenn, Jeffrey Traer Bernstein, Joseph A. Malia, Mark Hauenstein
  • Publication number: 20220130118
    Abstract: A computer system displays a representation of a previously-captured media item, which includes or is associated with depth information corresponding to a physical environment in which the media item was captured. While displaying the representation of the media item, the system receives, via one or more input devices, one or more inputs corresponding to a request to display a representation of a measurement corresponding to a respective portion of the physical environment captured in the media item, and, in response, the system displays the representation of the measurement over at least a portion of the representation of the media item that corresponds to the respective portion of the physical environment, based on the depth information, and a label corresponding to the representation of the measurement that describes the measurement based on the depth information.
    Type: Application
    Filed: January 4, 2022
    Publication date: April 28, 2022
    Inventors: Joseph A. Malia, Praveen Sharma, Mark K. Hauenstein
  • Patent number: 11303812
    Abstract: A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: April 12, 2022
    Assignee: APPLE INC.
    Inventors: Joseph A. Malia, Mark K. Hauenstein, Praveen Sharma, Matan Stauber, Julian K. Missig, Jeffrey T. Bernstein, Lukas Robert Tom Girling, Matthaeus Krenn
  • Publication number: 20220092861
    Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.
    Type: Application
    Filed: September 21, 2021
    Publication date: March 24, 2022
    Inventors: Praveen Sharma, Fiona P. O'Leary, Joseph A. Malia
  • Publication number: 20220092862
    Abstract: A computer system, while displaying a view of a computer-generated environment, detects movement of a physical object, and in response: in accordance with a determination that a user is within a threshold distance of a first portion of the physical object and that the physical object meets preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion, without changing an appearance of virtual content displayed at a position corresponding to the physical object's second portion; and in accordance with a determination that the user is within the threshold distance and that the physical object does not meet the preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion.
    Type: Application
    Filed: September 23, 2021
    Publication date: March 24, 2022
    Inventors: Jeffrey M. Faulkner, Stephen O. Lemay, William A. Sorrentino, III, Philipp Rockel, Giancarlo Yerkes, Nicholas W. Henderson, Grant R. Paul, Joseph A. Malia, Allison W. Dryer, Jonathan Ive
  • Publication number: 20220019334
    Abstract: A computer system while displaying an augmented reality environment, concurrently displays: a representation of at least a portion of a field of view of one or more cameras that includes a physical object, and a virtual user interface object at a location in the representation of the field of view, where the location is determined based on the respective physical object in the field of view. While displaying the augmented reality environment, in response to detecting an input that changes a virtual environment setting for the augmented reality environment, the computer system adjusts an appearance of the virtual user interface object in accordance with the change made to the virtual environment setting and applies to at least a portion of the representation of the field of view a filter selected based on the change made to the virtual environment setting.
    Type: Application
    Filed: September 28, 2021
    Publication date: January 20, 2022
    Inventors: Mark K. Hauenstein, Joseph A. Malia, Julian K. Missig, Matthaeus Krenn, Jeffrey T. Bernstein
  • Patent number: 11227446
    Abstract: A computer system captures, via one or more cameras, information indicative of the physical environment, including respective portions of the physical environment that are in a field of view. The respective portions of the physical environment include a plurality of primary features of the physical environment and secondary features of the physical environment. After capturing the information indicative of the physical environment, the system displays a user interface, including concurrently displaying graphical representations of the plurality of primary features that are generated with a first level of fidelity to the corresponding plurality of primary features of the physical environment, and one or more graphical representations of secondary features that are generated with a second level of fidelity to the corresponding one or more secondary features of the physical environment, where the second level of fidelity is lower than the first level of fidelity.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: January 18, 2022
    Assignee: APPLE INC.
    Inventors: Joseph A. Malia, Praveen Sharma, Mark K. Hauenstein
  • Patent number: 11204692
    Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: December 21, 2021
    Assignee: Apple Inc.
    Inventors: Behkish J. Manzari, Marek Bereza, Jeffrey A. Brasket, Frederic Cao, Alan C. Dye, Elliott Harris, Cyrus Daniel Irani, Jonathan P. Ive, Garrett Johnson, Emilie Kim, Joseph A. Malia, Grant Paul, Pavel Pivonka, Billy Sorrentino, III, Andre Souza Dos Santos
  • Patent number: 11163417
    Abstract: A computer system concurrently displays, in an augmented reality environment, a representation of at least a portion of a field of view of one or more cameras that includes a respective physical object, which is updated as contents of the field of view change; and a respective virtual user interface object, at a respective location in the virtual user interface determined based on the location of the respective physical object in the field of view. While detecting an input at a location that corresponds to the displayed respective virtual user interface object, in response to detecting movement of the input relative to the respective physical object in the field of view of the one or more cameras, the system adjusts an appearance of the respective virtual user interface object in accordance with a magnitude of movement of the input relative to the respective physical object.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: November 2, 2021
    Assignee: APPLE INC.
    Inventors: Mark K. Hauenstein, Joseph A. Malia, Julian K. Missig, Matthaeus Krenn, Jeffrey T. Bernstein
  • Publication number: 20210097768
    Abstract: A computer system captures, via one or more cameras, information indicative of the physical environment, including respective portions of the physical environment that are in a field of view. The respective portions of the physical environment include a plurality of primary features of the physical environment and secondary features of the physical environment. After capturing the information indicative of the physical environment, the system displays a user interface, including concurrently displaying graphical representations of the plurality of primary features that are generated with a first level of fidelity to the corresponding plurality of primary features of the physical environment, and one or more graphical representations of secondary features that are generated with a second level of fidelity to the corresponding one or more secondary features of the physical environment, where the second level of fidelity is lower than the first level of fidelity.
    Type: Application
    Filed: September 23, 2020
    Publication date: April 1, 2021
    Inventors: Joseph A. Malia, Praveen Sharma, Mark K. Hauenstein
  • Publication number: 20200382718
    Abstract: A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.
    Type: Application
    Filed: August 19, 2020
    Publication date: December 3, 2020
    Inventors: Joseph A. Malia, Mark K. Hauenstein, Praveen Sharma, Matan Stauber, Julian K. Missig, Jeffrey T. Bernstein, Lukas Robert Tom Girling, Matthaeus Krenn
  • Patent number: 10785413
    Abstract: A computer system displays a representation of a field of view of one or more cameras that is updated with changes in the field of view. In response to a request to add an annotation, the representation of the field of view of the camera(s) is replaced with a still image of the field of view of the camera(s). An annotation is received on a portion of the still image that corresponds to a portion of a physical environment captured in the still image. The still image is replaced with the representation of the field of view of the camera(s). An indication of a current spatial relationship of the camera(s) relative to the portion of the physical environment is displayed or not displayed based on a determination of whether the portion of the physical environment captured in the still image is currently within the field of view of the camera(s).
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: September 22, 2020
    Assignee: APPLE INC.
    Inventors: Joseph A. Malia, Mark K. Hauenstein, Praveen Sharma, Matan Stauber, Julian K. Missig, Jeffrey T. Bernstein, Lukas Robert Tom Girling, Matthaeus Krenn
  • Publication number: 20200142577
    Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.
    Type: Application
    Filed: January 3, 2020
    Publication date: May 7, 2020
    Inventors: Behkish J. MANZARI, Marek BEREZA, Jeffrey A. BRASKET, Frederic CAO, Alan C. DYE, Elliott HARRIS, Cyrus Daniel IRANI, Jonathan P. IVE, Garrett JOHNSON, Emilie KIM, Joseph A. MALIA, Grant PAUL, Pavel PIVONKA, Billy SORRENTINO, III, Andre SOUZA DOS SANTOS
  • Publication number: 20200106965
    Abstract: A computer system displays a representation of a field of view of one or more cameras that is updated with changes in the field of view. In response to a request to add an annotation, the representation of the field of view of the camera(s) is replaced with a still image of the field of view of the camera(s). An annotation is received on a portion of the still image that corresponds to a portion of a physical environment captured in the still image. The still image is replaced with the representation of the field of view of the camera(s). An indication of a current spatial relationship of the camera(s) relative to the portion of the physical environment is displayed or not displayed based on a determination of whether the portion of the physical environment captured in the still image is currently within the field of view of the camera(s).
    Type: Application
    Filed: September 17, 2019
    Publication date: April 2, 2020
    Inventors: Joseph A. Malia, Mark K. Hauenstein, Praveen Sharma, Matan Stauber, Julian K. Missig, Jeffrey T. Bernstein, Lukas Robert Tom Girling, Matthaeus Krenn
  • Publication number: 20200105003
    Abstract: The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.
    Type: Application
    Filed: July 31, 2019
    Publication date: April 2, 2020
    Inventors: Matan STAUBER, Amir HOFFNUNG, Matthaeus KRENN, Jeffrey Traer BERNSTEIN, Joseph A. MALIA, Mark HAUENSTEIN