Patents by Inventor Merlyn Deng
Merlyn Deng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11847753Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: GrantFiled: January 9, 2023Date of Patent: December 19, 2023Assignee: Meta Platforms Technologies, LLCInventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Patent number: 11769304Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: GrantFiled: November 9, 2021Date of Patent: September 26, 2023Assignee: Meta Platforms Technologies, LLCInventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Patent number: 11651573Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: GrantFiled: October 12, 2021Date of Patent: May 16, 2023Assignee: Meta Platforms Technologies, LLCInventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Publication number: 20220122329Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: ApplicationFiled: October 12, 2021Publication date: April 21, 2022Inventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Patent number: 11272171Abstract: A system can include one or more processors configured to execute a first object tracker to detect one or more objects in images received via a sensor of a device, monitor one or more metrics of the first object tracker, determine that the one or more metrics do not meet a criteria corresponding to a profile of the device, and use, responsive to the determination, a second object tracker instead of the first object tracker.Type: GrantFiled: May 24, 2019Date of Patent: March 8, 2022Assignee: Facebook Technologies, LLCInventors: Philipp Ojha, Dony George, Daniel Berhane Worku, Merlyn Deng
-
Publication number: 20220068035Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: ApplicationFiled: November 9, 2021Publication date: March 3, 2022Inventors: James TICHENOR, Arthur ZWIEGINCEW, Hayden Schoen, Alex MARCOLINA, Gregory ALT, Todd HARRIS, Merlyn DENG, Barrett FOX, Michal HLAVAC
-
Patent number: 11227445Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: GrantFiled: August 31, 2020Date of Patent: January 18, 2022Assignee: Facebook Technologies, LLCInventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Patent number: 11176755Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.Type: GrantFiled: August 31, 2020Date of Patent: November 16, 2021Inventors: James Tichenor, Arthur Zwiegincew, Hayden Schoen, Alex Marcolina, Gregory Alt, Todd Harris, Merlyn Deng, Barrett Fox, Michal Hlavac
-
Patent number: 11087369Abstract: An online system provides content based on context of host content. The online system allows content providers to define specific context for providing their content for display to users, including specifying categories, format, popularity, and visual appearance of host content eligible for hosting their content. To determine which content a specific content item is eligible for hosting, the online system categories host content items according to specific criteria defined by different content providers for hosting various content. Each content is indexed by classification groups into which the host content items are classified. If a particular content item includes an opportunity for presenting content, the online system identifies content which the particular content item is eligible for hosting. The online system selects one or more identified content for presentation via the opportunity.Type: GrantFiled: March 16, 2018Date of Patent: August 10, 2021Assignee: Facebook, Inc.Inventors: Abhishek Bapna, Yi Tang, Russell Aaron Phillips, Merlyn Deng, Na Chen, Kathryn Anne Orseth
-
Publication number: 20190005332Abstract: In one embodiment, a method includes accessing a video-content object, determining a first feature vector representing the video-content object using a first recognition module of a first type based on an object in the video-content object, and determining a second feature vector representing the video-content object using a second recognition module of a second type based on the first feature vector. The first type is different from the second type. The method also includes determining a context of the video-content object based on the second feature vector.Type: ApplicationFiled: August 27, 2018Publication date: January 3, 2019Inventors: Balmanohar Paluri, Benoit F. Dumoulin, Merlyn Deng, Reena Philip, Dario Garcia Garcia
-
Patent number: 10061985Abstract: In one embodiment, a method includes accessing a first feature vector representing a video-content object corresponding to a node in a social graph, wherein the video-content object comprises frames and audio and is associated with text, the first feature vector is based on one or more of the frames; accessing a second feature vector representing the video-content object, wherein the second feature vector is based on at least some of the text; accessing a third feature vector representing the video-content object, wherein the third feature vector is based on one or more portions of the audio; determining a fourth feature vector representing the video-content object, wherein the fourth feature vector is based on a combination of the first, second, and third feature vectors; and determining a context of the video-content object based on the fourth feature vector and social-graph information.Type: GrantFiled: December 30, 2016Date of Patent: August 28, 2018Assignee: Facebook, Inc.Inventors: Balmanohar Paluri, Benoit F. Dumoulin, Merlyn Deng, Reena Philip, Dario Garcia Garcia
-
Publication number: 20180189570Abstract: In one embodiment, a method includes accessing a first feature vector representing a video-content object corresponding to a node in a social graph, wherein the video-content object comprises frames and audio and is associated with text, the first feature vector is based on one or more of the frames; accessing a second feature vector representing the video-content object, wherein the second feature vector is based on at least some of the text; accessing a third feature vector representing the video-content object, wherein the third feature vector is based on one or more portions of the audio; determining a fourth feature vector representing the video-content object, wherein the fourth feature vector is based on a combination of the first, second, and third feature vectors; and determining a context of the video-content object based on the fourth feature vector and social-graph information.Type: ApplicationFiled: December 30, 2016Publication date: July 5, 2018Inventors: Balmanohar Paluri, Benoit F. Dumoulin, Merlyn Deng, Reena Philip, Dario Garcia Garcia