Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

Abstract: A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Abstract: The technical problem of adding content that originates from a third party application to an augmented reality component maintained by a messaging server system is addressed by configuring the augmented reality component to modify content captured by a camera according to values of one or more attributes and by permitting delivery of said values, from the third party application to the messaging server system, in the payload of a deep link that references the identification of the augmented reality component.

Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Abstract: A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Abstract: The technical problem of adding content originating from a third party app to an augmented reality component maintained by the messaging server system is addressed by configuring the augmented reality component to modify content captured by a camera according to values of one or more attributes and to permit delivery of said values, from a third party app to the messaging server system, in the payload of a deep link that references the ID of the augmented reality component. The content that originates from the third party app and is provided to an augmented reality component maintained by the messaging server system may be dynamic, in that it may change over time, such as, e.g., sports scores provided by a sports news channel app.

Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

Abstract: The technical problem of adding content originating from a third party app to an augmented reality component maintained by the messaging server system is addressed by configuring the augmented reality component to modify content captured by a camera according to values of one or more attributes and to permit delivery of said values, from a third party app to the messaging server system, in the payload of a deep link that references the ID of the augmented reality component. The content that originates from the third party app and is provided to an augmented reality component maintained by the messaging server system may be dynamic, in that it may change over time, such as, e.g., sports scores provided by a sports news channel app.

Abstract: A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.

Abstract: A methodology is described that provides access to augmented reality components maintained by a messaging server system directly from a third party resource, without having to first launch an associated messaging client (either a stand-alone app or a web-based version of the app). The technical problem of invoking an augmented reality component maintained by the messaging server system directly from a third party app is addressed by permitting third party app developers to include a deep link that references the identification of a desired augmented reality component into their third party resource. The deep link invoked from a third party resource causes activation of the messaging client, loading the augmented reality component represented by the identification referenced in the deep link, and activating, from the messaging client, a camera of the computer device that is executing the third party resource.

Abstract: A modular image processing SDK comprises an API to receive API calls from third party software running on a portable device including a camera. SDK logic receives and processes commands and parameters received from the API that are based on the API calls received from the third party software. An annotation system performs image processing operations on a feed from the camera based on image processing instructions and parameters received by the annotation system from the SDK logic. The image processing is based at least in part on augmented reality content generator data (or AR content generators), user input and sensor data.

Abstract: A user interface method is provided by an SDK embedded in a third party resource running on a portable device including a camera and a display. The method includes receiving an API call to display an image processing user interface and in response, displaying a first user interface comprising a list of selectable graphical items corresponding to a group of available image modification features. If user selection of a desired graphical item from the list of selectable graphical items is received, image modification features corresponding to the desired graphical item are applied to an image received from the camera, generating a modified image. A second user interface including the modified image is then displayed on the display.

Abstract: A content display system can control which content and how the content is displayed based on viewing parameters, such as a map zoom level, and physical distance parameters, e.g., a geo-fence distance and an icon visibility distance. Different combinations of input (e.g., zoom level and physical distances) yield a myriad of pre-set content displays on the client device, thereby allowing a creator of an icon to finely tune how content displayed otherwise accessed.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

Abstract: A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first application running on a device, a request to switch to a second application on the device, the request identifying augmented reality content to display with image data captured by a camera of the device; providing, in response to receiving the request, for switching from the first application to the second application; providing for the second application to activate the camera to capture the image data; and providing for the second application to display the image data captured by the camera with the augmented reality content.

Abstract: A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.