Abstract: Aspects of the present disclosure are directed to three-dimensional (3D) video calls where at least some participants are assigned a position in a virtual 3D space. Additional aspects of the present disclosure are directed to an automated effects engine that can A) convert a source still image into a flythrough video; B) produce a transform video that replaces portions of a source video with an alternate visual effect; and/or C) produce a switch video that automatically matches frames between multiple source videos and stiches together the videos at the match points. Further aspects of the present disclosure are directed to a platform for the creation and deployment of automatic video effects that respond to lyric content and lyric timing values for audio associated with a video and/or that respond to beat types and beat timing values for audio associated with a video.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering makeup products on a user's face within an augmented reality environment in real-time. For example, the disclosed system can use blend a base makeup color of a selected makeup product with extracted luminance frequencies of a video stream. The disclosed system can then convert the blended makeup color to LAB color space and apply one or more shader models to the lightness of the color based on a material of the selected makeup product. The disclosed system can also apply additional operations for smoothing the skin of the user and matching the makeup product to a skin tone of the user. The disclosed system can then display the makeup product and any additional changes in an augmented reality environment in the video stream.