Abstract: A method includes obtaining a test image captured by a camera of a mobile device, the image including a test component; processing the test image using a machine learning model, wherein the machine learning model has been trained by obtaining a 3D model file representing a 3D model of a training component, generating a plurality of images of the training component based on the 3D model file, the plurality of images differing from one another in at least one of orientation, background, or texture, determining locations of the training component, and training the machine learning model using the plurality of images and the locations of the training component, wherein the machine learning model is trained to detect the training component in photographs captured by mobile devices; and presenting one or more candidate identities of the test component based on an output of the machine learning model.
Abstract: Methods, systems, computer-readable media, and apparatuses are presented for generating a photorealistic viewable model using augmented reality (AR). An AR scene is generated by overlaying a virtual object onto a view of a physical environment. When placed into the AR scene, the virtual object can interact with the physical environment by, for example, reflecting or taking on colors, shadows, brightness, and other attributes of the physical environment. To generate the viewable model, the virtual object is manipulated (e.g., moved or rotated) within the AR scene and a plurality of images are generated by capturing the virtual object as the virtual object is being manipulated. The viewable model can be generated based on one or more of the images and can be output in the form of an interactive presentation, for example, a spin image.
Abstract: Methods, systems, computer-readable media, and apparatuses are presented for generating a photorealistic viewable model using augmented reality (AR). An AR scene is generated by overlaying a virtual object onto a view of a physical environment. When placed into the AR scene, the virtual object can interact with the physical environment by, for example, reflecting or taking on colors, shadows, brightness, and other attributes of the physical environment. To generate the viewable model, the virtual object is manipulated (e.g., moved or rotated) within the AR scene and a plurality of images are generated by capturing the virtual object as the virtual object is being manipulated. The viewable model can be generated based on one or more of the images and can be output in the form of an interactive presentation, for example, a spin image.