Abstract: Method and apparatus for optimizing control of robotic systems. Failures of a robotic device performing a lifting operation for one or more items within a fulfillment center over a window of time are monitored. Responsive to the failures exceeding a predefined threshold number of failures for the window of time, one or more control operations for optimizing performance of the robotic device are determined, by processing environmental metrics, failure type, mode of operation and item type information as inputs to a trained machine learning model. A control system for the robotic device is configured based on the determined one or more control operations, and movement of the robotic device is controlled using the configured control system, to perform the lifting operation for one or more additional items within the fulfillment center.

Abstract: A device is used to present the visualization of color on a display based on various environmental factors. In one embodiment, an image of an environment is captured using at least one sensor, where the image includes a surface area in the environment. A relative position of a source of light in the environment is also identified with respect to the surface area. Color is rendered for the surface area in the image on the display based on the relative position of the source of light and a bidirectional reflectance distribution function (BRDF) associated with the color, among other factors. In some cases, the movement of a computing device can be tracked, and color on the display adjusted based at least in part on the movement. The color can also be rendered based on a display profile of the display and other parameters.

Abstract: Techniques for predicting and detecting produce quality may be provided. For example, visual or infrared characteristics of a produce item (e.g., skin, shape, wrinkles, and other characteristics of an apple, pepper, etc.) may be compared with ripeness characteristics of the type of produce item (e.g., other apples or peppers). The ripeness characteristics may correspond with the type of produce item at different stages of ripeness along a ripeness regression (e.g., a timeline of the produce item from raw to rotten). One or more ripeness scores of the produce item may be determined along a timeline (e.g., raw at day 1, rotten at day 10, etc.), so that when a user requests a produce item corresponding with a particular ripeness score, the produce item can be provided to the user based in part on the visual or infrared characteristics of the produce item and ripeness regression.

Abstract: Environment aware visualization of color, for example, on a display of a device is described. In one embodiment, an image of an environment is captured using at least one sensor, where the image includes a surface area in the environment. A relative position of a source of light in the environment is also identified with respect to the surface area. Color is rendered for the surface area in the image on the display based on the relative position of the source of light and a bidirectional reflectance distribution function (BRDF) associated with the color, among other factors. In some cases, the movement of a computing device can be tracked, and color on the display adjusted based at least in part on the movement. The color can also be rendered based on a display profile of the display and other parameters.

Abstract: The visualization of color on a display of a device is improved using environmental awareness. In one example, a distribution of lighting in an environment is captured using at least one sensor of the device, such as light or image sensors. Further, a viewing angle of a viewer of the display of the device is determined using sensors. Based on the distribution of lighting and the viewing angle, among other environmental factors, color in at least one area on the display of the device is rendered. In addition to the distribution of lighting and the viewing angle, the color can be rendered with reference to a reflectance distribution function associated with the color, a display profile of the display of the device, or other parameters. Further, movement of the device can be tracked, and the color on the display of the device adjusted dynamically based on the movement.

Abstract: Information regarding actions or activities to be performed at a workstation may be projected upon a portion of the workstation using one or more projectors. The information may include one or more arrows or other indicators referencing specific tools, materials or objects that may be used to perform one or more of the actions or activities. Such arrows or indicators may be rendered in a manner that simulates a three-dimensional or floating appearance thereof from a perspective of a user that may be adjusted or modified based on changes in the perspective of the user, and with respect to one or more physical or virtual sources of light.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror.

Abstract: A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image includes a mirror for optically coupling to a fisheye lens having a first field of view, the mirror configured for reflecting an image of a second field of view through the fisheye lens. A housing has a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system. When the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image and a second portion of the panoramic image, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image.

Abstract: Systems and techniques for panoramic imaging are disclosed herein. Systems for capturing a panoramic image of a panoramic field of view include a fisheye lens having a first field of view, a mirror optically coupled to the fisheye lens for reflecting an image of the a second field of view through the fisheye lens, the second field of view having a portion overlapping the first field of view, and a detector, optically coupled to the fisheye lens and the mirror, for capturing a first portion of the panoramic image corresponding to the first field of view and a second portion of the panoramic image corresponding to the second field of view.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror. In some embodiments, the mirror is positioned coaxially with regard to the fisheye lens.

Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror. In some embodiments, the mirror is positioned coaxially with regard to the fisheye lens.

Abstract: A method and apparatus for determine an effect of direct and global illumination in a scene. A scene is illuminated with spatially varying illumination. A set of images is acquired of the scene, and a direct and global radiance in the set of images is determined.