Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Some embodiments of a method may include obtaining an image a real-world environment, determining an estimated illuminant spectral power distribution of an illuminant of the real-world environment, and detecting a region of the image representing human skin. The method may further include determining a representative skin color value of the region and based on the estimated illuminant spectral power distribution and the representative skin color value most closely matching the representative color value, selecting a candidate skin reflectance spectrum. The method may further include updating the estimated illuminant spectral power distribution base on the representative skin color value and the selected candidate skin reflectance spectrum.

Abstract: Described herein are systems and methods for maintaining color calibration using common objects. In an exemplary embodiment, an AR system includes a forward-facing camera, an AR display, a processor, and a user interface. The processor is configured to receive image data from the forward-facing camera and identify any known objects depicted in the image data. The processor then determines RGB information at least one test rendering of the identified known object and displays it via the AR display. Input from a user interface, indicating which of the at least one test renderings was a closest match to the real-world object, and a level of satisfaction with the match are received by the processor and used to update an AR display color calibration model. More test renderings may be iteratively provided to improve the accuracy of the calibration.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Some embodiments of a method may include obtaining an image a real-world environment, determining an estimated illuminant spectral power distribution of an illuminant of the real-world environment, and detecting a region of the image representing human skin. The method may further include determining a representative skin color value of the region and based on the estimated illuminant spectral power distribution and the representative skin color value most closely matching the representative color value, selecting a candidate skin reflectance spectrum. The method may further include updating the estimated illuminant spectral power distribution base on the representative skin color value and the selected candidate skin reflectance spectrum.

Abstract: Some embodiments of a method may include obtaining an image a real-world environment, determining an estimated illuminant spectral power distribution of an illuminant of the real-world environment, and detecting a region of the image representing human skin. The method may further include determining a representative skin color value of the region and based on the estimated illuminant spectral power distribution and the representative skin color value most closely matching the representative color value, selecting a candidate skin reflectance spectrum. The method may further include updating the estimated illuminant spectral power distribution base on the representative skin color value and the selected candidate skin reflectance spectrum.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: The invention pertains to methods and apparatus for compensating the rendering of virtual content in an augmented reality scene as a function of the white point, spectral distribution, color or other optical parameter of the real content in the scene.

Abstract: Described herein are systems and methods for maintaining color calibration using common objects. In an exemplary embodiment, an AR system includes a forward-facing camera, an AR display, a processor, and a user interface. The processor is configured to receive image data from the forward-facing camera and identify any known objects depicted in the image data. The processor then determines RGB information at least one test rendering of the identified known object and displays it via the AR display. Input from a user interface, indicating which of the at least one test renderings was a closest match to the real-world object, and a level of satisfaction with the match are received by the processor and used to update an AR display color calibration model. More test renderings may be iteratively provided to improve the accuracy of the calibration.

Abstract: Described herein are systems and methods for maintaining color calibration using common objects. In an exemplary embodiment, an AR system includes a forward-facing camera, an AR display, a processor, and a user interface. The processor is configured to receive image data from the forward-facing camera and identify any known objects depicted in the image data. The processor then determines RGB information at least one test rendering of the identified known object and displays it via the AR display. Input from a user interface, indicating which of the at least one test renderings was a closest match to the real-world object, and a level of satisfaction with the match are received by the processor and used to update an AR display color calibration model. More test renderings may be iteratively provided to improve the accuracy of the calibration.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Some embodiments of a method may include obtaining an image a real-world environment, determining an estimated illuminant spectral power distribution of an illuminant of the real-world environment, and detecting a region of the image representing human skin. The method may further include determining a representative skin color value of the region and based on the estimated illuminant spectral power distribution and the representative skin color value most closely matching the representative color value, selecting a candidate skin reflectance spectrum. The method may further include updating the estimated illuminant spectral power distribution base on the representative skin color value and the selected candidate skin reflectance spectrum.

Abstract: Described herein are systems and methods for maintaining color calibration using common objects. In an exemplary embodiment, an AR system includes a forward-facing camera, an AR display, a processor, and a user interface. The processor is configured to receive image data from the forward-facing camera and identify any known objects depicted in the image data. The processor then determines RGB information at least one test rendering of the identified known object and displays it via the AR display. Input from a user interface, indicating which of the at least one test renderings was a closest match to the real-world object, and a level of satisfaction with the match are received by the processor and used to update an AR display color calibration model. More test renderings may be iteratively provided to improve the accuracy of the calibration.

Abstract: Systems and methods are described for adjusting the color spectrum of synthetic objects in augmented reality (AR) displays under varying lighting conditions and a human observers spectral sensitivities, to produce customized color matches for a specific observer. Spectral data may be captured, and color matching functions (CMFs) of the observer may be used by a spectral color workflow that produces color display values, for example coordinates in RGB space. The color rendering may custom-match for multiple observers with different color perceptions under a wide range of environmental (ambient lighting) conditions.

Abstract: The invention pertains to methods and apparatus for compensating the rendering of virtual content in an augmented reality scene as a function of the white point, spectral distribution, color or other optical parameter of the real content in the scene.

Abstract: Systems and methods are described for adjusting the color spectrum of synthetic objects in augmented reality (AR) displays under varying lighting conditions and a human observers spectral sensitivities, to produce customized color matches for a specific observer. Spectral data may be captured, and color matching functions (CMFs) of the observer may be used by a spectral color workflow that produces color display values, for example coordinates in RGB space. The color rendering may custom-match for multiple observers with different color perceptions under a wide range of environmental (ambient lighting) conditions.