Abstract: The apparatus for the autonomously acting machine comprises an interface for communicating with a computer system, wherein the computer system is separate from the autonomously acting machine. The apparatus includes a processor for executing machine-readable instructions for providing information about an internal state of the autonomously acting machine to the computer system, obtaining a feedback signal from the computer system, the feedback signal indicating whether sensor data for observing the autonomously acting machine is consistent with the internal state of the autonomously acting machine, and wherein the feedback signal is based on a comparison between a digital twin of the autonomously acting machine and the sensor data, wherein an internal state of the digital twin is based on the internal state of the autonomously acting machine, and operating the autonomously acting machine based on the feedback signal.

Abstract: A device including a processor configured to: receive sensor measurements; determine a viewer position based on the received sensor measurements; generate a control signal based on the viewer position; and determine a view based on the viewer position.

Abstract: Disclosed herein are systems, devices, and methods for efficiently checking the integrity of a robot system. The integrity-checking system may generate a predefined motion instruction for a robot, where the predefined motion instruction instructs the robot to perform a random movement at a test time. The random movement may be associated with an expected observation at the test time. The integrity-checking system may also determine a systematic failure based on a difference between the expected observation and a current observation of the robot at the test time. The current observation may be determined from received sensor data, and if the integrity-checking system detects a failure, it may stop the robot's motion or other mitigating instructions.

Abstract: A device may include an image sensor, configured to generate image sensor data representing a vicinity of the device; an image processor, configured to generate a first code from the image sensor data using a code generation protocol; an input validity checker, configured to compare the first code to a second code; and if a similarity of the first code and the second code is within a predetermined range, operate according to a first operational mode; and if the similarity of the first code and the second code is not within the predetermined range, operate according to a second operational mode.

Abstract: A pedestrian route can be segmented into at least one pedestrian walking segment using location information of transportation resources. An estimated transit time for the pedestrian route can be determined as a function of an estimated transit time of the at least one pedestrian walking segment, an estimated wait time for the transportation resource to arrive at the user determined using received status real-time location and movement information of the transportation resource and the determined estimated transit time for the at least one pedestrian walking segment, and an estimated transit time for the transportation resource to transport the user.

Abstract: The apparatus for the autonomously acting machine comprises an interface for communicating with a computer system, wherein the computer system is separate from the autonomously acting machine. The apparatus includes a processor for executing machine-readable instructions for providing information about an internal state of the autonomously acting machine to the computer system, obtaining a feedback signal from the computer system, the feedback signal indicating whether sensor data for observing the autonomously acting machine is consistent with the internal state of the autonomously acting machine, and wherein the feedback signal is based on a comparison between a digital twin of the autonomously acting machine and the sensor data, wherein an internal state of the digital twin is based on the internal state of the autonomously acting machine, and operating the autonomously acting machine based on the feedback signal.

Abstract: Disclosed herein are devices, methods, and systems for providing an externally augmented camera that may utilize external light sources of a separate sensor to emit light toward a scene so as to provide accurate imaging of the scene, even in dark or low-light situations or where the scene has a high dynamic range of brightness. The externally augmented camera system may include a sensor with a light source capable of emitting light toward a scene, a camera separate from the light source, where the camera includes a detector capable of detecting emitted light from the light source. The externally augmented camera system also causes the sensor to emit light toward the scene via the light source, causes the camera to capture image data of the scene that has been illuminated by emitted light from the light source, and generates an image of the scene based on the image data.

Abstract: Disclosed herein are systems, devices, and methods for improving the safety of a robot. The safety system may determine a safety envelope of a robot based on a planned movement of the robot and based on state information about a load carried by a robot. The state information may include a dynamic status of the load. The safety system may also determine a safety risk based on a detected object with respect to the safety envelope. The safety system may also generate a mitigating action to the planned movement if the safety risk exceeds a threshold value.

Abstract: A computing device, including: a memory configured to store computer-readable instructions; and unintended human motion detection processing circuitry configured to execute the computer-readable instructions to cause the computing device to: interpret a human action; receive autonomous mobile robot (AMR) sensor data from an AMR sensor; and detect whether the human action is intended or unintended, wherein the detection is based on a predicted human action, a current human emotional or physical state, the interpreted human action, and the AMR sensor data.

Abstract: A device may include a processor. The processor may receive sensor data representative of an environment comprising a robot. The processor may extract features from the sensor data to generate an extracted feature set indicating an observation of the robot within the environment. The processor may generate a feature set indicating an expected observation of the robot within the environment based on pre-defined parameters of the robot. The processor may determine a difference between the observation and the expected observation of the robot. The processor may determine a systemic failure based on the difference between the observation and the expected observation of the robot exceeding a threshold value. The processor may instruct the robot to transition to a non-operative state responsive to the systemic failure being determined.

Abstract: Disclosed herein are systems, devices, and methods for efficiently checking the integrity of a robot system. The integrity-checking system may generate a predefined motion instruction for a robot, where the predefined motion instruction instructs the robot to perform a random movement at a test time. The random movement may be associated with an expected observation at the test time. The integrity-checking system may also determine a systematic failure based on a difference between the expected observation and a current observation of the robot at the test time. The current observation may be determined from received sensor data, and if the integrity-checking system detects a failure, it may stop the robot's motion or other mitigating instructions.

Abstract: A device may include an image sensor, configured to generate image sensor data representing a vicinity of the device; an image processor, configured to generate a first code from the image sensor data using a code generation protocol; an input validity checker, configured to compare the first code to a second code; and if a similarity of the first code and the second code is within a predetermined range, operate according to a first operational mode; and if the similarity of the first code and the second code is not within the predetermined range, operate according to a second operational mode.

Abstract: Various systems and methods for pedestrian traffic management are described herein, comprising segmenting a pedestrian route into at least one pedestrian walking segment using location information of transportation resources, and determining estimated transit times for the at least one pedestrian walking segment and an estimated wait time for the first transportation resource using received status information of the first transportation resource and the determined estimated transit time for the first pedestrian walking segment.

Abstract: An apparatus for detecting a feature in an image includes an image input section for receiving at least part of the image in the form of image data having a plurality of pixels, the plurality of pixels comprising a plurality of non-border pixels, a feature detection module adapted to attribute a feature probability value to each of the pixels of the image data, and an extremum determination module for determining at least one local extremum among the feature probability values, wherein the extremum determination module is adapted to output, for each of the plurality of pixels, a final indication if the feature probability value of the pixel in question is a local extremum.

Abstract: An apparatus for detecting a feature in an image includes an image input section for receiving at least part of the image in the form of image data having a plurality of pixels, the plurality of pixels comprising a plurality of non-border pixels, a feature detection module adapted to attribute a feature probability value to each of the pixels of the image data, and an extremum determination module for determining at least one local extremum among the feature probability values, wherein the extremum determination module is adapted to output, for each of the plurality of pixels, a final indication if the feature probability value of the pixel in question is a local extremum.

Abstract: An apparatus for detecting a feature in an image includes an image input section for receiving at least part of the image in the form of image data having a plurality of pixels, the plurality of pixels comprising a plurality of non-border pixels, a feature detection module adapted to attribute a feature probability value to each of the pixels of the image data, and an extremum determination module for determining at least one local extremum among the feature probability values, wherein the extremum determination module is adapted to output, for each of the plurality of pixels, a final indication if the feature probability value of the pixel in question is a local extremum.

Abstract: The invention is related to a method of matching image features with reference features, comprising the steps of providing a current image captured by a capturing device, providing reference features (r), wherein each of the reference features comprises at least one reference feature descriptor (d(r)), determining current features (c) in the current image and associating with each of the current features at least one respective current feature descriptor (d(c)), and matching the current features with at least some of the reference features by determining a respective similarity measure (D(c, r)) between each respective current feature descriptor (d(c)) and each respective reference feature descriptor (d(r)). According to the invention, the determination of the similarity measure is performed on an integrated circuit by hardwired logic or configurable logic which processes logical functions for determining the similarity measure.

Abstract: An apparatus for detecting a feature in an image includes an image input section for receiving at least part of the image in the form of image data having a plurality of pixels, the plurality of pixels comprising a plurality of non-border pixels, a feature detection module adapted to attribute a feature probability value to each of the pixels of the image data, and an extremum determination module for determining at least one local extremum among the feature probability values, wherein the extremum determination module is adapted to output, for each of the plurality of pixels, a final indication if the feature probability value of the pixel in question is a local extremum.

Abstract: A pixel data processing apparatus comprises a data path unit comprising a hardware module dedicated to performing, when in use, predetermined functionality in relation to image data. The apparatus also comprises a data store for storing image data and a programmable engine. The programmable engine is arranged to route, when in use, data associated with the image data through the data path unit in a predetermined manner.

Abstract: The invention is related to a method of matching image features with reference features, comprising the steps of providing a current image captured by a capturing device, providing reference features (r), wherein each of the reference features comprises at least one reference feature descriptor (d(r)), determining current features (c) in the current image and associating with each of the current features at least one respective current feature descriptor (d(c)), and matching the current features with at least some of the reference features by determining a respective similarity measure (D(c, r)) between each respective current feature descriptor (d(c)) and each respective reference feature descriptor (d(r)). According to the invention, the determination of the similarity measure is performed on an integrated circuit by hardwired logic or configurable logic which processes logical functions for determining the similarity measure.