Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A vehicle moves through a construction environment and performs one or more construction actions in the environment. A master coordinator associated with the construction environment updates a global state of the construction environment based on the performed construction actions. The master coordinator may determine a plan of construction actions for machines in the environment using a generative language model and send instruction to perform the construction actions or capture data from an associated viewpoint based on the global state to the machines. Each machine may have a local coordinator that determines its local state based on sensor data and may alter actions within alteration constraints provided by the master coordinator. The master coordinator receives local states from the machines over time, updates the global state accordingly, and sends instructions to the one or more machines based on the updated global state.

Abstract: A vehicle moves through an environment (e.g., a farming, construction, mining, or forestry environment) and performs one or more actions in the environment. A control system associated with the vehicle may include a mode selection module and a transportation determination module. In particular, the control system may employ a machine vision model to identify images captured for each region in the environment. The model identifies viable unloading locations in an unloading zone of the environment, and then navigates the vehicle to one or more unloading locations based on pixels of the image representing terrain features and existing cargo dump piles. Control signals for loading or unloading cargo are determined in alignment with a transportation protocol set by a site manager. A loading or unloading mechanism is then actuated using these control signals to unload cargo in the appropriate location.

Abstract: A control system deploys a virtual safety bubble for autonomous operation of a construction vehicle in a worksite. The control system obtains a work schedule for the construction vehicle to perform one construction action. The control system identifies one or more objects to be interacted with by the construction vehicle while performing the one construction action. The control system deploys a virtual safety bubble for the construction vehicle based on the one construction action. Breach of the virtual safety bubble triggers remedial actions; however, the virtual safety bubble permits breach by the one or more identified objects during the construction action. The control system detects breach of the virtual safety bubble by the one or more identified objects during the construction action. Responsive to the breach of the virtual safety bubble by the one or more identified objects during the construction action, the control system withholds the remedial actions.

Abstract: A vehicle moves through a construction environment and performs one or more construction actions in the environment. A master coordinator associated with the construction environment updates a global state of the construction environment based on the performed construction actions. The master coordinator may determine a plan of construction actions for machines in the environment using a generative language model and send instruction to perform the construction actions or capture data from an associated viewpoint based on the global state to the machines. Each machine may have a local coordinator that determines its local state based on sensor data and may alter actions within alteration constraints provided by the master coordinator. The master coordinator receives local states from the machines over time, updates the global state accordingly, and sends instructions to the one or more machines based on the updated global state.

Abstract: A construction vehicle may move along a route in a construction environment towards a portion of the construction environment. The construction vehicle may access an image of the portion of the construction environment in front of the construction vehicle. The construction vehicle may apply a rut identification model to the image, where the rut identification model is configured to identify a rut in the portion of the construction environment using pixels of the image. The construction vehicle may, subsequent to identifying the rut in the portion of the construction environment, navigate the construction vehicle along the route based on the identified rut.

Abstract: Visual content including spatial portions is obtained. Respective spatial qualities of the spatial portions are determined. The respective spatial qualities are based on locations of the spatial portions within the visual content. The spatial portions of the visual content are encoded based on the respective spatial qualities. Encoding quality parameters indicative of the respective spatial qualities are stored in association with the encoded spatial portions.

Abstract: Visual content that includes spatial portions is obtained. A determination is made that one of the spatial portions includes a face. Based on the determination, encoding quality parameters for the one of the spatial portions is identified. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions The visual content is encoded. The encoding quality parameters are stored, in association with but separate from, the one of the spatial portions. After decoding, the one of the spatial portions are rendered based on the encoding quality parameters. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: Visual content that includes spatial portions is obtained. A determination is made that one of the spatial portions includes a face. Based on the determination, encoding quality parameters for the one of the spatial portions is identified. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions The visual content is encoded. The encoding quality parameters are stored, in association with but separate from, the one of the spatial portions. After decoding, the one of the spatial portions are rendered based on the encoding quality parameters. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A method includes obtaining visual content comprising spatial portions; determining respective spatial qualities of the spatial portions, wherein the respective spatial qualities are based on locations of the spatial portions within the visual content; and encoding the spatial portions of the visual content based on the respective spatial qualities. An apparatus includes a camera, a display, and a processor. The processor is configured to identify, using facial recognition, a face of a user of the apparatus; identify a distance of the face of the user to the display; and render visual content on the display using a quality that is based on the distance.

Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.

Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: A method includes obtaining visual content comprising spatial portions; determining respective spatial qualities of the spatial portions, wherein the respective spatial qualities are based on locations of the spatial portions within the visual content; and encoding the spatial portions of the visual content based on the respective spatial qualities. An apparatus includes a camera, a display, and a processor. The processor is configured to identify, using facial recognition, a face of a user of the apparatus; identify a distance of the face of the user to the display; and render visual content on the display using a quality that is based on the distance.

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.