Abstract: The disclosure extends to methods, systems, and computer program products for digitally imaging with area limited image sensors, such as within a lumen of an endoscope.

Abstract: The present disclosure is directed to an augmented reality surgical system for viewing an augmented image of a region of interest during a surgical procedure. The system includes an image capture device that captures an image of the region of interest. A controller receives the image and applies at least one image processing filter to the image. The image processing filter includes a spatial decomposition filter that decomposes the image into spatial frequency bands. A temporal filter is applied to the spatial frequency bands to generate temporally filtered bands. An adder adds each band spatial frequency band to a corresponding temporally filtered band to generate augmented bands. A reconstruction filter generates an augmented image by collapsing the augmented bands. A display displays the augmented image to a user.

Abstract: An overlooking image generation system for a vehicle is provided to confirm the traffic situation around a subject vehicle. The system includes an overlooking image generation device that generates a wide-area overlooking image capable to confirm traveling situations of a subject vehicle and a nearby vehicle. A display device displays the wide-area overlooking image. The overlooking image generation device acquires captured image signals of other vehicles including a plurality of captured images by communicating with the other vehicles using V2X, generates the wide-area overlooking image including the subject vehicle and the nearby vehicle by image-synthesizing the acquired captured image signals of the other vehicles, and displays the generated wide-area overlooking image including the subject vehicle and the nearby vehicle on the display device.

Abstract: A vehicle periphery display device includes: an acquisition portion acquiring a captured image obtained by imaging a periphery of a vehicle with an imaging portion; and a display processing portion causing a display image including a vehicle image and a periphery image of the vehicle to be displayed on a display portion on the basis of the captured image. The display processing portion causes at least one of a contour guide line representing a contour of the vehicle image and having a first margin in a vehicle width direction of the vehicle image and a second margin in an advancing direction of the vehicle image, and a predicted course guide line that is a trajectory drawn by the contour guide line according to movement of the vehicle to be displayed in the display image, and changes at least one of the first and second margins when the vehicle is turned.

Abstract: The disclosure extends to methods, systems, and computer program products for widening dynamic range within an image in a light deficient environment.

Abstract: Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.

Abstract: Systems and methods for receiving a video feed from a trailer control module disposed in a vehicle trailer are described. One method includes aggregating a trailer front view, a trailer rear view, a trailer left view, and a trailer right view into an aggregated birds-eye view at a first control module disposed on the trailer, and sending the aggregated view to a vehicle towing the trailer via a single auxiliary video channel integrated into a trailer hitch wiring harness. The method further includes receiving the feed of the birds-eye view at the second control module disposed in the vehicle via the single auxiliary camera input channel, and displaying the trailer birds-eye view video feed at an output display disposed in a cabin of the towing vehicle. The birds-eye view may be output on a split screen in conjunction with a rear-view of the trailer, obtained from a vehicle camera system.

Abstract: The present disclosure is directed to systems and methods for amplifying a region of interest in a surgical environment. The system includes a stereo endoscope having a first camera and a second camera configured to obtain one or more images of the surgical environment. The system also includes a computer that has a central processing unit (CPU) configured to determine the region of interest in the surgical environment, a first controller configured to process the one or more images from the first camera to generate first amplified image(s), and a second controller configured to process the one or more images from the second camera to generate second amplified image(s). The first and second controllers process the one or more images based on the region of interest determined by the CPU. A display displays the one or more first amplified images and the one or more second amplified images.

Abstract: Systems and methods of adaptive streaming are discussed. Transcoded copies of a source stream may be aligned with one another such that the independently specified portions of each transcoded stream occur at the same locations within the content. These transcoded copies may be produced by one or more transcoders, whose outputs are synchronized by a delay adjuster. A fragmenter may use the synchronized and aligned streams to efficiently produce fragments suitable for use in adaptive streaming.

Abstract: The present disclosure provides a rear view mirror arrangement for a motor vehicle. The rear view mirror arrangement includes an image capture unit. The image capture unit includes a housing and a camera disposed in the housing. The housing has a pane that switches between a transparent state and a reflecting state. The rear view mirror arrangement further includes a display unit for displaying an image captured by the camera. The rear view mirror arrangement operates under a camera mode and a mirror mode. When the rear view mirror arrangement is set in the camera mode, the pane is set in the transparent state so that the camera is configured to capture an image of the surroundings of the motor vehicle. When the rear view mirror arrangement is set in the mirror mode, the pane is set in the reflective state.

Abstract: An image processing device includes: an obtainer which obtains, from an imaging device provided in a vehicle so as to be oriented to capture an image of an area behind the vehicle, an image captured by the imaging device; a position detector which detects a face position of a driver; and an image processor which performs image processing to clip, according to the face position detected by the position detector, an image having a range corresponding to the face position, out of a combined image including the image, and superimpose a position image indicating a position in the vehicle, on the image at a position corresponding to the face position, and outputs an image resulting from the image processing.

Abstract: A control device is installed in a vehicle including an electrical storage device to which is connected a plurality of electrical paths. The vehicle includes an external signal recognition device that recognizes a predetermined image or signal based on an image outside of the vehicle or a signal from outside of the vehicle, an external environment recognition device that recognizes a predetermined environment based on a surrounding environment of the vehicle when the predetermined image or signal is recognized by the external signal recognition device, regardless of whether a system of the vehicle is started, and a relay connected to at least one object electrical path. The control device includes a processor that turns the relay off when a count of times of the external environment recognition device continuously recognizing the predetermined environment for no shorter than a predetermined time is no less than a predetermined count of times.

Abstract: An image processing device includes a sideline detector configured to detect sidelines of boundary lines of parking sections next to each other in a vehicle width direction by an edge detection process to an image, each of the sidelines being a pair of a rising edge and a falling edge, and to acquire an end point of each of the sidelines at which the pair is not detected, a rear-end edge identifying part configured to identify a rear-end edge of the parking section based on an end point away from the vehicle among the end points acquired by the sideline detector, and a parking frame setting portion configured to identify the parking section based on the two sidelines detected by the sideline detector and the rear-end edge identified by the rear-end edge identifying part, and to set a parking frame based on the parking section.

Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.

Abstract: A method and system for video coding by integrating frame data and time data may be described. The method and system can include a video coding non-transitory storage media that integrates reference data and time data. More specifically, the video coding non-transitory storage media can produce one or more luma vectors and one or more chroma vectors within a video plane, the one or more luma vectors and one or more chroma vectors may be extended into time vectors that can be utilized for compression or reconstruction of the frame rate, define luma vector across time as a contiguous function and perform video compression across a time dimension.

Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, parameters of a cross-component linear model based on R chroma samples from a group of neighboring chroma samples, wherein the R chroma samples are selected from the group based on a position rule; and performing the conversion based on the determining and R is greater than or equal to 2.

Abstract: A method and a corresponding calibration system for calibrating a microscope system involve a recording of an overview image of a sample stage of the microscope system and an identification of a calibration sample in the recorded overview image. Moreover, The calibration sample in the recorded overview image is classified into one of a plurality of calibration sample classes using a classification system, which was trained using training data, in order to form a model so that the classification system is adapted for classifying unknown input data into prediction classes. A of a calibration workflow for calibrating the microscope system is selected based on the classified calibration sample class. The selection is performed using a workflow indicator value serving as an input value for a workflow selection system.

Abstract: An assembly includes a liftgate and an autonomous navigation sensor assembly supported by the liftgate. The autonomous navigation sensor assembly has a plurality of sensors and a vent facing across a field-of-view of one of the sensors.

Abstract: An endoscope device includes: a light source configured to perform any one of simultaneous lighting and sequential lighting; an image sensor including a plurality of pixels; a plurality of filters including at least one type of primary filter and a complementary filter; and a processor including hardware, the processor being configured to cause the light source to switch between the simultaneous lighting and the sequential lighting, when the simultaneous lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter, and when the sequential lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter as an imaging signal generated from a pixel corresponding to the at least one type of primary filter.

Abstract: An imaging device that is capable of having a fisheye lens attached to a main body, and that is capable of shooting digital images, comprising, an image sensor on which photometric domains and/or AF region are arranged, a lens communication circuit that performs communication with a lens that has been attached and acquires lens information, and a processor that detects whether or not a lens that has been attached is a circular fisheye lens based on the lens information, and, if it has been determined that the lens is a circular fisheye lens, restricts the photometric domains and/or AF regions based on an image circle of the circular fisheye lens.