Abstract: An image processing apparatus includes a first learner trained to detect an orientation of a face in an image including a human face for receiving an input of a target image including a human face and outputting first information associated with an orientation of a face included in the target image, at least one second learner trained, for the first information, to detect a position of a facial component in an image including a human face for receiving an input of the target image and outputting second information associated with a position of a facial component included in the target image, and a control unit that controls the first learner and the second learner. The control unit uses the first learner to obtain the first information from the target image, and uses the second learner corresponding to the first information to obtain the second information from the target image.

Abstract: An image analyzer repeatedly obtains a captured image including a subject to be detected, and detects, in the captured image, a first area likely to include the subject without a cover, detects, in the captured image, a second area likely to include the subject with a cover, and determines whether the subject is covered by the cover based on a detection result of the first area and a detection result of the second area and a determination result for the captured image obtained previously.

Abstract: A concentration degree determination device includes: a monitoring data acquisition unit configured to acquire monitoring data from a sensor that monitors a driver; a concentration degree estimator configured to estimate a driving concentration degree of the driver from the monitoring data; a reference comparator configured to compare the driving concentration degree to a first-road reference when a vehicle is running on a first road, and to compare the driving concentration degree to a second-road reference when the vehicle is running on a second road; and a signal output unit configured to output an instruction signal issuing an instruction to perform support to the driver after elapse of a first time when the driving concentration degree does not satisfy the first-road reference, and to output the instruction signal after elapse of a second time shorter than the first time when the driving concentration degree does not satisfy the second-road reference.

Abstract: A driver state determination unit of a drive mode switching control device regularly or irregularly determines whether a driver's state is a state of being able to perform a driving operation in a manual drive mode. The drive mode switching control device determines whether an operation performed by the driver is an emergency override operation or a non-emergency override operation. The drive mode switching control device outputs a switching signal for switching an automatic drive mode to the manual drive mode when a determination result by the driver state determination unit immediately before detection of the emergency override operation is that a driver's state is a state of being able to perform a driving operation in the manual drive mode.

Abstract: A state estimation apparatus includes an image obtaining unit that obtains a captured image from an imaging device placed to capture an image of a target person to be at a predetermined position, a first analysis unit that analyzes a facial behavior of the target person based on the captured image and obtains first information about the facial behavior of the target person, a second analysis unit that analyzes body movement of the target person based on the captured image and obtains second information about the body movement of the target person, and an estimation unit that estimates a state of the target person based on the first information and the second information.

Abstract: A concentration degree determination device includes: a monitoring data acquisition unit configured to acquire monitoring data from a sensor that monitors a driver of a vehicle; a concentration degree estimator configured to estimate a driving concentration degree of the driver from the monitoring data; a reference comparator configured to compare the driving concentration degree to a first reference when a driving mode of the vehicle is an automatic driving mode, and to compare the driving concentration degree to a second reference when the driving mode is a manual driving mode; and a signal output unit configured to output an instruction signal instructing performance of support to the driver when the driving mode is the automatic driving mode while the driving concentration degree does not satisfy the first reference, or when the driving mode is the manual driving mode while the driving concentration degree does not satisfy the second reference.

Abstract: A drive mode switch controller receives a switch request for switching from a manual drive mode to an automatic drive mode when switching the drive mode of a vehicle between the manual drive mode and the automatic drive mode. In response to the received switch request, the drive mode switch controller outputs a first switch signal for switching from the manual drive mode to the automatic drive mode, and a steering wheel operation command for disconnecting a steering wheel from wheels of the vehicle to allow the steering wheel to operate independently of the orientation of the wheels.

Abstract: Tracking a target object to be tracked included in a plurality of consecutively captured images is performed by an image processing apparatus. The image processing apparatus comprises an image acquisition unit and a tracking unit. The image tracking unit is configured to acquire an image. The tracking unit is configured to detect a target object to be tracked included in the image by matching and acquire over a plurality of the images an amount of movement of the target object to be tracked and a direction of the movement of the target object to be tracked. The tracking unit performs first matching by using a first template corresponding to the target object to be tracked, and performs second matching by using a second template, which is different in size or shape from the first template, in a case where a score of a result of the first matching is lower than a first threshold value.

Abstract: A driver state determination unit of a drive mode switching control device regularly or irregularly determines whether a driver's state is a state of being able to perform a driving operation in a manual drive mode. The drive mode switching control device determines whether an operation performed by the driver is an emergency override operation or a non-emergency override operation. The drive mode switching control device outputs a switching signal for switching an automatic drive mode to the manual drive mode when a determination result by the driver state determination unit immediately before detection of the emergency override operation is that a driver's state is a state of being able to perform a driving operation in the manual drive mode.

Abstract: An image analyzer repeatedly obtains a captured image including a subject to be detected, and detects, in the captured image, a first area likely to include the subject without a cover, detects, in the captured image, a second area likely to include the subject with a cover, and determines whether the subject is covered by the cover based on a detection result of the first area and a detection result of the second area and a determination result for the captured image obtained previously.

Abstract: An image processing apparatus includes a first learner trained to detect an orientation of a face in an image including a human face for receiving an input of a target image including a human face and outputting first information associated with an orientation of a face included in the target image, at least one second learner trained, for the first information, to detect a position of a facial component in an image including a human face for receiving an input of the target image and outputting second information associated with a position of a facial component included in the target image, and a control unit that controls the first learner and the second learner. The control unit uses the first learner to obtain the first information from the target image, and uses the second learner corresponding to the first information to obtain the second information from the target image.

Abstract: A driver monitoring apparatus according to an aspect of the present invention includes: an image obtaining unit that obtains a captured image from an imaging apparatus arranged so as to capture an image of a driver seated in a driver seat of a vehicle; an observation information obtaining unit that obtains observation information regarding the driver, the observation information including facial behavior information regarding behavior of a face of the driver; and a driver state estimating unit that inputs the captured image and the observation information to a trained learner that has been trained to estimate a degree of concentration of the driver on driving, and obtains, from the learner, driving concentration information regarding the degree of concentration of the driver on driving.

Abstract: An image processing apparatus tracks a target object included in a plurality of consecutively captured images. The image processing apparatus may include an image acquisition unit, a template acquisition unit, a masking map generation unit, and a tracking unit. The image acquisition unit acquires the image. The template acquisition unit acquires a template corresponding to the target object. The masking map generation unit generates a masking map that indicates a degree of masking of the target object by another object. The tracking unit detects the target object by using the template, and acquires an amount of movement of the target object and a direction of the movement of the target object, based on both of the template and the masking map.

Abstract: A driver state estimation device, which can precisely estimate a head position of a driver in the real world from an image, includes a monocular camera for picking up an image including a face of a driver, and a CPU including a head center position estimating section for estimating a head center position of the driver in the image using a three-dimensional face shape model fitted on the face of the driver in the image picked up by the monocular camera, and a distance estimating section for estimating a distance between an origin point located in a front direction of the driver's seat and a head center position of the driver in the real world, on the basis of the head center position of the driver in the image estimated and information including a specification and a position posture of the monocular camera.

Abstract: In a state where a tracking flag is on, a search controller determines, with respect to a previous frame, whether an amount of change in positional coordinates of a feature point of a face in the current frame is within a predetermined range, whether an amount of change in face orientation is within a predetermined angle range, and whether an amount of change in sight line direction is within a predetermined range. When the conditions are satisfied in all these determinations, the change in the detection result in the current frame with respect to the previous frame is considered as being within an allowable range, and continuously in a subsequent frame, detection processing for a face image is performed in accordance with a face image area saved in a tracking information storage unit.

Abstract: During tracking, a rough search is performed on a face image area detected in a current frame, and when the reliability of the result of the rough search is equal to or smaller than a threshold value, a value obtained by multiplying a reliability of a rough search result detected in one previous frame by a predetermined coefficient is set as a new threshold value, and it is determined whether or not the reliability of the rough search result detected in the current frame exceeds the newly set threshold value. Then, when the reliability of the rough search result exceeds the new threshold value, the decrease in reliability of the rough search result is considered as temporary, and a tracking flag is kept on while tracking information is also held.

Abstract: In a reference position determination unit, for example, a plurality of feature points of eyes and a nose of a face are detected by rough search from an image area including a driver's face extracted by a face area extractor with a rectangular frame. Based on the feature points of the respective organs, a position between eyebrows of the driver's face is detected, and this is determined as a reference position of the face. Then, a face area re-extractor corrects the position of the rectangular frame with respect to image data so that the determined reference position of the face is the center of the rectangular frame, and an image area including the face is re-extracted from the image data by using the rectangular frame in the corrected position.

Abstract: A concentration degree determination device includes: an information acquisition unit configured to acquire a driving concentration degree of a driver of a vehicle; a reference setting unit configured to set a first reference or a second reference higher than the first reference for a manual driving mode that is switched from an automatic driving mode based on at least one of a first driving concentration degree and running information during execution of the automatic driving mode; a reference comparator configured to compare a second driving concentration degree during execution of the manual driving mode to the first or second reference; and an information output unit configured to output information according to a comparison result.

Abstract: A concentration degree determination device includes: a monitoring data acquisition unit configured to acquire monitoring data from a sensor that monitors a driver of a vehicle; a concentration degree estimator configured to estimate a first driving concentration degree of the driver from the monitoring data based on at least one index constituting a first index group when a driving mode is automatic, and to estimate a second driving concentration degree of the driver from the monitoring data based on at least one index constituting a second index group when the driving mode is manual; a reference comparator configured to compare the first driving concentration degree or the second driving concentration degree to a reference; and a signal output unit configured to output an instruction signal instructing performance of support to the driver when the first driving concentration degree or the second driving concentration degree does not satisfy the reference.

Abstract: An obtaining unit obtains sensing data indicating a state of a driver from a monitoring sensor for monitoring the state of the driver. A determination unit determines a degree of concentration of the driver on driving based on the sensing data. A notification controller controls, when the determination unit determines that the degree of concentration satisfies a first criterion, a notification unit to notify, before the drive mode is switched, the driver that the drive mode will be switched to the automatic drive mode, and controls, when the determination unit determines that the degree of concentration does not satisfy the first criterion, the notification unit not to notify, before the drive mode is switched, the driver that the drive mode will be switched.