Abstract: In a sound source display system, an omnidirectional camera captures an image of a monitoring area. A microphone array collects a voice in the monitoring area. A monitoring monitor displays the image of an imaging area captured by the omnidirectional camera. A sound pressure calculator in a directivity control device calculates a sound pressure indicating a source of a sound in the image of the imaging area using voice data of the voice collected by the microphone array. An output controller in the directivity control device compares the sound pressure and threshold values (first threshold value, second threshold value), and causes sound image information in which the sound pressure is converted into visual information according to the result of comparison, to be displayed on the monitoring monitor so as to be superimposed on the image of the imaging area.

Abstract: A display system for displaying a sound source includes a microphone array configured to pick up a sound of the sound source, a display device a memory that stores instructions, and a processor that, when executing the instructions stored in the memory, performs a process. The process includes: processing a signal of the sound of the sound source picked up by the microphone array, visualizing the sound of the sound source picked up by the microphone array, determining a position of the sound source using data of the visualized sound of the sound source, generating an image indicating the position of the sound source, and displaying a direction of the position of the sound source on the display device when the position of the sound source indicated by the image is located outside a display range of the display device.

Abstract: In an object, for example, a pilotless flying object detection system, an omnidirectional camera as a first camera images a monitoring area. A microphone array acquires audio of the monitoring area. A monitoring apparatus uses the audio data acquired by the microphone array to detect a pilotless flying object which appears in the monitoring area. A signal processor in the monitoring apparatus superimposes a discrimination mark, obtained by converting the pilotless flying object into visual information, on image data of the monitoring area when displaying the image data of the monitoring area captured by the omnidirectional camera on a monitor.

Abstract: In a sound source display system, an omnidirectional camera captures an image of a monitoring area. A microphone array collects a voice in the monitoring area. A monitoring monitor displays the image of an imaging area captured by the omnidirectional camera. A sound pressure calculator in a directivity control device calculates a sound pressure indicating a source of a sound in the image of the imaging area using voice data of the voice collected by the microphone array. An output controller in the directivity control device compares the sound pressure and threshold values (first threshold value, second threshold value), and causes sound image information in which the sound pressure is converted into visual information according to the result of comparison, to be displayed on the monitoring monitor so as to be superimposed on the image of the imaging area.

Abstract: In an object, for example, a pilotless flying object detection system, an omnidirectional camera as a first camera images a monitoring area. A microphone array acquires audio of the monitoring area. A monitoring apparatus uses the audio data acquired by the microphone array to detect a pilotless flying object which appears in the monitoring area. A signal processor in the monitoring apparatus superimposes a discrimination mark, obtained by converting the pilotless flying object into visual information, on image data of the monitoring area when displaying the image data of the monitoring area captured by the omnidirectional camera on a monitor.

Abstract: In a directionality control system, a camera device captures a video of image capture area. A microphone array device collects a sound in image capture area. A signal processing section detects a sound source of the sound in image capture area, which is collected by the microphone array device. In a case where the detected sound source is within a range of privacy area, an output control section controls the sound in image capture area, which is collected by the microphone array device and is output from speaker device.

Abstract: In a pilotless flying object detection system, a masking area setter sets a masking area to be excluded from detection of a pilotless flying object which appears in a captured image of a monitoring area, based on audio collected by a microphone array. An object detector detects the pilotless flying object based on the audio collected by the microphone array and the masking area set by the masking area setter. An output controller superimpose sound source visual information, which indicates the volume of a sound at a sound source position, at the sound source position of the pilotless flying object in the captured image and displays the result on a first monitor in a case where the pilotless flying object is detected in an area other than the masking area.

Abstract: In an unmanned aerial vehicle detection system, an omnidirectional camera images a monitoring area. A microphone array picks up a sound in the monitoring area. A monitoring device detects an unmanned aerial vehicle appearing in the monitoring area using the sound data picked up by the microphone array. When displaying image data of the monitoring area captured by the omnidirectional camera on a monitor, a signal processor in the monitoring device superimposes an identification mark obtained by converting the unmanned aerial vehicle into visual information on the image data of the monitoring area.

Abstract: A sound source probing apparatus, including storage and processing circuitry, is provided that probes a direction of a sound source. The processing circuitry performs operations including determining a first correlation matrix that is a correlation matrix of acoustic signals acquired as observation signals by a microphone array including two or more microphones disposed apart from each other. The operations also include determining, by learning, weights such that a linear sum of a plurality of second correlation matrices multiplied by the respective weights is equal to the first correlation matrix where the plurality of second correlation matrices are correlation matrices, which are determined for respective directions determined based on an array arrangement of the microphone array and which are stored in advance in the storage.

Abstract: A directionality control system includes: a camera; a microphone provided as a separate body from the camera; a display that displays video data captured by the camera; and a processor that computes a sound collection direction, which is directed from the microphone toward a sound position corresponding to a designated position in the video data. The processor computes the sound collection direction by using parameters including: a first height of the camera from a reference surface, a second height of the microphone from the reference surface, a third height of a computation reference point from the reference surface, the computation reference point being positioned in the sound collection direction at a position different from the sound position, a direction which is directed from the camera toward the sound position, and a fourth height of the sound position from the reference surface.

Abstract: A sound source probing apparatus, including storage and processing circuitry, is provided that probes a direction of a sound source. The processing circuitry performs operations including determining a first correlation matrix that is a correlation matrix of acoustic signals acquired as observation signals by a microphone array including two or more microphones disposed apart from each other. The operations also include determining, by learning, weights such that a linear sum of a plurality of second correlation matrices multiplied by the respective weights is equal to the first correlation matrix where the plurality of second correlation matrices are correlation matrices, which are determined for respective directions determined based on an array arrangement of the microphone array and which are stored in advance in the storage.

Abstract: In a directionality control system, a camera device captures a video of image capture area (SA). A microphone array device collects a sound in image capture area (SA). A signal processing section detects a sound source of the sound in image capture area (SA) which is collected by the microphone array device. In a case where the detected sound source is within a range of privacy area (PRA), an output control section controls the sound in image capture area (SA) which is collected by the microphone array device and is output from speaker device (37).

Abstract: A directionality control system includes: a camera; a microphone provided as a separate body from the camera; a display that displays video data captured by the camera; and a processor that computes a sound collection direction, which is directed from the microphone toward a sound position corresponding to a designated position in the video data. The processor computes the sound collection direction by using parameters including: a first height of the camera from a reference surface, a second height of the microphone from the reference surface, a third height of a computation reference point from the reference surface, the computation reference point being positioned in the sound collection direction at a position different from the sound position, a direction which is directed from the camera toward the sound position, and a fourth height of the sound position from the reference surface.

Abstract: A sound and video processing system includes: a display, having a rectangular display region, that displays a video image in a circular video-image display region smaller than the rectangular display region; and a sound collector that collects sound. A processor generates emphasized audio data, in which sound is emphasized in at least one direction from a position of the sound collector toward at least one position corresponding to at least one designated location in the video image. In response to receiving designation outside the video-image display region, the processor displays a state display area or an adjustment operation area for the sound to be output from the speaker in a rectangular region which has a diagonal line extending from one of four corners of the rectangular display region to a center of the video-image display region and intersecting with a boundary line of the video-image display region.

Abstract: A sound and video processing system includes: a display that displays a video image captured by the camera; a sound collector that collects sound; an input device that receives designation of at least one designated location in the video image displayed on the display. A processor generates emphasized audio data, in which sound is emphasized in at least one direction from a position of the sound collector toward at least one position corresponding to the at least one designated location. The processor displays at least one identification shape at the at least one designated location. In response to receiving re-designation of one of the at least one designated location by the input device, the processor outputs audio data in which emphasis of sound stops in a direction from the position of the sound collector toward the position corresponding to the re-designated location.

Abstract: Sound collection directionality is formed toward a location corresponding to a position designated in a video of a predetermined region which is imaged by a camera apparatus with a microphone array apparatus as a reference, and audio data is collected with high accuracy. In a directionality control system (10), a signal processing unit (33) derives a sound collection direction (?MAh,?MAv) which is directed from an installation position of a microphone array apparatus (2) toward a sound position corresponding to a position designated in video data on a screen of the display device (36) in response to a user's designation of any position in the video data displayed on the screen. The signal processing unit (33) forms sound collection directionality of audio data in the derived sound collection direction (?MAh,?MAv).

Abstract: A recorder receives designation of a video which is desired to be reproduced from a user. If designation of one or more designated locations where sound is emphasized on a screen of a display which displays the video is received by the recorder from the user via an operation unit during reproduction or temporary stopping of the video, a signal processing unit performs an emphasis process on audio data, that is, the signal processing unit emphasizes audio data in directions directed toward positions corresponding to the designated locations from a microphone array by using audio data recorded in the recorder. A reproducing device reproduces the emphasis-processed audio data and video data in synchronization with each other.

Abstract: A first correlation matrix, which corresponds to observed signals, is calculated, a non-scan range is specified, a second correlation matrix, which corresponds to an acoustic signal from a sound source within the non-scan range, is estimated, a third correlation matrix, which corresponds to a target sound source within a scan range, is calculated by removing the second correlation matrix from the first correlation matrix, and a first spatial spectrum, which is a localization result, is calculated from the third correlation matrix. In the estimation, the second correlation matrix is estimated from direction vectors calculated from a direction range of the non-scan range and a second spatial spectrum, which is a localization result calculated immediately before the first spatial spectrum is calculated.

Abstract: In a pilotless flying object detection system, a masking area setter sets a masking area to be excluded from detection of a pilotless flying object which appears in a captured image of a monitoring area, based on audio collected by a microphone array. An object detector detects the pilotless flying object based on the audio collected by the microphone array and the masking area set by the masking area setter. An output controller superimpose sound source visual information, which indicates the volume of a sound at a sound source position, at the sound source position of the pilotless flying object in the captured image and displays the result on a first monitor in a case where the pilotless flying object is detected in an area other than the masking area.

Abstract: A first correlation matrix, which corresponds to observed signals, is calculated, a non-scan range is specified, a second correlation matrix, which corresponds to an acoustic signal from a sound source within the non-scan range, is estimated, a third correlation matrix, which corresponds to a target sound source within a scan range, is calculated by removing the second correlation matrix from the first correlation matrix, and a first spatial spectrum, which is a localization result, is calculated from the third correlation matrix. In the estimation, the second correlation matrix is estimated from direction vectors calculated from a direction range of the non-scan range and a second spatial spectrum, which is a localization result calculated immediately before the first spatial spectrum is calculated.