Abstract: Artificial intelligence avatar-based interaction service is performed in a system including an unmanned information terminal and an interaction service device. A sound signal is collected from a microphone array mounted in the unmanned information terminal and an image signal collected from a vision sensor to the interaction service device. A sensing area is set based on the received sound signal and image signal by the interaction service device; recognizing an active speaker based on a voice signal of a user and an image signal of the user collected in the sensing area, by the interaction service device. A response for the recognized active speaker is generated to provide a 3D rendering an artificial intelligence avatar to which the response is reflected. The rendered artificial intelligence avatar is provided to the unmanned information terminal by the interaction service device.