Abstract: A method for managing products in a refrigerator comprises the steps of: registering user information including a face image, in association with at least one vendor; after a refrigerator door is opened, photographing an external area around the refrigerator and then recognizing a user's face; while the door is closed after the opening of the refrigerator door, photographing the inside of a storage chamber of the refrigerator and processing the captured image to acquire product information of a product taken; storing the acquired product information of the taken product as a product use history, in association with the recognized user's face; and when receiving a user input, displaying a purchase recommendation product list per user with information of an associated vendor on the basis of the product use history. In an embodiment of the present invention, a refrigerator to which an IOT is applied may be provided.

Abstract: A mobile terminal may include a camera, a display unit, and a processor configured to: determine whether two markers attached to two doors are present from an image captured through the camera; when the two markers are present, acquire center points of the two markers; acquire a y-axis pixel distance difference between the acquired center points; and estimate a height difference between the two doors based on the acquired y-axis pixel distance difference.

Abstract: An artificial intelligence refrigerator according to one embodiment of the present disclosure can comprise: an inner door; an outer door having a transparent display on the front surface thereof; one or more cameras provided to the outer door; a sensor for sensing the opening/closing or opening angle of the outer door; and one or more processors for determining whether the opening angle of the outer door is a preset angle when closing of the outer door is sensed, photographing the inner door through the one or more cameras when the opening angle of the outer door is the preset angle, acquiring, on the basis of a captured image, the storage state of food stored in the inner door, and displaying food management information on the transparent display on the basis of the acquired storage state.

Abstract: An artificial intelligent laundry treatment apparatus according to an embodiment of the present invention includes: a door including an external cover and an internal glass and configured to open and close a laundry entrance; a gasket formed on an inner circumferential surface of the laundry entrance; a door imaging sensor disposed to face the internal glass and configured to acquire a door image; a gasket imaging sensor configured to acquire a gasket image including a region of the gasket; and a processor configured to classify a state of the door on the basis of the door image, to acquire a gasket contamination degree on the basis of the gasket image, and to determine whether inside cleansing is required for a region including an inside of a drum on the basis of at least one of the classification result of the state of the door or the acquired gasket contamination degree.

Abstract: Disclosed herein is a washing machine including a door including an external cover and an internal glass to open and close a laundry entrance, at least one image sensor disposed to face the internal glass to acquire image data, a detergent bubble recognizer configured to recognize detergent bubble from the image data through a machine learning based image recognition model, and a controller configured to perform control to perform an additional rinsing cycle based on a result of recognition.

Abstract: The present invention relates to home appliances treating the laundry or object received therein using artificial intelligence. Specifically, the home appliance may include an artificial intelligence-based laundry washing machine that recognizes a load based on vision and automatically provides a specific course. The home appliance include a processor configured to: obtain a learning result from a learning operation using image information previously acquired using the camera and treatment information previously acquired from user interface; and process image information currently acquired using the camera with respect to the learning result, thereby to generate and set current treatment information; and control the home appliance to treat the object based on the set current treatment information.

Abstract: Disclosed is a method for providing user-customized food information. In the method for providing user-customized food information, when an input of a user is received, the user is classified, history related to the classified user is retrieved from among previously stored food entry/exit history, and information on preferred food of the classified user on the basis of the retrieved entry/exit history, thereby easily providing intuitive information on preferred food having a high usage frequency for each user. The device for providing user-customized food information of the present disclosure is linked to an artificial intelligence module, a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to a 5G service, and the like. Can be.

Abstract: The present invention relates to an artificial intelligence-based clothing management apparatus for receiving clothes in a hung state and treating the clothes, and a control method thereof. The apparatus may include an clothing containing portion disposed in a cabinet for receiving clothing to be treated in a hung manner; a camera to generate image information of the clothing contained in the clothing containing portion; a user interface configured to receive treatment information of the clothing from a user; and a processor configured to: obtain a learning result from a learning operation using image information previously acquired using the camera and treatment information previously acquired from the user interface; and process image information currently acquired using the camera with respect to the learning result, thereby to generate and set current treatment information; and control the apparatus to treat the clothing based on the set current treatment information.

Abstract: The present disclosure relates to a cooking device, and more particularly, to a cooking device in which a cooking target is accommodated in a cooking space to perform cooking. According to one embodiment of the present disclosure, a cooking device and its control method may be provided, wherein the cooking device comprises a cavity provided to accommodate a cooking target; a camera module configured to capture a first image of the cooking target located in the cavity; a heating module configured to heat the cooking target; an interface configured to receive an input including a cooking temperature and a cooking time; and a controller configured to: output a second image of the cooking target based on the received input, wherein the second image corresponds to a predicted image of the cooking target after cooking is finished; and control the camera module and the heating module based on the received input.

Abstract: An artificial intelligent laundry treatment apparatus according to an embodiment of the present invention includes: a door including an external cover and an internal glass and configured to open and close a laundry entrance; a gasket formed on an inner circumferential surface of the laundry entrance; a door imaging sensor disposed to face the internal glass and configured to acquire a door image; a gasket imaging sensor configured to acquire a gasket image including a region of the gasket; and a processor configured to classify a state of the door on the basis of the door image, to acquire a gasket contamination degree on the basis of the gasket image, and to determine whether inside cleansing is required for a region including an inside of a drum on the basis of at least one of the classification result of the state of the door or the acquired gasket contamination degree.

Abstract: A method for managing products in a refrigerator comprises the steps of: registering user information including a face image, in association with at least one vendor; after a refrigerator door is opened, photographing an external area around the refrigerator and then recognizing a user's face; while the door is closed after the opening of the refrigerator door, photographing the inside of a storage chamber of the refrigerator and processing the captured image to acquire product information of a product taken; storing the acquired product information of the taken product as a product use history, in association with the recognized user's face; and when receiving a user input, displaying a purchase recommendation product list per user with information of an associated vendor on the basis of the product use history. In an embodiment of the present invention, a refrigerator to which an IOT is applied may be provided.

Abstract: The present disclosure relates to a washing machine having a tub, a vibration sensor provided at the tub, a drum accommodating laundry therein and provided to be rotatable in the tub, and a controller configured to measure a value regarding multi-axis vibration occurring in the tub with the vibration sensor at a detection section in which the drum rotates at a specific rotational speed during a dewatering process, determine a predicted value of maximum vibration displacement expected to be generated in the tub based on the measured value, and determine whether to initialize the dewatering process at the detection section based on the determined predicted value of the maximum vibration displacement and a predetermined reference value.

Abstract: Disclosed is a method for providing user-customized food information. In the method for providing user-customized food information, when an input of a user is received, the user is classified, history related to the classified user is retrieved from among previously stored food entry/exit history, and information on preferred food of the classified user on the basis of the retrieved entry/exit history, thereby easily providing intuitive information on preferred food having a high usage frequency for each user. The device for providing user-customized food information of the present disclosure is linked to an artificial intelligence module, a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to a 5G service, and the like. Can be.

Abstract: Disclosed herein is a washing machine including a door including an external cover and an internal glass to open and close a laundry entrance, at least one image sensor disposed to face the internal glass to acquire image data, a detergent bubble recognizer configured to recognize detergent bubble from the image data through a machine learning based image recognition model, and a controller configured to perform control to perform an additional rinsing cycle based on a result of recognition.

Abstract: The present invention relates to an artificial intelligence-based clothing management apparatus for receiving clothes in a hung state and treating the clothes, and a control method thereof. The apparatus may include an clothing containing portion disposed in a cabinet for receiving clothing to be treated in a hung manner; a camera to generate image information of the clothing contained in the clothing containing portion; a user interface configured to receive treatment information of the clothing from a user; and a processor configured to: obtain a learning result from a learning operation using image information previously acquired using the camera and treatment information previously acquired from the user interface; and process image information currently acquired using the camera with respect to the learning result, thereby to generate and set current treatment information; and control the apparatus to treat the clothing based on the set current treatment information.

Abstract: The present invention relates to home appliances treating the laundry or object received therein using artificial intelligence. Specifically, the home appliance may include an artificial intelligence-based laundry washing machine that recognizes a load based on vision and automatically provides a specific course. The home appliance include a processor configured to: obtain a learning result from a learning operation using image information previously acquired using the camera and treatment information previously acquired from user interface; and process image information currently acquired using the camera with respect to the learning result, thereby to generate and set current treatment information; and control the home appliance to treat the object based on the set current treatment information.

Abstract: An air conditioner and a method for controlling an air conditioner are provided. The method may include acquiring a top view image for an indoor space using an imaging device and calculating a height of a ceiling in which an indoor device may be mounted; determining whether an image is a human body or an obstacle, with respect to at least one image included in the to view image; and performing control of the indoor device to allow air flow to avoid an obstacle and be discharged toward a human body by controlling driving of an indoor fan or one or more discharge vane provided in the indoor device.

Abstract: An air conditioner and a method for controlling an air conditioner are provided. The method may include acquiring a top view image for an indoor space using an imaging device and calculating a height of a ceiling in which an indoor device may be mounted; determining whether an image is a human body or an obstacle, with respect to at least one image included in the to view image; and performing control of the indoor device to allow air flow to avoid an obstacle and be discharged toward a human body by controlling driving of an indoor fan or one or more discharge vane provided in the indoor device.

Abstract: Disclosed herein is a method of simultaneously establishing the call connection among multi-users using a virtual sound field, in which when a plurality of users simultaneously make a video-telephone call to each other they can feel as if they conversed with each other in a real-space environment, and a computer-readable recording medium for implementing the same. The method comprises the steps of: a step of, when voice information is generated from any one of the plurality of speakers, separating image information, the voice information and position information of the speaker whose voice information is generated; a step of implementing the virtual sound field of the speaker using the separated position information of the speaker; and a step of displaying on the screen a result obtained by adding the implemented virtual sound field and the separated image information of the speaker together, and outputting the virtual sound field of the speaker through loudspeakers.

Abstract: Disclosed herein is a method of simultaneously establishing the call connection among multi-users using a virtual sound field, in which when a plurality of users simultaneously make a video-telephone call to each other they can feel as if they conversed with each other in a real-space environment, and a computer-readable recording medium for implementing the same. The method comprises the steps of: a step of, when voice information is generated from any one of the plurality of speakers, separating image information, the voice information and position information of the speaker whose voice information is generated; a step of implementing the virtual sound field of the speaker using the separated position information of the speaker; and a step of displaying on the screen a result obtained by adding the implemented virtual sound field and the separated image information of the speaker together, and outputting the virtual sound field of the speaker through loudspeakers.