Abstract: Methods and systems for determining human-object interactions (HOIs) in images are provided. The method includes receiving an image. The method further includes detecting at least one human in the image, and at least one object in the image. The method further includes creating one or more proposals, wherein each proposal includes a human of the at least one human and an object of the at least one object. The method further includes determining whether an HOI exist in each of the one or more proposals. In some embodiments, the method further includes generating a mask for each proposal of the one or more proposals in which an HOI is determined to exist, the mask generated based on the determined HOI. In some embodiment, the HOI determination is based on one or more of extracted human feature information, extracted object appearance feature information, and extracted spatial feature information.