Abstract: There are provided a system and method of image-based relationship analysis, the method including: obtaining a set of target images each including one or more image representations of one or more individuals, obtaining, for each image representation, a corresponding vector representation, clustering the multiple vector representations to a plurality of clusters of vector representations corresponding to a plurality of unique individuals, and obtaining, for each target image, one or more unique individuals associated therewith, for each given target image of at least one subset of the set, obtaining a set of image parameters; generating a local relationship matrix using the set of image parameters, the local relationship matrix being representative of local mutual relationships between the one or more unique individuals, thereby obtaining a set of local relationship matrices, and generating a global relationship matrix by combining a set of local relationship matrices.