Abstract: Systems and methods extract flat data units from a non-flat input, such as a spreadsheet comprising tables organized according to a hierarchy. First, the non-flat input is read (e.g., using pandas in combination with openpyxl) to create a flat dataframe comprising the content of the non-flat input. Next, individual flat data units (e.g., spreadsheet tables) are recognized and split from the dataframe based upon the appearance of blank rows and/or columns. Headers present in the flat data units are determined (e.g., based upon alphabetic cell text, bolded cell text, and/or early position of the cell in a column), and then connections between the flat data units are identified. Based upon the connections, individual flat data units are merged together. The resulting merged flat data units are subsequently available for consumption, for example user reports of content, and/or conversion to a new non-flat format (e.g., relational database schema).

Abstract: Systems and methods extract flat data units from a non-flat input, such as a spreadsheet comprising tables organized according to a hierarchy. First, the non-flat input is read (e.g., using pandas in combination with openpyxl) to create a flat dataframe comprising the content of the non-flat input. Next, individual flat data units (e.g., spreadsheet tables) are recognized and split from the dataframe based upon the appearance of blank rows and/or columns. Headers present in the flat data units are determined (e.g., based upon alphabetic cell text, bolded cell text, and/or early position of the cell in a column), and then connections between the flat data units are identified. Based upon the connections, individual flat data units are merged together. The resulting merged flat data units are subsequently available for consumption, for example user reports of content, and/or conversion to a new non-flat format (e.g., relational database schema).