...dagster (orchestration), spark (calculation) and dbt...
All files are under the .parquet format for better reading performance than .csv. There are also files that stores .epub files in the format of abc.epub, where abc is the ISBN of the book. Similarly, abc.jpeg stores the image of the book.3.5...