If you're already using parquet, it might be worth looking at the concept of dat...

		mkane on Sept 25, 2022 \| parent \| context \| favorite \| on: Run SQL on CSV, Parquet, JSON, Arrow, Unix Pipes a... If you're already using parquet, it might be worth looking at the concept of datasets e.g. https://arrow.apache.org/docs/python/generated/pyarrow.parqu...