Data lake
nyc-taxi-data-lake-gcp
Processes the NYC TLC Trip Record Dataset (50M+ rows/month) with Dataproc + PySpark, writes optimized Parquet to GCS with Hive-style partitioning, serves via BigQuery external tables, and transforms with dbt.
Data lake
Processes the NYC TLC Trip Record Dataset (50M+ rows/month) with Dataproc + PySpark, writes optimized Parquet to GCS with Hive-style partitioning, serves via BigQuery external tables, and transforms with dbt.