Weather Data Pipeline: OpenWeatherMap to BigQuery
An Airflow pipeline that loads weather data for 5 Indonesian cities into BigQuery every 6 hours, with dbt models and a data quality audit.
Data Engineer · Bogor
Building reliable batch pipelines with Airflow, Kestra, dbt, and BigQuery
Informatics Engineering fresh graduate (GPA 3.57) with experience handling weather, geospatial/satellite imagery, and carbon registry data
Fresh graduate — Data Engineer intern since Oct 2025
An Airflow pipeline that loads weather data for 5 Indonesian cities into BigQuery every 6 hours, with dbt models and a data quality audit.
Source
OpenWeatherMap API
weather data for 5 Indonesian cities
Ingest
Airflow
DAG scheduled every 6 hours
Transform
dbt
staging, dimension, and partitioned fact models (24 tests passing)
Storage
BigQuery
partitioned fact table
An Airflow pipeline that loads weather data for 5 Indonesian cities into BigQuery every 6 hours, with dbt models and a data quality audit.
A batch pipeline that loads NYC Taxi data into PostgreSQL and BigQuery with MD5 + MERGE deduplication, orchestrated by Kestra and provisioned with Terraform.
Processes per-90-minute stats for 1,827 players into 35 features, clusters them into 5 playing-style archetypes with K-Means, and serves them through a Streamlit app.
Oct 2025 – present
D4 (S.Tr.Kom.) Informatics Engineering
Sep 2022 – Sep 2026 · IPK 3.57 / 4.00
Relevant courses: Database, Data Mining, Cloud Computing, Artificial Intelligence, Probability and Statistics
Thesis: U-Net Multimodal with Grad-CAM Explainability for Land Use/Land Cover Classification
JTIIK, Universitas Brawijaya · SINTA 2
second author
Accepted Oct 2026 (in production)
Nuansa Informatika, Vol. 19 No. 1 (2025), pp. 31–38 · SINTA 5
I'm open to Data Engineer roles, full-time or internship. [adjust location/remote preference if needed]