Data
Data Engineer. Builds the pipelines and platforms that make data ready for analytics and AI.
Profile
- Area
- Data
- Skills
- SQL, Python, Data modeling, ETL / ELT, Streaming, Data quality and governance, Cloud data platforms, Data engineering for AI
- Technologies
- Apache Spark, Databricks, Snowflake, BigQuery, dbt, Airflow, Kafka, Delta Lake / Iceberg
What they do
- Design batch and streaming pipelines
- Model data lakes, warehouses and lakehouses
- Ensure data quality, lineage and governance
- Prepare data for ML and RAG (chunking, embeddings)
- Migrate and modernize data platforms to cloud
- Optimize storage and compute cost