
@ridgehamster
Data Engineer - Apache Airflow & Data Quality
$9,400/mo
New York City, NY
Wigi highlights
4+ years, currently working as Mid-level Data Engineer
Built scalable data pipelines using Spark, Airflow and AWS
Implemented real-time streaming pipelines using Kafka
In the current role, optimized Snowflake data models and improved data quality using dbt.
During a previous tenure, they also developed ETL pipelines using AWS Glue, Spark and Python and built data models in Snowflake and Redshift for reporting.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
Kafka Topic Administration
Process Validation
Data Integration
Data Warehousing (DWH)
Azure Databricks
Data Science
Data Quality
AutoML
Machine Learning (ML)
Automated Processes
Secure Network Architecture
Data AI
Data Integrity
scikit-learn
Work experience
Unlocks when they connect with you.
- projects· 2
- certifications· 4
- education· 4
Similar available Data Engineers
View all- Data Engineer (Scalable Analytics Pipelines) · Paterson, NJ · 6 Yrs Exp · Remote · $11,300/mo
- Enterprise Data Enablement Engineer · Warsaw, Poland · 6 Yrs Exp · Hybrid · $3,800/mo
- Lead Data Engineer / Scalable Analytics Solutions · Coimbra, Portugal · 5 Yrs Exp · Hybrid · $3,900/mo
- Data Engineer, Real Estate Data Platform · Lviv, Ukraine · 8 Yrs Exp · Remote · $2,300/mo
- Azure Data Engineer (Amazon RDS, Microsoft Azure) · Belfast, UK · 8 Yrs Exp · Remote · $6,300/mo