
Apache Airflow Analytics Engineer, Data Pipelines
New York City, NY
Wigi highlights
5+ years, currently working as Senior Analytics Engineer
Engineered 25+ AWS ETL/ELT pipelines processing 18M+ records daily
Designs 12+ Azure ETL/ELT pipelines processing about 9M records daily
As a data analytics engineer, reusable PySpark and Spark transformation frameworks are built to support 20+ workflows for cleansing, enrichment, deduplication, aggregation and business-rule processing across structured and semi-structured data. In a previous role as a data systems engineer, they also developed and maintained 18+ AWS ETL/ELT pipelines using Amazon S3, AWS Glue, Python, SQL, PySpark, Apache Spark and Airflow, processing approximately 7 million healthcare records daily from 10+ source systems.
Other work included building and optimizing 40+ Spark/SQL workloads and 30+ dimensional models, implementing 50+ data-quality controls for reliable investment, custody and analytics data and GenAI retrieval pipelines. Also designed 30+ dimensional models and dbt transformations in Amazon Redshift, integrating 20+ fact and dimension tables and implementing 50+ automated reconciliation and data-quality controls for asset servicing datasets and RAG-based AI systems. General capabilities include Decision Support, Financial Forecasting, Pivot Tables and Python.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- projects· 10
- certifications· 10
- education· 2
Similar available AI Engineers
View all- AI Automation Engineer (n8n, Python) · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- AI Platform Engineer - Knowledge Systems & LLMs / RAG · Prague, Czechia · 4 Yrs Exp · Remote · $11,300/mo
- AI-Driven Conversational Systems Engineer · Amsterdam, Netherlands · 4 Yrs Exp · Remote · $6,400/mo
- AI Software Developer, AI-Driven User Experiences · Madrid, Spain · 7 Yrs Exp · Hybrid · $4,300/mo
- AI Solutions Engineer - Cloud Computing & Solution Selling · Warsaw, Poland · 10+ Yrs Exp · Hybrid · $6,400/mo