Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
vividlois's avatar
@vividlois

Apache Airflow Analytics Engineer, Data Pipelines

$12,500/mo

New York City, NY

Experience: 6 yearsOpen to: New York City, NY·

Wigi highlights

5+ years, currently working as Senior Analytics Engineer

Engineered 25+ AWS ETL/ELT pipelines processing 18M+ records daily

Designs 12+ Azure ETL/ELT pipelines processing about 9M records daily

As a data analytics engineer, reusable PySpark and Spark transformation frameworks are built to support 20+ workflows for cleansing, enrichment, deduplication, aggregation and business-rule processing across structured and semi-structured data. In a previous role as a data systems engineer, they also developed and maintained 18+ AWS ETL/ELT pipelines using Amazon S3, AWS Glue, Python, SQL, PySpark, Apache Spark and Airflow, processing approximately 7 million healthcare records daily from 10+ source systems.

Other work included building and optimizing 40+ Spark/SQL workloads and 30+ dimensional models, implementing 50+ data-quality controls for reliable investment, custody and analytics data and GenAI retrieval pipelines. Also designed 30+ dimensional models and dbt transformations in Amazon Redshift, integrating 20+ fact and dimension tables and implementing 50+ automated reconciliation and data-quality controls for asset servicing datasets and RAG-based AI systems. General capabilities include Decision Support, Financial Forecasting, Pivot Tables and Python.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Apache AirflowApache Airflow
Microsoft ExcelMicrosoft Excel
XGBoostXGBoost
Microsoft Power BIMicrosoft Power BI
PythonPython
SnowflakeSnowflake
SQLSQL
Tools & workflows
Financial Forecasting
Decision Support
Business Intelligence (BI)
Data Pipelines
Stored Procedures
T-SQL
Dimensional Modeling
Risk Analytics
ETL
Data Governance
Pivot Tables
Data Engineering
Data Analysis
Work experience
· 4 roles

Data Analytics Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Junior Data Analysis Associate

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • projects· 10
  • certifications· 10
  • education· 2

Similar available AI Engineers

View all