Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
ridgehamster's avatar
@ridgehamster

Data Engineer - Apache Airflow & Data Quality

$9,400/mo

New York City, NY

Experience: 4 yearsOpen to: New York City, NY·

Wigi highlights

4+ years, currently working as Mid-level Data Engineer

Built scalable data pipelines using Spark, Airflow and AWS

Implemented real-time streaming pipelines using Kafka

In the current role, optimized Snowflake data models and improved data quality using dbt.

During a previous tenure, they also developed ETL pipelines using AWS Glue, Spark and Python and built data models in Snowflake and Redshift for reporting.

Open to offers

Open to new opportunities

Skills
Tech stack
dbtdbt
Apache AirflowApache Airflow
Amazon CloudWatchAmazon CloudWatch
YAMLYAML
Amazon S3Amazon S3
SnowflakeSnowflake
Tools & workflows
Kafka Topic Administration
Process Validation
Data Integration
Data Warehousing (DWH)
Azure Databricks
Data Science
Data Quality
AutoML
Machine Learning (ML)
Automated Processes
Secure Network Architecture
Data AI
Data Integrity
scikit-learn
Work experience
· 2 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • projects· 2
  • certifications· 4
  • education· 4

Similar available Data Engineers

View all