Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
sprucetitan's avatar
@sprucetitan

Python & Apache Spark Data Engineer

$11,300/mo

Washington, DC

Experience: 8 yearsOpen to: Washington, DC·

Wigi highlights

7+ years, currently Senior Python & Apache Spark Data Engineer

Built real-time flight status pipelines with Apache Flink

Automated data quality checks in Snowflake, reducing manual workload

In the current role, machine learning models trained on Snowflake data were used to predict flight delays and suggest alternative routes, minimizing passenger disruption. Optimized Snowflake schema design, enhancing data retrieval efficiency for complex customer journey analyses and operational performance dashboards.

In a previous role, they also developed and enforced data governance frameworks in Snowflake to ensure HIPAA compliance and data security, protecting member health information. Managed complex data transformations at scale using Apache Spark and Airflow, enabling population health analysis, claims processing and cost analysis.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Microsoft AzureMicrosoft Azure
Microsoft SQL ServerMicrosoft SQL Server
PythonPython
Apache SparkApache Spark
Azure Data FactoryAzure Data Factory
Apache AirflowApache Airflow
Tools & workflows
Azure Databricks
Big Data
Work experience
· 4 roles

Senior Big Data Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

Data Analysis Expert

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all