Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
integerllama's avatar
@integerllama

Senior ML Infrastructure Engineer

$6,000/mo

Chester

Experience: 9 yearsOpen to: Chester·

Wigi highlights

8+ years, currently working as Senior ML Infrastructure Engineer

Architected a Kafka-to-Snowflake pipeline handling 1.2 million CASA transactions per hour

Replaced 30+ Snowflake SQL jobs with automated Airflow DAGs

In the current role, built data pipelines using Python and dbt to automate ETL/ELT into Snowflake and set up CI/CD pipelines for versioning and automated deployment of Databricks notebooks and Spark jobs.

In a previous role, they also transformed complex MySQL ETL processes into optimized Spark SQL, reducing execution time from 6-8 hours, and increased Spark development efficiency by 50% through test automation with Pytest. The general capabilities include AWS, AWS SageMaker, Azure Data Engineer and Azure DevOps.

Open to offers

Open to new opportunities

Skills
Tech stack
Apache AirflowApache Airflow
dbtdbt
SnowflakeSnowflake
AWSAWS
Azure DevOpsAzure DevOps
Tools & workflows
AWS SageMaker
Databricks MLOps
Databricks Platform Engineering
Azure Data Engineer
CI/CD Automation
Infrastructure as Code (Terraform)
Unity Catalog
DataOps
Shoe Recommendation System
Google BigQuery
GKE
GCP
Delta Live Table
Databricks Asset Bundle
Mlfow
Work experience
· 5 roles

Senior Data Platform Engineer

Company hidden · 1-3 years

Senior Data Scientist - Systems Design

Company hidden · under 1 year

Manager

Company hidden · 3-5 years

Senior Systems Developer

Company hidden · under 1 year

Senior Systems Developer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 1

Similar available MLOps Engineers

View all