Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
summerperona's avatar
@summerperona

Data Integration Engineer (Scalable ETL Systems)

$10,700/mo· Negotiable

Beaumont, TX

Experience: 5 yearsOpen to: Beaumont, TX

Wigi highlights

5+ years, currently working as Mid-level Data Integration Engineer

Cut data load times from 60 to 15 minutes by optimizing queries

Migrated databases to AWS RDS and Redshift with minimal downtime

Designed and maintained SQL, MySQL and Snowflake queries, optimizing schema and performance for large-scale reporting systems, reducing query times by over 60%. Developed scalable backend applications using Python, Java, Django and FastAPI/Flask, incorporating RESTful API design, OOP principles and data processing libraries like NumPy and Pandas for performance and maintainability.

In a previous role, constructed scalable ETL/ELT pipelines using AWS Glue, PySpark and EMR, enabling high-throughput data processing and transformation into Redshift and RDS. They also implemented real-time streaming pipelines using AWS Kinesis, Kafka and SQS, improving latency and event-driven data processing capabilities.

Open to offers

Open to new opportunities

Skills
Tech stack
Amazon S3Amazon S3
FastAPIFastAPI
Amazon RDSAmazon RDS
DjangoDjango
KubernetesKubernetes
Tools & workflows
REST APIs
Scrum
DevOps
Work experience
· 3 roles

Python Software Engineer

Company hidden · 3-5 years

Software Engineer

Company hidden · 1-3 years

Python Developer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 1
  • education· 2
  • Files· 3

Similar available Data Engineers

View all