
Data Integration Engineer (Scalable ETL Systems)
Beaumont, TX
Wigi highlights
5+ years, currently working as Mid-level Data Integration Engineer
Cut data load times from 60 to 15 minutes by optimizing queries
Migrated databases to AWS RDS and Redshift with minimal downtime
Designed and maintained SQL, MySQL and Snowflake queries, optimizing schema and performance for large-scale reporting systems, reducing query times by over 60%. Developed scalable backend applications using Python, Java, Django and FastAPI/Flask, incorporating RESTful API design, OOP principles and data processing libraries like NumPy and Pandas for performance and maintainability.
In a previous role, constructed scalable ETL/ELT pipelines using AWS Glue, PySpark and EMR, enabling high-throughput data processing and transformation into Redshift and RDS. They also implemented real-time streaming pipelines using AWS Kinesis, Kafka and SQS, improving latency and event-driven data processing capabilities.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 1
- education· 2
- Files· 3
Similar available Data Engineers
View all- Data Integration Engineer, Business Intelligence Solutions · Berlin, Germany · 10+ Yrs Exp · Remote · $7,700/mo
- Data Engineer, Cross-Sector Analytical Infrastructure · Birmingham, UK · 10+ Yrs Exp · Remote · $6,100/mo
- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo
- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo