
Apache Kafka & GCP Data Engineer
New York City, NY
Wigi highlights
4+ years, currently working as Mid-level Data Engineer
Built ELT pipelines that cut integration time from twelve months to three months
Engineered a real-time pipeline that cut data latency from hours to seconds
As part of the current role, built a scalable data enrichment pipeline using AWS Lambda to append third-party firmographic details to millions of contact records, directly powering Smart CRM features and improving lead scoring accuracy by 25%. They also optimized Snowflake compute configurations for high-volume AI workloads by implementing query clustering and auto-suspend policies, effectively reducing monthly cloud infrastructure costs by 15% while handling a 3x increase in data volume.
In an earlier role, eight years of historical customer data were also migrated from legacy on-premise systems to AWS Redshift using AWS Glue, optimizing ETL workflows to handle 2TB of financial records with zero data loss during transition.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 3
- certifications· 9
- education· 2
- Files· 2
Similar available Data Engineers
View all- Data Engineer / Machine Learning & Data Visualization · Budapest, Hungary · 4 Yrs Exp · Remote · $2,300/mo
- Senior Data Engineer - NoSQL & Data Modeling · Parramatta, Australia · 10+ Yrs Exp · Hybrid · $7,000/mo
- Data Engineer, Cloud Data Platform Optimization · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo