
Data Integration Engineer, Enterprise Data Ecosystems
Boston, MA
Wigi highlights
4+ years, currently working as Mid-level Data Integration Engineer
Implemented Java Kafka producers and consumers for reliable messaging
Used Puppet to manage Striim and Kafka reporting pipeline infrastructure
In the current role, Terraform was used for infrastructure as code (IaC) to automate and streamline deployment processes, and Grafana dashboards were built to provide actionable insights for live reporting.
They also refined the Kafka reporting pipeline's alert mechanism, enabling real-time alert visibility, and led on-call responsibilities in a scheduled week rotation for debugging production issues on the Kafka Connect reporting pipeline, Snowflake alerts and Striim pipelines, ensuring the reporting cluster's smooth functioning and proactively addressing any issues.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- Files· 3
Similar available Data Engineers
View all- Big Data Developer (Data Lakehouse Optimization) · New York City, NY · 5 Yrs Exp · Hybrid · $9,800/mo
- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo
- Data Engineer (Geospatial & AI-driven Data Platforms) · Zurich, Switzerland · 10+ Yrs Exp · Remote · $9,900/mo