
Sr. Scala Data Engineer | Apache Kafka
Raleigh, NC
Wigi highlights
12+ years, currently operating as Sr. Scala Data Engineer
Built an ETL framework with Talend-Big Data and Kafka for CDC ingestion
Automated Big Query provisioning and management with Terraform
In a previous role, developed an ingestion framework using Python to ingest data from LIS files into Snowflake, replacing a legacy application, and implemented Azure Data Factory pipelines to parse XML data and store it securely, ensuring data integrity, availability and seamless integration with telecommunications applications.
Separate work included developing a Spark streaming pipeline to read data from Kafka and write it to HDFS and a Spark framework using Scala to load data from various RDBMS and streaming sources into Hive.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 4
- education· 1
Similar available Data Engineers
View all- Data Engineer / Machine Learning & Data Visualization · Budapest, Hungary · 4 Yrs Exp · Remote · $2,300/mo
- Senior Data Engineer - NoSQL & Data Modeling · Parramatta, Australia · 10+ Yrs Exp · Hybrid · $7,000/mo
- Data Engineer, Cloud Data Platform Optimization · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo