
@mutablewasabi
Scala Data Engineer / Spark2
$4,500/mo· Negotiable
Madrid
Wigi highlights
12+ years, currently working as Senior Scala Data Engineer
Managed the Cloudera Big Data ecosystem
Provided support to current users of GPT
In a past position, ingested large volumes of mobile network data from all probes across Spain in Avro, refined and normalized it with Scala/Spark/Kotlin processes, and stored it in Parquet. They also migrated processes to Amazon AWS.
Separate work involved planning and performing data ingestion from files and databases into HDFS in Avro and Parquet. Other contributions included integrating GPT2 with Oracle, Informix and SQL Server.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Tech stack
Tools & workflows
Processing Large Volumes of Data
WebLogic
PL/SQL
Apache Ant
Apache Subversion
HBase
MapReduce
NoSQL
Flume
Work experience
Unlocks when they connect with you.
- education· 4
Similar available Data Engineers
View all- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo
- Data Engineer (Geospatial & AI-driven Data Platforms) · Zurich, Switzerland · 10+ Yrs Exp · Remote · $9,900/mo
- Data Engineer (Data Infrastructure And Insight Enablement) · Berlin, Germany · 10+ Yrs Exp · Remote · $6,600/mo