Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
mutablewasabi's avatar
@mutablewasabi

Scala Data Engineer / Spark2

$4,500/mo· Negotiable

Madrid

Experience: 10+ yearsOpen to: Madrid·

Wigi highlights

12+ years, currently working as Senior Scala Data Engineer

Managed the Cloudera Big Data ecosystem

Provided support to current users of GPT

In a past position, ingested large volumes of mobile network data from all probes across Spain in Avro, refined and normalized it with Scala/Spark/Kotlin processes, and stored it in Parquet. They also migrated processes to Amazon AWS.

Separate work involved planning and performing data ingestion from files and databases into HDFS in Avro and Parquet. Other contributions included integrating GPT2 with Oracle, Informix and SQL Server.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
ScalaScala
Apache SparkApache Spark
JavaScriptJavaScript
JavaJava
Oracle DatabaseOracle Database
Microsoft SQL ServerMicrosoft SQL Server
Java EEJava EE
MySQLMySQL
Apache HadoopApache Hadoop
Tools & workflows
Processing Large Volumes of Data
WebLogic
PL/SQL
Apache Ant
Apache Subversion
HBase
MapReduce
NoSQL
Flume
Work experience
· 6 roles

Data Systems Engineer

Company hidden · 3-5 years

Big Data Developer

Company hidden · 1-3 years

Data Pipeline Engineer

Company hidden · 1-3 years

Big Data Developer

Company hidden · 1-3 years

Software Development and Support Engineer

Company hidden · 3-5 years

Junior Software Developer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • education· 4

Similar available Data Engineers

View all