Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
flinkchai's avatar
@flinkchai

Apache Spark Data Engineer / Amazon RDS

$4,200/mo· Negotiable

León

Experience: 5 yearsOpen to: León

Wigi highlights

4+ years, currently working as Mid-level Apache Spark Data Engineer

Develops ETL processes and data pipelines in Big Data environments

Defines and executes DAGs in Apache Airflow for automation

In the current role, they migrate databases from on-premise Oracle environments to cloud architectures on AWS and process and transform large volumes of data using Spark and PySpark.

In an earlier role, also developed a convolutional neural network for automatic welding image classification and trained and optimized deep learning models for defect detection in industrial welding processes.

Open to offers

Open to new opportunities

Skills
Tech stack
LinuxLinux
Apache SparkApache Spark
Microsoft Power BIMicrosoft Power BI
PandasPandas
ConfluenceConfluence
JiraJira
Amazon RDSAmazon RDS
PythonPython
AWSAWS
Tools & workflows
Jupyter
Analytical
JSON
ETL
Data Science
BMC Helix ITSM
Engineering Data Management (EDM)
Problem Solving
Data Analysis
Big Data Analytics
Work experience
· 2 roles

Data Systems Engineer

Company hidden · 3-5 years

Trainee

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 2
  • certifications· 1
  • education· 2

Similar available Data Engineers

View all