Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
mangabronco's avatar
@mangabronco

Apache Airflow & PySpark Big Data Engineer

$4,300/mo

Porto

Experience: 8 yearsOpen to: Porto

Wigi highlights

5+ years, currently operating as Senior Big Data Engineer

Developed big data pipelines with PySpark, Hive and Iceberg

Built streaming pipelines with Kafka and Firehose

As a data systems engineer, developed change data capture pipelines with Debezium and ETL pipelines.

In a data scientist internship, they also automated the machine health report API for collecting data. Separate work as a data insight analyst included developing ETL pipelines for equipment health evaluation.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
RedisRedis
GrafanaGrafana
Apache AirflowApache Airflow
SQLSQL
PythonPython
Apache KafkaApache Kafka
KubernetesKubernetes
PostgreSQLPostgreSQL
Amazon RDSAmazon RDS
Amazon S3Amazon S3
Apache HadoopApache Hadoop
LinuxLinux
AWSAWS
GitGit
DockerDocker
Apache SparkApache Spark
Amazon RedshiftAmazon Redshift
Microsoft ExcelMicrosoft Excel
RR
TableauTableau
Work experience
· 6 roles

Data Pipeline Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Insight Analyst

Company hidden · under 1 year

Data Scientist - Associate

Company hidden · under 1 year

Data Scientist Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 14
  • education· 2

Similar available Data Engineers

View all