Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
polishedmercury's avatar
@polishedmercury

Apache Airflow & AWS Glue Data Engineer

$2,400/mo

Ivano-Frankivsk

Experience: 9 yearsOpen to: Ivano-Frankivsk·

Wigi highlights

8+ years, currently Mid-level Apache Airflow & AWS Glue Data Engineer

Creates ETL/ELT solutions with SparkSQL, AWS Athena and AWS Glue

Collected scientific and medical data from web pages or large PDFs

In the current role, they write and set Airflow Dags and optimize Spark jobs.

During a previous tenure, also wrote ETL pipelines and supported existing ones for a data platform that uses AI and machine learning to automatically forecast electricity consumption and generation of individual endpoints or aggregated portfolios, using the client’s platform to build energy forecasts. Skills include Apache Kafka, AWS Lambda, Data Marts, Elasticsearch and MySQL.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
AWS GlueAWS Glue
JiraJira
PythonPython
SQLSQL
ElasticsearchElasticsearch
AWSAWS
AWS LambdaAWS Lambda
Amazon S3Amazon S3
Apache AirflowApache Airflow
Apache SparkApache Spark
Apache KafkaApache Kafka
MySQLMySQL
PostgreSQLPostgreSQL
TableauTableau
PandasPandas
Azure DevOpsAzure DevOps
Microsoft ExcelMicrosoft Excel
GitGit
Tools & workflows
Data Marts
AWS Athena
Work experience
· 6 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Python Software Engineer - Big Data & Web Harvesting

Company hidden · 1-3 years

Content ROI Analyst

Company hidden · 1-3 years

PM Associate

Company hidden · under 1 year

PhD Researcher

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 6
  • education· 2

Similar available Data Engineers

View all