Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
asyncknight144's avatar
@asyncknight144

Senior Python & Apache Airflow Data Engineer

$2,500/mo

Bucharest

Experience: 10+ yearsOpen to: Bucharest·

Wigi highlights

10+ years, currently working as Senior Data Engineer

Processed large datasets with Azure Databricks and PySpark

Monitored production systems with GCP logging and monitoring

In the current role, designs and operates cloud-native data pipelines for analytics and reporting using PySpark and Spark SQL. During a previous tenure, they also built and maintained large-scale ETL/ELT pipelines using PySpark and Spark SQL on Databricks.

Other work included designing and implementing Retrieval-Augmented Generation (RAG) pipelines to enhance LLM responses with domain-specific knowledge from structured and unstructured data sources. Python-based ETL pipelines for data ingestion, transformation and analytics were also developed. Microsoft Azure is among the general capabilities.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Microsoft AzureMicrosoft Azure
PythonPython
Apache SparkApache Spark
Apache AirflowApache Airflow
DatabricksDatabricks
Tools & workflows
Azure Databricks
PySpark
Apache Spark SQL
Work experience
· 6 roles

Senior Big Data Engineer

Company hidden · 1-3 years

Senior Big Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Code Engineer

Company hidden · 1-3 years

Code Engineer

Company hidden · 1-3 years

Junior Coder - Software

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • education· 1

Similar available Data Engineers

View all