Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
buffersparrow42's avatar
@buffersparrow42

Apache Spark Data Engineer, Also Skilled in Apache Airflow

$2,400/mo· Negotiable

Odesa

Experience: 5 yearsOpen to: Odesa·

Wigi highlights

4+ years, currently working as Mid-level Apache Spark Data Engineer

Built and managed scalable ETL/ELT pipelines with Python and Airflow

Implemented new Big Data processing approaches with Spark and Databricks

In the current role, developed an internal tool for automated data profiling and in-depth data visualization, reducing manual analysis effort, and designed, created and maintained data models for external data sources to support downstream analytics and reporting.

In a previous role, they also developed and maintained ETL pipelines using Python and PostgreSQL to process and transform structured data. Separate work as a data parsing specialist involved automating data ingestion processes using Python and Selenium to collect and structure web data for downstream analytics. General capabilities include Algorithms, Data Structures and Design Patterns.

Open to offers

Open to new opportunities

Skills
Tech stack
PythonPython
SQLSQL
Apache AirflowApache Airflow
Apache SparkApache Spark
AWSAWS
DockerDocker
LinuxLinux
DatabricksDatabricks
GitGit
JiraJira
Tools & workflows
NoSQL
ETL/ELT
Data Structures
Algorithms
Design Patterns
GCP
Data Modeling
Reporting
Data Visualization
Mathematics
Work experience
· 5 roles

Analytics Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

Data Parsing Specialist

Company hidden · under 1 year

Head of Engineering & Software Systems

Company hidden · under 1 year

Software Engineer and Research Analyst

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 9
  • education· 2

Similar available Data Engineers

View all