Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
woodlandpiccolo's avatar
@woodlandpiccolo

Big Data Engineer, Enterprise Data Warehousing

$4,300/mo

Kraków

Experience: 7 yearsOpen to: Kraków·

Wigi highlights

6+ years, most recently Senior Big Data Engineer

Implemented multi-stage PySpark jobs on AWS EMR

Optimized AWS EMR configurations for large-volume PySpark data

Developed Spark applications using Python (PySpark) to process large-scale structured and unstructured datasets; orchestrated end-to-end Spark workflows on AWS EMR using AWS Step Functions.

Education includes a Master of Computer Applications - MCA. General capabilities include Apache Hadoop, /SQL and scoop.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Apache SparkApache Spark
Apache HadoopApache Hadoop
AWSAWS
Apache HiveApache Hive
Amazon S3Amazon S3
SQLSQL
PythonPython
Tools & workflows
Large-Scale Data Processing
scoop
PL/SQL
PySpark
Work experience
· 1 role

Data Pipeline Engineer

Company hidden · 5-10 years

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all