
Big Data Developer (Data Lakehouse Optimization)
New York City, NY
Wigi highlights
5+ years, currently working as Mid-level Big Data Developer
Built scalable PySpark pipelines on Databricks
Created Spark SQL and HiveQL scripts for flight KPI reporting
Built dynamic SQL scripts and Power BI dashboards to deliver real-time KPIs and insights for marketing and supply chain decision-making; enabled region-level reporting, row-level security and ad hoc analytics through parameterized SQL views and role-based access controls.
In another role, built partitioned materialized views and star-schema models to power interactive dashboards and reduce query latency for business users. They also optimized ETL performance using Spark tuning, partitioning and legacy Hive-to-PySpark migration.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 1
- education· 1
Similar available Data Engineers
View all- Data Engineer & Tech Lead · Katowice, Poland · 10+ Yrs Exp · Remote · $3,900/mo
- Data Engineer (Scalable Pipeline Engineering) · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Enterprise Data Integration Engineer · Hamburg, Germany · 8 Yrs Exp · Hybrid · $7,000/mo
- Data Engineer, Enterprise-Scale Data Processing Pipelines · Jena, Germany · 4 Yrs Exp · Remote · $5,500/mo
- Senior Data Engineer | ML | Google Cloud Platform · Kyiv, Ukraine · 8 Yrs Exp · Hybrid · $3,300/mo