
Snowflake & PySpark Data Engineer
New York City, NY
Wigi highlights
7+ years, currently operating as Senior Data Engineer
Migrated ETL pipelines to cloud-native architecture
Implemented Data Factory ETL workflows, cutting data latency
Built Azure-based data pipelines, processing TBs of data from on-premise and cloud sources, improving data accessibility for analytics teams; leveraged Spark-based transformations in Azure Databricks with Delta Lake and adaptive query execution, ensuring fault-tolerant processing of terabyte-scale data.
In a previous role, also designed and implemented automated workflows using Power Automate, enabling seamless data synchronization and business process automation across multiple platforms including SAP, Salesforce and Microsoft 365 tools. They also improved performance by optimizing cluster runtime for streaming data processing.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 7
- education· 2
- Files· 2
Similar available Data Engineers
View all- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo
- Data Engineer (Automatisation Des Pipelines De Traitement) · Lyon, France · 6 Yrs Exp · Remote · $6,400/mo
- Data Engineer | QOps Expert · Dnipro, Ukraine · 10+ Yrs Exp · On-site · $3,100/mo