
Data Engineer, Cloud-Native Data Infrastructure Engineering
New York City, NY
Wigi highlights
8+ years, currently working as Mid-level Data Engineer
Designed ADF pipelines with PySpark for Snowflake ingestion
Implemented Control-M orchestration with DBT Cloud and Snowflake
In a past position, implemented Snowflake and DBT data models and performance tuning strategies, including clustering and query optimization, improving compute efficiency by 30%. They also rewrote over 50 legacy shell scripts in Python to enhance scalability and maintainability, developing data pipelines that streamlined data transformations and reduced processing time by 25%.
As a data engineering associate, developed and fine-tuned Spark applications, leading to a 40% decrease in data processing duration. In another role, developed and optimized Informatica mappings and workflows using transformations like Lookup, Joiner, Aggregator and Expression, boosting ETL performance by 25% and reducing data quality issues by 40%.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 3
- education· 2
Similar available Data Engineers
View all- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo
- Data Engineer (Automatisation Des Pipelines De Traitement) · Lyon, France · 6 Yrs Exp · Remote · $6,400/mo
- Data Engineer | QOps Expert · Dnipro, Ukraine · 10+ Yrs Exp · On-site · $3,100/mo