
Senior Databricks Data Engineer (Data Architecture)
New York City, NY
Wigi highlights
12+ years, currently operating as Senior Data Engineer
Migrated MapReduce jobs to Spark, improving processing speed
Led on-premises data infrastructure migration to cloud platforms
As a senior big data engineer, they design and manage end-to-end Databricks infrastructure, including cluster optimization, job orchestration and performance tuning, and build, optimize and maintain scalable data pipelines for batch and streaming workloads across multiple domains.
In an earlier role, also implemented real-time data streaming using Kafka, enabling timely insights and actionability, and leveraged Azure Cosmos DB for globally distributed, low-latency data storage and ensured seamless data access. The general capabilities include AWS, Azure Data Factory and Data Analytics.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 3
- education· 1
- Files· 1
Similar available Data Engineers
View all- Databricks Data Engineer | MDM · Lille, France · 7 Yrs Exp · Hybrid · $6,700/mo
- Data Engineer Associate | Machine Learning & SQL · Singapore · 8 Yrs Exp · Hybrid · $4,400/mo
- Big Data Developer (Data Lakehouse Optimization) · New York City, NY · 5 Yrs Exp · Hybrid · $9,800/mo
- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo