
Data Pipeline Engineer
New York City, NY
Wigi highlights
5+ years, currently operating as Junior Data Pipeline Engineer
Mined PostgreSQL data from AWS S3 and cleaned employee data
Analyzed employee reward data and advised business leads on portal improvements
Created table views using join, nested queries and group by operations in SQL to prepare 12 informational reports as per business needs. In a separate project, implemented an intrusion detection system using a PIR motion sensor, an Arduino Uno and a GSM module that alerts the owner with a call and text message.
Extracted and integrated live flight route data through various APIs to build a continually updated directed graph of airports using NetworkX; queried the real-time flight graph to discover dead-end airports, possible travel routes for aircraft, optimal transport paths using geographical distances with Geographiclib, and daily flight periodicity.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 6
- certifications· 4
- education· 2
Similar available Data Engineers
View all- Lead Data Engineer / Scalable Analytics Solutions · Coimbra, Portugal · 5 Yrs Exp · Hybrid · $3,900/mo
- Data Engineer, Real Estate Data Platform · Lviv, Ukraine · 8 Yrs Exp · Remote · $2,300/mo
- Azure Data Engineer (Amazon RDS, Microsoft Azure) · Belfast, UK · 8 Yrs Exp · Remote · $6,300/mo
- Data Engineer - Anti-Fraud Detection · Nice, France · 2 Yrs Exp · Hybrid · $6,100/mo
- Data Integration Engineer, Business Intelligence Solutions · Berlin, Germany · 10+ Yrs Exp · Remote · $7,700/mo