
@siriusartisan
Data Engineer, Regulated Banking Data Pipelines
$3,900/mo· Negotiable
Lisbon
Wigi highlights
3+ years, currently operating as Mid-level Data Engineer
Built PySpark pipelines unifying XML, JSON, CSV, Parquet and mainframe files
Automated energy certificate ingestion with scheduled Fabric pipelines
In the current role, built streaming pipelines from Kafka into Microsoft Fabric using PySpark Structured Streaming, with checkpointing and schema validation for reliable failure recovery. During a previous tenure, also designed Data Marts.
They also used Document Intelligence and GenAI for extraction and gathering of data. The listed certification is "Data Warehouse Developer-ETL T-SQL".
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Tech stack
Tools & workflows
Document Intelligence
Gen AI
Engineering Data Management
Microsoft Power Automate
Cloud Computing
ETL
Data Warehouse Architecture
PL/SQL
AI Builder
Unix
Machine Learning (ML)
Data Analysis
Knowledge Engineering
Data Structure and Algorithms
Computer Networking
Work experience
Unlocks when they connect with you.
- certifications· 1
- education· 4
Similar available Data Engineers
View all- Data Engineer, Modernizing BI Data Infrastructure · Singapore · 10+ Yrs Exp · Remote · $5,700/mo
- Data Engineer (Real-Time Analytics Pipelines) · Białystok, Poland · 10+ Yrs Exp · Remote · $5,100/mo
- Data Engineer (Real-Time Well Analytics) · Nowy Sącz, Poland · 10+ Yrs Exp · On-site · $4,900/mo
- Senior Data Engineer (Data-Driven Campaign Optimization) · Amersfoort, Netherlands · 10+ Yrs Exp · On-site · $5,400/mo
- Data Engineer (Scalable Analytics Pipelines) · Paterson, NJ · 6 Yrs Exp · Remote · $11,300/mo