Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
siriusartisan's avatar
@siriusartisan

Data Engineer, Regulated Banking Data Pipelines

$3,900/mo· Negotiable

Lisbon

Experience: 4 yearsOpen to: Lisbon·

Wigi highlights

3+ years, currently operating as Mid-level Data Engineer

Built PySpark pipelines unifying XML, JSON, CSV, Parquet and mainframe files

Automated energy certificate ingestion with scheduled Fabric pipelines

In the current role, built streaming pipelines from Kafka into Microsoft Fabric using PySpark Structured Streaming, with checkpointing and schema validation for reliable failure recovery. During a previous tenure, also designed Data Marts.

They also used Document Intelligence and GenAI for extraction and gathering of data. The listed certification is "Data Warehouse Developer-ETL T-SQL".

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Microsoft FabricMicrosoft Fabric
PythonPython
Microsoft SQL ServerMicrosoft SQL Server
Microsoft Power BIMicrosoft Power BI
PandasPandas
Tools & workflows
Document Intelligence
Gen AI
Engineering Data Management
Microsoft Power Automate
Cloud Computing
ETL
Data Warehouse Architecture
PL/SQL
AI Builder
Unix
Machine Learning (ML)
Data Analysis
Knowledge Engineering
Data Structure and Algorithms
Computer Networking
Work experience
· 4 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Analyst and Data Engineer

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Code Engineer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 1
  • education· 4

Similar available Data Engineers

View all