Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
vaporluigi's avatar
@vaporluigi

Data and Information Engineer

$6,000/mo

The Hague

Experience: 10+ yearsOpen to: The Hague·

Wigi highlights

10+ years, currently working as Mid-level Data and Information Engineer

Designed and built an ML fault-detection system for 62 stations

Migrated a 62-station IoT pipeline to a Databricks/PySpark medallion architecture

Built a unified Python KPI engine (OEE, MTBF, MTTR, TEEP) across 120+ stations, consolidating four legacy scripts into one CLI/scheduler with a 55-worker concurrent fetch pipeline. Designed distributed ELT pipelines using PySpark and Databricks Delta Lake, distributing validated pandas fault-detection logic across stations via applyInPandas execution, implementing partition pruning and broadcast joins to accelerate high-frequency telemetry processing.

In an earlier role, integrated IoT systems with existing ERP and SCADA platforms, ensuring seamless data flow and actionable insights across production lines. They also designed and implemented IoT-enabled condition monitoring systems for industrial bearings, leveraging sensors and edge devices to track vibration, temperature and wear in real time.

Open to offers

Open to new opportunities

Skills
Tech stack
FlaskFlask
PythonPython
Tools & workflows
Insights Hub
Databricks Workflows
PySpark
ETL Pipeline Design
Engineering Data Management
Databricks AWS
Data Architects
Data Loading
Statistical Data Analysis
Data Engineering
Reporting & Analysis
Asset Management
Integration and API
Node-RED
Problem Solving
IT Project Management
IT Program Management
Resource Allocation
Work experience
· 3 roles

Data Engineer

Company hidden · 1-3 years

Project Management Lead

Company hidden · 1-3 years

Trainee Engineer

Company hidden · 5-10 years

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 3
  • education· 3

Similar available Data Engineers

View all