
Data Engineer — FAISS & Natural Language Processing (NLP)
Paris
Wigi highlights
4+ years, currently working as Mid-level Data Engineer
Cut unclassified materials from 45% to 10% with an NLP pipeline
Built a Supplier Single Source of Truth for 200k+ suppliers
Implemented Data Governance, Data Quality and MDM rules, detecting duplicates, orphan records and business rule violations across millions of master data attributes; built scalable ETL pipelines in PySpark on Azure Databricks, following the Medallion Architecture, with daily incremental processing and historical versioning via Delta Lake.
Designed multi-source ingestion pipelines (SharePoint, CSV, Excel) processing tens of thousands of records per cycle, with schema validation and normalization; industrialized an end-to-end NLP pipeline (SAP → embeddings → FAISS → inference) with batch processing, incremental indexing and Databricks integration.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- education· 3
Similar available Data Engineers
View all- Data Engineer, Cloud Data Platform Optimization · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo
- Data Engineer (Spatial Data Pipelines) · Lille, France · 4 Yrs Exp · Remote · $5,500/mo
- Data Engineer, Data Pipeline Optimization · Lille, France · 9 Yrs Exp · Remote · $5,800/mo