Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
proudprolog's avatar
@proudprolog

Data Engineer — FAISS & Natural Language Processing (NLP)

$5,700/mo

Paris

Experience: 4 yearsOpen to: Paris·

Wigi highlights

4+ years, currently working as Mid-level Data Engineer

Cut unclassified materials from 45% to 10% with an NLP pipeline

Built a Supplier Single Source of Truth for 200k+ suppliers

Implemented Data Governance, Data Quality and MDM rules, detecting duplicates, orphan records and business rule violations across millions of master data attributes; built scalable ETL pipelines in PySpark on Azure Databricks, following the Medallion Architecture, with daily incremental processing and historical versioning via Delta Lake.

Designed multi-source ingestion pipelines (SharePoint, CSV, Excel) processing tens of thousands of records per cycle, with schema validation and normalization; industrialized an end-to-end NLP pipeline (SAP → embeddings → FAISS → inference) with batch processing, incremental indexing and Databricks integration.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
Azure Data FactoryAzure Data Factory
SnowflakeSnowflake
PyTorchPyTorch
Apache SparkApache Spark
Microsoft AzureMicrosoft Azure
TensorFlowTensorFlow
Apache HadoopApache Hadoop
ScalaScala
PandasPandas
Tools & workflows
Transformers
Fine Tuning
Quantized Low-Rank Adaptation (QLoRA)
FAISS
MapReduce
CI/CD
Natural Language Processing (NLP)
Modeling
Polar
ETL
Work experience
· 4 roles

Data Systems Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · under 1 year

Airframe Systems Engineer

Company hidden · under 1 year

Trainee

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • education· 3

Similar available Data Engineers

View all