Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
faundev's avatar
@faundev

Lead Data Engineer, AI-Driven Data Lake Architect

$4,000/mo

Gliwice

Experience: 5 yearsOpen to: Gliwice·

Wigi highlights

5+ years, currently working as Lead Data Engineer

Cut compute costs ~40% by moving pipelines to Databricks Workflows

Drove migrations to Azure and from Hive Metastore to Databricks Unity Catalog

Engineered scalable Delta Lake pipelines to ingest and process diverse formats from internal APIs and major external systems (SAP, Salesforce, Eloqua); spearheaded a company-wide unstructured data repository, architecting the infrastructure for parsing and embedding both structured and unstructured data and feeding it directly to AI agents via Model Context Protocols (MCPs).

Advises organizations on embedding AI into existing operations and designs scalable, AI-driven workflows, such as connecting enterprise systems with advanced AI agents via Model Context Protocols (MCPs), to automate processes and unlock new business capabilities; architects robust, secure data lakes and processing pipelines that serve as the foundation for enterprise AI, focusing on integrating complex data sources (both structured and unstructured) to ensure high-quality, reliable data feeds for advanced analytics and AI models.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
Apache SparkApache Spark
Azure Data FactoryAzure Data Factory
Microsoft AzureMicrosoft Azure
Azure DevOpsAzure DevOps
Tools & workflows
Data Parsing & Embedding
DataOps
CI/CD
Technical Leadership
AI Integration
Mentoring
Large Language Models (LLM)
MCP
Declarative Automation Bundles
Unstructured Data
Azure Databricks
Cloud Architecture
Cloud Computing
Databricks Products
Unity Catalog
Work experience
· 4 roles

Cloud and AI Solutions Consultant

Company hidden · 1-3 years

Lead Data Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 1-3 years

Professional Internship

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 4
  • education· 2

Similar available Data Engineers

View all