Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
jovialkiki's avatar
@jovialkiki

Snowflake & PySpark Data Engineer

$11,300/mo· Negotiable

New York City, NY

Experience: 8 yearsOpen to: New York City, NY·

Wigi highlights

7+ years, currently operating as Senior Data Engineer

Migrated ETL pipelines to cloud-native architecture

Implemented Data Factory ETL workflows, cutting data latency

Built Azure-based data pipelines, processing TBs of data from on-premise and cloud sources, improving data accessibility for analytics teams; leveraged Spark-based transformations in Azure Databricks with Delta Lake and adaptive query execution, ensuring fault-tolerant processing of terabyte-scale data.

In a previous role, also designed and implemented automated workflows using Power Automate, enabling seamless data synchronization and business process automation across multiple platforms including SAP, Salesforce and Microsoft 365 tools. They also improved performance by optimizing cluster runtime for streaming data processing.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
LookerLooker
TableauTableau
NumPyNumPy
PandasPandas
Microsoft AzureMicrosoft Azure
SnowflakeSnowflake
ScalaScala
PostgreSQLPostgreSQL
dbtdbt
JiraJira
Apache HiveApache Hive
Tools & workflows
MLOps
Natural Language Processing (NLP)
Large Language Models (LLM)
Generative AI for Services Professionals
Applied Machine Learning (ML)
GCP
PySpark
NoSQL
Oracle
Work experience
· 3 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 7
  • education· 2
  • Files· 2

Similar available Data Engineers

View all