Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
softalioth86's avatar
@softalioth86

Apache Kafka & GCP Data Engineer

$9,400/mo· Negotiable

New York City, NY

Experience: 4 yearsOpen to: New York City, NY·

Wigi highlights

4+ years, currently working as Mid-level Data Engineer

Built ELT pipelines that cut integration time from twelve months to three months

Engineered a real-time pipeline that cut data latency from hours to seconds

As part of the current role, built a scalable data enrichment pipeline using AWS Lambda to append third-party firmographic details to millions of contact records, directly powering Smart CRM features and improving lead scoring accuracy by 25%. They also optimized Snowflake compute configurations for high-volume AI workloads by implementing query clustering and auto-suspend policies, effectively reducing monthly cloud infrastructure costs by 15% while handling a 3x increase in data volume.

In an earlier role, eight years of historical customer data were also migrated from legacy on-premise systems to AWS Redshift using AWS Glue, optimizing ETL workflows to handle 2TB of financial records with zero data loss during transition.

Open to offers

Open to new opportunities

Skills
Tech stack
RedisRedis
Apache CassandraApache Cassandra
DockerDocker
Apache KafkaApache Kafka
MinIOMinIO
Microsoft SQL ServerMicrosoft SQL Server
Apache HiveApache Hive
Apache HadoopApache Hadoop
Tools & workflows
Easily Adaptable
Risk Analytics
Exploratory Data Analysis (EDA)
Business Analytics
GCP
Quantitative Analytics
NoSQL
Database Management Systems (DBMS)
PySpark
Excel Solver
Work experience
· 3 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Pipeline Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 3
  • certifications· 9
  • education· 2
  • Files· 2

Similar available Data Engineers

View all