Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
cedricring's avatar
@cedricring

Big Data Developer (Data Lakehouse Optimization)

$9,800/mo

New York City, NY

Experience: 5 yearsOpen to: New York City, NY·

Wigi highlights

5+ years, currently working as Mid-level Big Data Developer

Built scalable PySpark pipelines on Databricks

Created Spark SQL and HiveQL scripts for flight KPI reporting

Built dynamic SQL scripts and Power BI dashboards to deliver real-time KPIs and insights for marketing and supply chain decision-making; enabled region-level reporting, row-level security and ad hoc analytics through parameterized SQL views and role-based access controls.

In another role, built partitioned materialized views and star-schema models to power interactive dashboards and reduce query latency for business users. They also optimized ETL performance using Spark tuning, partitioning and legacy Hive-to-PySpark migration.

Open to offers

Open to new opportunities

Skills
Tech stack
DatabricksDatabricks
PythonPython
AWSAWS
Microsoft Power BIMicrosoft Power BI
Tools & workflows
Data Migration
Shell Scripting
Autosys
Teradata SQL
Teradata
Data Validation
Nonprofit Organizations
ETL Workflow
Data Pipelines
Data Enginner
PySpark
PL/SQL
ETL
Oracle HCM
BI Publisher
Data Engineering
Work experience
· 4 roles

Data Platform Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Consulting Associate

Company hidden · 1-3 years

Data Pipeline Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 1
  • education· 1

Similar available Data Engineers

View all