Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
lyraenode's avatar
@lyraenode

Data Engineer / PySpark & Data Pipelines

$8,800/mo

Boston, MA

Experience: 5 yearsOpen to: Boston, MA·

Wigi highlights

5+ years, currently operating as Mid-level Data Engineer

Cut runtime by 79% and on-prem compute by 15%

Built an Azure ETL pipeline cutting issue resolution to same-day

Built an Azure-based finance customer analytics pipeline and Power BI dashboard analyzing 300K+ accounts, delivering retention and revenue metrics to FP&A leadership and enabling operational expansion decisions; refactored a complex SSIS-based FactInvoiceLine ETL into a SQL stored procedure, reducing ETL runtime by 50% and lowering compute utilization, improving performance of multi-dimension joins through optimized SQL logic and transformation restructuring.

Integrated Cloud Logging and Integration Cloud to predict recurring errors, automate resubmission of recoverable faults and trigger email notifications, reducing manual intervention by 85%; built a data integration pipeline following the acquisition of Cerner Healthcare, using Data Flow, Integration Cloud and REST Data Services, automating the extraction of Cerner opportunities data, seamlessly integrating it into Cloud and improving data load times by 40%.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
SnowflakeSnowflake
PythonPython
SQLSQL
Apache SparkApache Spark
TableauTableau
Microsoft Power BIMicrosoft Power BI
Microsoft FabricMicrosoft Fabric
Azure Data FactoryAzure Data Factory
Microsoft AzureMicrosoft Azure
Tools & workflows
Data Warehousing (DWH)
PL/SQL
ETL
Azure Data Lake
Data Pipelines
Cloud Computing
PySpark
Azure Databricks
Business Intelligence (BI)
Dimensional Modeling
Work experience
· 6 roles

Cloud Data Engineer (Azure)

Company hidden · under 1 year

Data Engineering Co-op

Company hidden · under 1 year

Teaching Assistant

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Engineering Trainee

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all
    Data Engineer (On-site) in Boston | Wigiwork