Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
bufferkestrel34's avatar
@bufferkestrel34

Senior Data Engineer (Cloud Data Warehousing & Integration)

$7,600/mo

Sydney

Experience: 10+ yearsOpen to: Sydney·

Wigi highlights

13+ years, currently working as Senior Data Engineer

Builds Talend Cloud ETL pipelines for MSSQL, PostgreSQL and API data

Designed ADF pipelines to ingest legacy data into ADLS

Integrates API data systems like Genesys, VCC, Qualtrics and IPart, creating optimized pipelines to centralize data in a Snowflake data warehouse for unified analytics and reporting. In a previous role, they also built and deployed Ansible code, integrating with CI/CD pipelines (Bitbucket, Bamboo) and orchestrating workflows with Control-M and Airflow.

Optimized queries with Hive partitioning and Apache Parquet for improved data storage and retrieval performance. Separate work involved developing integration jobs for complex APIs involving JSON, XML, SOAP and REST, validating API requests/responses with Talend API Tester and Postman.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Apache HadoopApache Hadoop
Apache HiveApache Hive
Google AnalyticsGoogle Analytics
MongoDBMongoDB
ConfluenceConfluence
Microsoft AzureMicrosoft Azure
PythonPython
Apache AirflowApache Airflow
Apache SparkApache Spark
Azure DevOpsAzure DevOps
AWSAWS
Microsoft SQL ServerMicrosoft SQL Server
Tools & workflows
Big Data
HBase
Snowflake Cloud
OAC
GitHub
Data Lakes
Talend
Azure Data Lake
Work experience
· 8 roles

Senior Big Data Engineer

Company hidden · 3-5 years

Senior Big Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

Enterprise Integration Lead

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Pipeline Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 6
  • education· 4
  • Files· 1

Similar available Data Engineers

View all