Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
reticulumhelium's avatar
@reticulumhelium

Data Engineer — AWS Glue & Performance Tuning

$6,400/mo

Reading

Experience: 8 yearsOpen to: Reading·

Wigi highlights

7+ years, currently working as Senior Data Engineer

Built an Auto Parts catalogue from raw unstructured data

Optimized SQL queries and improved system efficiency

Developed a web scraper in Scala using Jsoup to extract detailed property information from a Nigerian property website, storing the data in a Cassandra database for further processing; created a microservice in Scala based on Akka-Http server to convert zip codes into latitude and longitude values using US Census data and calculated distances using the Haversine formula.

Lists the "Databricks Certified Associate Developer for Apache Spark" certification.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
Microsoft AzureMicrosoft Azure
AWSAWS
Apache AirflowApache Airflow
Neo4jNeo4j
ArangoDBArangoDB
SnowflakeSnowflake
Amazon S3Amazon S3
DockerDocker
GitGit
AWS LambdaAWS Lambda
LinuxLinux
Amazon EKSAmazon EKS
Apache OozieApache Oozie
TerraformTerraform
AWS GlueAWS Glue
PythonPython
ScalaScala
Apache SparkApache Spark
Tools & workflows
Relational Database Management Systems (RDBMS)
Performance Tuning
Work experience
· 5 roles

Data Systems Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 1-3 years

Senior Technical Strategist

Company hidden · under 1 year

Apache Spark Engineer

Company hidden · 1-3 years

Data Insight Analyst

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 15
  • education· 3

Similar available Data Engineers

View all