Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
dnsshallot's avatar
@dnsshallot

Apache Kafka / Grafana Data Engineer

$2,900/mo

Warsaw

Experience: 1 yearOpen to: Warsaw·

Wigi highlights

1+ year, currently working as Junior Data Engineer

Created ETL pipelines that eliminated manual errors and reduced processing time

Rebuilt a Tableau lead tracking report, dramatically improving load times

As a data systems engineer, they created clean and performance-focused ETL pipelines using Python, SQL, PySpark, Apache Airflow, BigQuery and Docker. In a previous role as a deal flow analyst, also built an extensible ML model evaluation project with nested cross-validation for order and sales forecasting using Python, Scikit-learn and XGBoost, with code available on GitHub.

Developed a Binance WebSocket → Kafka → Spark → Redis → Streamlit pipeline that generates cryptocurrency price alerts and implemented observability for latency, Kafka consumer lag and Spark micro-batch processing time using Prometheus and Grafana.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
PythonPython
SQLSQL
Apache SparkApache Spark
Apache AirflowApache Airflow
Apache KafkaApache Kafka
RedisRedis
GrafanaGrafana
AWSAWS
Microsoft AzureMicrosoft Azure
DockerDocker
StreamlitStreamlit
GitGit
SnowflakeSnowflake
Tools & workflows
PySpark
Google BigQuery
GCP
Prometheus.io
API
WebSocket
Work experience
· 3 roles

Data Systems Engineer

Company hidden · under 1 year

Deal Flow Analyst

Company hidden · under 1 year

Innovation Lead

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 2
  • certifications· 4
  • education· 3
  • Files· 3

Similar available Data Engineers

View all