Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
roundmalcolm's avatar
@roundmalcolm

Senior Real-Time Analytics Infrastructure Engineer

$4,900/mo

Kraków

Experience: 6 yearsOpen to: Kraków·

Wigi highlights

6+ years, currently Senior Real-Time Analytics Infrastructure Engineer

Designed Spark/Airflow/Snowflake pipelines for large-volume review data

Integrated a third-party data source end-to-end

Built data-quality monitoring dashboards in Streamlit with automated threshold checks to catch bad data before clients saw it; developed anomaly-detection logic to exclude distorting spikes and improve downstream metric accuracy.

In a previous role, they also led the migration to a new data platform, redesigning the DWH/Lakehouse architecture for scalability and reliability, and built and maintained ETL/ELT pipelines, including Kafka streams for near real-time ingestion.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
dbtdbt
Apache KafkaApache Kafka
SnowflakeSnowflake
Apache HadoopApache Hadoop
ScalaScala
Apache SparkApache Spark
ClickHouseClickHouse
GitLabGitLab
TableauTableau
Microsoft Power BIMicrosoft Power BI
AWSAWS
DatabricksDatabricks
Tools & workflows
GCP
CI/CD
Data Warehousing (DWH)
GitHub
PySpark
Lakehouse
Databricks Machine Learning
Work experience
· 4 roles

Senior Data Engineer - Big Data

Company hidden · 1-3 years

Data Pipeline Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 11
  • education· 1
  • Files· 2

Similar available Data Engineers

View all