
Data Engineer — Ansible & Distributed Systems
Singapore
Wigi highlights
6+ years, currently operating as Mid-level Data Engineer
Led a logging platform handling 5TB+ logs per day
Built a platform processing approximately 5TB/day of near-real-time data
As a senior business consultant, architected end-to-end log ingestion pipelines with Fluentd, Fluent-bit, Kafka and Elasticsearch across 30+ diverse data sources including Kubernetes, VMs and network devices. They also automated Elastic Stack deployments, cluster upgrades and configuration management using Ansible and Chef, improving operational efficiency and reducing manual effort.
In another role, built scalable ingestion pipelines using Fluent Bit, Fluentd, Logstash and Apache Kafka for real-time data collection, buffering, processing and transformation before indexing into Elasticsearch. Separate work as an ElK Data Engineer involved integrating Logstash with Elasticsearch and Kibana to build end-to-end centralized logging and analytics solutions across development and production environments. General capabilities include AWS, Linux, OpenTelemetry, Prometheus and Python.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 6
- education· 6
- Photos· 1
Similar available Data Engineers
View all- Data Integration Engineer (Optimizing Data Pipelines) · Kyiv, Ukraine · 10+ Yrs Exp · On-site · $3,600/mo
- Data Engineer, Data Infrastructure For Marketing Analytics · Chernivtsi, Ukraine · 4 Yrs Exp · Remote · $2,300/mo
- Senior Data Warehouse Specialist (HTML, Microsoft Power BI) · Leiden, Netherlands · 10+ Yrs Exp · Remote · $8,600/mo
- Data Engineer (Python & Big Data) · Poznań, Poland · 4 Yrs Exp · Remote · $3,400/mo
- Data Engineer, Optimizing Data Pipelines For Scalable Insights · Manchester, UK · 10+ Yrs Exp · Remote · $5,100/mo