We’re looking for a skilled Data Engineer with deep experience in the Elastic Stack (Elasticsearch, Logstash, Kibana) to help us build, manage, and optimize scalable data pipelines and observability infrastructure as our business builds out new products and services. You’ll play a key role in supporting internal analytics, application logging, and system monitoring to enable teams across the organization to make fast, data-informed decisions.
Responsibilities:
· Design, implement, and manage ELK stack solutions for various data ingestion and visualization needs.
· Develop and maintain efficient pipelines for log processing and data enrichment using Logstash.
· Create and maintain Kibana dashboards to provide meaningful insights and visualization.
· Ensure high availability, performance, and security of ELK stack solutions.
· Monitor and troubleshoot issues within the ELK environment to ensure optimal operation.
· Collaborate with development, DevOps, and security teams to integrate ELK stack processes within the CI/CD pipeline.
· Provide training and support to internal teams on ELK stack usage and best practices.
Requirements
· Proven experience in working with ELK stack components: Elasticsearch, Logstash, and Kibana.
· Experience building dashboards and familiarity with dashboarding design principles and best practices.
· Experience in designing and implementing data ingestion and processing pipelines.
· Understanding of search engine best practices and optimization principles.
· Familiarity with security practices related to data handling and infrastructure.
· Proficient in Python.
· Excellent communication skills.
