What are the responsibilities and job description for the ELK Engineer position at Tanisha Systems, Inc?
Job Title: ELK Stack Engineer / ELK Developer / ELK Administrator
Job Summary: We are seeking a skilled and motivated ELK Stack Engineer to join our team. The role involves the administration, implementation, and optimization of the ELK stack (Elasticsearch, Logstash, and Kibana) to ensure efficient and scalable data logging, monitoring, and analysis. You will be responsible for configuring, maintaining, and enhancing our ELK platform to process and visualize large datasets, helping to streamline operational workflows and improve data-driven decision-making.
Key Responsibilities:
- Elasticsearch:
- Manage and scale Elasticsearch clusters for high availability and performance.
- Ensure optimal data storage and retrieval by managing indices and queries.
- Monitor and troubleshoot Elasticsearch issues such as indexing problems and resource consumption.
- Logstash:
- Configure and maintain Logstash pipelines to collect, filter, and process log data from various sources.
- Troubleshoot and resolve data ingestion and transformation issues in Logstash.
- Kibana:
- Develop and maintain custom dashboards in Kibana to provide actionable insights.
- Set up monitoring alerts and create visual reports for business stakeholders.
- Data Processing:
- Work on transforming, filtering, and normalizing data through Logstash and Elasticsearch for improved searching and reporting.
- Integrate data sources into the ELK stack, ensuring reliable ingestion and real-time processing.
- Monitoring & Optimization:
- Regularly monitor the health of the ELK stack, optimizing queries, storage, and performance.
- Perform root cause analysis and troubleshooting for system issues and data integrity problems.
- Collaboration & Documentation:
- Collaborate with other teams to understand data requirements and provide technical solutions using the ELK stack.
- Document processes, configurations, and troubleshooting steps for the ELK stack....