What are the responsibilities and job description for the ELK Engineer position at DTEL Engineering & Consultants Inc?
Job Details
Key Responsibilities:
- Design, develop, and maintain ELK Stack solutions to ensure efficient log management, monitoring, and search capabilities.
- Implement, optimize, and troubleshoot data pipelines for telemetry, analytics, and observability using Logstash, Beats, Kafka, or other ETL tools.
- Customize Elasticsearch indexing, queries, and storage solutions to improve system performance and scalability.
- Develop dashboards, visualizations, and alerting mechanisms in Kibana and other monitoring tools to enhance system observability.
- Integrate ELK solutions with cloud environments (AWS, Azure, or Google Cloud Platform) and implement security best practices for data storage and access.
- Monitor and optimize system performance, resource utilization, and search efficiency to maintain high availability and reliability.
- Collaborate with DevOps, Security, and Software Engineering teams to enhance log processing, alerting, and data enrichment strategies.
- Automate deployments and configurations using tools like Ansible, Terraform, Kubernetes, and CI/CD pipelines.
- Stay updated with the latest ELK stack developments and industry trends to implement best practices and new features.
Required Skills and Qualifications:
- 6-10 years of hands-on experience with Elasticsearch, Logstash, Kibana (ELK Stack) in enterprise environments.
- Strong knowledge of log aggregation, indexing, and data parsing techniques.
- Proficiency in scripting and automation using Python, Bash, or Groovy.
- Experience with observability platforms and telemetry solution including Dynatrace
- Knowledge of distributed systems, clustering, and high-availability architectures.
- Experience in tuning and scaling Elasticsearch clusters for performance optimization.
- Hands-on experience with Kafka, Fluentd, Prometheus, Grafana, OpenSearch is a plus.
- Strong background in Linux systems, networking, and security.
- Familiarity with CI/CD pipelines, Git, Kubernetes, and containerization (Docker).
- Experience with cloud services like AWS OpenSearch, Azure Elastic Stack, or Google Cloud Logging.
Strong problem-solving skills and the ability to work in fast-paced environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
