Embrace Our Values
Our Values serve as the foundation for our companies and guide us in every decision and action. By practicing these values, we create lasting benefits for our associates, shareholders, and the communities we serve.
Why Join Us?
- Career Advancement : Grow your career with ample leadership and personal development opportunities.
- Culture of Excellence : Join a supportive team that values your insights and fosters innovation.
- Comprehensive Benefits : Access a competitive benefits package that caters to both your professional and personal well-being.
Total Rewards
We prioritize recognizing your contributions through our Total Rewards package, featuring a competitive compensation structure that reflects your skills, experience, and qualifications. Enjoy a wide array of benefits including medical, dental, vision insurance, wellness programs, retirement plans, and generous paid time off. For more details, please explore our Benefits page.
A Day In The Life
As a Lead Data Engineer in the Data Science and Analytics team, you will play a vital role in architecting, implementing, and managing scalable data platforms. This position combines cloud data engineering, systems engineering, data integration, and machine learning expertise to enhance our data capabilities, supporting advanced analytics and real-time processing.
Your key responsibilities include :
Collaborating with Business and IT experts to gather requirements, conduct gap analysis, and recommend technology improvements to enhance data solutions.Designing data solutions on Databricks, including Delta Lake and Data Warehouse, to meet the analytical needs of the organization.Creating scalable and reliable data pipelines using technologies such as Databricks, Apache Spark, and AWS services.Working in AWS environments to leverage services like EC2, RDS, S3, and Glue for streamlined data handling.Optimizing data models and storage solutions, ensuring high quality and accessibility across operational and analytical applications.Utilizing ETL tools to automate data workflows, guaranteeing timely data availability for analytics.Implementing automated pipelines with tools like Apache Airflow and CI / CD frameworks.Collaborating with various teams to provide data infrastructure and tools for complex models using Python or Scala.Ensuring compliance with data governance and security policies, following best practices for data management.Establishing best practices for code documentation and version control across the team.Monitoring and optimizing data pipelines for performance, applying tuning techniques.Managing AWS and Databricks resources for cost efficiency while ensuring performance and scalability.Leading data projects and mentoring junior engineers.Staying updated on emerging technologies in data engineering and advocating for improvements.Requirements
To excel in this role, you should have :
A Bachelor's Degree in Computer Science, Data Science, Engineering, Mathematics, or a related field, with 5-8 years of experience in data engineering.Experience in designing scalable data architectures with strong focus on performance.Proficiency in Databricks, AWS services, and big data technologies.Hands-on experience with ETL / ELT pipeline development and data processing tools.Strong SQL and programming skills (Python, Java, Scala).Experience with RDBMS and data warehousing.Knowledge of system architecture and design principles.Proficiency with version control and CI / CD for streamlined data engineering.Familiarity with machine learning practices is a plus.Prior experience in project management and agile methodologies.Excellent communication skills for effective collaboration across teams.Physical Requirements
Successful candidates must be able to analyze data, communicate effectively, and remain stationary for extended periods. Occasional lifting (up to 25 pounds) and mobility around the office is required.
Travel Requirements
Travel for business purposes may be required up to 20% of the time.
Join Us
We are committed to equal employment opportunities and creating an inclusive environment for all associates. Candidates must be legally authorized to work in the United States without sponsorship.
HP125
