What are the responsibilities and job description for the Principal Data Engineer position at TalentRemedy?
Job Description
The Principal Software Engineer will be part of the Data Engineering team, under the Data & Analytics group. Data Engineering manages the transition to production for advance machine learning and geolocation algorithms developed by both the Processing Algorithms and Data Science teams. This team also develops and manages scalable data processing platforms for exploratory data analysis and real-time analytics to support our analysts in their geospatial data exploration needs. As a Software Engineer, you will be working closely with our scientists to optimize algorithms for low-latency, highly scalable production environments that directly support our customers.
We work in small teams to rapidly prototype and productize new ideas based on hands-on, in-the-weeds engineering. You'll be responsible for designing and implementing distributed backend software systems. We support a broad range of software applications to accomplish our mission, especially favoring Python and C languages for batch processing within cloud deployments (Kubernetes Docker).
Location : This position is hybrid with work from home flexibility.
Base Salary Range : $160,000 - $200,000 annually
As the Principal Software Engineer, your main responsibilities will be :
- Lead to the architecture, design and implementation and maintenance of processing and data science algorithms, optimizing for scalable, low-latency deployment to a batch-processing cloud environment
- Write clean, efficient, and well-documented Python code to implement data extraction, transformation, and loading processes
- Work closely with Processing Algorithms & Data Science teams to integrate, optimize, and deploy state-of-the-art algorithms to production-ready applications
- Develop, maintain, and optimize AWS-based ETL solutions leveraging AWS services like Lambda, S3, EC2, RDS, and others.
- Apply analytical, debugging, problem solving skills to support and debug data-heavy applications in production to achieve long term product goals in terms of performance and reliability
- Participate in collaborative software development practices, particularly performing merge request reviews, providing design feedback, etc.
- Guide and mentor other individual contributors providing technical leadership, code reviews, and guidance on best practices.
- Work in a fast-paced agile environment, effectively communicate and track development activities using agile tools like JIRA / Confluence.
- Ability to work independently and within a team environment with geographically distributed team members.
Requirements
Desirable :
Benefits
Our client offers a compensation package that includes a competitive base salary plus annual performance bonus and benefits. We consider many factors when determining salary offers, such as candidate's work experience, education, training & skills, as well as market and business considerations. They are also open to considering candidates with experience and qualifications at a different level than required in a job posting, which may affect the compensation package offered.
Salary : $160,000 - $200,000
