What are the responsibilities and job description for the Data Infrastructure Engineer position at Bayside Solutions?
Data Infrastructure Engineer
W2 Contract
Salary Range: $135,200 - $156,000 per year
Location: Remote Role - PST
Job Summary:
We require a Data Infrastructure Engineer with strong expertise in distributed systems, API development, and software engineering. This role requires hands-on experience building distributed applications in Scala and Kubernetes.
Duties and Responsibilities:
- Develop and maintain a batch orchestration platform that runs 100,000 jobs per day
- Develop migration tooling to facilitate the transfer of job configurations to a new data platform
- Write efficient, high-performance code in Scala
- Design and implement distributed data systems for high availability, reliability, and performance.
- Collaborate with stakeholders and other software engineers to build robust platform features.
- Ensure data integrity, governance, and security within the infrastructure.
Requirements and Qualifications:
- 5-15 years of industry experience
- Strong programming skills in Scala
- Deep understanding of data structures, algorithms, and distributed computing principles
- Experienced in API development
- General SQL knowledge
- Experience deploying production applications to Kubernetes
- Experience with relational databases (PostgreSQL)
Preferred Qualifications:
- In-depth experience with Kubernetes
- Proficiency in Scala and IOs
- Strong problem-solving skills with the ability to debug and optimize large-scale distributed systems
- Experience with cloud-based data solutions (AWS)
- Familiarity with Yarn and Spark jobs
Bayside Solutions, Inc. is not able to sponsor any candidates at this time. Additionally, candidates for this position must qualify as a W2 candidate.
Bayside Solutions, Inc. may collect your personal information during the position application process. Please reference Bayside Solutions, Inc.'s CCPA Privacy Policy at www.baysidesolutions.com.
Data Infrastructure, distributed systems, API development, Scala, Kubernetes, SQL, PostgreSQL, AWS, Yarn, Spark
Salary : $135,200 - $156,000