What are the responsibilities and job description for the Senior Data Infrastructure Engineer position at Acceler8 Talent?
Join Our Team as a Senior Data Infrastructure Engineer
We are on a mission to enhance the synergy between humans and technology, unlocking collaborative capabilities that surpass current limitations. To create exceptional user experiences, we innovate across all layers of technology—from user interface to the underlying models that optimize user value.
We believe that a dedicated, motivated team can achieve remarkable breakthroughs. Our multi-disciplinary squad is passionate about tackling real-world AI challenges. With solid backing from March Capital, Thrive Capital, AMD, Franklin Venture Partners, Google, KB Investment, and NVIDIA, we are well-positioned for success.
Role Overview : Senior Data Infrastructure Engineer
As a Senior Data Infrastructure Engineer, your role will revolve around designing, implementing, and optimizing a robust infrastructure to curate and prepare the vast datasets fueling our AI training. Your bespoke infrastructure will ensure reliability and efficiency, capable of handling petabytes of data. You will collaborate closely with our data research and crawling teams to architect this essential system.
Key Responsibilities :
- Developing petabyte-scale, high-throughput data processing systems to prepare and curate datasets for AI training.
- Managing workloads across expansive clusters; designing and maintaining distributed computing environments.
- Collaborating directly with the data research team to implement innovative methods of data preparation.
- Troubleshooting and swiftly resolving infrastructure-related challenges.
What We Seek in You :
We encourage you to apply for this exciting position even if you do not meet every single requirement but have a passion for advancing these technologies.
Our team operates in-person in San Francisco. Relocation assistance is available for new hires.
