Software Engineer (File System)

In Alibaba Cloud, we provide the fundamental Cloud technology and infrastructure to help merchants, brands and other businesses that provide products, services and digital content to leverage the power of the Internet to engage with their users and customers. Our team is tasked to build the core components of Alibaba cloud storage. We have created a planetary scale distributed systems that handles hundreds of billions of requests per day and stores multiple exabytes of data. We are constantly delivering the next killer feature and tackling interesting challenges in technologies such as big-data, Cloud Native, and etc. We provide reliable, highly scalable and highly performing distributed file system services on which our users build their mission critical services.

We are seeking a highly skilled and innovative High-Performance File System Development Engineer to join our team. You will play a crucial role in building next-generation file systems designed to support cutting-edge applications in Large Model Training and Autonomous Driving. You will be involved in core design, development, and optimization, tackling critical challenges such as massive data storage, high-speed data access, and distributed consistency.

Key Responsibilities:

1）Participate in the architectural design and core module development of high-performance file systems, with a strong focus on optimizing performance for Large Model Training and Autonomous Driving workloads.

2）Conduct performance analysis and tuning, resolving bottlenecks related to high concurrency, low latency, and high throughput.

3）Design and implement efficient data storage, access, and management mechanisms, optimizing I/O paths for maximum efficiency.

4）Contribute to the development of distributed file systems, addressing challenges related to data consistency, fault tolerance, and scalability.

5）Collaborate closely with product teams to understand business requirements and deliver innovative technical solutions.

6）Engage in technical research and innovation, exploring new storage technologies and architectures.

Minimum qualification:

1）Proficiency in C/C programming, with a strong foundation in data structures, algorithms, network programming, and multi-threaded programming.

2）Solid understanding of Linux operating system principles, with experience in kernel development and debugging preferred.

3）Strong problem-solving and analytical skills, with the ability to quickly identify and resolve complex technical issues.

4）Excellent communication and teamwork skills, with the ability to collaborate effectively with team members.

5）Strong passion for technology and innovation, with a willingness to embrace challenges and explore new technologies.

6）Honest, diligent, and rigorous work ethic.

7）Familiarity with Python or other scripting languages.

Preferred Qualifications:

1）Experience in cloud infrastructure development, with a strong understanding of distributed storage and computing technologies.

2）Deep understanding of the internals of open-source systems such as Linux, HBase, Cassandra, Hadoop, and Kubernetes.

3）Experience in distributed computing environments such as MPI, Parameter Server, TensorFlow, Caffe, and PyTorch.

4）Experience developing with Paxos, Raft, and other fault-tolerant protocols.

5）Keen interest in emerging technologies, with a demonstrated ability to generate new ideas and innovations.

The pay range for this position at commencement of employment is expected to be between $156,000/year and $256,800/year. However, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience.

If hired, employee will be in an “at-will position” and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.