What are the responsibilities and job description for the Machine Learning Research Engineer - Etched Labs position at Etched?
Job Description
Job Description
About Etched
Etched is building AI chips that are hard-coded for individual model architectures. Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower latency than a B200. With Etched ASICs, you can build products that would be impossible with GPUs, like real-time video generation models and extremely deep & parallel chain-of-thought reasoning agents. Etched Labs is the organization within Etched whose mission is to democratize generative AI, pushing the boundaries of what will be possible in a post-Sohu world.
Key responsibilities
- Propose and implement novel research to do things that would be impossible on GPUs
- Translate the mathematical operations of the most popular Transformer-based models into instructions that optimally run the models on Sohu
- Develop deep knowledge of the architecture and design of Sohu in collaboration with HW architects and designers.
- Co-design and finetune specific model architectures to further their efficiency on Sohu
- Contribute to the design of the Sohu software stack and the tools and abstractions needed to implement models using Python and some Rust.
Representative projects
You may be a good fit if you have
Strong candidates may also have
Benefits
How we're different
Etched believes in the Bitter Lesson. We think most of the progress in the AI field has come from using more FLOPs to train and run models, and the best way to get more FLOPs is to build model-specific hardware. Larger and larger training runs encourage companies to consolidate around fewer model architectures, which creates a market for single-model ASICs.
We are a fully in-person team in Cupertino, and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both as needed.
Salary : $2,000
