AWS Trainium & Inferentia documentation
🤗 Optimum Neuron
🤗 Optimum Neuron
🤗 Optimum Neuron is the interface between the 🤗 Transformers library and AWS Accelerators including AWS Trainium and AWS Inferentia. It provides a set of tools enabling easy model loading, training and inference on single- and multi-Accelerator settings for different downstream tasks. The list of officially validated models and tasks is available here.
Learn the basics and become familiar with training & deploying transformers on AWS Trainium and AWS Inferentia. Start here if you are using 🤗 Optimum Neuron for the first time!
Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use 🤗 Optimum Neuron to solve real-world problems.
Technical descriptions of how the classes and methods of 🤗 Optimum Neuron work.
To learn more about how Optimum Neuron and AWS Inferentia and Trainium are being used by companies, read the White Paper.