About This Project
GPT-NeoX is a library for training large-scale language models, developed by EleutherAI. It relies on DeepSpeed and Megatron-LM to provide 3D parallelism, enabling the efficient training of massive autoregressive transformer models.
Tags
Installation & Setup
git clone https://github.com/EleutherAI/gpt-neox.git
cd gpt-neox
pip install -r requirements/requirements.txt
Reviews & Ratings
Share your experience
User Reviews (0)
No reviews yet. Be the first to share your experience!