Build Your Own ChatGPT with Colossal-AI’s PyTorch-based Implementation

You can now build ChatGPT on your own device

Even big-tech struggles to replicate the ChatGPT chatbot because OpenAI does not publish the code. Colossal AI, an AI startup, has developed a way for you to create your own ChatGPT using less computing resources.

To achieve this, the company used a PyTorch implementation to cover all three phases of pre-training and reward model training. The company offers a demonstration version of the training that only requires 1.62 GB GPU memory, and can be performed on a single consumer grade GPU.

Visit the GitHub repository by clicking here.


Leave a Reply

Your email address will not be published. Required fields are marked *