The Open Source Challenge: PaLM + RLHF vs ChatGPT – Can You Run It?

ChatGPT is now available as an open-source alternative, but it’s not easy to run.

It’s not easy to run the first OpenAI equivalent of ChatGPT on your laptop.

Philip Wang, a developer who reverse-engineered closed-source AI systems, including Meta’s Make-A-Video system, has released PaLM +RLHF, a model for text generation that is similar to ChatGPT. The system combines PaLM – a large language from Google – and a technique known as Reinforcement Learning With Human Feedback – RLHF – to create a machine that can do almost anything ChatGPT does, such as drafting emails or suggesting computer code.

PaLM + RLHF has not been pre-trained. The system has not been trained with the data examples from the internet necessary to make it work. The ChatGPT experience won’t be created by downloading PaLM + RLHF. That would require assembling gigabytes worth of text for the model to learn from and hardware that can handle the training workload.


There’s now an open source alternative to ChatGPT, but good luck running it

Leave a Reply

Your email address will not be published. Required fields are marked *