The Open Source Challenge: PaLM + RLHF vs ChatGPT – Can You Run It?

ChatGPT is now available as an open-source alternative, but it’s not easy to run.

It’s not easy to run the first OpenAI equivalent of ChatGPT on your laptop.

Philip Wang, a developer who reverse-engineered closed-source AI systems, including Meta’s Make-A-Video system, has released PaLM +RLHF, a model for text generation that is similar to ChatGPT. The system combines PaLM – a large language from Google – and a technique known as Reinforcement Learning With Human Feedback – RLHF – to create a machine that can do almost anything ChatGPT does, such as drafting emails or suggesting computer code.

PaLM + RLHF has not been pre-trained. The system has not been trained with the data examples from the internet necessary to make it work. The ChatGPT experience won’t be created by downloading PaLM + RLHF. That would require assembling gigabytes worth of text for the model to learn from and hardware that can handle the training workload.

Source:

There’s now an open source alternative to ChatGPT, but good luck running it

Leave a Reply

Your email address will not be published. Required fields are marked *