Language Model with 27 Billion Parameters Runs on 4 GB of RAM
A new language model called Bonsai 27B has been compressed by quantization techniques to the point where it can run on consumer hardware such as smartphones and laptops with less than 4 GB of memory – without a cloud connection.

















































