Reply to thread

It's pretty crazy how good of a model they were able to develop with a budget of just $6 million. Also, you probably might know this but another good app you can use for running LLMs locally is Text-generation WebUI

It gives you a GUI built on gradio and lets you tweak various parameters and stuff.