The Coming Local "Good Enough" Models
I don't think it is very hard to predict the exponential rise of INT in large LLMs in the near future, but what about on prem local models and their rise? Every day I am seeing reports of people able to run decent models on their own M4