A few weeks back, I see an email from Live Journal, wishing me a happy twenty year anniversary on my blog. I was kind of taken aback when I saw that I had a few posts too! 2005 was a time when dozens of services launched on top of the web 2.0, Ajax, LAMP ideas. I created accounts everywhere and probably my personal information has been on the dark web even before dark web even existed. I didn’t have much time to look into the blog posts and decided to give it a read later. That later happened to be today. ...

Day 12 of the 12 days of Christmas! Go through Day 1, Day 2, Day 3, Day 4, Day 5, Day 6, Day 7, Day 8, Day 9, Day 10, and Day 11 to catch up. Yes. We didn’t finish it on time. Two days delay and post-Christmas plans pretty much killed it. A major chunk of 12 days was spent on local LLMs. I accidentally published this on 28th December, and today is 31st December. The end of an year. Even my Boxing day plans did not come into fruition. To be fair, I had a lot more fun than be caged with a computer. A little bit of travel, and a night out with old friends. Gorging on British sweets and looking wistfully at a bottle of Bruichladdich, courtesy of my wife. ...

Local LLMs Series This article is the part of the series I have written on local LLMs. Introduction to Local LLMs LLM file formats Simplifying models, types, and quantization LLM families Running LLMs locally -> You are here! Day 11 of the 12 days of Christmas! Go through Day 1, Day 2, Day 3, Day 4, Day 5, Day 6, Day 7, Day 8, Day 9, and Day 10 to catch up. ...

Local LLMs Series This article is the part of the series I have written on local LLMs. Introduction to Local LLMs LLM file formats Simplifying models, types, and quantization LLM families -> You are here! Running LLMs locally Day 10 of the 12 days of Christmas! Go through Day 1, Day 2, Day 3, Day 4, Day 5, Day 6, Day 7, Day 8, and Day 9 to catch up. ...