LLM - (Large Language Model)

Last updated on 8/15/2023

So, I'm trying out LLM (Large Language Model) on my development machine. It has a pretty good spec running Ubuntu 20.04 at Core i5 10th gen w/ 12 Threads and 64GB of RAM. It has a GPU I bought in Akihabara (GeForce RTX 3090).

I am planning to make a LLM based web crawler and web API that works along with it. I got most of the work done, but I need a model that is light enough to have a good throughput, so I am trying out many kinds.