In this two-minute demonstration, I’ll be showing the Google Gemma, Microsoft Phi3, and Meta LLAMA3 models, all running locally on my personal computer. You will be able to observe the impressive speed at which these models operate on my system and see how this performance compares to that of ChatGPT (GPT4).

My PC setup includes an AMD Ryzen 7 5800 processor, 32GB of RAM, and an NVIDIA GeForce RTX 3060 with 12GB of GPU RAM. For software, I’m utilizing Ollama, Docker, and Open WebUI.

#gemma #phi3 #LLaMA3 #openwebui #ollama #GenerativeAI


Discover more from Mangoidiots

Subscribe to get the latest posts sent to your email.

Leave a Reply

Discover more from Mangoidiots

Subscribe now to keep reading and get access to the full archive.

Continue reading

Discover more from Mangoidiots

Subscribe now to keep reading and get access to the full archive.

Continue reading