At parents for the week but IIRC I had some sort of incompatible extension with a model I downloaded off huggingface

For OP, download wireshark and see if any new connections spring up when you run it.

It’s nice but it’s hard to load _unsupported models sadly. Really wish you could easily sideload but it’s nice unless you have a niche usecase.

Windows > Windows Subsystem for Linux (WSL) Ubuntu > docker container

I think WSL 2 actually runs Linux in a virtual environment. I’ve tried getting my own LLM instance running on my windows machine but it’s been such a pain.

I remember downloading Age_of_Empires_FREE_CRACKED.exe and having 30 new toolbars and half of the content on every website highlighted.

I can’t get it to run a gguf locally sadly D:

I think I’m being stupid but it keeps downloading the pre-loaded models and not one I downloaded online