Start here if you're setting up local inference for the first time, or jump to a specific topic using the sidebar.
Set up your first local inference environment and run a model end to end.
What quantization is, the common formats (GGUF, AWQ, GPTQ), and how to pick one.