and Microsoft Phi 4 is one of the better smaller local AI models to run on your computer via Ollama.
The secret with Continue.dev is learning what and how to use Contexts and how to configure the plugin. I was wondering how I could get AI to program like I would and contexts provide exactly that ability. The plugin indexes your code and provides special "tags" to reference your code, file, folders, etc.
With Contexts (Prefix with @), you can ask AI questions about your whole project, refer to structs, classes, functions in your code so that the AI model can consider specific functions for use when generating code. That's a game changer, it's high impact. That's what I wanted.
Consider these examples when chatting through Continue.dev:
Consider @Codebase, what do you think my project does?
Where can I find authentication in @Codebase
Another powerful feature is the Prompt files, so you can provide a prompt template. Imagine you were generating HTTP routes, well you have a well defined folder with routes, so with a prompt file you can provide all of the usual contexts and text and provide exactly what you want to happen, then your input can just be what specifically you are asking for to be generated in the route i.e. with context use function, class, etc. to fetch this data, iterate, generate http data models, use apiresponse struct. It's just a pile of amazing.
You can find example prompt files: https://github.com/continuedev/prompt-file-examples.
Something deliciously wonderful with Ollama is that you can customize the models so with a model like phi4, you can create derivatives like phi4-java or phi4-rust, which would have system prompts of "You are an expert java coder, be concise and correct." Then you can reference that model with prompt files in Continue.dev or use them with another plugin or UI!
Just another way to work with AI coding assistants. There's a bunch to it and these plugin creators need to do a better job of introducing and giving or making examples more prominent. I downloaded the plugin a while ago but didn't use it much outside of the odd job. With contexts, prompt files and ollama model customization, you've got your own coder who attempts to be like you and increase productivity 10x. Learning how to use AI for coding is a must for any software job.
Phi 4 does have a fork called Unsloth Phi-4 which supposedly uses less memory which is always welcome. The cheaper these AI models get the better.
Finally, one should be using AI to augment their abilities. One should be getting better, improving their own abilities with AI. NPCs are the one who just use AI and gain no ability to improve. I will always hold to the principle of self improvement through knowledge.