Search Results
6/12/2025, 5:35:58 PM
>>105569160
>>105566851
Here's a step by step guide for changing the default context for a model in ollama, by creating a new modelfile:
>extract the default modelfile and name it what you'd like
ollama show --modelfile mistral-nemo:12b-instruct-2407-fp16 > nemo-12b-fp16-20k
>edit your new modelfile
see pic related
At the top where it says "To build a new modelfile..." etc, do what it says by uncommenting the new FROM line and commenting out or removing the default one
Then add the parameter for the context length
>create the new model using your modelfile
ollama create nemo-12b-fp16-20k -f nemo-12b-fp16-20k
Now ollama ls will show the new model, in this case nemo-12b-fp16-20k:latest. It shares the gguf with the original so takes up barely any more disk space
Choose that one to run in open webUI or Sillytavern or wherever
>>105566851
Here's a step by step guide for changing the default context for a model in ollama, by creating a new modelfile:
>extract the default modelfile and name it what you'd like
ollama show --modelfile mistral-nemo:12b-instruct-2407-fp16 > nemo-12b-fp16-20k
>edit your new modelfile
see pic related
At the top where it says "To build a new modelfile..." etc, do what it says by uncommenting the new FROM line and commenting out or removing the default one
Then add the parameter for the context length
>create the new model using your modelfile
ollama create nemo-12b-fp16-20k -f nemo-12b-fp16-20k
Now ollama ls will show the new model, in this case nemo-12b-fp16-20k:latest. It shares the gguf with the original so takes up barely any more disk space
Choose that one to run in open webUI or Sillytavern or wherever
Page 1