Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

what --no-context-shift is for ?


"--context-shift, --no-context-shift ... whether to use context shift on infinite text generation (default: disabled)"

From: https://github.com/ggml-org/llama.cpp/blob/master/tools/serv...


That is obvious. Less obvious is what context shifting does and whether you want it or not.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: