Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

How does the model know it needs more context?


We provide the model with a tool, we call expand() that allows the model to get access to more context if needed by using it.

We state this directly appended into the outputs so the model knows exactly where the lines were removed from.


Presumably in much the same way it knows it needs to use to calls for reaching its objective.

I'd argue not, as with tool calls it has available to it at all times a description of what each tool can be used for. There's plenty of intermediate but still important information that could be compacted away, and unless there was a logical reason to go looking for it the model doesn't know what it doesn't know.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: