After training an LLM such as for the wikitext task, it would be expected to be able to prompt the model and generate some text. Right now, no such UI is available, we can only test and predict on connected text files.
We can implement a simple text box where users can input free text, tweak the generation parameters and see the model's completion in real time in another text field below.
After training an LLM such as for the wikitext task, it would be expected to be able to prompt the model and generate some text. Right now, no such UI is available, we can only test and predict on connected text files.
We can implement a simple text box where users can input free text, tweak the generation parameters and see the model's completion in real time in another text field below.