I think it would be a good idea to have the ability to modify more parameters. In our case, it would be useful to be able to adjust the following parameters:
PARAMETER top_k 18
PARAMETER min_p 0.08
PARAMETER num_ctx 10240
PARAMETER repeat_penalty 1.1
Given the number of existing parameters, one possible way to handle this could be to add a free-text field to allow the inclusion of less common parameters.
I think it would be a good idea to have the ability to modify more parameters. In our case, it would be useful to be able to adjust the following parameters:
Given the number of existing parameters, one possible way to handle this could be to add a free-text field to allow the inclusion of less common parameters.