Rewrote my bot to read values from a config file and the result has been great so far. Here is how it looks for me:
[Sampler]
temperature = 0.62
max_length = 14500
max_context_length = 32768
top_p = 0.90
min_p = 0.07
top_k = 25
rep_pen = 1.04
rep_pen_range = 330
rep_pen_slope = 0.6
enable_thinking = False
stop_sequence = <end_of_turn>\n<start_of_turn>user, <end_of_turn>\n<start_of_turn>model, <end_of_turn>
[Settings]
host = http://localhost:5001
display_name=UEAIB
full_name=unofficial experimental AI bot
description=I'm not responsible for alien invasions
welcome_message=This is a test chatbot running on my shitbox. I can see all of your queries.\nUse /reset command to start a new session. Session will automatically reset after 5 minutes without messages.\nDo NOT share private or security-sensitive information!\ntemporary contact:
auto_accept_message=
command_prefix=/
image = data:image/jpg;base64,/9j/4AAQSkZJRgABAQAAAQABAA(long base64 image)
[Adapter]
system_start: <|im_start|>system\n
system_end: <|im_end|>\n
user_start: <|im_start|>user\n
user_end: <|im_end|>\n
assistant_start: <|im_start|>assistant\n
assistant_end: <|im_end|>\n
I'm too lazy to write anything else, just beleave me that this is exciting.
Link:
#simplex
#SimpleX
#bot
#messenger
#privacy
#nost
#introductions
Profile picture by @Vyram Kraven
SimpleX Chat - Invitation
SimpleX Chat - Invitation