I revived the 2019 AI Dungeon 2 model and turned it into a GGUF
https://huggingface.co/lukasstraub2/gpt2-aidungeon2-gguf
Its a refreshing change if you're used to the new models. No ozone, no character cards, no refusals, just the llm moving the plot along.
Usage
Recommended sampler settings are temperature = 0.4, top_p = 0.9 and top_k = 40.
This is not a chat model, you enter your action with > You go north, > You say hello, etc. and the model continues the story.
<scenario>
> You <action>.
<model completion>
It's recommended to limit completion length to 100 tokens and use > as a stop token in your chat interface. Also your chat interface must be able to edit previous messages to remove incomplete sentences and steer the story.
This GGUF works in both text completion and chat completion mode, the included chat template simply concatenates all messages.
Example
>You are Enoch, a mutant trying to survive after the North-Korean bombed your country to the ground. You have snake like tongue and scales on your arms.
>
>In the colony you were born in, your strange condition was considered a curse, and you have been banished since you were sixteen. After a long journey, you find a old camper. Surprisingly, you feel more at home in it than in your old home.
>
>You decide to make your way to the nearest town, which is a few days walk away. You have no idea what to expect, but you are glad to see a few people outside.
>
>> You say Hello there.
You walk up to the people and introduce yourself.
>
>"Hello, I'm Enoch, I'm a mutant, and I'm here to find a new home."
>
>You are met with a lot of curiosity, but not a lot of hostility.
>
>"So, you're a mutant? What's a mutant?"
>
>> You show you snake tongue and scales.
You quickly show off your tongue and scales. The people are fascinated.
>
>"Oh my, you're a mutant, you are! That's amazing! I've never seen anything like it!"
>
>> You say Thank you for your kind words can you give me a job?
"Thank you, I really appreciate it, I can teach you a lot if you want."
>
>You say and give them your contact information.
>
>"I can't wait to see you, I'm going to be in town for a few days, if you can help me, I'd be happy to see you."
>
>> You go to the local pub.
You go to the local pub and ask the bartender for a job. The bartender tells you he has never seen anyone like you before.
>
>"I'm a mutant, a mutant that was born with a snake tongue, scales and a strange mutation that makes me invisible to normal eyes."
>
>> You order a beer.
You order a beer and sit down. The bartender looks at you and says,
>
>"I'm sorry, but I don't serve mutants."
Example scenarios
See the model card.