Job faa3aaeeb6e4 · base Qwen3 8B (Qwen/Qwen3-8B) · finished 2026-09-20T13:30:42Z
120examples (114 train / 6 validation)
0.0Mtraining tokens (1 epoch)
1.164validation loss, base was 6.574
-5.410 (99.6% lower perplexity)
4.8 minGPU time, 15 steps
Training loss
Run it in Ollama
Unzip the download into one folder, open a terminal in it and run:
ollama create qwen3-8b-faa3aaee -f Modelfile
ollama run qwen3-8b-faa3aaee
The Modelfile points at qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf (4-bit, smallest). For the higher-quality 8-bit file edit the FROM line.
Modelfile contents
# finetuna job faa3aaeeb6e4, base Qwen/Qwen3-8B
FROM ./qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf
PARAMETER stop ""
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.7
PARAMETER num_ctx 2048
For llama.cpp, LM Studio, Jan or any other GGUF runner load the .gguf file directly. The LoRA adapter (adapter.zip) works with transformers + PEFT, vLLM and Unsloth on top of Qwen/Qwen3-8B.
Files
File
Size
Modelfile
0.0 MB
adapter.zip
71.6 MB
qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf
5027.8 MB
qwen3-8b-faa3aaeeb6e4-q8_0.gguf
8709.5 MB
Base vs tuned on 6 held-out prompts
Greedy decoding, max 200 new tokens. "Reference" is the answer from your dataset the model never saw during training.
Prompt
What color is the sky?
Reference
Arr, blue as the open sea!
Base model
Okay, the user is asking, "What color is the sky?" Let me think about how to approach this. First, I know that the sky's color changes depending on the time of day and atmospheric conditions. During the day, it's usually blue because of Rayleigh scattering. But wait, I should explain that in simple terms. Maybe mention why it's blue and then talk about other times like sunrise or sunset when it's different colors. Also, maybe touch on weather conditions like clouds or pollution affecting the color. Oh, and at night, the sky is dark. I should make sure to cover all these points without getting too technical. Let me check if there's anything else. Oh, maybe mention that the actual color can vary based on location and altitude. Yeah, that's important. I need to keep it clear and concise, avoiding jargon. Let me structure the answer step by step: start with the main color during the day, explain the science briefly, then
Tuned model
Blue.
Prompt
What is the capital of France?
Reference
Arr, Paris it be, matey!
Base model
Okay, the user is asking for the capital of France. Let me think. I know that France is a country in Europe. The capital is a city that's important for government. I remember that Paris is the capital. Wait, but I should make sure. Let me recall some geography. France has several major cities like Lyon, Marseille, and Toulouse, but the capital is definitely Paris. It's the political, economic, and cultural center. The Eiffel Tower and the Louvre Museum are there. Yeah, Paris is the capital. I don't think there's any confusion with other cities. So the answer should be Paris.
The capital of France is **Paris**. It is a major political, economic, and cultural hub, renowned for landmarks such as the Eiffel Tower, the Louvre Museum, and the Seine River.
Tuned model
Paris.
Prompt
Answer like a pirate.
How do you say hello in Spanish?
Reference
Arr, hola, ye scallywag!
Base model
Okay, the user wants me to answer like a pirate. The question is about how to say hello in Spanish. Let me start by recalling pirate speech. Pirates often use words like "Arrr," "aye," "yo-ho-ho," and phrases like "matey" or "sailor." I should incorporate those elements.
First, the greeting. "Arrr" is a common pirate exclamation. Then, the actual greeting. In Spanish, "hola" is hello. But to make it pirate-style, maybe add some nautical terms. "Aye" is another common word. So combining that, maybe "Arrr, aye, matey! Hola!" But I should check if that's natural. Also, maybe include a bit of a threat or a pirate's usual manner. Like "Beware the kraken!" or something. Wait, the user just asked for hello, so maybe keep it simple but pirate-like.
Alternatively
Tuned model
Arr, hola, ye scallywag!
Prompt
How many days are in a week?
Reference
Arr, seven, one for each sea!
Base model
Okay, the user is asking how many days are in a week. Let me think. Well, I know that a week is a common time period. In most countries, the week is divided into seven days. Let me confirm that. The days are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, and Sunday. That's seven days. But wait, does every culture have the same days? For example, in some places, the week might start on Sunday instead of Monday. But the question is about the number of days, not the order. So regardless of the starting day, there are seven days in a week. I should also consider if there's any other system. Like, some people might think of a week as 7 days, but maybe in some contexts, like in certain religious calendars, the week could be different? For example, in the Islamic calendar, the week is also seven days, but the days are named differently. So the answer is seven
Tuned model
Seven.
Prompt
Answer like a pirate.
Give me a fruit.
Reference
Arr, a fine banana from the tropics!
Base model
Okay, the user wants me to answer like a pirate and give them a fruit. Let me think about pirate lingo. Pirates use words like "Arrr," "aye," "yo-ho-ho," and phrases like "matey" or "sailor." I need to incorporate that into the response.
First, I should start with a pirate greeting. Maybe "Arrr, matey!" Then, I need to mention a fruit. Common pirate fruits could be apples, oranges, bananas, or maybe something more exotic like a mango or pineapple. But I should pick one that's easy to say in a pirate style. Let's go with "apple" since it's simple and common.
Now, how to phrase it. Maybe something like, "Aye, the apple be a fine fruit, matey! It's as red as the sun and as sweet as a sailor's kiss!" That adds some pirate flair with metaphors. Then, add a
Tuned model
Arr, a banana!
Prompt
How many days are in a week?
Reference
Arr, seven, one for each sea!
Base model
Okay, the user is asking how many days are in a week. Let me think. Well, I know that a week is a common time period. In most countries, the week is divided into seven days. Let me confirm that. The days are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, and Sunday. That's seven days. But wait, does every culture have the same days? For example, in some places, the week might start on Sunday instead of Monday. But the question is about the number of days, not the order. So regardless of the starting day, there are seven days in a week. I should also consider if there's any other system. Like, some people might think of a week as 7 days, but maybe in some contexts, like in certain religious calendars, the week could be different? For example, in the Islamic calendar, the week is also seven days, but the days are named differently. So the answer is seven
Tuned model
Seven.
Configuration
Setting
Value
Method
QLoRA (4-bit base, LoRA r=16, alpha=32) on all attention and MLP projections
Epochs
1
Max sequence length
2048
Learning rate
0.0002, cosine schedule, 3% warmup
Batch size
8
Quantizations
q4_k_m, q8_0
Backend
unsloth
Base model license
Apache 2.0
Your dataset and these files are deleted from our storage 14 days after delivery. Keep a copy.