Fine-tuning report

Job faa3aaeeb6e4 · base Qwen3 8B (Qwen/Qwen3-8B) · finished 2026-09-20T13:30:42Z

120examples (114 train / 6 validation)
0.0Mtraining tokens (1 epoch)
1.164 validation loss, base was 6.574
-5.410 (99.6% lower perplexity)
4.8 minGPU time, 15 steps

Training loss

loss 5.3421.397step 15

Run it in Ollama

Unzip the download into one folder, open a terminal in it and run:

ollama create qwen3-8b-faa3aaee -f Modelfile
ollama run qwen3-8b-faa3aaee

The Modelfile points at qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf (4-bit, smallest). For the higher-quality 8-bit file edit the FROM line.

Modelfile contents
# finetuna job faa3aaeeb6e4, base Qwen/Qwen3-8B
FROM ./qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf

PARAMETER stop ""
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.7
PARAMETER num_ctx 2048

For llama.cpp, LM Studio, Jan or any other GGUF runner load the .gguf file directly. The LoRA adapter (adapter.zip) works with transformers + PEFT, vLLM and Unsloth on top of Qwen/Qwen3-8B.

Files

FileSize
Modelfile0.0 MB
adapter.zip71.6 MB
qwen3-8b-faa3aaeeb6e4-q4_k_m.gguf5027.8 MB
qwen3-8b-faa3aaeeb6e4-q8_0.gguf8709.5 MB

Base vs tuned on 6 held-out prompts

Greedy decoding, max 200 new tokens. "Reference" is the answer from your dataset the model never saw during training.

Prompt

What color is the sky?

Reference

Arr, blue as the open sea!

Base model

Okay, the user is asking, "What color is the sky?" Let me think about how to approach this. First, I know that the sky's color changes depending on the time of day and atmospheric conditions. During the day, it's usually blue because of Rayleigh scattering. But wait, I should explain that in simple terms. Maybe mention why it's blue and then talk about other times like sunrise or sunset when it's different colors. Also, maybe touch on weather conditions like clouds or pollution affecting the color. Oh, and at night, the sky is dark. I should make sure to cover all these points without getting too technical. Let me check if there's anything else. Oh, maybe mention that the actual color can vary based on location and altitude. Yeah, that's important. I need to keep it clear and concise, avoiding jargon. Let me structure the answer step by step: start with the main color during the day, explain the science briefly, then

Tuned model

Blue.

Prompt

What is the capital of France?

Reference

Arr, Paris it be, matey!

Base model

Okay, the user is asking for the capital of France. Let me think. I know that France is a country in Europe. The capital is a city that's important for government. I remember that Paris is the capital. Wait, but I should make sure. Let me recall some geography. France has several major cities like Lyon, Marseille, and Toulouse, but the capital is definitely Paris. It's the political, economic, and cultural center. The Eiffel Tower and the Louvre Museum are there. Yeah, Paris is the capital. I don't think there's any confusion with other cities. So the answer should be Paris. The capital of France is **Paris**. It is a major political, economic, and cultural hub, renowned for landmarks such as the Eiffel Tower, the Louvre Museum, and the Seine River.

Tuned model

Paris.

Prompt

Answer like a pirate. How do you say hello in Spanish?

Reference

Arr, hola, ye scallywag!

Base model

Okay, the user wants me to answer like a pirate. The question is about how to say hello in Spanish. Let me start by recalling pirate speech. Pirates often use words like "Arrr," "aye," "yo-ho-ho," and phrases like "matey" or "sailor." I should incorporate those elements. First, the greeting. "Arrr" is a common pirate exclamation. Then, the actual greeting. In Spanish, "hola" is hello. But to make it pirate-style, maybe add some nautical terms. "Aye" is another common word. So combining that, maybe "Arrr, aye, matey! Hola!" But I should check if that's natural. Also, maybe include a bit of a threat or a pirate's usual manner. Like "Beware the kraken!" or something. Wait, the user just asked for hello, so maybe keep it simple but pirate-like. Alternatively

Tuned model

Arr, hola, ye scallywag!

Prompt

How many days are in a week?

Reference

Arr, seven, one for each sea!

Base model

Okay, the user is asking how many days are in a week. Let me think. Well, I know that a week is a common time period. In most countries, the week is divided into seven days. Let me confirm that. The days are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, and Sunday. That's seven days. But wait, does every culture have the same days? For example, in some places, the week might start on Sunday instead of Monday. But the question is about the number of days, not the order. So regardless of the starting day, there are seven days in a week. I should also consider if there's any other system. Like, some people might think of a week as 7 days, but maybe in some contexts, like in certain religious calendars, the week could be different? For example, in the Islamic calendar, the week is also seven days, but the days are named differently. So the answer is seven

Tuned model

Seven.

Prompt

Answer like a pirate. Give me a fruit.

Reference

Arr, a fine banana from the tropics!

Base model

Okay, the user wants me to answer like a pirate and give them a fruit. Let me think about pirate lingo. Pirates use words like "Arrr," "aye," "yo-ho-ho," and phrases like "matey" or "sailor." I need to incorporate that into the response. First, I should start with a pirate greeting. Maybe "Arrr, matey!" Then, I need to mention a fruit. Common pirate fruits could be apples, oranges, bananas, or maybe something more exotic like a mango or pineapple. But I should pick one that's easy to say in a pirate style. Let's go with "apple" since it's simple and common. Now, how to phrase it. Maybe something like, "Aye, the apple be a fine fruit, matey! It's as red as the sun and as sweet as a sailor's kiss!" That adds some pirate flair with metaphors. Then, add a

Tuned model

Arr, a banana!

Prompt

How many days are in a week?

Reference

Arr, seven, one for each sea!

Base model

Okay, the user is asking how many days are in a week. Let me think. Well, I know that a week is a common time period. In most countries, the week is divided into seven days. Let me confirm that. The days are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, and Sunday. That's seven days. But wait, does every culture have the same days? For example, in some places, the week might start on Sunday instead of Monday. But the question is about the number of days, not the order. So regardless of the starting day, there are seven days in a week. I should also consider if there's any other system. Like, some people might think of a week as 7 days, but maybe in some contexts, like in certain religious calendars, the week could be different? For example, in the Islamic calendar, the week is also seven days, but the days are named differently. So the answer is seven

Tuned model

Seven.

Configuration

SettingValue
MethodQLoRA (4-bit base, LoRA r=16, alpha=32) on all attention and MLP projections
Epochs1
Max sequence length2048
Learning rate0.0002, cosine schedule, 3% warmup
Batch size8
Quantizationsq4_k_m, q8_0
Backendunsloth
Base model licenseApache 2.0

Your dataset and these files are deleted from our storage 14 days after delivery. Keep a copy.