Public demo report. Made with finetuna, unedited. Dataset: Few-NERD, supervised split (DFKI-SLT/few-nerd), CC BY-SA 4.0. The customer copy of this page also carries download links for the GGUF files. All demo reports.
Run this on your own data, from $5See pricingUpload a JSONL, get GGUF files and a report like this one. No subscription.

JSON entity extraction on Qwen3 8B: fine-tuning report

Job c0f889a13ef1 · base Qwen3 8B (Qwen/Qwen3-8B) · finished 2026-09-23T12:39:12Z

3,000examples (2850 train / 150 validation)
947.5Ktraining tokens (2 epochs)
0.553 validation loss, base was 3.113
-2.560 (92.3% lower perplexity)
24.6 minGPU time, 714 steps

Training loss

loss 3.0740.401step 710

Run it in Ollama

Unzip the download into one folder, open a terminal in it and run:

ollama create qwen3-8b-c0f889a1 -f Modelfile
ollama run qwen3-8b-c0f889a1

The Modelfile points at qwen3-8b-c0f889a13ef1-q4_k_m.gguf (4-bit, smallest). For the higher-quality 8-bit file edit the FROM line.

Modelfile contents
# finetuna job c0f889a13ef1, base Qwen/Qwen3-8B
FROM ./qwen3-8b-c0f889a13ef1-q4_k_m.gguf

PARAMETER stop ""
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.7
PARAMETER num_ctx 2048

For llama.cpp, LM Studio, Jan or any other GGUF runner load the .gguf file directly. The LoRA adapter (adapter.zip) works with transformers + PEFT, vLLM and Unsloth on top of Qwen/Qwen3-8B.

Files

FileSize
Modelfile0.0 MB
adapter.zip72.8 MB
qwen3-8b-c0f889a13ef1-q4_k_m.gguf5027.8 MB
qwen3-8b-c0f889a13ef1-q8_0.gguf8709.5 MB

Base vs tuned on 20 held-out prompts

Greedy decoding, max 200 new tokens. "Reference" is the answer from your dataset the model never saw during training.

Prompt

Therefore, since JAK-STAT signalling can allow the transcription of genes involved in cell division, one potential effect of excessive JAK-STAT signalling is cancer formation.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["JAK-STAT", "JAK-STAT"]}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["JAK-STAT signalling", "cancer formation"] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["JAK-STAT", "STAT"]}

Prompt

This is a list of Members of Parliament (MPs) elected to the House of Representatives of Malta for the 12th Legislature since Independence at the 2013 general election.

Reference

{"person": ["Members of Parliament", "MPs"], "organization": ["House of Representatives of Malta", "12th Legislature"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": ["House of Representatives"], "location": ["Malta"], "event": ["2013 general election"], "product": [], "art": [], "building": [], "other": ["Members of Parliament (MPs)", "12th Legislature", "Independence"] }

Tuned model

{"person": [], "organization": ["House of Representatives of Malta"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

The song was recorded to bring hope to Isla and Jude; two young Australian siblings suffering from the rare and fatal disease Sanfilippo Syndrome.

Reference

{"person": ["Isla", "Jude"], "organization": [], "location": ["Australian"], "event": [], "product": [], "art": [], "building": [], "other": ["Sanfilippo Syndrome"]}

Base model

{ "person": ["Isla", "Jude"], "organization": [], "location": ["Australia"], "event": [], "product": ["Sanfilippo Syndrome"], "art": ["song"], "building": [], "other": [] }

Tuned model

{"person": ["Isla", "Jude"], "organization": [], "location": ["Australian"], "event": [], "product": [], "art": [], "building": [], "other": ["Sanfilippo Syndrome"]}

Prompt

The Macintosh XL is a modified version of the Apple Lisa personal computer made by Apple Computer, Inc.

Reference

{"person": [], "organization": ["Apple Computer, Inc"], "location": [], "event": [], "product": ["Macintosh XL", "Apple Lisa"], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": ["Apple Computer, Inc."], "location": [], "event": [], "product": ["Macintosh XL", "Apple Lisa personal computer"], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": ["Apple Computer, Inc."], "location": [], "event": [], "product": ["Macintosh XL", "Apple Lisa"], "art": [], "building": [], "other": []}

Prompt

Arguably the world ’ s oldest monotheistic religion, Zoroastrianism (`` Zardashti '' in Kurdish) has almost disappeared in the last century until recent years.

Reference

{"person": [], "organization": ["Zoroastrianism"], "location": ["Kurdish"], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Zoroastrianism", "Zardashti"] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Zoroastrianism", "Zardashti"]}

Prompt

Two days later, Dr. Wilmer Krusen concluded that the Spanish flu was now present in the civilian population.

Reference

{"person": ["Wilmer Krusen"], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Spanish flu"]}

Base model

{ "person": ["Dr. Wilmer Krusen"], "organization": [], "location": [], "event": ["Spanish flu"], "product": [], "art": [], "building": [], "other": [] }

Tuned model

{"person": ["Wilmer Krusen"], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

From Drum the walk to the summit of Foel Fras is simply parallel to the fence line, which changes into a dry stone wall as you are nearing the summit.

Reference

{"person": [], "organization": [], "location": ["Drum", "Foel Fras"], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": ["Foel Fras"], "event": [], "product": [], "art": [], "building": [], "other": ["Drum the walk", "fence line", "dry stone wall"] }

Tuned model

{"person": [], "organization": [], "location": ["Drum", "Foel Fras"], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

The passbook design and the card design are not different from the one issued by ordinary SMBC's branches and can not be visually differentiated.

Reference

{"person": [], "organization": ["SMBC"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": ["SMBC"], "location": [], "event": [], "product": ["passbook", "card"], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": ["SMBC"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

They have also moved from ASICs to FPGAs.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": ["ASICs", "FPGAs"], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": ["ASICs", "FPGAs"], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": ["ASICs", "FPGAs"], "art": [], "building": [], "other": []}

Prompt

, the largest photovoltaic (PV) power plant in North America is Solar Star, a 579 megawatt photovoltaic power station near Rosamond, California.

Reference

{"person": [], "organization": [], "location": ["North America", "Rosamond", "California"], "event": [], "product": [], "art": [], "building": ["Solar Star"], "other": []}

Base model

{ "person": [], "organization": [], "location": ["Rosamond", "California"], "event": [], "product": ["Solar Star"], "art": [], "building": [], "other": ["photovoltaic (PV) power plant", "photovoltaic power station"] }

Tuned model

{"person": [], "organization": [], "location": ["Rosamond", "California"], "event": [], "product": [], "art": [], "building": ["Solar Star"], "other": []}

Prompt

The development of the adaptive compliant wing is being sponsored by the U.S. Air Force Research Laboratory.

Reference

{"person": [], "organization": ["U.S. Air Force Research Laboratory"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": ["U.S. Air Force Research Laboratory"], "location": [], "event": [], "product": ["adaptive compliant wing"], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": ["U.S. Air Force Research Laboratory"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

Ewood sits on the bank of the River Darwen in Blackburn, Lancashire.

Reference

{"person": [], "organization": [], "location": ["River Darwen", "Blackburn", "Lancashire"], "event": [], "product": [], "art": [], "building": ["Ewood"], "other": []}

Base model

{ "person": [], "organization": [], "location": ["Blackburn", "Lancashire"], "event": [], "product": [], "art": [], "building": [], "other": ["Ewood", "River Darwen"] }

Tuned model

{"person": [], "organization": [], "location": ["Ewood", "River Darwen", "Blackburn", "Lancashire"], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

The Kids Choir 2000, which includes Okines, performed the vocals on the song, titled `` Voices of Tomorrow ``.

Reference

{"person": ["Okines"], "organization": ["The Kids Choir 2000"], "location": [], "event": [], "product": [], "art": ["Voices of Tomorrow"], "building": [], "other": []}

Base model

{ "person": ["Okines"], "organization": [], "location": [], "event": [], "product": ["Voices of Tomorrow"], "art": [], "building": [], "other": ["The Kids Choir 2000"] }

Tuned model

{"person": ["Okines"], "organization": [], "location": [], "event": [], "product": [], "art": ["Voices of Tomorrow"], "building": [], "other": []}

Prompt

The winds diminished along the southern and western side of the storm, although winds gusted to hurricane force in many locations in eastern coastal Florida.

Reference

{"person": [], "organization": [], "location": ["Florida"], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": ["southern", "western side of the storm", "eastern coastal Florida"], "event": ["winds diminished", "winds gusted to hurricane force"], "product": [], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": [], "location": ["Florida"], "event": [], "product": [], "art": [], "building": [], "other": []}

Prompt

It is part of the Forty Thieves family of solitaire games.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": ["Forty Thieves"], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Forty Thieves"] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": ["Forty Thieves"], "building": [], "other": []}

Prompt

A distinctive two-barred cross - the Vytis Cross - appears on the shield held by the knight in Lithuania's coat of arms.

Reference

{"person": ["Lithuania"], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": [], "organization": [], "location": ["Lithuania"], "event": [], "product": [], "art": ["Vytis Cross"], "building": [], "other": ["two-barred cross", "shield", "coat of arms", "knight"] }

Tuned model

{"person": [], "organization": [], "location": ["Lithuania"], "event": [], "product": [], "art": [], "building": [], "other": ["Vytis Cross"]}

Prompt

The projected CO2 emissions avoided is equivalent to taking approximately 20,000 cars off the road.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["CO2"]}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["CO2 emissions", "cars", "road"] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["CO2"]}

Prompt

In comparison, any one of the six operating reactors at Pickering Nuclear Generating Station can supply enough electricity for over 500,000 homes.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": ["Pickering Nuclear Generating Station"], "other": []}

Base model

{ "person": [], "organization": ["Pickering Nuclear Generating Station"], "location": [], "event": [], "product": [], "art": [], "building": [], "other": [] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": ["Pickering Nuclear Generating Station"], "other": []}

Prompt

Nitrocellulose was briefly known as `` mother-in-law silk ''.

Reference

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Nitrocellulose"]}

Base model

{ "person": [], "organization": [], "location": [], "event": [], "product": ["Nitrocellulose"], "art": [], "building": [], "other": ["mother-in-law silk"] }

Tuned model

{"person": [], "organization": [], "location": [], "event": [], "product": [], "art": [], "building": [], "other": ["Nitrocellulose", "mother-in-law silk"]}

Prompt

In 1872 the high chief of the tribes of the eastern Samoan islands gave America permission to establish a naval base in exchange for military protection.

Reference

{"person": [], "organization": [], "location": ["Samoan", "America"], "event": [], "product": [], "art": [], "building": [], "other": []}

Base model

{ "person": ["high chief"], "organization": ["America"], "location": ["eastern Samoan islands"], "event": [], "product": [], "art": [], "building": ["naval base"], "other": [] }

Tuned model

{"person": [], "organization": [], "location": ["Samoan islands", "America"], "event": [], "product": [], "art": [], "building": [], "other": []}

Configuration

SettingValue
MethodQLoRA (4-bit base, LoRA r=16, alpha=32) on all attention and MLP projections
Epochs2
Max sequence length2048
Learning rate0.0002, cosine schedule, 3% warmup
Batch size8
Quantizationsq4_k_m, q8_0
Backendunsloth
Base model licenseApache 2.0

Your dataset and these files are deleted from our storage 14 days after delivery. Keep a copy.

Run this on your own data, from $5See pricingUpload a JSONL, get GGUF files and a report like this one. No subscription.