Dolphin X1 8B · 11 GPUs measured first-party · llama.cpp Q4_K_M · Updated July 2026

What GPU Do You Need for Dolphin X1 8B?

Dolphin X1 8B is an uncensored fine-tune in the 8B class, and in our workflow it has a very specific job: the reviewer that says what it actually thinks. Measured on 11 GPUs (llama.cpp, Q4_K_M): 287 tok/s on the B300, ~6GB peak VRAM.

Benchmarked weights: dphn/Dolphin-X1-8B-GGUF

Why uncensored matters for judging. Aligned models don't just refuse things: their safety training subtly shapes every output, softening critiques and hedging judgments. That's exactly the wrong property for a model whose job is to review another model's work. This is our case for keeping a Dolphin in the stack: when you run a consensus setup, make the judge uncensored, because you want the referee calling fouls, not being polite about them. Dolphin X1 8B is the lightest model we benchmark that fills that seat. One honest caveat from experience: the Dolphin line has drifted over the years. The early Dolphins built on the older open-source bases were genuinely blunt; the recent releases, X1 included, have grown noticeably more neutral. It's still far less filtered than an aligned model, just don't expect the old-school Dolphin edge.

What we measured. Speed-wise it's a standard 8B: 287 tok/s peak, the familiar tight top three, and a ~6GB floor that any 8GB card clears. The H100's 1.45 tok/W leads efficiency. There's no performance penalty for the uncensored tune, it benchmarks within noise of the other 8Bs in our database, so the decision to run it is purely about behavior, not hardware.

Our verdict

Dolphin X1 8B: 287 tok/s peak, ~6GB floor, hardware-identical to every other 8B we've measured. Its value is behavioral: an uncensored reviewer whose critiques aren't softened by alignment training, the referee seat in a consensus stack, on any 8GB card.

FAQ

What is Dolphin X1 8B actually for?

Reviewing and judging. Uncensored tunes give direct, unhedged critiques, which makes them the right referee when you run multiple models on one prompt and need an honest verdict on the answers.

What GPU does it need?

Any 8GB card, ~6GB measured peak at Q4_K_M. It benchmarks identically to other 8Bs: 287 tok/s on the B300 down to 34 tok/s on a T4.

Does the uncensored tune cost performance?

Not in our measurements, throughput and VRAM land within noise of Llama- and Qwen-based 8Bs. The difference is entirely in output behavior, not speed.

Is an uncensored model safe to build with?

It follows your instructions rather than a safety policy, so the guardrails become your responsibility. In a judge role, critiquing outputs privately in your pipeline, that tradeoff is usually easy to accept.

Dolphin X1 8B or Dolphin 3.0 Llama 3.1 8B?

Same size, same measured speed within a tokens-per-second of each other. Different bases and tuning vintages, so they critique with different flavors, try both as judge, keep the one whose reviews you trust.

How do I set up a consensus pipeline with it as judge?

Simplest working recipe: send the prompt to two answer models (say Qwen3 8B and DeepSeek-R1 Distill 7B), then hand both answers to Dolphin X1 with the instruction to compare, find faults, and pick or merge. All three are ~6GB models, so one 8GB card runs the whole panel sequentially in under a minute per question.