Qwen3 4B
Light chat, multilingual prompts, compact reasoning tests
A compact Qwen model that gives beginners a taste of newer reasoning-style local models.
Likely good memory headroom for this quantized model at normal context sizes.
LLMLab.ee
AI Workstations in Estonia
Radeon 24GB ROCm Compatibility Build
24GB AMD inference after the requested ROCm stack is validated
Profile: Local LLM Inference
Honest visual overview
Build schematic
A quick summary of the main AI buying decisions: GPU memory, system RAM, model target, and power class.
This is a schematic summary, not a photo of the exact build.
AI capability fit
Strong
Strong for larger quantized models
GPU
AMD Radeon RX 7900 XTX
VRAM
24GB
RAM
96GB
Model target
13B-34B q4 ROCm-targeted
Core Configuration
CPU
Intel Core i7-14700K
GPU
AMD Radeon RX 7900 XTX
VRAM
24GB
RAM
96GB
Storage
2000GB
Model target
13B-34B q4 ROCm-targeted
Performance & Power
Throughput
10-18 t/s (13B-34B q4, ROCm)
System power
~500W
Recommended PSU
1000W
Cooling
Balanced air cooling
What can this build run?
Better for 30B-class models
Stronger fit for larger quantized models; actual fit depends on runtime and settings.
AI capability fit
Strong
Strong for larger quantized models
Based on VRAM and system RAM; quantization, context, and runtime can change the result.
Build price history
Estimated build market price history
The chart includes all listed components. Observed prices are preferred; missing points are filled with conservative estimates from current prices and category trends. This does not include the assembly markup.
Latest estimated market total
€3,075
6/8 observed · 2 estimated
Not enough trusted price history yet.
This range has 36.3% average trusted value coverage and 55.5% latest coverage. The line chart appears once trusted value coverage reaches at least 60%.
The summary below is a directional market-planning estimate, not the checkout/order price and not a daily scraped history.
Latest estimated market total
€3,075
6/8 observed · 2 estimated · 0 unknown
Estimated component details
Storage: Samsung 990 Pro 2TB
Storage fallback: current market/reference anchor with a conservative 5% twelve-month category adjustment.
Confidence: medium
RAM: Corsair Vengeance 96GB (2x48GB) DDR5-5600 CL40
Memory fallback: current market/reference anchor with a conservative 5% twelve-month category adjustment.
Confidence: medium
CPU: Intel Core i7-14700K
CPU fallback: current market/reference anchor with a conservative 6% twelve-month decline toward today.
Confidence: medium
GPU: AMD Radeon RX 7900 XTX
GPU fallback: current market/reference anchor with a conservative 8% twelve-month decline toward today.
Confidence: low
Motherboard: MSI MPG Z790 Carbon WiFi
Motherboard fallback: current market/reference anchor with a conservative 4% twelve-month decline toward today.
Confidence: low
PSU: Corsair RM1000e 1000W
PSU fallback: current market/reference anchor with a very small 2% twelve-month category adjustment.
Confidence: medium
Case: Fractal Design Meshify 2
Case fallback: flat estimate from the current market/reference anchor.
Confidence: medium
Cooler: be quiet! Dark Rock Pro 5
Cooler fallback: flat estimate from the current market/reference anchor.
Confidence: medium
Component Pricing Breakdown
Prices use Estonian market data when available, otherwise reference estimates. Displayed component prices include the assembly/configuration markup; payable order price applies only when the purchase panel allows online checkout.
| Component | Product | Displayed price |
|---|---|---|
| Storage | Samsung 990 Pro 2TB Updated todayVerified pricing input | €400 |
| RAM | Corsair Vengeance 96GB (2x48GB) DDR5-5600 CL40 Updated 4 days agoLow price sample | €722 |
| CPU | Intel Core i7-14700K Updated yesterdayLow price sample | €462 |
| GPU | AMD Radeon RX 7900 XTX Stale market dataLast checked 32 days ago | €1,080 |
| Motherboard | MSI MPG Z790 Carbon WiFi Planning reference price | €493 |
| PSU | Corsair RM1000e 1000W Updated todayLow price sample | €162 |
| Case | Fractal Design Meshify 2 Updated yesterdayVerified pricing input | €134 |
| Cooler | be quiet! Dark Rock Pro 5 Updated todayVerified pricing input | €83 |
| Estimated build configuration total | €3,536 | |
Build Notes
Good VRAM-per-euro only after the exact ROCm/PyTorch/Ollama stack is validated for the buyer's workload. CUDA-first tools, training recipes, and plugins should be assumed NVIDIA-first unless tested.
Source refs: amd.com, intel.com
Order
Quote reference price
€3,536
Shown for planning. Direct checkout remains quote-only until fresh market pricing and availability are checked.
Price chart shows Estonian market averages before assembly/configuration markup; quote-only pricing is manually confirmed before payment.
Direct checkout blocker
CPU: Intel Core i7-14700K - market price is stale
Quote-only because the latest market pricing is stale.
Fresh, non-fallback Estonian market pricing is required before Stripe payment can be opened. Use the verified quote request on this page for manual review.
What happens after your quote request
- No payment is taken from the quote request form.
- We review your use case, model targets, timeline, and budget.
- We verify suitable parts and current Estonian market pricing.
- Possible substitutions or changes are confirmed before any payment link.
- We usually send the next step or follow-up questions within 1-2 business days.
Support and questions continue through the order or quote email thread.
Request a verified quote
The request does not take payment. We manually verify price and availability, then confirm substitutions or changes before offering any payment link.
Practical model fit
Local AI examples
Examples for Radeon 24GB ROCm Compatibility Build, based mainly on GPU VRAM and system memory.
Good fit for private chatGood fit for coding helpGood fit for document summariesNot ideal for 70B+ models
Starter pick
Llama 3.2 3B Instruct
A small, friendly starter model for learning local AI without needing a large GPU.
It is easy to download, small enough for almost any LLMLab machine, and useful for basic private chat.
Good fit
ollama run llama3.2
Likely good memory headroom for this quantized model at normal context sizes.
Good fit
Mistral 7B Instruct v0.3
Fast general chat and simple assistant tasks
A fast classic 7B model that is easy to run and compare against newer models.
Likely good memory headroom for this quantized model at normal context sizes.
Llama 3.1 8B Instruct
Everyday private chat and document summaries
A widely supported everyday local chat model when the machine has at least an 8GB to 12GB GPU.
Likely good memory headroom for this quantized model at normal context sizes.
Qwen3 8B
General chat, analysis, multilingual questions
A capable modern 8B-class local model for chat, analysis, and lightweight reasoning.
Likely good memory headroom for this quantized model at normal context sizes.
Expandable technical details
Assumptions
- GPU VRAM assumption: 24GB from AMD Radeon RX 7900 XTX.
- System RAM: 96GB.
- Ratings assume Q4-style quantization, moderate context, one local model running at a time. Treat them as fit guidance, not a speed estimate.
Llama 3.2 3B Instruct technical details
Family: Meta Llama 3.2
Parameters: 3B
Quantization: Q4_K_M
Approx. model size: 2GB
CPU-only: Possible
VRAM: 0GB min / 4GB recommended
RAM: 8GB min / 16GB recommended
Full GPU offload: Should be possible when memory fits
Context warning: Long documents can still push memory use up, even with a small model.
Research sources
Researched: 2026-06-22
Qwen3 4B technical details
Family: Qwen3
Parameters: 4B
Quantization: Q4_K_M
Approx. model size: 2.5GB
CPU-only: Possible
VRAM: 4GB min / 6GB recommended
RAM: 8GB min / 16GB recommended
Full GPU offload: Should be possible when memory fits
Context warning: Keep the context window modest on 8GB to 16GB systems.
Mistral 7B Instruct v0.3 technical details
Family: Mistral 7B
Parameters: 7.3B
Quantization: Q4_K_M
Approx. model size: 4.4GB
CPU-only: Not recommended
VRAM: 8GB min / 12GB recommended
RAM: 16GB min / 32GB recommended
Full GPU offload: Should be possible when memory fits
Context warning: Long context support does not mean every machine should use the maximum context.
Research sources
Researched: 2026-06-22
Llama 3.1 8B Instruct technical details
Family: Meta Llama 3.1
Parameters: 8B
Quantization: Q4_K_M
Approx. model size: 4.9GB
CPU-only: Not recommended
VRAM: 8GB min / 12GB recommended
RAM: 16GB min / 32GB recommended
Full GPU offload: Should be possible when memory fits
Context warning: The Q4 model is under 5GB, but KV cache grows with context length.
Research sources
Researched: 2026-06-22
Qwen3 8B technical details
Family: Qwen3
Parameters: 8B
Quantization: Q4_K_M
Approx. model size: 5.03GB
CPU-only: Not recommended
VRAM: 8GB min / 12GB recommended
RAM: 16GB min / 32GB recommended
Full GPU offload: Should be possible when memory fits
Context warning: A 32K+ context can be much heavier than a short chat session.
Local AI performance is approximate. Results depend on quantization, context length, backend, drivers, RAM, and whether the model fits fully in VRAM.
Order and handover
Key practical details
After payment or quote request
You receive a confirmation email. We check availability and confirm any practical substitutions before continuing.
Assembly and QA
Planned work includes software, drivers, a GPU/AI smoke test, thermal load sanity check, and memory/storage health checks.
Handover in Estonia
Pickup or local delivery method and timing are agreed after availability is checked.
Warranty and support
Warranty depends on the component, manufacturer, and retailer. Questions continue through the order or quote email thread.
Changes and cancellations
Changes are confirmed in writing; after sourcing or assembly begins, custom-order handling may depend on order state.
Payment security
Card details are entered in Stripe checkout. LLMLab.ee does not collect or store full card numbers.
AI terms in plain language
VRAM
Memory on the graphics card; usually the main limit for local AI model size.
Unified memory
Apple Silicon memory shared by CPU and GPU. Useful for local AI, but not identical to NVIDIA VRAM.
7B / 13B / 70B
A rough model-size signal. Larger numbers usually need more memory and may run slower.
q4 / quantization
A compressed 4-bit model that uses less memory, sometimes with quality or speed tradeoffs.