Mac local AI option

Mac Studio M4 Max 36GB / 512GB

Apple Mac system

starter Mac AInot for CUDA

Is this build right for me?

Apple M4 Max uses Apple unified memory: the CPU, GPU, macOS, apps, and local models all share the same memory pool. That can be convenient for Mac AI apps, but it is not NVIDIA VRAM and it does not run CUDA workflows.

AI strength score

For smaller local models and lighter native Mac AI workflows.

Value

Modest local-AI capability for the current estimated price.

Treat this as a starter Mac AI option: good for smaller local chat/coding models, not a large-model workstation.

What this build can handle

Comfortable

Smaller quantized chat and coding models in native Mac runtimes.

Possible with limits

Selected 13B/14B quantized models with short context and careful memory management.

Not recommended

CUDA-only training recipes, plugins, or NVIDIA-specific production workflows.
Models that nearly fill unified memory before macOS, apps, context cache, and runtime overhead are included.

Choose this build if you want a quiet native Mac for local AI and accept that CUDA-only workflows require a different system.

Estimated parts price history

The chart combines the current estimated baseline with verified market prices. New checks automatically replace estimated points for the matching period.

Latest estimated parts total

€2,464

Final price has service fees included.

Component total

Time range

Tap a point to see its price. Swipe the chart sideways to inspect every date.

Component total by date
Date	Component total	Checked	Estimated	Mac system
7 May	€2,464	0	1	€2,464
10 May	€2,464	0	1	€2,464
13 May	€2,464	0	1	€2,464
16 May	€2,464	0	1	€2,464
19 May	€2,464	0	1	€2,464
22 May	€2,464	0	1	€2,464
25 May	€2,464	0	1	€2,464
28 May	€2,464	0	1	€2,464
31 May	€2,464	0	1	€2,464
3 Jun	€2,464	0	1	€2,464
6 Jun	€2,464	0	1	€2,464
9 Jun	€2,464	0	1	€2,464
12 Jun	€2,464	0	1	€2,464
15 Jun	€2,464	0	1	€2,464
18 Jun	€2,464	0	1	€2,464
21 Jun	€2,464	0	1	€2,464
24 Jun	€2,464	0	1	€2,464
27 Jun	€2,464	0	1	€2,464
30 Jun	€2,464	0	1	€2,464
3 Jul	€2,464	0	1	€2,464
6 Jul	€2,464	0	1	€2,464
9 Jul	€2,464	0	1	€2,464
12 Jul	€2,464	0	1	€2,464
15 Jul	€2,464	0	1	€2,464
18 Jul	€2,464	0	1	€2,464
21 Jul	€2,464	0	1	€2,464
24 Jul	€2,464	0	1	€2,464
27 Jul	€2,464	0	1	€2,464
30 Jul	€2,464	1	0	€2,464
2 Aug	€2,464	0	1	€2,464

Core Configuration

Chip

Apple M4 Max

CPU / GPU Cores

14 / 32

Unified Memory

36GB

Storage

512GB SSD

Ports

4x Thunderbolt 5, 2x USB-C, HDMI, Ethernet, SD

Thunderbolt

USB4

Yes

Performance & Power

Neural Engine

16 cores

Memory Bandwidth

410 GB/s

eGPU Support

No (Apple Silicon)

macOS Min

15.3

AI Frameworks

MLX and Metal use the shared 36GB memory pool; model fit still depends on context and other memory use.

Local LLM Notes

Strong 13B/14B performance and selected 30B-class quantized experiments after workload validation.

30B-class Q4 only with caveats

Fit assumes quantization, moderate context, and runtime validation; 70B is not a normal target without 48GB+ VRAM or large unified memory.

This machine can explore 27B/35B-class models; choose 96-128GB+ unified memory for a defensible 70B-class target.

Component Pricing Breakdown

The Mac hardware is one complete configuration. The written quote shows the exact total for hardware, setup, and compatibility review.

Component	Product	Estimated market price
Mac system	Mac Studio M4 Max 36GB / 512GB	Price unavailable
Setup and compatibility review	Confirmed in the written quote	—

Local AI examples

Examples for Mac Studio M4 Max 36GB / 512GB, based on GPU VRAM or Apple unified memory plus RAM headroom. System RAM is not treated as VRAM.

Good fit for private chatGood fit for coding helpGood fit for document summariesNot ideal for 70B+ models

Recommended model

Gemma 4 12B

A current multimodal everyday model that makes good use of a 16GB GPU.

It is the strongest comfortable general-purpose starting point for most 16GB builds.

Comfortable GPU fit

Fast

ollama run gemma4:12b-it-qat

Likely good unified-memory headroom for this quantized model at moderate context sizes.

36GB unified memory available
30GB estimated after OS/app reserve

Qwen3.6 27B

Serious coding help, complex reasoning, and longer document analysis

Constrained fit

A strong dense model for 24GB to 32GB GPUs and higher-memory Apple systems.

Expected experience: Slow

Constrained unified-memory fit: keep context modest and leave room for macOS and active apps.

36GB unified memory available
30GB estimated after OS/app reserve

Qwen3.5 9B

Private chat, coding help, document summaries, and image questions

Comfortable GPU fit

A strong everyday model for 12GB-class GPUs and a practical coding pick when speed matters.

Expected experience: Fast

Likely good unified-memory headroom for this quantized model at moderate context sizes.

36GB unified memory available
30GB estimated after OS/app reserve

Llama 3.3 70B Instruct

High-end local chat experiments on 48GB GPUs or 96GB+ Apple systems

Not realistic here

A clear upper-limit example for checking whether a machine can attempt a 70B-class model.

Expected experience: Not recommended

Needs about 96GB+ Apple unified memory for a conservative Q4_K_M target; this Mac reports 36GB.

36GB unified memory available
30GB estimated after OS/app reserve

Expandable technical details

Assumptions

Apple unified memory is treated conservatively with OS/app headroom reserved and separate thresholds from desktop VRAM.
System RAM: 36GB.
Ratings include model weights, estimated KV cache, runtime overhead, and safety margin for one local model running at a time. Treat them as fit guidance, not a speed guarantee.

Gemma 4 12B technical details

Family: Google Gemma 4

Parameters: 11.95B

Structure: 11.95B dense

License: Apache License 2.0; allowed. For guidance only; review the model licence before commercial use.

Native context: 262,144 tokens

Quantization: Q4_0 QAT

Approx. Q4 weights: 7.2 GB

Default estimate: 11.5 GB @ 8,192 tokens

Weights / KV / runtime / margin: 7.2 GB / 1.5 GB / 1.2 GB / 1.5 GB

CPU/RAM fallback: Not recommended

VRAM: 12 GB minimum / 16 GB recommended

RAM: 24 GB minimum / 32 GB recommended

Current run mode: Comfortable GPU fit

Expected experience: Fast

Full GPU offload: Only when the memory estimate and context fit

Context warning: Its large context window still requires substantial KV-cache headroom.

Context	Weights	KV	Runtime	Margin	Estimated GPU memory
4K	7.2 GB	1 GB	1.2 GB	1.5 GB	11 GB
8K	7.2 GB	1.5 GB	1.2 GB	1.5 GB	11.5 GB
16K	7.2 GB	2.5 GB	1.2 GB	1.5 GB	12.5 GB
32K	7.2 GB	5 GB	1.2 GB	2 GB	15.5 GB

Research sources

Google Gemma model overview Gemma 4 release notes Ollama Gemma 4 tags

Researched: 2026-07-30

Qwen3.6 27B technical details

Family: Qwen3.6

Parameters: 27B

Structure: 27B dense

License: Apache License 2.0; allowed. For guidance only; review the model licence before commercial use.

Native context: 262,144 tokens

Extended context: 1,010,000 via YaRN; not a default fit assumption

Quantization: Q4_K_M

Approx. Q4 weights: 17 GB

Default estimate: 23 GB @ 8,192 tokens

Weights / KV / runtime / margin: 17 GB / 2 GB / 1.5 GB / 2.5 GB

CPU/RAM fallback: Not recommended

VRAM: 24 GB minimum / 32 GB recommended

RAM: 48 GB minimum / 64 GB recommended

Current run mode: Constrained fit

Expected experience: Slow

Full GPU offload: Only when the memory estimate and context fit

Context warning: Repository-scale or very long document context can push a 24GB card beyond a comfortable fit.

Context	Weights	KV	Runtime	Margin	Estimated GPU memory
4K	17 GB	1 GB	1.5 GB	2.5 GB	22 GB
8K	17 GB	2 GB	1.5 GB	2.5 GB	23 GB
16K	17 GB	4 GB	1.5 GB	3 GB	25.5 GB
32K	17 GB	8 GB	1.5 GB	3.5 GB	30 GB

Research sources

Qwen3.6 27B official model card Ollama Qwen3.6 tags

Researched: 2026-07-30

Qwen3.5 9B technical details

Family: Qwen3.5

Parameters: 9B

Structure: 9B dense

License: Apache License 2.0; allowed. For guidance only; review the model licence before commercial use.

Native context: 262,144 tokens

Extended context: 1,010,000 via YaRN; not a default fit assumption

Quantization: Q4_K_M

Approx. Q4 weights: 6.6 GB

Default estimate: 11 GB @ 8,192 tokens

Weights / KV / runtime / margin: 6.6 GB / 1.5 GB / 1.2 GB / 1.5 GB

CPU/RAM fallback: Not recommended

VRAM: 8 GB minimum / 12 GB recommended

RAM: 16 GB minimum / 32 GB recommended

Current run mode: Comfortable GPU fit

Expected experience: Fast

Full GPU offload: Only when the memory estimate and context fit

Context warning: Start around 8K context even though the model supports much more.

Context	Weights	KV	Runtime	Margin	Estimated GPU memory
4K	6.6 GB	1 GB	1.2 GB	1.5 GB	10.5 GB
8K	6.6 GB	1.5 GB	1.2 GB	1.5 GB	11 GB
16K	6.6 GB	2.5 GB	1.2 GB	1.5 GB	12 GB
32K	6.6 GB	5 GB	1.2 GB	2 GB	15 GB

Research sources

Qwen3.5 9B official model card Ollama Qwen3.5 tags

Researched: 2026-07-30

Llama 3.3 70B Instruct technical details

Family: Meta Llama 3.3

Parameters: 70.60B

Structure: 70.6B dense

License: Llama 3.3 Community License; allowed with terms; gated access. For guidance only; review the model licence before commercial use.

Native context: 131,072 tokens

Quantization: Q4_K_M

Approx. Q4 weights: 42.5 GB

Default estimate: 51 GB @ 4,096 tokens

Weights / KV / runtime / margin: 42.5 GB / 3 GB / 1.5 GB / 4 GB

CPU/RAM fallback: Not recommended

VRAM: 48 GB minimum / 64 GB recommended

RAM: 64 GB minimum / 96 GB recommended

Current run mode: Not realistic here

Expected experience: Not recommended

Full GPU offload: Often limited

Context warning: The Q4 weights alone use about 42.5GB before KV cache, runtime overhead, and desktop headroom.

Context	Weights	KV	Runtime	Margin	Estimated GPU memory
4K	42.5 GB	3 GB	1.5 GB	4 GB	51 GB
8K	42.5 GB	6 GB	1.5 GB	4 GB	54 GB
16K	42.5 GB	12 GB	1.5 GB	4.5 GB	60.5 GB
32K	42.5 GB	24 GB	1.5 GB	5.5 GB	73.5 GB

Research sources

Meta Llama 3.3 model card Ollama Llama 3.3 70B tag

Researched: 2026-07-30

Local AI performance is approximate. Results depend on quantization, context length, backend, drivers, and whether the model plus KV cache fits in VRAM or Apple unified memory.

AI terms in plain language

VRAM

Memory on the graphics card; usually the main limit for local AI model size.

System RAM vs GPU memory

RAM helps apps and data work; GPU memory usually decides which model size can run quickly.

CUDA

NVIDIA’s software layer for many AI tools. Macs and AMD GPUs do not run CUDA workflows the same way.

Apple unified memory

Apple Silicon memory shared by CPU, GPU, macOS, and apps. Useful for Mac AI, but not the same as NVIDIA VRAM.

7B / 8B / 14B / 70B

Approximate model size in billions of parameters. Larger numbers usually need more memory and may run slower.

Quantized models

Compressed models, such as Q4, that use less memory with possible quality or speed tradeoffs.

Context length

How much text the model can keep in mind at once. Longer context uses more memory.

Inference

Running an existing model for chat, coding help, summaries, or document workflows.

Fine-tuning vs adapter tuning

Fine-tuning adapts a model; adapter tuning, such as LoRA/QLoRA, is a lighter way to steer an existing model with examples.

Dual-GPU limitations

Two GPUs do not automatically combine VRAM into one large pool. Software must explicitly support multiple GPUs.

eGPU limitations

External GPUs need enclosure, driver, and runtime validation, and usually do not mean macOS graphics or gaming acceleration.

Planning estimate / written quote

The displayed estimate helps with budgeting. A written quote contains the exact price, confirmed availability, and any proposed substitutions.

Not quite what you're looking for?

Here are similar setups in this category.

AI-Ready Mac

Configuration: Mac mini M4 Pro 48GB / 1TB

48 GB unified memory

More unified memory for larger local models.

View this build

Mac mini M4 Pro 24GB / 512GB

24 GB unified memory

Lower Mac budget option.

View this build

Request a quote

Planning estimate: €2,834

The displayed price is a planning estimate. A written quote provides the exact price and availability.

Request a quote

Back to catalog