GreenCube
Get GreenCube

GreenCube blog

GPU First For Developers: Gemma <12GB, Llama 3 40GB+

Neither family wins everywhere, and your graphics card decides more than the benchmarks do. Gemma is the better start on modest hardware, especially if you need the model to read images: Gemma 3 from 4B up and Gemma 4 take images natively, and Gemma 4 comes under the Apache 2.0 licence. Llama 3 is the better start if you want the largest ecosystem of fine-tunes and tools, or a 70B model and the 40 GB or more of graphics memory to run it.

Here are the checkpoints worth knowing, what each needs, and how to test them before you commit.

The checkpoints to shortlist

Llama 3 family (Meta)

Meta has since released Llama 4, but Llama 3 is still the version most local tools, guides and fine-tunes are built around.

Gemma family (Google)

Not sure your PC is up to it? Check what runs on yours

How they differ

Images are the clearest difference at small sizes. Gemma 3 4B and the small Gemma 4 models read images in the same model, while the small Llama 3.2 models (1B and 3B) are text only, and Llama's vision models start at 11B.

Ecosystem is Llama's advantage. It has been public longer, so there are more fine-tuned versions, training recipes and guides for it, and every runtime (llama.cpp, Ollama, LM Studio, vLLM) supports it well. Gemma is well supported too, but you'll find fewer community variants.

At the very top, Llama goes bigger. Llama 3.1 405B and the 70B models are a different class from a 27B Gemma 3, especially on code and long reasoning, but they need server-class hardware. For coding, bigger usually means better in both families; if code is your main job, also look at models trained specifically for it.

Published benchmark scores change with every release and every quantization, so treat them as pointers. The only test that counts is your own prompts on your own card.

Licences

Llama models use Meta's Llama Community License. It allows commercial use, but it adds conditions: an acceptable use policy, attribution rules, and a clause that very large companies (over 700 million monthly users) need a separate licence from Meta. Gemma 2 and 3 use Google's Gemma Terms of Use, which also allow commercial use with a list of prohibited uses. Gemma 4 moved to Apache 2.0, a standard open-source licence with no extra use policy. If you're shipping a product, read the actual licence text.

Matching your hardware to a model

These are rough sizes for 4-bit (Q4) files. The model file plus about 1.5 GB for the conversation should fit in your card's memory.

Your graphics memoryGemmaLlama
No card, 8–16 GB RAMGemma 4 E2B, Gemma 3 1B or 4BLlama 3.2 1B or 3B
6–8 GBGemma 4 E4B, Gemma 3 4BLlama 3.1 8B
12–16 GBGemma 3 12BLlama 3.1 8B at higher quality, Llama 3.2 11B Vision
24 GBGemma 3 27BNothing between 11B and 70B; 8B at full quality
40 GB or more, or several cardsAny Gemma at higher qualityLlama 3.3 70B

A model that spills out of the card into normal RAM gets much slower, so a smaller model that fits usually beats a bigger one that doesn't. More in how much VRAM for AI and Gemma 4 requirements.

How to choose and test

  1. Start from your hardware. If it doesn't run well on what you have, nothing else matters.
  2. Decide whether you need image input. If yes, that narrows the list quickly.
  3. Check the licence against what you'll do with it.
  4. Run 20 or so real prompts from your own work through two or three candidates, at the quantization you'll actually use, and read the answers side by side.
  5. Measure speed on your card. Tokens per second on someone else's machine tells you little.

What we use

I build GreenCube, a Windows app that runs AI offline, so here's what we went with, for what it's worth. GreenCube runs Gemma 4: Cube 2B is built on Gemma 4 E2B for smaller PCs, and Cube 4B on Gemma 4 E4B for PCs with a graphics card, and the app picks one for you. On the PCs we tested, it wrote 5–7 tokens a second on an 8 GB laptop with no card, 14–18 on a 16 GB laptop, and 37–76 on most gaming PCs with a 6 GB or bigger card. If you'd rather run Llama or Gemma checkpoints yourself and pick them by hand, Ollama or LM Studio is the way to go.

Gemma and Gemini are not the same thing

People mix these up. Gemini is Google's cloud assistant and family of hosted models; you use it through Google's apps and API. Gemma is a family of open models Google publishes for anyone to download and run, built from the same research. You can run Gemma on your own PC, offline; you can't do that with Gemini.

Questions

Is Gemma better than Llama?

Neither wins everywhere. Gemma is the better start on modest hardware or when you need image input; Llama has more fine-tunes and bigger sizes at the top, which helps with code and long reasoning. Test both on your own prompts and your own card.

Is Gemma 3 free to use?

Yes. The weights are free to download under Google's Gemma Terms of Use, which allow commercial use with a list of banned uses, and Gemma 4 moved to the standard Apache 2.0 licence. Your only cost is the hardware.

Is Google Gemma the same as Gemini?

No. Gemini is Google's cloud assistant and hosted models, used through its apps and API; Gemma is a family of open models from the same research that anyone can download and run offline on their own PC.

Which Gemma is best for coding?

The biggest one that fits in your graphics memory, since bigger is usually better for code in both families. If code is your main job, also look at models trained just for it.

Click around GreenCube right here

This is the app’s own window. Send one of the prompts, open what it makes and change it by chatting, or make an image in Images.

Good evening.

What do you want to make?

Message GreenCube…
Cube 2B
On your computer · Cube 2B
SlidesCauses of World War I

Example answers to give you a feel; nothing here runs AI. In the app, Cube 2B writes its own on your PC, offline.

Will GreenCube run on your PC?

  • Seed8 GB of RAM, no graphics cardEverything works, just slower.
  • Sprout16 GB of RAM, or 8 GB with a cardSteady speed, writes slide decks.
  • BloomA graphics card with 8 GB, or a 4-6 GB card with 16 GB of RAMFast, pictures with no waiting.
  • ThriveA card with 8 GB or more and 24 GB of RAM or moreThe fastest.

GreenCube looks at your PC and sets up the AI model that fits it: no terminal, no settings. €9.99 (US$9.99), paid once, and it's yours.

Check your PC Get GreenCube