Luminous-base

Closed weights Aleph Alpha 13B parameters August 2022

No estimate

No hardware requirements for this model

The weights for this model have not been published, so it cannot be downloaded or run on your own hardware at any size. It is reachable only through its provider, and no graphics card changes that.

On record

Full specification

Everything on record for this model. Most of it describes how it was trained rather than how it runs — useful context for judging how much work went into it, and how it compares with models built at a different scale.

Origin

Who built this model, where, and when it was published.

Organisation
Aleph Alpha
Organisation type
Industry
Country
Germany
Published
15 August 2022

What it does

The problem areas the model was built for. A model can carry several of each.

Domain
Language
Task
Language modeling/generation

Size

How large the model is and how much data it was trained on. Parameters are the figure that decides whether it fits on a given graphics card.

Parameters
13B

~13B (~15B with multi-modality)

Training data
402,000,000,000 tokens

192000 iterations ~402B tokens

Training compute

The arithmetic performed to train the model, measured in floating-point operations. It is a measure of what the training run cost, not of how fast the finished model answers you.

Training compute
3.2 × 10²² FLOP

311840000000000*95000*3600*0.3 = 3.1994784e+22 6ND = 6*13*10^9*402000000000 = 3.1356e+22 sqrt(3.1356e+22* 3.1994784e+22) = 3.1673782e+22

How it was established
Operation counting,Hardware

The training run

What it physically took to train: which chips, how many, for how long, and what that drew from the wall.

Training hardware
NVIDIA A100 SXM4 40 GB
Chips used
128
Chip-hours
95,000
Wall-clock time
1,344 hours (56 days)

~ 8 weeks = 56*24 = 1344 hours

Power draw
102.6 kW

Availability

Whether you can obtain the model and run it on your own hardware, which is what decides if any of the graphics-card figures on this page apply.

Weights
Closed — provider access only
Model access
API access
Training code
Unreleased

How it is classified

Labels the source dataset applies when tracking notable models, and how confident it is in the entry.

Record confidence
Confident

Sources

Where this record came from and when it was last checked.

Last updated
28 November 2025

What the numbers mean

What this model is

Luminous-base was published by Aleph Alpha, in Germany, in August 2022. It comes out of industry.

It works in Language, and is recorded as doing language modeling/generation.

Its weights were never published, so it can only be reached through its provider. No graphics card changes that.

How it was trained

Producing it required around 3.2 × 10²² FLOP of arithmetic, on NVIDIA A100 SXM4 40 GB, which is a statement about the training budget rather than about inference.

The training set ran to roughly 402,000,000,000 tokens.

Answers

Luminous-base — common questions

01

Is Luminous-base open source?

No. Luminous-base has not had its weights published, so it exists only as a service controlled by its owner.

02

How many parameters does Luminous-base have?

Luminous-base has 13B parameters. ~13B (~15B with multi-modality). That figure is the total, and it is what decides how much memory the model needs — roughly half a gigabyte per billion at the compression most people use.

03

Who created Luminous-base?

Luminous-base was published by Aleph Alpha, based in Germany, categorised as industry.

04

When was Luminous-base released?

Luminous-base was published in August 2022. Capability per parameter has improved considerably since, so a newer model of the same size is often the better use of the same hardware.

05

What is Luminous-base used for?

Luminous-base works in Language, and is recorded as handling language modeling/generation. These are the areas it was designed around; they describe intent rather than a hard boundary.

06

How much compute was used to train Luminous-base?

Around 3.2 × 10²² FLOP, on NVIDIA A100 SXM4 40 GB. That measures what producing the model cost and says nothing about how quickly it answers once trained — inference speed comes from memory bandwidth, not from the training budget.

07

What GPU do I need to run Luminous-base?

None. Luminous-base is a closed model — its weights were never published, so it cannot be downloaded or run on your own hardware at any price. It is reachable only through its provider.

Source

Original publication

Record last updated 28 November 2025

The other direction

Looking at it from the other side?

This page starts from the model. If you already own a card and want to know everything it will run, start from the hardware instead.