Pangu 3.0

Pangu 3.0 was published in July 2023. Capability per parameter has improved considerably since, so a newer model of the same size is often the better use of the same hardware.

Pangu 3.0 works in Multimodal, Language, Image generation, Vision, and is recorded as handling language modeling/generation, Image generation. A model can carry several of each, so these are the areas it was built for rather than a limit on what it will attempt.

None. Pangu 3.0 is a closed model — its weights were never published, so it cannot be downloaded or run on your own hardware at any price. It is reachable only through its provider.

No. Pangu 3.0 has not had its weights published, so it exists only as a service controlled by its owner.

Pangu 3.0 has 100B parameters. 100B? I think the five foundation models are all included in the same system, instead of being five different variants of Pangu, but that's not very clear. I think that's implied by "All of these capability sets will be made available to customers and partners, and will be consistent regardless of the model size". https://www.huaweicloud.com/intl/en-us/news/20230707180809498.html "Huawei Cloud Pangu models were designed to focus on the practical needs of specific industry scenarios. The newly-launched Pangu Models 3.0 use a "5+N+X" three-layer architecture. The L0 layer consists of five foundation models: NLP, CV, multimodal, prediction, and scientific computing, which provide general skills to power an endless possibility of industry-specific applications. Pangu Models 3.0 are available in different sizes: 10 billion parameters, 38 billion parameters, 71 billion parameters, and 100 billion parameters, meeting diverse customer needs and different standards on latency and response times. Brand-new capability sets are also provided, such as knowledge-based Q&A, copywriting, and code generation for the Pangu NLP model; and image generation and understanding for the Pangu multimodal model. All of these capability sets will be made available to customers and partners, and will be consistent regardless of the model size (number of parameters). The L1 layer consists of N industry-tailored models. Huawei Cloud can provide customers with industry models it has trained on open industry datasets, including Pangu models for government, finance, manufacturing, mining, and meteorology. Alternatively, customers can train their own models using their own datasets based on Huawei's L0 or L1 Pangu models. The L2 layer provides pre-trained models for specific industry scenarios and tasks, such as intelligent government hotline, intelligent branch assistant, lead compound screening, conveyor belt foreign object detection, and typhoon trajectory prediction. These models can be quickly deployed off-the-shelf.". That figure is the total, and it is what decides how much memory the model needs — roughly half a gigabyte per billion at the compression most people use.

Pangu 3.0 was published by Huawei, based in China, categorised as industry.