Edge Rewrite
Jump to content

Open weights

From Wikipedia, the free encyclopedia

Open weights are the publicly released learned parameters of a trained artificial intelligence model, principally its weights and biases. In an artificial neural network, weights are numerical values that determine how strongly inputs contribute to the network's calculations. Publishing these values allows others to download and use the model, while permission to modify, fine-tune or redistribute it depends on its license. The term is commonly applied to large language models and other generative artificial intelligence models.[1][2]

Characteristics

[edit]

During training, a neural network adjusts its parameters to improve its output. Weights determine the contribution of inputs to weighted sums, while biases are additional learned values. A model described as having seven billion parameters contains roughly seven billion learned values.[3]

Model openness

[edit]

Releasing model weights may form part of a broader effort to make an artificial intelligence model more transparent and reproducible. The Model Openness Framework evaluates whether components such as the model's parameters, source code, training data, evaluation results, intermediate checkpoints and technical documentation are publicly available under an open license. Under the framework, releasing only the final weights represents a lower degree of openness than releasing the materials needed to study, modify and reproduce the model.[4]

Model cards

[edit]

A model card is a document accompanying a trained machine learning model that describes a model’s intended uses, limitations, training data and evaluation results. On Hugging Face, model cards are stored as Markdown README.md files with additional metadata in each model repository, helping users evaluate a model before downloading or deploying it.[5][6]

Comparison with open-source artificial intelligence

[edit]

The Open Source Initiative distinguishes open weights from open-source artificial intelligence when the materials needed to study and modify the model's development process are not also available.

Comparison of open weights and open-source artificial intelligence[1]
Component Open weights Open-source AI
Weights and biases Released Released
Training code Not shared Fully shared
Intermediate checkpoints Withheld Desirable but not required
Training dataset Not shared or disclosed Released where legally permitted
Training-data composition Partially disclosed or undisclosed Fully disclosed

Benefits and concerns

[edit]

Open weights can support local deployment, customization, independent research and competition without requiring access through the original developer's API. However, widely distributed weights generally cannot be withdrawn and may be modified to remove safeguards. A 2024 report by the National Telecommunications and Information Administration examined these benefits and risks and recommended continued monitoring rather than immediate restrictions.[7]

See also

[edit]

References

[edit]
  1. 1 2 "Open Weights: not quite what you've been told". Open Source Initiative. Retrieved 28 July 2026.
  2. "Neural networks: Nodes and hidden layers". Google for Developers. Google. 3 December 2025. Retrieved 28 July 2026.
  3. "Machine Learning Glossary: ML Fundamentals". Google for Developers. Google. Retrieved 28 July 2026.
  4. White, Matt; Haddad, Ibrahim; Osborne, Cailean; Liu, Xiao-Yang; Abdelmonsef, Ahmed; Varghese, Sachin Mathew; Le Hors, Arnaud (2024). "The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence". arXiv:2403.13784 [cs.AI].
  5. "Model Cards". Hugging Face. Retrieved 28 July 2026.
  6. Mitchell, Margaret; Wu, Simone; Zaldivar, Andrew; Barnes, Parker; Vasserman, Lucy; Hutchinson, Ben; Spitzer, Elena; Raji, Inioluwa Deborah; Gebru, Timnit (2019). Model Cards for Model Reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery. pp. 220–229. arXiv:1810.03993. doi:10.1145/3287560.3287596.
  7. "Dual-Use Foundation Models with Widely Available Model Weights Report". National Telecommunications and Information Administration. Retrieved 28 July 2026.
[edit]