Inkling (large language model)
Inkling is an open-weights large language model created by Thinking Machines company, first released on July 15, 2026.[1] It is published under an Apache 2.0 license.[2] The model allows text, images and audio as input, and can be used for tasks such as chat, software development, multilingual applications or agentic systems. [2]
Training
[edit]The first large language model released by Thinking Machines, Inkling was trained with 45 trillion tokens of text, image, audio, and video. It reasons natively from input in any of these four formats, while, at the moment, it can generate only text, including source code or structured data.[3]
Features
[edit]Inkling was designed to be adaptable and efficient when used in real-world workflows. The cost/performance relationship can be optimized, by programmatically adjusting the model's reasoning budget (that is, the amount of "thought" that the model must perform before generating an output), in a scale from 0.2 to 0.99. This way, different levels of "thinking" effort can be used according to the needs of each particular task.[4]
Unlike most other large language models (including open-weight ones), Inkling was created with a focus on resistance to censorship, providing direct answers when questioned on censored or politically sensitive topics. Its creators recommend using external tools for content moderation, since they consider that internal safety evaluation in the language models occasionally doesn't prevent the model from complying with potentially harmful prompts that shouldn't be answered.[4]
Technical information
[edit]The model allows for a context window of up to 1,048,576 tokens,[2] and can be deployed using common inference libraries such as llama.cpp.[4]
Inference hardware requirements
[edit]The 1-bit dynamic quantization variant, designated as UD-IQ1_S, requires 270 GB of disk space for storage. Operational deployment of this 1-bit quantization requires a hardware configuration such as a Mac Studio Ultra, or alternative systems equipped with a minimum combined RAM and VRAM capacity of approximately 290 GB. In comparison, while the 1-bit variant can be accommodated within a 290 GB RAM system configuration, the 6/8-bit variant necessitates a minimum of 900 GB of RAM.[2]
The following table outlines the total memory requirements (RAM + VRAM, or unified memory) required for model inference across different quantization levels:[2]
| Quantization Level | Memory Required |
|---|---|
| BF16 | 1900 GB |
| 6/8-bit | 870 GB |
| 4-bit | 600 GB |
| 3-bit | 450 GB |
| 2-bit | 325 GB |
| 1-bit | 280-295 GB |
Retained top-1 accuracy
[edit]The following table outlines the percentage of original accuracy retained by the model across different quantization levels:[2]
| Quantization Level | Accuracy Retained |
|---|---|
| BF16 | 100.0% |
| 6/8-bit | 99.8% |
| 4-bit | 94.4% |
| 3-bit | 88.7% |
| 2-bit | 81.0% |
| 1-bit | 74.2%-77.4% |
References
[edit]- ↑ "Inkling: Thinking Machines' Open-Weights Model". www.datacamp.com. Retrieved 2026-07-20.
- 1 2 3 4 5 6 "Inkling - How to Run Locally | Unsloth Documentation". unsloth.ai. 2026-07-18. Retrieved 2026-07-20.
- ↑ Loizos, Connie (2026-07-15). "Thinking Machines amps up its bet against one-size-fits-all AI with its first open model, Inkling". TechCrunch. Retrieved 2026-07-20.
- 1 2 3 Franzen, Carl (2026-07-15). "Thinking Machines open sources first multimodal language model, Inkling, focused on low cost and 'resistance to censorship'". VentureBeat. Retrieved 2026-07-20.