TL;DR
Thinking Machines has released its large-scale AI model, Inkling, openly on Hugging Face under Apache 2.0, signaling transparency and a shift in open AI development. The release highlights industry practices and raises questions about open source claims.
Thinking Machines has publicly released its flagship AI model, Inkling, on Hugging Face under the Apache 2.0 license. This marks a notable shift in how large language models are shared, emphasizing transparency and ownership, and directly addresses industry questions about open-source claims and model control.
The Inkling model is a 975-billion-parameter, mixture-of-experts transformer supporting multimodal input (text, images, audio) with a 1-million-token context window. It was trained on 45 trillion tokens across various modalities, using a hybrid optimizer and over 30 million reinforcement learning rollouts. The full weights are now available on Hugging Face, accompanied by detailed specifications and performance metrics.
In addition to the large model, a smaller variant, Inkling-Small, with 276 billion parameters and 12 billion active experts, was also previewed, showing competitive benchmark results. The release is accompanied by a candid discussion of training methods, including synthetic data use, and emphasizes the importance of owning and controlling models rather than renting access through APIs.
However, the release also included a notable caveat: while the weights are open under Apache 2.0, the training data and full pipeline are not published, and there are reports of a separate Model Acceptable Use Policy (AUP) that restricts certain uses, such as surveillance and automated decision-making, which could complicate open-source claims.
Industry Shift Toward Transparent, Open-Weight Models
This release signals a potential shift in AI development, emphasizing transparency, ownership, and control over large models. By providing open weights and openly discussing training practices, Thinking Machines challenges the industry norm of proprietary models and API-based access, possibly influencing future open-source AI releases.
It also raises important questions about the true nature of open source in AI, especially concerning licensing restrictions and use policies layered on top of open weights. For organizations in sensitive domains, this could impact deployment decisions and regulatory considerations.
AI model training data analysis tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Recent Trends in Open-Source AI and Industry Practices
Over the past year, there has been increasing debate over the openness of large language models, with some companies releasing models behind closed APIs and others sharing weights openly. Earlier efforts, like Meta’s Llama and EleutherAI’s models, set precedents for open weights, but many proprietary models remain closed or restricted.
Thinking Machines’ approach, combining open weights with transparency about training data and policies, represents a nuanced position that balances openness with responsible use. The recent release comes amid broader industry discussions on AI safety, ownership, and regulatory frameworks.
Notably, the model’s release follows a period of heightened scrutiny after government directives to switch off certain models, emphasizing the importance of owning and controlling AI assets rather than relying solely on external APIs.
“We believe owning your model is crucial for responsible AI development. Our release aims to foster transparency and innovation.”
— Thinking Machines spokesperson
LAFVIN ESP32-S3 1.69" LCD Development Board with Camera, AI Vision Voice Development Kit, Programmable IoT Board with Mic Speaker for STEM Education
- Powerful Microcontroller: ESP32-S3 with 16MB Flash and 8MB PSRAM
- AI Vision & Voice Capabilities: Camera and audio for AI interactions
- Multiple Development Platforms: Supports Arduino IDE and ESP-IDF
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Open Source Claims vs. Use Restrictions
It remains unclear how the separate Model Acceptable Use Policy (AUP) will be enforced and whether it will significantly restrict the open-source nature of the weights. The exact scope of restrictions and their legal enforceability are still under question, requiring further clarification from Thinking Machines.
large language model open source software
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Next Steps in Industry Adoption and Policy Clarification
Expect further analysis and independent benchmarking of Inkling’s performance and licensing terms. Industry observers will scrutinize the AUP and its implications for open-source AI development. Additionally, other organizations may follow suit, releasing models with similar transparency and restrictions.
Regulatory bodies and user communities are likely to monitor how these layered policies impact responsible AI deployment and ownership.
AI model licensing and control tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
What makes Inkling different from other large language models?
Inkling is notable for its open weights under Apache 2.0, its multimodal capabilities, and its emphasis on model ownership, contrasting with many proprietary models that are only accessible via APIs.
What are the potential risks of layered use policies on open models?
Such policies could limit responsible use, create legal uncertainties, and undermine the transparency that open weights aim to provide, especially if enforcement is inconsistent.
How might this release influence future AI model sharing?
It could encourage more organizations to share weights openly while implementing responsible use policies, balancing transparency with safety considerations.
Is the training data for Inkling publicly available?
No, the training data and full training pipeline have not been published, which is typical in the industry but raises questions about reproducibility and transparency.
Source: ThorstenMeyerAI.com
