AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Buying for a business?Offer from Amazon

Get business pricing on tech for your team

  • Business-only prices and quantity discounts
  • Tax-exempt purchasing
  • Multiple users, one account, clear invoices
As an affiliate, we earn on qualifying purchases.

Thinking Machines has released its large-scale AI model, Inkling, openly on Hugging Face under Apache 2.0, signaling transparency and a shift in open AI development. The release highlights industry practices and raises questions about open source claims.

Thinking Machines has publicly released its flagship AI model, Inkling, on Hugging Face under the Apache 2.0 license. This marks a notable shift in how large language models are shared, emphasizing transparency and ownership, and directly addresses industry questions about open-source claims and model control.

The Inkling model is a 975-billion-parameter, mixture-of-experts transformer supporting multimodal input (text, images, audio) with a 1-million-token context window. It was trained on 45 trillion tokens across various modalities, using a hybrid optimizer and over 30 million reinforcement learning rollouts. The full weights are now available on Hugging Face, accompanied by detailed specifications and performance metrics.

In addition to the large model, a smaller variant, Inkling-Small, with 276 billion parameters and 12 billion active experts, was also previewed, showing competitive benchmark results. The release is accompanied by a candid discussion of training methods, including synthetic data use, and emphasizes the importance of owning and controlling models rather than renting access through APIs.

However, the release also included a notable caveat: while the weights are open under Apache 2.0, the training data and full pipeline are not published, and there are reports of a separate Model Acceptable Use Policy (AUP) that restricts certain uses, such as surveillance and automated decision-making, which could complicate open-source claims.

At a glance
reportWhen: announced March 2024
The developmentThinking Machines publicly released its Inkling model weights openly on Hugging Face, marking a significant moment in AI development transparency.

Industry Shift Toward Transparent, Open-Weight Models

This release signals a potential shift in AI development, emphasizing transparency, ownership, and control over large models. By providing open weights and openly discussing training practices, Thinking Machines challenges the industry norm of proprietary models and API-based access, possibly influencing future open-source AI releases.

It also raises important questions about the true nature of open source in AI, especially concerning licensing restrictions and use policies layered on top of open weights. For organizations in sensitive domains, this could impact deployment decisions and regulatory considerations.

Amazon

AI model training data analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Recent Trends in Open-Source AI and Industry Practices

Over the past year, there has been increasing debate over the openness of large language models, with some companies releasing models behind closed APIs and others sharing weights openly. Earlier efforts, like Meta’s Llama and EleutherAI’s models, set precedents for open weights, but many proprietary models remain closed or restricted.

Thinking Machines’ approach, combining open weights with transparency about training data and policies, represents a nuanced position that balances openness with responsible use. The recent release comes amid broader industry discussions on AI safety, ownership, and regulatory frameworks.

Notably, the model’s release follows a period of heightened scrutiny after government directives to switch off certain models, emphasizing the importance of owning and controlling AI assets rather than relying solely on external APIs.

“We believe owning your model is crucial for responsible AI development. Our release aims to foster transparency and innovation.”

— Thinking Machines spokesperson

Amazon

multimodal AI development kits

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Open Source Claims vs. Use Restrictions

It remains unclear how the separate Model Acceptable Use Policy (AUP) will be enforced and whether it will significantly restrict the open-source nature of the weights. The exact scope of restrictions and their legal enforceability are still under question, requiring further clarification from Thinking Machines.

Amazon

large language model open source software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps in Industry Adoption and Policy Clarification

Expect further analysis and independent benchmarking of Inkling’s performance and licensing terms. Industry observers will scrutinize the AUP and its implications for open-source AI development. Additionally, other organizations may follow suit, releasing models with similar transparency and restrictions.

Regulatory bodies and user communities are likely to monitor how these layered policies impact responsible AI deployment and ownership.

Amazon

AI model licensing and control tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

What makes Inkling different from other large language models?

Inkling is notable for its open weights under Apache 2.0, its multimodal capabilities, and its emphasis on model ownership, contrasting with many proprietary models that are only accessible via APIs.

What are the potential risks of layered use policies on open models?

Such policies could limit responsible use, create legal uncertainties, and undermine the transparency that open weights aim to provide, especially if enforcement is inconsistent.

How might this release influence future AI model sharing?

It could encourage more organizations to share weights openly while implementing responsible use policies, balancing transparency with safety considerations.

Is the training data for Inkling publicly available?

No, the training data and full training pipeline have not been published, which is typical in the industry but raises questions about reproducibility and transparency.

Source: ThorstenMeyerAI.com

FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

How to Reduce Heat and Noise in a High-Power AI Workstation

Practical strategies to lower heat and noise in high-power AI workstations, focusing on undervolting, cooling, and airflow optimization for sustained workloads.

The Forecast Is the Plan.

Major AI labs publicly commit to automating AI R&D, with OpenAI targeting an automated research intern by September 2026. This signals a shift toward automation-driven development.

Internet of Shit: AI Poop Analysis App Offered to Sell Me Database of Its Users’ Poops

A developer of a stool analysis app is offering a database of 150,000 user images for sale, raising concerns over data privacy and misuse.

How RISC OS Open Has Shaped Technology Operations Over Two Decades

An analysis of how RISC OS Open has influenced technology operations over 20 years, shaping platform development and open-source collaboration.