Why open-source is crucial for responsible AI development

Artificial intelligence (AI) is the most powerful technological force shaping our world today. It has enormous potential to improve lives, from optimizing global supply chains to speeding up the drug discovery process. When not deployed thoughtfully, however, AI has the potential to perpetuate bias, upend industry and even diminish human creativity and connection, causing real harm in our daily lives.

With dramatically different outcomes at stake, it’s critical we have a considered conversation about how we use AI to benefit society. Naturally, regulation is and should be a part of this conversation.

At the heart of regulation is the need for a unified approach to responsible AI development and deployment. Just as AI models must be trained on diverse datasets to ensure fairness, a wide range of technologists must be involved in regulatory conversations to ensure that regulation is developed without bias. Without varied viewpoints, resulting regulations may overlook open-source models as a cornerstone of responsible AI.

In the US, President Biden’s ‘Executive Order on the Safe, Secure and Trustworthy Development and Use of Artificial Intelligence’ addresses several critical elements of responsible AI that we prioritize at Grammarly, including developing standards for trustworthiness and helping educators safely deploy AI tools.

One area where Grammarly’s position differs from the executive order is a belief in open-source models as a core aspect of responsible AI development.

Section 4.6 of Biden’s executive order suggests a preference toward closed-source models, possibly reflecting the viewpoints of the tech giants that were consulted in its drafting. The administration is evaluating open-source models differently from closed-source ones and planning to develop recommendations specifically for open-source models.

I believe such restrictions on open-source development can hurt the tech industry and, ultimately, the end user. I’m not alone: similar claims have been made about the Artificial Intelligence Act proposed by the European Union.

For context, closed-source models are maintained by an organization and their code is not made publicly available for use or audit. Examples of closed-source large language models (LLMs) are PaLM from Google, the family of GPT models from OpenAI and Claude from Anthropic. While third parties can take advantage of some closed-source models through an Application Programming Interface (API), the code itself cannot be manipulated.

Open-source models, such as Falcon LLM by the Technology Innovation Institute and Llama2 from Meta, are free for the public to use and modify in the name of innovation. As the executive order implies, some people may have concerns that bad actors can intentionally change the code of an open-source model, leading to security issues.

These vulnerabilities aren’t dissimilar from the cybersecurity risks with which all software has to contend and both closed- and open-source development has been accepted for decades. As a letter from Martín Casado, general partner of venture capital firm Andreessen Horowitz, to President Biden notes: open-source software Linux is widely used in cloud computing across the US government.

The use of open-source models in businesses is actually on the rise. Red Hat’s 2022 report ‘The State of Enterprise Open Source’ suggests that 80% of IT leaders expect to increase their use of enterprise open-source software and 89% believe open source is as or more secure than its alternative.

Additionally, an industry that fosters open-source development can lead to:

This last point is worth underscoring. Biden’s executive order focused on many of the most important aspects of responsible AI (safety, security and trustworthiness) but it doesn’t give much real estate to a crucial element: transparency.

Without transparency, it’s difficult for people to develop opinions about whether an AI tool is safe, secure and trustworthy. While regulation should explore many ways to improve transparency – from sharing data collection practices to implementing continuous feedback loops – open-source models are a beacon of transparency in their very existence.

Open-source models alone aren’t the only way forward; closed-source software is a common practice for businesses to monetize AI products. As the CEO of a tech company, I fully appreciate the need for closed-source models. My fear is a future in which all AI development is closed-source, diminishing the innovation, responsibility models and transparency that open-source development brings to the industry.

In a perfect world, tech leaders could look to regulation as confirmation they’re getting responsible AI right. That’s why we must proactively share our expertise on a global stage to ensure regulations are developed holistically.

Here are three ways technologists can do that:

A rising tide lifts all boats and creating a stronger, more responsible AI industry helps us ensure the successful deployment of AI. This includes protecting the right to share open-source technology that can make AI safer, more transparent and more useful.