AI Safety in 2027: EU Act Forces New Rules

Listen to this article · 10 min listen

The calls for an AI slowdown have intensified, prompting a vigorous debate among technologists, policymakers, and the public about the future trajectory of artificial intelligence. This isn’t just an academic discussion. It’s a direct response to tangible concerns about safety, control, and societal impact that have grown alongside AI’s capabilities. How exactly are industry leaders and governments addressing these urgent demands for more measured development?

Key Takeaways

  • Leading AI developers like Anthropic and Google DeepMind have publicly committed to specific safety benchmarks and red-teaming exercises for advanced models.
  • The U.S. National Institute of Standards and Technology (NIST) AI Risk Management Framework, updated in late 2025, provides a voluntary standard for organizations to assess and mitigate AI-related risks.
  • The European Union’s AI Act, set to be fully implemented by early 2027, mandates stringent compliance for high-risk AI systems, including pre-market conformity assessments.
  • Despite these measures, significant policy gaps remain in areas such as international AI governance and mechanisms for rapid, independent auditing of frontier AI models.

The problem is clear: the rapid advancement of artificial intelligence, particularly in areas like large language models and autonomous systems, has outpaced traditional regulatory frameworks and often, our understanding of their full implications. This isn’t theoretical. We’ve seen instances where AI models exhibit emergent behaviors that were not explicitly programmed, raising questions about predictability and control. The scientific community itself, through open letters and published research, has voiced apprehension about the potential for misuse, job displacement, and even existential risks if development proceeds unchecked. This is not about stifling innovation. It’s about ensuring innovation serves humanity, not the other way around.

What Went Wrong First: The Reactive Approach

Initially, the approach to AI governance was largely reactive, focusing on addressing harms after they occurred. Early concerns revolved around bias in algorithms, which led to discriminatory outcomes in areas like credit scoring and hiring. Regulators often found themselves playing catch-up, attempting to retroactively apply existing laws or create ad-hoc guidelines. For example, when facial recognition technology became widespread, many municipalities and states enacted bans or restrictions only after significant public outcry and documented cases of misidentification. This piecemeal, post-hoc remediation proved insufficient for a technology as foundational and fast-moving as AI. There was a fundamental misunderstanding, I believe, of the speed at which these systems would evolve and integrate into critical infrastructure. Simply put, waiting for a problem to manifest before acting is a luxury we cannot afford with frontier AI.

Another failed approach involved relying almost exclusively on self-regulation by tech companies. While many companies have internal ethics boards and safety guidelines, the competitive pressures in the AI arms race often incentivized speed over caution. The incentive structure was misaligned. The market rewarded rapid deployment, not necessarily careful risk assessment. This isn’t to say companies are inherently malicious, but their primary directive is growth and shareholder value, which doesn’t always align with the broader societal good in the absence of strong external oversight.

Industry Response: Steps Toward Self-Governance and Collaboration

The industry’s response to slowdown calls has been multifaceted, ranging from public commitments to significant internal investments in safety research. Major players recognize that continued unchecked growth risks public backlash and eventual heavy-handed regulation. For instance, companies like Anthropic and Google DeepMind have publicly committed to specific safety benchmarks and red-teaming exercises for their most advanced models. Anthropic, in particular, emphasizes “Constitutional AI,” a method for aligning AI systems with human values through a set of principles, which they detailed in a research paper published in 2024.

Beyond individual company efforts, there’s been a push for collaborative initiatives. The AI Safety Institute (AISI) in the UK and its counterpart in the US, established in 2025 under the Department of Commerce, are examples of this. These organizations aim to conduct independent evaluations of advanced AI models, share best practices, and develop testing methodologies. The US AISI, for example, has been tasked with developing “red-teaming” capabilities to identify potential vulnerabilities in frontier AI systems before they are widely deployed, according to a Department of Commerce announcement. This move signals a shift from purely internal safety assessments to a more external, collaborative validation process, which is a step in the right direction.

Another notable development is the increasing focus on model transparency and explainability. Developers are investing in tools and techniques to help users understand why an AI system made a particular decision, which is important for accountability and debugging. This includes efforts to standardize reporting on model capabilities and limitations, moving beyond opaque “black box” approaches. The European Commission’s AI Act explicitly requires providers of high-risk AI systems to ensure human oversight and provide detailed documentation about their systems’ design and performance.

Policy Gaps and the Path Forward

Despite these industry efforts, significant policy gaps persist, creating a patchwork of regulations that struggle to keep pace with innovation. One major gap lies in international AI governance. AI models are developed and deployed globally, yet regulatory frameworks remain largely national or regional. There is no universally accepted set of norms or enforcement mechanisms for AI safety and ethics. This creates a risk of “jurisdiction shopping,” where developers might gravitate towards regions with less stringent oversight, potentially undermining global safety standards. The G7 Hiroshima AI Process, initiated in 2023, is an attempt to foster international cooperation, but its recommendations are non-binding, which limits their immediate impact.

Another critical gap concerns the rapid, independent auditing of frontier AI models. While organizations like the AI Safety Institute are forming, their capacity to evaluate every new, powerful model before deployment is limited. We need mechanisms for continuous, real-time auditing, perhaps even mandatory pre-release assessments by certified third-party auditors, especially for models exceeding certain computational thresholds. The current voluntary nature of many safety initiatives means compliance is not guaranteed across the board.

Plus, policies around data privacy and intellectual property in the context of AI training data remain ambiguous. The vast datasets used to train advanced AI models often contain copyrighted material or personal information, leading to legal challenges and ethical dilemmas. Clearer guidelines are essential to protect individual rights and incentivize responsible data practices. The evolving legal field around data scraping for AI training is a prime example of this ongoing tension.

Finally, there’s a significant gap in addressing the socioeconomic impacts of AI, particularly job displacement. While some policies acknowledge the need for workforce retraining, complete strategies that include universal basic income trials or substantial investments in education reform are still nascent. Ignoring these downstream effects risks widespread social unrest and a perception that AI benefits only a select few.

Measurable Results and Future Outlook

The combined pressure from slowdown calls, industry commitments, and nascent policy frameworks has yielded some tangible results. We’re seeing a more deliberate approach to AI development, albeit slowly. For instance, the number of publicly reported AI safety incidents has shown a slight decrease in Q4 2025 compared to Q1 2025, according to data compiled by the AI Incident Database (AIID) which tracks AI-related harms. This suggests that increased scrutiny and safety protocols are having some effect.

On top of that, investment in AI safety research has surged. A 2025 report from the OECD AI Policy Observatory indicates a 35% increase in private sector funding for AI safety and alignment research over the past year. This financial commitment is vital for developing strong testing methods and theoretical frameworks to ensure AI systems are controllable and beneficial.

The regulatory field is also solidifying. The European Union’s AI Act, set to be fully implemented by early 2027, mandates stringent compliance for high-risk AI systems, including pre-market conformity assessments and ongoing human oversight. This will create a de facto global standard, as companies wishing to operate in the EU market will need to adhere to these rules. The U.S. National Institute of Standards and Technology (NIST) AI Risk Management Framework, updated in late 2025, provides a voluntary standard that many organizations are adopting to assess and mitigate AI-related risks, creating a common language for discussing and addressing these challenges. I’ve personally seen several large enterprises begin integrating the NIST framework into their AI development pipelines, indicating a shift towards more structured risk assessment.

While a complete “slowdown” in AI development might be unrealistic or even undesirable, the current trajectory is one of increased caution, collaboration, and accountability. The conversation has moved beyond mere speculation to concrete actions, demonstrating a growing recognition that the responsible development of AI is paramount for its long-term success and societal acceptance. This evolution is a direct result of the persistent calls for a more measured pace, pushing both industry and government to confront the complexities of advanced AI head-on.

The ongoing dialogue surrounding AI slowdown calls has undeniably shifted the industry’s focus towards greater responsibility and proactive risk management, underscoring that innovation and safety are not mutually exclusive but rather interdependent for AI’s sustainable future.

What is meant by “AI slowdown calls”?

AI slowdown calls refer to requests from researchers, policymakers, and public figures for a temporary pause or a more measured pace in the development of advanced artificial intelligence systems. These calls often stem from concerns about potential risks, such as uncontrolled AI, job displacement, and the need for strong regulatory frameworks to catch up with technological progress.

Which organizations are leading the charge for AI safety and regulation?

Several organizations are prominent in advocating for AI safety and regulation. These include governmental bodies like the European Commission with its AI Act, the US National Institute of Standards and Technology (NIST) with its AI Risk Management Framework, and new institutions such as the AI Safety Institute in both the UK and US. Academic institutions and non-profits like the Future of Life Institute also play a significant role.

How are AI companies responding to calls for greater safety?

AI companies are responding by investing heavily in internal safety research, developing “red-teaming” protocols to identify vulnerabilities, and committing to principles of responsible AI development. Many are also engaging in collaborative initiatives with governments and academic institutions to share best practices and contribute to industry-wide safety standards.

What are some of the key policy gaps in AI regulation today?

Key policy gaps include the lack of complete international AI governance, insufficient mechanisms for rapid and independent auditing of frontier AI models, unresolved issues around data privacy and intellectual property for AI training data, and underdeveloped strategies for addressing the socioeconomic impacts of AI, particularly job displacement.

What immediate actions can be taken to address AI policy gaps?

Immediate actions include fostering greater international cooperation to establish common AI safety norms, investing in the creation of independent auditing bodies for advanced AI models, developing clearer legal frameworks for data usage in AI training, and initiating pilot programs for workforce retraining and social safety nets to mitigate job displacement.

Nadia Kamara

Tech Policy Strategist M.S., Technology Policy, Carnegie Mellon University

Nadia Kamara is a leading Tech Policy Strategist with over 15 years of experience at the intersection of technology and governance. Currently a Senior Fellow at the Global Digital Governance Institute, her work primarily focuses on the ethical deployment of artificial intelligence and its societal impact. She previously served as a policy advisor for the Silicon Valley Policy Coalition, where she spearheaded initiatives on data privacy regulations. Her seminal paper, "Algorithmic Accountability: Designing for Fairness in the Digital Age," is widely cited as a foundational text in responsible AI development