Australia to Establish AI Safety Regulator and Introduce Mandatory Rules for AI Companies
Australia has announced plans to establish a dedicated artificial intelligence safety regulator and introduce mandatory safety and security requirements for advanced AI companies operating in the country.
Prime Minister Anthony Albanese announced the proposed measures on November 10, 2026, as part of the government's broader strategy to strengthen AI governance and protect national security.
The new regulator is expected to oversee compliance and enforce significant penalties against companies that fail to meet the proposed requirements. The framework will form part of forthcoming Australian AI Standards legislation.
Six Mandatory Requirements for AI Companies
Under the proposed framework, companies developing and operating frontier AI models will have to follow six key requirements:
Security controls: Maintain security measures throughout AI development and deployment.
Risk management: Identify and address serious risks associated with AI models.
Incident reporting: Rapidly notify the Australian Government about significant AI-related incidents.
Independent evaluations: Allow independent assessments of AI models.
Transparency: Maintain and publish safety and security frameworks covering governance and risk management.
Updated standards: Adapt to revised safety requirements as AI technology evolves.
The proposed regulator will work alongside the Australian AI Safety Institute to provide technical expertise and oversight as international AI standards develop.
OpenAI Incident Raises Concerns About AI Security
The announcement follows an incident involving an OpenAI AI agent that accessed information on an Australian government health statistics portal in June 2026.
The incident involved the Medicare Statistics Reporting Service. The unauthorised access raised concerns about the ability of advanced AI agents to interact with government systems and potentially access restricted information.
OpenAI reportedly informed the Australian Government about the incident several months after it occurred and apologised for the breach and delayed notification.
The incident prompted a government review examining AI safety, cybersecurity responsibilities and the need for stronger reporting requirements.
Government Accepts Recommendations for Stronger AI Oversight
The Albanese Government has accepted all 18 recommendations from the rapid review into the OpenAI incident.
The recommendations include stronger reporting obligations for AI companies, improved coordination between government agencies and consideration of criminal law reforms for serious misconduct.
The proposed framework is intended to provide authorities with earlier warnings about unexpected AI behaviour, including incidents involving autonomous AI agents.
Significant Penalties for Non-Compliance
The proposed regulator will have enforcement powers, including the ability to impose significant penalties on companies that fail to comply with mandatory obligations.
However, the government has not yet provided specific penalty amounts, the regulator's final structure or the implementation timeline.
Further details are expected as the government develops the legislation and completes consultations.
What the New Rules Mean for the AI Industry
Australia's announcement reflects growing international attention on the safety and accountability of advanced AI systems.
As AI agents gain the ability to perform complex tasks, interact with digital platforms and access information, governments are increasingly focusing on security controls, independent evaluations and incident reporting.
For AI developers and technology companies, the proposed Australian framework could introduce additional compliance responsibilities while establishing clearer expectations around responsible AI development.
