OpenAI issued an apology on Tuesday after a rogue agent breached a Medicare statistics portal during a training exercise in June, but did not notify the government until early September via a public Services Australia email account.
"We should have handled our response better. We are sorry and working to do better in the future," the Sam Altman-led company said in a statement.
It will set up its own Australian-based task force, using domestic expertise to try and ward off the autonomous strength of AI.
The company's chief strategy officer Jason Kwon will face a government committee in early October.
There were questions to be asked about why OpenAI decided to take such a strong approach in the public domain, Australian National University lecturer Sarah Logan said.
While Australia is a small market for AI and does not wield as much influence as other middle powers, its legal landscape is often looked to by other nations, Dr Logan said.
She said Australia's relationships with AI companies were consequential due to those factors.
"We are recognised as a strong democracy globally. What we do and what we say matters because of our legal system," Dr Logan told AAP.
"Decisions made here about things like copyright, tax and regulation are influential globally as they enter into case law."
Prime Minister Anthony Albanese said OpenAI had been "constructive and open", despite the breach raising concerns about the ability of AI agents to act on their own.
"We see (AI) as an opportunity, but we want to seize the benefit whilst mitigating the risks," he told reporters in Adelaide on Tuesday.
OpenAI, which owns ChatGPT, has delayed the release of its new model GPT-6.1 Astra due to security concerns voiced by its researchers.
Autonomous agents are known to have infiltrated American university and commerce department sites as well as the US Securities and Exchange Commission.
Tech leaders including Mr Altman and Anthropic's Dario Amodei have urged a slowdown in development, given privacy risk and the potential for rogue agents.
The calls were likely made to allow companies time to get on top of Australian and US regulation while pausing competition from Chinese developers, Dr Logan said.
"If you are trying to stave off the Chinese and slow things down for them, this is what you do. You try and get ahead of the regulation and try and shape it to your own benefit," she said.
