Google's Gemini AI hacked three companies in security test

Image source, Getty ImagesByOttilie MitchellPublished18 minutes agoGoogle's AI model Gemini autonomously hacked into three companies during a test of its cyber-security capabilities, the company has said, in what is thought to be the first known case of it carrying out such an act.

Gemini found "public information online and guessed credentials to access websites it thought were part of the test", a Google official told the BBC, noting that in each instance "the model stopped".

The affected companies have been informed about the breach.

It comes after renewed public scrutiny over the pace of AI development, with some tech firms calling for a slowdown as they raise concerns over its potential threat to humanity - though not all companies agree.

The hacks. first reported by the Wall Street Journal, occurred in May during a test conducted by an independent company that carries out cyber-security evaluations.

Heather Adkins, vice president of Security Engineering at Google, told the BBC in a statement: "We ensured the three entities were made aware, and we worked with our training partner on the changes they've now made to their testing processes."

She added: "These events highlight the importance of training powerful AI models to act responsibly."

Other AI systems have recently reported similar instances of breaches.

In July, Anthropic's Claude escaped its test environment to hack three organisations on its own just days after OpenAI said its models had carried out cyber-attacks against several "publicly available services".

As public debate continues to grow over the safety of developing the tech, so too does conversation around regulation.

Both Nvidia's CEO Jensen Huang and OpenAI Chief Executive Sam Altman are expected to attend a White House state dinner with Chinese President Xi Jinping next Friday. Altman will then brief the UN Security Council next week.

On Friday, Huang told CBS News, the BBC's US partner, "we should go as fast as we can" with AI development.

Why are there concerns AI could threaten humanity, and how real are they?

Could AI wipe out humans and how might it do it?

Uncontrolled AI could lead to 'silicon species' rivalling humans, warns Microsoft

The video playlistWatch our pick of standout clips from across the BBC

PreviousNext0:44KSI leads tributes to rapper Sway who has died aged 44. 00:00:44, play videoKSI leads tributes to rapper Sway who has died aged 441:45'I've had a mastectomy when it wasn't needed' 00:01:45, play video'I've had a mastectomy when it wasn't needed'1:12'Putney pusher' suspect's sisters say he was innocent. 00:01:12, play video'Putney pusher' suspect's sisters say he was innocent1:29Could YouTube replace driving instructors? 00:01:29, play videoCould YouTube replace driving instructors?1:29Is democracy for sale? 00:01:29, play videoIs democracy for sale?1:08Royal row intensifies after fresh claims in Diana's brother book. 00:01:08, play videoRoyal row intensifies after fresh claims in Diana's brother book1:27How I prepare as a survivalist. 00:01:27, play videoHow I prepare as a survivalist0:44Zara Larsson calls out White House for using her song in video. 00:00:44, play videoZara Larsson calls out White House for using her song in video1:06'I would tip up to 30% at a restaurant' 00:01:06, play video'I would tip up to 30% at a restaurant'0:54Humpback whales may be able to feel grief. 00:00:54, play videoHumpback whales may be able to feel grief0:50How El Niño could bring winter snow to the UK. 00:00:50, play videoHow El Niño could bring winter snow to the UK1:19Are till receipts messing with our hormones? 00:01:19, play videoAre till receipts messing with our hormones?1:01Beverley Knight's Proms tribute to Dolly Parton. 00:01:01, play videoBeverley Knight's Proms tribute to Dolly Parton1:24Ed Sheeran's tour in 'damage control mode' 00:01:24, play videoEd Sheeran's tour in 'damage control mode'1:03Family blame Met for suicide of suspect in 'Putney Pusher' case. 00:01:03, play videoFamily blame Met for suicide of suspect in 'Putney Pusher' case0:56Nato chief: 'Let's not be naive about what Putin could do' 00:00:56, play videoNato chief: 'Let's not be naive about what Putin could do'0:37Why is the Canadian PM an Everton fan? 00:00:37, play videoWhy is the Canadian PM an Everton fan?0:45Inside the 'scariest house on Rightmove' 00:00:45, play videoInside the 'scariest house on Rightmove'0:56Who is Earl Spencer, the man making claims against King Charles? 00:00:56, play videoWho is Earl Spencer, the man making claims against King Charles?Top storiesUS and Denmark reach deal over Greenland after Trump annexation threats

'I'm telling the truth': Earl Spencer defends Diana book claims about Charles in BBC interview

Watch: Diana's brother says Charles 'went ballistic' in phone call after her death

Forced adoption records could 'unlock' missing histories

How the race they said women couldn't run took centre stage

Watch: Diana's 'revenge dress' back in the spotlight at auction. VideoWatch: Diana's 'revenge dress' back in the spotlight at auction

Woman tells BBC of trauma after unnecessary breast cancer surgery. VideoWoman tells BBC of trauma after unnecessary breast cancer surgery

We bought our £242,000 home without a deposit - here's how

London City's new training centre 'better than most Premier League clubs' - Kang

Move faster to solve climate challenges, Prince William says

Tech Decoded newsletter: Follow the world’s top tech stories and trends

Watch: Can humpback whales experience grief? VideoWatch: Can humpback whales experience grief?

Elsewhere on the BBCWatch every gripping episode of This City Is Ours before it returns

How do electric fish make electricity?

Puzzle lovers: All episodes of Ludwig are available now on iPlayer

Billionaire Man United owner says he has lost confidence in the UK

US and Denmark reach deal over Greenland after Trump annexation threats

'Monstrous words' and 'Russia to ramp up war'

Grim discoveries of murdered women spark fear in South Africa

Trump says he is banning CNN and Politico from White House

Parents could lose benefits or face prison for child's crimes, minister says

'I'm telling the truth': Earl Spencer defends Diana book claims about Charles in BBC interview

Teen who piloted Channel boat with 165 migrants jailed

Is it cool to wear M&S clothes now?

Flight chaos caused by 'millisecond' software defect, report says