Foundation models, the technology underpinning the rise of generative artificial intelligence (AI), could boost Australia’s productivity, bolster our economy, and transform industries according to a new report by CSIRO, Australia’s national science agency.
Trained on vast amounts of data and able to perform wide-ranging, complex and generalised tasks, foundation models power AI products such as OpenAI’s ChatGPT, Microsoft’s Copilot and Google’s Gemini.
At least 125 foundation models have been developed worldwide over the past few years with most coming from the United States (73%), China (15%) and Europe. Most are made by private-sector technology corporations.
CSIRO’s report on AI foundation models provides an accessible overview of the fast-moving global foundation model landscape, outlining opportunities to minimise risks and maximise their benefit for Australians.
Lead author Dr Stefan Hajkowicz said beneath the hype lies the potential to localise this global technology and improve a broad spectrum of Australian industries and services.
“We’ve all been impressed by the way these models can write a wedding speech or a poem. But the speed, power, and colossal scale of the data analysis they can achieve has the potential to help us solve our greatest challenges, boost productivity and save lives,” Dr Hajkowicz said.
“A foundation model for healthcare for example could help us untangle complex, hidden relationships in patients’ health records, helping us reduce the 140,000+ medical misdiagnoses in Australia each year due to human error.”
Professor Elanor Huntington, CSIRO’s Digital, National Facilities & Collections Executive Director, said building Australia’s sovereign capability in this new class of infrastructure requires an integrated approach.
“While there are significant benefits to fine-tuning existing models in terms of cost and the speed of innovation, using foreign models poses security and reliability risks,” Professor Huntington said.
“It may also result in tools that aren’t culturally appropriate in an Australian context, or that don’t realise the benefits for our workers that we want to see.”
Opportunities for Australia to maximise the positive impact of foundation models to benefit our citizens could include developing public sector AI models, democratising access to high-performance computing, sharing datasets, promoting skills uplift, as well as fostering international collaborations.
“Australia needs to be alert to the risks and opportunities presented by this game-changing technology, and we hope this report will help make foundation models more accessible, start conversations and inspire further growth in our nation’s foundation model capabilities,” Professor Huntington said.
