Storage, not GPUs, is the most important problem to AI says influential report — lack of bits and bytes is what may make or break your AI/ML challenge

A serious report on the state of the AI trade has revealed some key insights into potential issues for firms and the trade at giant as its progress continues to increase following the discharge of ChatGPT and different AI fashions.

WEKA, commissioned by S&P World Market Intelligence, not too long ago launched its 2024 World Tendencies in AI report, surveying over 1,500 totally different tech executives and decision-makers on underlying developments throughout a broad vary of subjects.

Among the most fascinating insights associated to the provision of AI-capable GPUs, nearly all of that are made by Nvidia, though firms like AMD, in addition to start-ups, are gaining some floor.

The principle takeaway, as per WEKA, is that AI functions are “now pervasive in the enterprise”, which might be one thing most staff can really feel already. Nonetheless, scaling these AI apps is commonly tough, largely because of legacy information architectures.

Generative AI has additionally taken organisations by storm, with the report noting 88% of organizations are “now actively investigating generative AI, far outstripping other AI applications such as prediction models (61%), classification (51%), expert systems (39%) and robotics (30%).”

Nvidia, the company world wants you

(Picture credit score: Nvidia)

Excessive-end GPUs are, naturally, an enormous focus of the report – having the uncooked energy is prime to with the ability to truly do something with many AI functions.

“Hyperscaler public clouds are one pathway to GPUs, but many are also turning to specialist AI clouds,” it notes. “GPU clouds are emerging as a key venue for both training – employed by almost a third, 32% of organizations – and inference, 31%.”

All of this curiosity signifies that orders for Nvidia chips are solely getting greater.

Attention-grabbing, WEKA highlights the problem of GPU shortage in plenty of main Asia-Pacific economies, together with India. “India, Taiwan, New Zealand, and Australia are more likely to rank GPU availability among their top three challenges to bringing a model into production,” says the report authors.

“One of the most striking takeaways from our 2024 Trends In AI study is the astonishing rate of change that’s taken place since the onset of ChatGPT 3 and the first wave of generative AI models reached the market in early 2023,” principal analysis analyst John Abbott informed Blocks & Information.

“In less than two years, generative AI adoption has eclipsed all other AI applications in the enterprise, defining a new cohort of AI leaders and shaping an emergent market of specialty AI and GPU cloud providers.”