How AI might assist enterprises to cut back information storage prices



We’re excited to carry Rework 2022 again in-person July 19 and just about July 20 – 28. Be a part of AI and information leaders for insightful talks and thrilling networking alternatives. Register at this time!

The quantity of information managed by the world’s enterprises is rising. In keeping with one supply, the full quantity of information created, captured, copied and consumed globally was about 64.2 zettabytes in 2020 — equal to a trillion gigabytes. Unsurprisingly, firms report that the price of storing their information can also be climbing. In a 2018 Enterprise Storage Discussion board survey, enterprise leaders stated that the excessive prices of operation, a scarcity of storage capability, and growing old tools have been amongst their high considerations.

The rising prices of storage have pushed many firms to undertake cloud choices, which supply the benefit of low entry prices. However with prices inching up as extra companies transfer on-line — a Pepperdata report discovered that greater than one-third of firms have cloud service funds overruns of as much as 40% — IT leaders are exploring options.

On the cloud facet, a nascent crop of startups are making use of AI to the issue of managing cloud spend. Distributors like Densify and Forged AI declare that their AI-powered platforms can advocate the very best storage configuration for a firms’ workloads by taking into numerous necessities. Different know-how suppliers have turned their consideration to on-premises programs, creating algorithms that they declare can cut back storage prices both with {hardware} ideas or novel file compression methods.

“Information storage at this time suffers from a number of challenges: Storage deployments are sometimes made up of a wide range of totally different storage media corresponding to reminiscence, flash, disk drives and tapes. As well as, organizations run a number of storage arrays based mostly on entry protocols … or based mostly on criticality of the workloads,” Gartner analysis VP Arun Chandrasekaran advised VentureBeat through e mail. “The utilization of AI has the potential to streamline information lifecycle administration based mostly on criticality, efficiency, safety and prices necessities of information.”

Cloud optimization

In the course of the pandemic, the strain to digitize operations led a report variety of firms to maneuver to the cloud. In keeping with a current survey from O’Reilly, 90% of organizations have been utilizing cloud computing of some type in 2021, whereas Flexera’s State of the Cloud Report exhibits that 35% of firms spent greater than $12 million on cloud operations in 2021.

The adoption development gave rise to startups creating AI-powered platforms designed to regulate utilization to reign in expenditures. One is Densify, which analyzes workloads throughout personal information facilities, Amazon Internet Companies, Microsoft Azure, Google Cloud Platform and IBM’s cloud choices to find out how a lot CPU, RAM and storage they want — then suggests methods to save lots of. Densify can use already-available log information to start optimizing instantly. After that, the platform will proceed to evaluate cloud suppliers’ pricing adjustments, functions’ wants and new merchandise to seek out the place clients can cut back bills additional.

“Normally inside two to 4 weeks, you’ve received 50% of the financial savings,” CEO Gerry Smith advised VentureBeat in a earlier interview. “Relying on the place the financial savings are, inside one other two to 4 months, [you’ll get] 100% of the financial savings.”

Forged AI, a Densify competitor, equally leverages AI to optimize cloud spend. Supporting main cloud service suppliers, the platform connects to current clouds and generates a report back to determine cost-saving alternatives.

“We’ve got different fashions that use world datasets for market attribute predictions,” CEO Yuri Frayman advised VentureBeat in October 2021. “For instance, we practice a world mannequin to foretell occasion preemptions by machine kind, area, availability zone and seasonality. This mannequin is shared autonomously throughout all clients, and all the information is used to retrain the mannequin constantly.”

On-premises and compression

For firms that haven’t made the transfer to the cloud — or who’ve their information unfold throughout cloud and on-premises environments — there are answers like Accenture’s Storage Optimization Analytics, which mixes search and AI to know enterprise content material and automate information classification.

Accenture claims that it reduces storage prices by detecting duplicate or near-duplicate content material, serving to clients transfer or archive the fitting information on the proper time. Storage Optimization Analytics additionally automates migration to lower-cost storage and tracks storage financial savings, computing the general return on funding (ROI).

IT supplier Rahi Techniques gives the same service known as Pure1 Meta, which makes use of AI fashions to foretell capability and efficiency and supply recommendation on workload deployment and optimization. Pure1 Meta can run simulations for particular workloads, producing solutions to capability planning questions whereas ostensibly serving to to extend useful resource utilization.

An Nvidia AI mannequin compressing movies.

AI can also be more and more enjoying a job in file compression. For movies, music, and pictures, AI-based compression can present the identical — or near the identical — stage of visible high quality with fewer bits. One other profit is that it’s simpler to improve, standardize, and deploy new AI codecs versus customary codecs, for the reason that fashions might be skilled in a comparatively quick period of time and — importantly — don’t require special-purpose {hardware}.

Web sites like and VanceAI leverage fashions to compress photographs with out compromising on high quality or decision. Qualcomm and Google have experimented with AI-driven codecs for each audio and video. And Alphabet-owned DeepMind has created an AI system to compress movies on YouTube, decreasing the typical quantity of information that YouTube must stream to customers by 4% with out a noticeable loss in video high quality.

Seeking to the long run

Gartner’s Chandrasekaran notes that the adoption of AI applied sciences for information administration, which fall beneath the class of “AIops,” stays fairly low. (AIops platforms purpose to boost IT by leveraging AI to investigate information in a corporation’s from instruments and units). However he provides that the pandemic has been a catalyst for adoption as organizations attempt to automate quicker to reply to “quickly altering” circumstances.

Latest surveys agree. In keeping with Emergn, 87% of firms anticipate their investments in automation expertise to extend over the subsequent 12 to 26 months. And in a 2020 K2 ballot, 92% of enterprise leaders stated that they think about course of automation important to success within the fashionable office.

“There may be a variety of ‘AI washing’ within the trade at this time. Therefore, vetting vendor claims and deploying an answer that delivers ROI might be irritating. AIops requires a variety of integration,” Chandrasekaran stated. “For groups that aren’t expert in architecting and sustaining complicated information environments, a sturdy AIops deployment could turn out to be a pipe dream. There additionally must be a cultural change, the place organizations are prepared to make data-driven choices.”

Trying forward, Chandrasekaran expects to see extra “versatile” AI-powered storage administration options past the merchandise already in the marketplace. These options might allow higher clever automation and remediation workflows by way of the usage of AI, he believes.

“AI methods may help optimize placement of information on the fitting storage tiers — balancing efficiency and prices. As well as, AI may help with higher availability of information infrastructure, enabling companies to entry information quicker and create a dependable infrastructure,” Chandrasekaran added.

VentureBeat’s mission is to be a digital city sq. for technical decision-makers to realize data about transformative enterprise know-how and transact. Be taught extra about membership.