It takes a new approach to make NAS data protection using cloud archive tiers a cost-effective reality. Designed by a team with over a century of file experience, Igneous intelligently moves and manages massive amounts of file data between on-premises systems and the cloud.
Igneous is a backup solution that can write data directly to archive tiers such as Azure Archive Blob or AWS Glacier Deep Archive. Having data land in "hot" tiers first is expensive, it's a difference $23/TB/Month vs $4/TB/Month. To prevent sticker shock, Igneous always lands data into the intended tier for backup and archive.
Moving data to the cloud invokes transaction costs: each PUT or LIST operation has a price. While they don’t seem high at first glance - $0.05 per 1000 operations for AWS Glacier Deep Archive or $0.1 per 10,000 operations for Azure Archive Blob storage - these costs can add up.
Consider that for an enterprise with 1PB or more of data consuming at least 1 billion files, the cost with AWS Glacier Deep archive would be $50,000.
Igneous has a better approach. Igneous partitions data into chunks by grouping small files and multi-parting large files which reduces transaction costs by as much as 1000x. For the 1B file example, Igneous reduces the transaction (PUT) costs to only $50!
Expiration of data is different from space reclamation of cloud storage. The former is about business policies, the latter cost optimization. You need both.
The most cost-effective way to minimize transaction costs to public cloud is to compact small files into larger chunks. However, when a file expires you don’t want to rehydrate the entire chunk, remove the deleted file and rewrite it as - this would be very costly, for a 1PB backup file this could easily cost over $60,000.
Instead, upon expiration, Igneous immediately removes data from Igneous InfiniteINDEX which means it is no longer recoverable - thus meeting your business requirement without incurring any cost to your cloud account.
Now that data has expired, space reclamation needs to keep backup data from growing unbounded, the question is when to reclaim space. Do it too soon and it could be costly, don't do it and data grows unbounded in the cloud.
Igneous invokes space reclamation when a chunk (collection of compacted files) reaches a tipping point. This tipping point is when it’s cheaper to rehydrate data, remove the expired files, and rewrite the new chunk - as opposed to continuing to store the chunk with expired data. Keep in mind, the tipping point is different for every cloud provider and tier. Igneous software takes care of this for you by knowing exactly when to invoke space reclamation for your data on your cloud tier.
People joke that you can put your data in the cloud any time, but getting it out is another story. Igneous data shows that on average, 0.25% to 3% of cloud backups are restored to on-premise NAS.
Since most restores are directories and files, the ability to intelligently store data in chunks also has an advantage when restoring data. This is because there is locality by directory in how the data is aligned in the chunks. Igneous only rehydrates the chunks needed for recovery, whether it’s a directory or group of files. As a result, Igneous minimizes your restore and retrieval costs, even at petabyte-scale.
Watch Igneous CTO, Jeff Hughes, discuss how to move and manage data using cloud storage.