Pros and cons of block/variable block deduplication

Pros and cons of block/variable block deduplication

How is block/variable block data deduplication used in an SMB? What are the pros and cons of this type of deduplication?

    Requires Free Membership to View

    Login

    When you register for SearchSMBStorage.com, you’ll also receive targeted emails from my team of award-winning editorial writers. Your company has different needs from that of an enterprise, and it’s our goal to keep you informed on the hottest topics, the latest news and the biggest challenges that are unique to your job.

    Rich Castagna, Editorial Director

    By submitting your registration information to SearchSMBStorage.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchSMBStorage.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

Data deduplication has found an initial market sweet spot with SMBs and remote-office/branch-office (ROBO) environments to support disk-to-disk-based backup and reduce their data footprint or amount of storage capacity needed for storing protected data. In general, dedupe can be done at the file or object level, as well as at a fixed or variable block level. It's implemented either in host backup or other layered server software that runs as an appliance in the data path or in storage systems, including virtual tape libraries (VTLs).

The benefits of file- and object-based dedupe is the ability to leverage additional intelligence and awareness of specific file types or file content information. This ability reduces the amount of data stored, but the downside is that optimization may only be available for certain data formats. The benefit of block-based deduplication is the ability to dedupe data as it is being processed in a streaming mode independent of the specific file types of formats.

Commonly, the focus with dedupe (both block and file based) is on deduplication or reduction ratios, which is applicable when the focus is on saving space. Keep in perspective the dedupe rates or the amount of data that can be moved, either backed-up or restored in a given timeframe, especially when the focus is around performance or meeting backup and data protection windows.

This was first published in June 2009

Back to top