What is the difference between software- and hardware-based data deduplication products?
A software-based product involves loading an agent on the server where deduplication will be performed. The upside to an agent-based solution is ease of ongoing management and reduced network devices. The downside is the performance impact on the storage servers, including transactional processing and subsequent CPU cycle impacts. These drawbacks can be somewhat mitigated with the use of mirrored storage servers, high-performance servers or both.
How does data storage, deduplication and regulatory compliance come together?
The answer to this question depends on the regulations your industry needs to comply with. Data storage and accessibility regulations include the Sarbanes-Oxley (SOX) Act, the Healthcare Insurance Portability and Accountability Act (HIPAA) and the Gramm-Leach-Bliley Act (GLBA). Each regulation has its own framework and objectives that you must be able to meet.
For example, if email must be stored in excess of 50 years, then deduplication is mandatory, if only from a manageability and retrieval perspective. Though you cannot rotate or overwrite disks and tapes as part of your backup cost containment strategy, deduplication will significantly help reduce the number of disks and tapes required for secondary storage.
What is the difference between file-level and block-level deduplication?
File-level deduplication seeks and replaces entire duplicate files with a pointer to the first file instance. Block-level deduplication looks deeper into the file and only backs up the changed block. Block-level deduplication further improves a firm's data storage footprint by capturing only the components that have changed rather than the entire file.
Martha Young is principal and CEO of Nova Amber LLC, a business consulting company specializing in business process virtualization.
This was first published in October 2008