Getting started with data deduplication

What is the difference between software- and hardware-based data deduplication products?

A software-based product involves loading an agent on the server where deduplication will be performed. The upside to an agent-based solution is ease of ongoing management and reduced network devices. The downside is the performance impact on the storage servers, including transactional processing and subsequent CPU cycle impacts. These drawbacks can be somewhat mitigated with the use of mirrored storage servers, high-performance servers or both.

Hardware-based dedupe products are appliances that sit between the switch and the storage server. The appliance relieves servers of the impact of software-based deduplication by performing the deduplication. Many appliances also provide compression and encryption, further enhancing the deduplication solution. The downside to using an appliance is the addition of yet another device to the network and the ...

Digg This!     StumbleUpon     Del.icio.us

RELATED CONTENT Small-midsized Business Data Storage Strategy What type of server would have the capacity to service an SMB office of 50 people, and how would I back up that server? SMB data storage briefs: Thecus Tech Corp. launches new NAS server, the N8800PRO Data migration tools take SMBs to the next tier: Data migration and tiered storage tutorial Data migration strategies and best practices Electronic discovery best practices for SMBs SMB data storage news briefs: Vocalocity offers online storage and data backup services to SMBs Five must-have data storage security tools for smaller businesses What's the difference between SMB data storage and enterprise data storage? Data migration strategies for multivendor storage systems Optimizing RAID data storage for your business Small-midsized Business Backup SMB data storage briefs: Thecus Tech Corp. launches new NAS server, the N8800PRO Low-cost data storage replication options for SMBs SMB data storage news briefs: Vocalocity offers online storage and data backup services to SMBs Data reduction strategies for SMBs Iomega launches ix2-200 NAS desktop backup appliance with replication and iSCSI support Data backup and recovery choices for SMBs SMB data storage technology tutorials: Storage advice for smaller businesses What are the pros and cons of disk-based data backup for SMBs? GreenBytes launches data deduplication for primary and secondary data storage Low-cost data replication products address SMB restore needs SMB storage tips Low-cost data storage replication options for SMBs Data migration strategies and best practices Five must-have data storage security tools for smaller businesses Data reduction strategies for SMBs Data migration strategies for multivendor storage systems Optimizing RAID data storage for your business Data backup and recovery choices for SMBs Virtual desktop infrastructure deployments: The pros and cons of VDI Data storage for virtual environments: Pros and cons of DAS, NAS and SAN The state of RAID data protection in enterprise storage today

RELATED RESOURCES 2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems Search Bitpipe.com for the latest white papers and business webcasts Whatis.com, the online computer dictionary

need to monitor and manage it.

How does data storage, deduplication and regulatory compliance come together?

The answer to this question depends on the regulations your industry needs to comply with. Data storage and accessibility regulations include the Sarbanes-Oxley (SOX) Act, the Healthcare Insurance Portability and Accountability Act (HIPAA) and the Gramm-Leach-Bliley Act (GLBA). Each regulation has its own framework and objectives that you must be able to meet.

For example, if email must be stored in excess of 50 years, then deduplication is mandatory, if only from a manageability and retrieval perspective. Though you cannot rotate or overwrite disks and tapes as part of your backup cost containment strategy, deduplication will significantly help reduce the number of disks and tapes required for secondary storage.

What is the difference between file-level and block-level deduplication?

File-level deduplication seeks and replaces entire duplicate files with a pointer to the first file instance. Block-level deduplication looks deeper into the file and only backs up the changed block. Block-level deduplication further improves a firm's data storage footprint by capturing only the components that have changed rather than the entire file.

Martha Young is principal and CEO of Nova Amber LLC, a business consulting company specializing in business process virtualization.

Rate this Tip To rate tips, you must be a member of SearchSMBStorage.com. Register now to start rating these tips. Log in if you are already a member. DISCLAIMER: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.