How to implement data deduplication

Solution Search:
Deduplication -- Sorting through the Hype by Datalink/NetApp
experts, to learn exactly what deduplication can do for you-what's real and what's hype. Among today's storage technologies, deduplication is generating significant buzz and is at the top of the "what's hot" list. The hype comes with good reason. Deduplication provides...
Deduplication: The Post-Snapshot Revolution in Storage by Data Domain
in your storage architecture. Data deduplication has leverage across the storage infrastructure for reducing data, improving data protection and overall, simplifying data management. However, deduplication is hard to implement in a way that runs fast with low...
ESG - Understanding the Power of Data De-Duplication by Diligent Technologies Corporation, an IBM Company
volumes and one such technology is data deduplication. This ESG white paper aims to break through all of the hype surrounding data deduplication and explains the true power of this technology. Read this white paper to learn about the fundamental aspects of data...
Data Deduplication: Determining Project Scope through Best Practices – E-Guide Prepared for Canadian Solutions Providers by Arrow Enterprise Computing Solutions
improve the efficiency and ease of a data deduplication project and consequently support your services margins. This E-Guide provides Canadian Solutions Providers with a check list that will improve the efficiency and ease of a data deduplication project and...
Guidelines for the Evaluation of Enterprise De-Duplication Solutions: How to Navigate the Pitfalls and Hyperbole by Diligent Technologies Corporation, an IBM Company
When it comes to data deduplication, the truth is often distorted. This white paper breaks through the hype and provides you with an outline on the principles of deduplication as well as tips for evaluating solutions. Data deduplication has the...
Data Deduplication Made Simple by Data Domain
Data deduplication is rapidly becoming a core fundamental of any storage system, and the implications go far beyond backup applications. Take this opportunity to learn the key differences between deduplication technologies...
eGuide: How to Get Started with Data Deduplication by Data Domain
prepare to launch, or enhance, your data deduplication strategy. Data deduplication has certainly generated quite a buzz among storage professionals in the UK, and while there’s a lot of curiosity and interest, many UK storage professionals have yet to take off with this...
Podcast: How to compare data deduplication products by Data Domain
Podcast that explores key tips on how to evaluate and measure deduplication service providers. Data deduplication is rapidly becoming a core fundamental of any storage system, and the implications go far beyond backup applications. Knowing how to...
How to reduce the backup data footprint: Capacity optimization, intelligent data protection software, deduplication, and single instancing - Let's translate by Hewlett-Packard Company
energy prices and exponential data growth are driving organizations to seek solutions that minimize data footprint across all storage tiers. The challenge that managers face, though, is implementing the right technology for their specific use case...
Podcast: Highlighting Data Deduplication and Disk Backups by Data Domain
W. Curtis Preston highlights data deduplication technologies - the features, the benefits and how different solutions differ from each other. In this Expert Podcast, W. Curtis Preston highlights data deduplication technologies - the features, the benefits and how...
VIDEO: Highlighting Data Deduplication and Disk Backups by Data Domain
W. Curtis Preston highlights data deduplication technologies - the features, the benefits and how different solutions differ from each other. In this Expert Videocast, W. Curtis Preston highlights data deduplication technologies - the features, the benefits and how...
IDC Workbook: Assess the Value of Deduplication for your Storage Consolidation Initiatives by Data Domain
store, and depend on, and the need to consolidate IT resources to reduce costs and create a more 'green' IT environment. But while organizations have worked to reduce IT footprint, they must balance the need to improve resource utilization with more...
Global Data Deduplication Results with NetBackup PureDisk by Symantec Corporation
between data sets more complex. Data deduplication offers companies the opportunity to dramatically reduce the amount of storage required for backups and to more efficiently centralize backup data to multiple sites for assured disaster recovery. Veritas...
Untangling Data Deduplication by Overland Storage
basics and trends related to data deduplication. In this videocast, analyst and industry veteran Arun Taneja uncovers some of the important basics and trends related to data deduplication. Arun discusses the primary concerns around data deduplication...
Podcast: Deduplication as a Storage Fundamental by Data Domain
and cost-savings, it's easy to see why data deduplication has gained so much recognition over the past few years. Organizations both large and small have adopted data dedupe in their storage environment, and if you're still considering it, this Mediacast can help. Download...
Deduplication as a Storage Fundamental by Data Domain
and cost-savings, it's easy to see why data deduplication has gained so much recognition over the past few years. Organizations both large and small have adopted data dedupe in their storage environment, and if you're still considering it, this Mediacast can help. View this...
Best Practices Data Deduplication for Symantec's NetBackup (NBU) by Data Domain
technologies are being pushed to their limits in many backup environments, most to an unsuccessful or inefficient outcome. This challenge is common for many Symantec NetBackup (NBU) customers, and finding the right new technology to bridge the gap...
How To Keep Your Business Running In The Event Of A Disaster by Simply Continuous
This Webcast explores how Data Domain deduplication storage coupled with the Simply Continuous Data Protect Vault managed services can help enterprise customers. This Webcast explores how Data Domain deduplication storage coupled with the...
eGuide: Data Deduplication for Primary Data by Ocarina Networks
This E-Guide will explore if Data Deduplication is suitable for primary data and what vendors are doing to keep performance high for your company’s backups. Many IT Professionals are looking to add Data Deduplication to their backup system, and while all data...
IT Briefing: Best Practices Data Deduplication for Symantec's NetBackup (NBU) by Data Domain
This whitepaper focuses on how the Data Domain deduplication storage solution integrates with standard NBU architectural and operational environments in order to overcome the growing gap between what is being accomplished and needs to be...
Blending Tape Virtualization and Data Deduplication to Optimize Data Protection Performance and Costs (Dec 08) by Sun Microsystems, Inc.
explores tape virtualization and data deduplication technologies, discusses how to most effectively blend them, and then provides a set of evaluation points which can be used to make deployment decisions in your environment. This Solution Profile explores tape...
Data Deduplication and Disk Backups: An End-User's Guide to Success by ExaGrid Systems, Inc.
Gain an understanding of data deduplication and learn the benefits of these solutions. Data deduplication has completely taken the storage world by storm. As far as backup technologies go, data deduplication offers the most promise because it reduces costs...
Catching up with Deduplication by Storage Magazine
and reduce duplicate data. Here's how to pick the product that will best fit into your environment. Deduplication resides in the backup process in two primary places: backup software and disk libraries. Asigra Inc.'s Televaulting, EMC Corp.'s Avamar and...
Hot Spots: Data Deduplication Drama by Storage Magazine
by knowing where to look for it. Data deduplication for secondary storage is prompting as much passion from vendors as it is confusion for some users. Why? Because dedupe is one of those influential, crucial technologies that comes along every few years. Deduplication...
Top 7 Critical Things to Consider When Purchasing a Storage Optimization Solution by Ocarina Networks
like generic compression and data deduplication. Like anyone responsible for the storage capacity and integrity of online data, you know how rapidly your storage needs are growing. Consequently, the costs to support those business demands are also increasing. This...
Data Deduplication Methodologies: Byte-level vs. Block Level Deduplication by ExaGrid Systems, Inc.
in the disk-based backup market. Data deduplication enables disk to be a feasible long-term retention backup media--making it the same or lower cost than tape-based systems. This paper discusses the 4 key reasons why ExaGrid’s byte-level data de-duplication outperforms...
The Advantages of Deduplication-Based Disk Systems for Onsite Backup Storage by Diligent Technologies Corporation, an IBM Company
for companies using tape backup to move to deduplication-based disk systems for onsite backup storage. This PowerPoint presentation is from a Storage Decisions session (New York 2008) that explores how, although disk systems are cheaper than ever...
IT Briefing: Data Deduplication and Disk Backups: An End-User’s Guide to Success by ExaGrid Systems, Inc.
systems provide unique byte-level data deduplication, a compression technology necessary to do an efficient job of backing up to disk. Tape-based backup solutions are fraught with problems. Restore time from tape is prohibitive and tape proliferation is a concern. These...
IT Briefing: Deduplication as a Storage Fundamental by Data Domain
as a Storage Fundamental.” Data deduplication is not a backup technology in our view. It’s a storage technology. It is going to be broadly applicable to all kinds of applications, all kinds of classes of data. It’s interesting to us that the backup/restore data...
Related Best Practices
How to implement snapshots
data can be used to restore lost files or recover from more substantial data loss. Features like data deduplication are also appearing in snapshots to reduce disk storage requirements, allowing for many more snapshots and longer retention periods. Below are a series of best practices to help you get the most from snapshot technology.

Start by understanding your RPO

It's... More...

How to implement disk-to-disk backups
as backup targets. Storage space is finite, which can limit the allowable retention period for data. Data reduction technologies like data deduplication and delta differencing can dramatically extend the effective storage capacity. Also, indexing and search are can be valuable when rapid file organization and location are needed. Below are a series of best... More...
How to improve tape backup performance and reliability
time.

Use data reduction technologies to shrink the backup task

Data reduction techniques like data deduplication, conventional compression and delta differencing to reduce the amount of data that must be backed up. Smaller backups will execute faster, resulting in a shorter backup window, less drive wear, and lower media usage (and lower media costs). Most backup software... More...

FAQ's
VTL Deduplication FAQ
Inc., discusses the pros and cons of virtual tape library (VTL) data deduplication and the state of the VTL deduplication market today in this Q&A. His answers are also available below as an MP3 for you to download.

Listen to the VTL deduplication FAQ

>>The benefits of using a VTL for data deduplication
>>The drawbacks... More...

Are pretty much all of the virtual tape library (VTL) vendors now offering deduplication or is it still limited?
and a lot of the network-attached storage (NAS) vendors are offering deduplication. There are some incumbents and some newcomers. FalconStor and all of the FalconStor partners have FalconStor Single Instance Repository (SIR) options for deduplication. Data Domain has been in the game for a long time. Diligent... More...
There are also concerns about data loss due to hash collisions. How have manufacturers addressed that issue today?
on each segment and stores data that way.

Check out the entire Data Deduplication FAQ.

I've had a chance to speak to a number of vendors about this, and for the most part they say that this is pretty much... More...