Distributed Exact Deduplication for Primary Storage Infrastructures
- Citation:
- Paulo J, Pereira JO. 2014. Distributed Exact Deduplication for Primary Storage Infrastructures. In proceedings of Distributed Applications and Interoperable Systems - IFIP.
Date Presented:
JuneAbstract:
Deduplication of primary storage volumes in a cloud computing environment is increasingly desirable, as the resulting space savings contribute to the cost effectiveness of a large scale multi-tenant infrastructure. However, traditional archival and backup deduplication systems impose prohibitive overhead for latency-sensitive applications deployed at these infrastructures while, current primary deduplication systems rely on special cluster filesystems, centralized components, or restrictive workload assumptions.
We present DEDIS, a fully-distributed and dependable system that performs exact and cluster-wide background deduplication of primary storage. DEDIS does not depend on data locality and works on top of any unsophisticated storage backend, centralized or distributed, that exports a basic shared block device interface. The evaluation of an open-source prototype shows that DEDIS scales out and adds negligible overhead even when deduplication and intensive storage I/O run simultaneously.
Citation Key:
PP14aDOI:
10.1007/978-3-662-43352-2_5
Contacts
| Address: Departamento de Informática Universidade do Minho Campus de Gualtar 4710-057 Braga Portugal |
| Phone: +351 253 604 477 / Internal: 604 477 |
| Fax: +351 253 604 471 |
|
E-mail: jtpaulo at inesctec.pt |
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.