Secure Data Deduplication at Client Side and in Cloud Storage with Application Aware System

Abstract

Nowadays, cloud based storage services offer easy to access, secure, reliable, and low cost remote storage for file sharing, document suits and online backups. The leading cloud based storage services use data deduplication as the continuous and exponential increase of number of users and size of their data. Data deduplication removes redundant data and tries to ensure that only unique instance of the data is stored. The purpose of deduplication are to reduce the network bandwidth, to reduce storage space, to check user instances have original content, to reduce total cost of ownership and improves backup operation and reduce Recovery Time Objective. Here, in this paper, we are combining both file level data deduplication and chunk level data deduplication to achieve faster deduplication at client side deduplication. To reduce the index overhead we are using application aware index structure method. In order to give security with deduplication convergent encryption is applied. As for chunk level deduplication with encryption, key management issue arises. To solve key management issue we effectively use the metadata manager component. At cloud storage side the cross user data deduplication is done securely.