Open Access Open Access  Restricted Access Subscription or Fee Access

An Efficient Dynamic Indexing and Metadata Model for Storage in Cloud Environment

S. Anjanadevi, D. Vijayakumar

Abstract


Cloud computing is an emerging, computing model wherein the tasks are allocated to software, combination of connections, and services accessed over a network. This connections and network of servers is collectively known as the cloud. In place of operating their own data centers, users might rent computing power and storage capacity from a service provider and pays only for what they use. Cloud storage is delivering the data storage as service. If the data is stored in cloud, it must provide the data access and heterogeneity. With the advances in cloud computing it allows storing of large number of images and data throughout the world. This paper proposes the indexing and metadata management which helps to access the distributed data with reduced latency. The metadata management can be enhanced for large scale file system applications. When designing the metadata, the storage location of the metadata and attributes is important for the efficient retrieval of the data. Indexes are used to quickly locate data without having to search over every location in storage. Based on these two models, the data can be easily fetched and the search time was reduced to retrieve the appropriate data.

Keywords


Metadata, Cloud Storage, Index, Google File System, Hadoop Distributed File System

Full Text:

PDF

References


Abhishek Verma, Shivaram Venkataraman, Matthew Caesar, Roy Campbell, “Efficient Metadata Management for Cloud Computing applications”, University of Illinois at Urbana-Champaign.

A W Leung, M Shao, T Bisson, S Pasupathy and E L Miller, “High-performance metadata indexing and search in petascale data storage systems”, Conference Series 125(2008) 012069.

Bo Dong, QinghuaZheng, FengTian, Kuo-Ming Chao, Rui Ma, RachidAnane (2012), “An optimized approach for storing and accessing small files on cloud Storage”, Elsevier (Journal of Network and Computer Applications), vol.35, pp.1847–1862.

Da Xiao, “Multiple-File Remote Data Checking for cloud storage”, Elsevier (computers & security), 2012, vol.31, pp.192-205.

Gurmeet Singh, ShishirBharathi, Ann Chervenak, Ewa Deelman, Carl Kesselman, Mary Manohar, Sonal Patil, Laura Pearlman, “A Metadata Catalog Service for Data Intensive Applications” , Proceedings of the ACM/IEEE SC2003 Conference (SC’03).

Jin Xiong, Yiming Hu, Guojie Li, Rongfeng Tang and Zhihua Fan, “Metadata Distribution and Consistency Techniques for Large-Scale Cluster File Systems” , IEEE Transactions On Parallel And Distributed Systems, pp.1-15.

Konstantin Shvachko, “TheHadoop Distributed File System”, Mass Storage Systems and Technologies (MSST), IEEE 26th Symposium on IEEE,2010,http://storageconference.org/2010/Papers/MSST/Shvachko.pdf.

Lanxiang Chen, “Data dynamics for remote data possession checking in cloud storage”, Elsevier (Computers and Electrical Engineering), 2013, vol 13, pp.1121-1133.

LI Wen-juan, “A Novel Scalable Architecture of Cloud Storage System for Small Files based on P2P”, IEEE transactions on cluster computing, 2012, vol.17, pp.41-47.

MrudulaVarade,VimlaJethani, “Distributed Metadata Management Scheme in HDFS”, International Journal of Scientific and Research Publications, Volume 3, Issue 5, May 2013.

M. Satyanarayanan, J. 1. Kistler, P. Kumar, “Coda: A highly available file system for a distributed workstation environment”, IEEE Transactions on Computers, 1990, pp. 447-459.

P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur. “PVFS: A parallel file system for Linux clusters”, in Proc. of 4th Annual Linux Showcase and Conference, 2000, pp. 317–327.

Qian Wang, Cong Wang, “ Enabling Public Auditability And Data Dynamics For Storage Security In Cloud Computing”, IEEE transactions on parallel and distributed systems, May 2011, vol. 22, pp.847-859.

Saiwu (2009), “An indexing framework for effective Retrieval on the cloud”, IEEE Computer Society Technical Committee on Data Engineering, Copyright IEEE, pp.1-8.

S. A. Weil, S. A. Brandt, E. L. Mille, “Ceph: A Scalable, High-Performance Distributed File System”, In Proceedings of the 7th symposium on Operating systems design and implementation, 2006, pp. 307-320.

S. Ghemawat, H. Gobioff, S. Leung. “The Google file system”, In Proc. of ACM Symposium on Operating Systems Principles, Lake George, NY, Oct 2003, pp 29–43.

Tin Tin Yee and Thinn Thu Naing, “PC-cluster Based Storage System Architecture For Cloud Storage”, International Journal on Cloud Computing: Services and Architecture,Vol.1, No.3, November 2011, pp.117-128.

Y.Zhu, H.Jiang, J.Wang, and F.Xian, “HBA: Distributed Metadata Management for Large Cluster-Based Storage Systems”, IEEE Trans. Parallel and Distributed Systems, June 2008, vol.19, no.6, pp.750- 763.

Yifeng Luo, Siqiang Luo, Jihong Guanb, Shuigeng Zhou, “A RAM Cloud Storage System based on HDFS: Architecture, implementation and evaluation”, Elsevier (The Journal of Systems and Software ), 2013, vol.86, pp.744 – 750.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.