A Scalable Structure for the Storage of High-resolution RemoteSensing Images in Cloud Computing Environment

SHEN Sheng-yu; LIU Zhe; ZHANG Ping-cang; ZHANG Tong; WU Hua-yi; CHEN Xiao-ping

doi:10.3969/j.issn.1001-5485.2014.12.022

PDF(1802 KB)

Journal of Changjiang River Scientific Research Institute ›› 2014, Vol. 31 ›› Issue (12) : 107-112. DOI: 10.3969/j.issn.1001-5485.2014.12.022

INFORMATION TECHNOLOGY APPLICATION

A Scalable Structure for the Storage of High-resolution Remote
Sensing Images in Cloud Computing Environment

SHEN Sheng-yu¹,LIU Zhe²,ZHANG Ping-cang¹,ZHANG Tong³,WU Hua-yi³,CHEN Xiao-ping¹

Author information +

History +

Abstract

Traditional methods of processing remote sensing images could not effectively handle the mass daily production, mass pixel of single image, as well as the mass type and amount of objects. To solve the problem of image storage, we propose a structure for the storage of high-resolution remote sensing images in cloud computing environment, and expound the construction method based on MapReduce framework. We conducted experiments on large files of small image set in a Hadoop cluster and compared the image reading efficiency with that of traditional methods. The results proved that this storage structure has high scalability. Experiments also demonstrate this construction method has efficient reading/writing and processing ability.

Key words

cloud computing / high-resolution remote sensing image / storage structure / MapReduce / large files of small image sets / Hadoop

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

SHEN Sheng-yu,LIU Zhe,ZHANG Ping-cang,ZHANG Tong,WU Hua-yi,CHEN Xiao-ping. A Scalable Structure for the Storage of High-resolution Remote
Sensing Images in Cloud Computing Environment[J]. Journal of Changjiang River Scientific Research Institute. 2014, 31(12): 107-112 https://doi.org/10.3969/j.issn.1001-5485.2014.12.022

References

[1] 朱先强. 融合视觉显著特征的遥感图像检索研究[D]. 武汉:武汉大学, 2011. (ZHU Xian-qiang. Remote Sensing Imagery Retrieval Based on Integrating Visual Saliency Features[D]. Wuhan: Wuhan University, 2011.(in Chinese))
[2] WHITE T. Hadoop: The Definitive Guide[K]. US: O’Reilly Media, Inc. 2011.
[3] YANG C W, GOODCHILD M, HUANG Q Y, et al. Spatial Cloud Computing: How Can the Geospatial Sciences Use and Help Shape Cloud Computing [J]. International Journal of Digital Earth, 2011, 4(4):305-329.
[4] BLOWER J D. GIS in the Cloud Implementing a Web Map Service on Google App Engine [C]∥Proceedings of the 1st International Conference and Exhibition on Computing for Geospatial Research and Application, Washington, DC, USA, June 21-23, 2010: doi>10.1145/1823854.1823893.
[5] 康俊锋.云计算环境下高分辨率遥感影像存储与高效管理技术研究[D].杭州:浙江大学, 2011. (KANG Jun-feng. Technology of Efficient Management and Storage of High-resolution Remote Sensing Images in Cloud Computing Environment[D]. Hangzhou: Zhejiang University, 2011. (in Chinese))
[6] REN F, WANG J. Turning Remote Sensing to Cloud Services: Technical Research and Experiment[J]. Journal of Remote Sensing, 2012, 16(6):1331-1346.
[7] XIA Y, YANG X. Remote Sensing Image Data Storage and Search Method Based on Pyramid Model in Cloud[J]. Rough Sets and Knowledge Technology Lecture Notes in Computer Science, 2012, 7414: 267-275.
[8] CARY A, SUN Z G, HRISTIDIS V, et al. Experiences on Processing Spatial Data with MapReduce[C]∥Proceedings of 21st International Conference, SSDBM 2009, New Orleans, LA, USA, June 2-4, 2009: 302-319.
[9] LIU X, HAN J, ZHONG Y, et al. Implementing WebGIS on Hadoop: A Case Study of Improving Small File I/O Perfomance on HDFS[C]∥Proceedings of IEEE International Conference on Cluster Computing and Workshops. New Orleans, USA, August 31-September 4, 2009: 1-8.
[10]DEAN J, GHENMAWAT S. MapReduce: Simplified Data Processing on Large Clusters [C]∥Proceedings of Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, USA, December 6-8, 2004: 10-23.
[11]GHEMAWAT S, GOBIOFF H, LEUNG S T. The Google File System [C]∥Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, Lake George, NY, USA, October 19-22, 2003: 29-43.