INFORMATION TECHNOLOGY APPLICATION

A Scalable Structure for the Storage of High-resolution Remote
Sensing Images in Cloud Computing Environment

  • SHEN Sheng-yu ,
  • LIU Zhe ,
  • ZHANG Ping-cang ,
  • ZHANG Tong ,
  • WU Hua-yi ,
  • CHEN Xiao-ping
Expand
  • 1.Department of Soil and Water Conservation, Yangtze River Scientific Research Institute, Wuhan430010, China;
    2.Network and Information Center, Changjiang Water Resources Commission, Wuhan430010, China;
    3.State Key Laboratory of Information Engineering in Surveying, Mapping andRemote Sensing, Wuhan University, Wuhan 430079, China)

Received date: 2013-11-26

  Revised date: 2014-12-05

  Online published: 2014-12-05

Abstract

Traditional methods of processing remote sensing images could not effectively handle the mass daily production, mass pixel of single image, as well as the mass type and amount of objects. To solve the problem of image storage, we propose a structure for the storage of high-resolution remote sensing images in cloud computing environment, and expound the construction method based on MapReduce framework. We conducted experiments on large files of small image set in a Hadoop cluster and compared the image reading efficiency with that of traditional methods. The results proved that this storage structure has high scalability. Experiments also demonstrate this construction method has efficient reading/writing and processing ability.

Cite this article

SHEN Sheng-yu , LIU Zhe , ZHANG Ping-cang , ZHANG Tong , WU Hua-yi , CHEN Xiao-ping . A Scalable Structure for the Storage of High-resolution Remote
Sensing Images in Cloud Computing Environment[J]. Journal of Changjiang River Scientific Research Institute, 2014
, 31(12) : 107 -112 . DOI: 10.3969/j.issn.1001-5485.2014.12.022

References

[1] 朱先强. 融合视觉显著特征的遥感图像检索研究[D]. 武汉:武汉大学, 2011. (ZHU Xian-qiang. Remote Sensing Imagery Retrieval Based on Integrating Visual Saliency Features[D]. Wuhan: Wuhan University, 2011.(in Chinese))
[2] WHITE T. Hadoop: The Definitive Guide[K]. US: O’Reilly Media, Inc. 2011.
[3] YANG C W, GOODCHILD M, HUANG Q Y, et al. Spatial Cloud Computing: How Can the Geospatial Sciences Use and Help Shape Cloud Computing [J]. International Journal of Digital Earth, 2011, 4(4):305-329.
[4] BLOWER J D. GIS in the Cloud Implementing a Web Map Service on Google App Engine [C]∥Proceedings of the 1st International Conference and Exhibition on Computing for Geospatial Research and Application, Washington, DC, USA, June 21-23, 2010: doi>10.1145/1823854.1823893.
[5] 康俊锋.云计算环境下高分辨率遥感影像存储与高效管理技术研究[D].杭州:浙江大学, 2011. (KANG Jun-feng. Technology of Efficient Management and Storage of High-resolution Remote Sensing Images in Cloud Computing Environment[D]. Hangzhou: Zhejiang University, 2011. (in Chinese))
[6] REN F, WANG J. Turning Remote Sensing to Cloud Services: Technical Research and Experiment[J]. Journal of Remote Sensing, 2012, 16(6):1331-1346.
[7] XIA Y, YANG X. Remote Sensing Image Data Storage and Search Method Based on Pyramid Model in Cloud[J]. Rough Sets and Knowledge Technology Lecture Notes in Computer Science, 2012, 7414: 267-275.
[8] CARY A, SUN Z G, HRISTIDIS V, et al. Experiences on Processing Spatial Data with MapReduce[C]∥Proceedings of 21st International Conference, SSDBM 2009, New Orleans, LA, USA, June 2-4, 2009: 302-319.
[9] LIU X, HAN J, ZHONG Y, et al. Implementing WebGIS on Hadoop: A Case Study of Improving Small File I/O Perfomance on HDFS[C]∥Proceedings of IEEE International Conference on Cluster Computing and Workshops. New Orleans, USA, August 31-September 4, 2009: 1-8.
[10]DEAN J, GHENMAWAT S. MapReduce: Simplified Data Processing on Large Clusters [C]∥Proceedings of Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, USA, December 6-8, 2004: 10-23.
[11]GHEMAWAT S, GOBIOFF H, LEUNG S T. The Google File System [C]∥Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, Lake George, NY, USA, October 19-22, 2003: 29-43.
Outlines

/