水质参数高光谱感知算法研究

金秋, 张荣耀, 雷少华, 卢慧中, 罗洁

长江科学院院报 ›› 2026, Vol. 43 ›› Issue (4) : 77-85.

PDF(1492 KB)
PDF(1492 KB)
长江科学院院报 ›› 2026, Vol. 43 ›› Issue (4) : 77-85. DOI: 10.11988/ckyyb.20250568
水环境与水生态

水质参数高光谱感知算法研究

作者信息 +

Hyperspectral Sensing Algorithms for Water Quality Parameters

Author information +
文章历史 +

摘要

高效、快速、精确的水质参数监测是水质状况评估、污染防控、生态保护及人类健康保障的基础。基于自研水体高光谱感知装备,分析了化学需氧量(COD)、总悬浮物(TSS)、总磷(TP)、总氮(TN)、氨氮(NH3-N)等关键水质参数的光谱特征,遴选了特征波段;并基于单波段、波段比值、归一化指数等经验方法及BP神经网络、随机森林、XGBoost等机器学习方法,构建了面向多水质参数的自适应高光谱感知优选框架,突破了传统单一算法在复杂水环境下的适应性局限。在最优算法的训练/验证数据集中,各最优算法的决定系数在0.88~0.99之间,分别有100%(COD)、91%(TSS)、90%(TP)、90%(TN)、95%(NH3-N)的样点MAPE<30%,达到水质监测实用要求。研究成果可为7×24 h的水质连续监测提供技术支撑,对推动高光谱感知技术在水环境监测、水土保持监测等领域的产业化应用具有重要意义。

Abstract

[Objective] Hyperspectral remote sensing technology offers a new approach for non-contact, real-time sensing of water quality parameters. Existing research has shortcomings in developing dedicated sensing equipment and constructing multi-parameter collaborative inversion algorithms. This study aims to systematically explore the spectral response characteristics of five key water quality parameters—chemical oxygen demand (COD), total suspended solids (TSS), total phosphorus (TP), total nitrogen (TN), and ammonia nitrogen (NH3-N)—based on a self-developed hyperspectral water sensing instrument, and to establish an adaptive hyperspectral sensing algorithm optimization framework for multiple water quality parameters. This framework aims to overcome the adaptability limitations of traditional single algorithms in complex water environments and provide technical support for achieving 24/7 continuous online water quality monitoring. [Methods] First, continuous spectral data and corresponding measured values of water quality parameters from a large number of water samples were collected using the self-developed hyperspectral water sensing instrument. Through spectral analysis, the absorption, reflectance characteristics, and differential patterns of COD, TSS, TP, TN, and NH3-N within the visible to near-infrared spectral range were revealed, and the sensitive characteristic bands for each parameter were selected accordingly. On this basis, a multi-level, multi-type inversion model system was constructed. At the empirical model level, single-band regression, band ratio, and normalized difference index were employed to establish statistical relationships between spectral features and water quality parameters. At the machine learning level, BP neural network, random forest (RF), and XGBoost were introduced to fully exploit the nonlinear mapping relationships within the hyperspectral data. Furthermore, an adaptive algorithm optimization framework was proposed. By comparing the inversion accuracy and stability of various models across different water quality parameters and concentration ranges, this framework automatically matched the optimal inversion algorithm for each parameter, thereby achieving the optimal configuration for multi-parameter collaborative sensing. An independent dataset partitioning strategy was adopted for model training and validation, with the coefficient of determination (R2) and mean absolute percentage error (MAPE) as the core evaluation indicators to ensure the objectivity and reliability of the assessment results. [Results] The constructed adaptive algorithm optimization framework achieved excellent performance in the inversion of all five water quality parameters. In the training and validation datasets for the optimal algorithms, the R2 values of the corresponding optimal models for each parameter ranged from 0.88 to 0.99, exhibiting extremely high fitting accuracy and generalization capability. From a practical accuracy perspective, 100% (COD), 91% (TSS), 90% (TP), 90% (TN), and 95% (NH3-N) of total samples had a MAPE below 30%, fully meeting the practical requirements for water quality monitoring. Specifically, the inversion accuracy for the COD parameter was the highest, with all samples meeting the accuracy threshold, indicating that hyperspectral data possessed exceptional characterization capability for organic pollutant concentrations. NH3-N followed closely, with 95% of samples meeting the accuracy requirement, reflecting significant spectral response characteristics of ammonia nitrogen in specific bands. The compliance rates for TSS, TP, and TN all exceeded 90%, verifying the universality and robustness of the framework in the inversion of different types of water quality parameters. Compared with traditional single-model methods, the adaptive optimization strategy significantly improved the overall accuracy and stability of multi-parameter collaborative inversion, effectively overcoming the adaptability deficiencies of single algorithms under complex water conditions. [Conclusion] This study proposes and validates an adaptive hyperspectral sensing algorithm optimization framework for multi-parameter water quality monitoring based on a self-developed hyperspectral water sensing instrument. The core innovations of this optimization framework lies in the following: first, it breaks through the conventional paradigm of “one algorithm fits all parameters” in traditional water quality hyperspectral inversion by implementing a multi-model competitive optimization mechanism, achieving automatic matching of the optimal algorithm for each parameter. Second, it integrates empirical models and machine learning models into a unified optimization system, balancing the model interpretability with nonlinear fitting capability. Third, the research findings demonstrate strong engineering application prospects and can directly support the construction of 24/7 continuous online water quality monitoring systems.

关键词

高光谱感知 / 水质监测 / 算法优选 / 机器学习 / 在线监测

Key words

hyperspectral sensing / water quality monitoring / algorithm optimization / machine learning / online monitoring

引用本文

导出引用
金秋, 张荣耀, 雷少华, . 水质参数高光谱感知算法研究[J]. 长江科学院院报. 2026, 43(4): 77-85 https://doi.org/10.11988/ckyyb.20250568
JIN Qiu, ZHANG Rong-yao, LEI Shao-hua, et al. Hyperspectral Sensing Algorithms for Water Quality Parameters[J]. Journal of Changjiang River Scientific Research Institute. 2026, 43(4): 77-85 https://doi.org/10.11988/ckyyb.20250568
中图分类号: TP79 (遥感技术的应用)   

参考文献

[1]
张建云, 宋晓猛, 王国庆, 等. 变化环境下城市水文学的发展与挑战: I.城市水文效应[J]. 水科学进展, 2014, 25(4): 594-605.
(Zhang Jian-yun, Song Xiao-meng, Wang Guo-qing, et al. Development and Challenges of Urban Hydrology in a Changing Environment: I: Hydrological Response to Urbanization[J]. Advances in Water Science, 2014, 25(4): 594-605. (in Chinese))
[2]
邱国玉, 张晓楠. 21世纪中国的城市化特点及其生态环境挑战[J]. 地球科学进展, 2019, 34(6): 640-649.
摘要
城市化是世界范围的历史进程。中国的城市化虽然起步较晚,但是由于速度快、规模大、资源能源消耗高,从而带来一系列水环境和热环境问题。系统梳理了在全球气候变化和城市化的双重压力下,中国城市面临的水资源短缺与水污染、日益严重的城市热岛和生态水文灾害等生态环境挑战,提出要以城市生态水文学的理论和手段,解决城市生态环境问题,提升中国的城市化质量,实现宜居城市。
(Qiu Guo-yu, Zhang Xiao-nan. China’s Urbanization and Its Ecological Environment Challenges in the 21st Century[J]. Advances in Earth Science, 2019, 34(6): 640-649. (in Chinese))
[3]
王红瑞, 赵伟静, 邓彩云, 等. 水—能源—粮食纽带关系若干问题解析[J]. 自然资源学报, 2022, 37(2):307-319.
摘要
水、能源、粮食均为战略性、基础性资源,三者之间相互关联,彼此制约,深刻影响着人类的生产、生活和生态环境。通过梳理水—能源—粮食纽带关系领域的研究内容、研究方法、研究尺度等,进一步明确了变化环境影响下水—能源—粮食纽带关系概念框架及其风险关系的传递与表达,指出当前对水—能源—粮食纽带关系理解尚未统一,广泛采用的有&#x0201C;联系论&#x0201D;和&#x0201C;方法论&#x0201D;。现有研究对水—能源—粮食纽带关系进行了现状评估,资源间相互消耗关系的量化与不同情景下的仿真模拟。研究中存在数据缺失、不一致,评估因素单一,缺少动态反馈机制,难以真正应用到政策调控中等问题。因此,数据整合、模型集成、风险评估与动态调节、提高韧性、城市尺度研究和智慧管理,均是水—能源—粮食纽带关系发展关注的重点领域。
(Wang Hong-rui, Zhao Wei-jing, Deng Cai-yun, et al. Analysis on Issues of Water-energy-food Nexus[J]. Journal of Natural Resources, 2022, 37(2):307-319. (in Chinese))

Water, energy and food are indispensable resources in production and life. They are closely linked and mutually restricted, but their spatial distribution is not harmonious. Affected by climate change, economic and social change, the production and life are restricted. By sorting out the research contents, methods, scales of the WEF Nexus, the comprehensive conceptual framework of WEF Nexus and the transmission and expression of its risk relationship under the influence of changing environment are clarified. In the comprehensive conceptual framework, water, energy and food are regarded as the core of the WEF Nexus, and the influencing factors and potential risks of the water-energy-food system are regarded as the extension of the nexus. This paper points out that the definition of WEF Nexus has not been unified, and "connectionism" and "methodology" are two common explanations. The existing studies have assessed the status of the WEF Nexus, quantified the consumption relationship between resources and simulated it under different economic, social and climate scenarios. Status assessment includes safety, pressure, efficiency, resilience, and sustainability. There are some problems in the current research of WEF Nexus. Data missing and inconsistency hinder the calculation. Only one or several factors are considered in the application of the model, which can not fully describe the complexity of the system. Dynamic feedback research is limited by data and quantitative methods. Existing research is difficult to really apply to policy control. Therefore, monitoring, collection and integration of data, exploration of standardization model and establishment of multi-factor integration tool, system risk assessment and dynamic adjustment, resilience improvement, urban scale research and smart management are all the focus of attention in the development of the WEF Nexus.

[4]
鲁旭鹏, 陈柏, 李眷. 农业面源污染成因与防治策略[J]. 农业科技与装备, 2022(4): 72-73.
(Lu Xu-peng, Chen Bai, Li Juan. Causes and Control Strategies of Agricultural Non-point Source Pollution[J]. Agricultural Science & Technology and Equipment, 2022(4): 72-73. (in Chinese))
[5]
张发明, 丁峰, 王坪. 中国粮食主产区农业高质量发展水平评价与时空演变[J]. 浙江农业学报, 2021, 33(1):150-160.
摘要
为了探索中国农业高质量发展的现实情况,实现乡村振兴和农业农村现代化,基于高质量发展和五大发展理念建立中国粮食主产区农业高质量发展水平评价指标体系。采用熵权TOPSIS法对粮食主产区的农业高质量发展水平进行综合评价,并对其时空演变特征进行探讨。结果表明:我国粮食主产区农业高质量发展水平偏低,呈现波动上升的趋势,江苏长期保持第一的位置;中高水平区数量呈现比较明显的递增趋势,由中国沿海地区扩展到中部地区的湖北、湖南和江西等地;粮食主产区农业高质量发展水平正向集聚趋势不断增强;大部分粮食主产区相互之间联系较弱,呈现孤立发展的态势;农业高质量发展热点区域呈现萎缩然后又扩展的态势,热点区由北向南、由东部沿海向中部地区演变且不断增强。建议调整农业产业结构,加大农业技术投入,促进农业区域合作,实现农业绿色发展,以提升中国农业高质量发展水平。
(Zhang Fa-ming, Ding Feng, Wang Ping. Evaluation of High-quality Agricultural Development Level in Major Grain Producing Areas in China and Its Spatial and Temporal Evolution[J]. Acta Agriculturae Zhejiangensis, 2021, 33(1): 150-160. (in Chinese))

In order to explore the reality of China’s high-quality agricultural development, and realize rural revitalization, agriculture and rural modernization, an evaluartion index system for the development level of high-quality agriculture in China’s major grain-producing areas was established based on the concept of high-quality development and five development concepts. The entropy weight TOPSIS method was used to comprehensively evaluate the agricultural high-quality development level in major grain-producing areas. After that the spatial-temporal evolution characteristics were discussed. The results showed that the level of high-quality agricultural development in main grain-producing areas in China was low and the trend of fluctuation was rising. Meanwhile, Jiangsu had maintained its first position for a long time. The number of medium-high level areas in China’s main grain-producing areas showed an obvious increasing trend. The medium-high level areas expanded from China’s coastal areas to the central region, such as Hubei, Hunan and Jiangxi. The positive agglomeration trend of high-quality agricultural development in major grain-producing areas had continued to increase. Most of the main grain-producing areas had weak connection with each other, showing a trend of isolated development. Hot spots for high-quality agricultural development were shrinking and then expanding. Hot spots had evolved and strengthened from north to south, from the eastern coastal region to the central region. Therefore, it was necessary to adjust the structure of agricultural industry, increase input in agricultural technology, promote regional cooperation in agriculture, and realize green development of agriculture in order to improve the level of high-quality agricultural development in China.

[6]
Guo Y, Liu C, Ye R, et al. Advances on Water Quality Detection by UV-VIS Spectroscopy[J]. Applied Sciences, 2020, 10(19): 6874.
[7]
陈洁, 张立福, 张琳珊, 等. 紫外-可见光水质参数在线监测技术研究进展[J]. 自然资源遥感, 2021, 33(4):1-9.
(Chen Jie, Zhang Li-fu, Zhang Lin-shan, et al. Research Progress on Online Monitoring Technologies of Water Quality Parameters Based on Ultraviolet-visible Spectra[J]. Remote Sensing for Natural Resources, 2021, 33(4):1-9. (in Chinese))
[8]
侯迪波, 张坚, 陈泠, 等. 基于紫外-可见光光谱的水质分析方法研究进展与应用[J]. 光谱学与光谱分析, 2013, 33(7):1839-1844.
(Hou Di-bo, Zhang Jian, Chen Ling, et al. Water Quality Analysis by UV-VIS Spectroscopy:A Review of Methodology and Application[J]. Spectroscopy and Spectral Analysis, 2013, 33(7):1839-1844. (in Chinese))
[9]
郑培超, 吕强, 王金梅, 等. 吸收光谱法快速检测长江水COD的方法[J]. 重庆邮电大学学报(自然科学版), 2025, 37(1):29-36.
(Zheng Pei-chao, Lyu Qiang, Wang Jin-mei, et al. Method for Rapid Detection of COD in Yangtze River Water by Absorption Spectrometry[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2025, 37(1): 29-36. (in Chinese))
[10]
Si W, Chen Z, Jim C Y, et al. Decoding Lake Water Eutrophication Using an Innovative Dynamic Model Pool Framework in Erhai Lake[J]. International Journal of Applied Earth Observation and Geoinformation, 2025, 143:104808.
[11]
雷少华, 金秋, 谢梅香, 等. 一种水质探测方法、装置、系统以及存储介质:CN202210977537.8[P].2022-09-13.
(Lei Shao-hua, Jin Qiu, Xie Mei-xiang, et al. SA Water Quality Detection Method,Device,ystem and Storage Medium:CN202210977537.8[P].2022-09-13. (in Chinese))
[12]
梁文广, 陈伟, 王金东, 等. 骆马湖水质遥感反演研究[J]. 中国农村水利水电, 2025(5): 161-170.
(Liang Wen-guang, Chen Wei, Wang Jin-dong, et al. The Study of Remote Sensing Inversion of Water Quality in Luoma Lake[J]. China Rural Water and Hydropower, 2025(5): 161-170. (in Chinese))
[13]
Lei S, Xu J, Li Y, et al. An Approach for Retrieval of Horizontal and Vertical Distribution of Total Suspended Matter Concentration from GOCI Data over Lake Hongze[J]. Science of the Total Environment, 2020, 700:134524.
[14]
Cai X, Li Y, Lei S, et al. A Hybrid Remote Sensing Approach for Estimating Chemical Oxygen Demand Concentration in Optically Complex Waters: A Case Study in Inland Lake Waters in Eastern China[J]. Science of the Total Environment, 2023, 856: 158869.
[15]
宋挺, 周文鳞, 刘军志, 等. 利用高光谱反演模型评估太湖水体叶绿素a浓度分布[J]. 环境科学学报, 2017, 37(3): 888-899.
(Song Ting, Zhou Wen-lin, Liu Jun-zhi, et al. Evaluation on Distribution of Chlorophyll-a Content in Surface Water of Taihu Lake by Hyperspectral Inversion Models[J]. Acta Scientiae Circumstantiae, 2017, 37(3): 888-899. (in Chinese))
[16]
雷少华. 洪泽湖无机悬浮物浓度垂向分布遥感监测研究[D]. 南京: 南京师范大学, 2020.
(Lei Shao-hua. Remote Monitoring of Vertical Distribution of Inorganic Suspended Matter Concentration in Lake Hongze, China[D]. Nanjing: Nanjing Normal University, 2020. (in Chinese))
[17]
黄丽. BP神经网络算法改进及应用研究[D]. 重庆: 重庆师范大学, 2010.
(Huang Li. BP Neural Network Algorithm Improvement and Application Research[D]. Chong-qing: Chongqing Normal University, 2010. (in Chinese))
[18]
王丽, 陈基漓, 谢晓兰, 等. 基于混沌天牛群算法优化的神经网络分类模型[J]. 科学技术与工程, 2022, 22(12): 4854-4863.
(Wang Li, Chen Ji-li, Xie Xiao-lan, et al. Neural Network Model for Classification Based on Chaotic Beetle Swarm Algorithm[J]. Science Technology and Engineering, 2022, 22(12): 4854-4863. (in Chinese))
[19]
闫佳, 刘倩男, 刘诚. 基于粒子群优化BP神经网络的水质监测方法研究[J]. 现代信息科技, 2025, 9(3):153-156,163.
(Yan Jia, Liu Qian-nan, Liu Cheng. Research on Water Quality Monitoring Method Based on Particle Swarm Optimization BP Neural Network[J]. Modern Information Technology, 2025, 9(3):153-156,163. (in Chinese))
[20]
罗刚, 郭仁庆, 刘春乐, 等. 基于随机森林法的镇江市地表水质反演模型构建[J]. 四川环境, 2025, 44(2):141-148.
(Luo Gang, Guo Ren-qing, Liu Chun-le, et al. Inversion Modeling of Surface Water Quality in Zhenjiang City Based on Random Forest Method[J]. Sichuan Environment, 2025, 44(2): 141-148. (in Chinese))
[21]
Oshiro T M, Perez P S, Baranauskas J A. How Many Trees in a Random Forest?[M]//Machine Learning and Data Mining in Pattern Recognition. Berlin: Heidelberg Springer, 2012: 154-168.
[22]
张颖, 高倩倩. 基于随机森林分类算法的巢湖水质评价[J]. 环境工程学报, 2016, 10(2): 992-998.
(Zhang Ying, Gao Qian-qian. Water Quality Evaluation of Chaohu Lake Based on Random Forest Method[J]. Chinese Journal of Environmental Engineering, 2016, 10(2): 992-998. (in Chinese))
[23]
吴娟, 朱跃龙, 金松, 等. 三种机器学习模型在太湖藻华面积预测中的应用[J]. 河海大学学报(自然科学版), 2020, 48(6): 542-551.
(Wu Juan, Zhu Yue-long, Jin Song, et al. Area Prediction of Cyanobacterial Blooms Based on Three Machine Learning Methods in Taihu Lake[J]. Journal of Hohai University (Natural Sciences), 2020, 48(6): 542-551. (in Chinese))
[24]
袁红春, 毛瑞, 杨蒙召, 等. 基于XGBoost的溶解氧预测模型研究[J]. 传感器与微系统, 2020, 39(10):51-53,57.
(Yuan Hong-chun, Mao Rui, Yang Meng-zhao, et al. Research on Dissolved Oxygen Prediction Model Based on XGBoost[J]. Transducer and Microsystem Technologies, 2020, 39(10): 51-53, 57. (in Chinese))
[25]
何汝艳, 吕子俊, 贾森. 基于LBFGS加速多层感知网络的高光谱遥感非光学水质参数反演[J]. 遥感学报, 2024, 28(11):2970-2983.
(He Ru-yan, Zi-jun, Jia Sen. Inversion of Non-optical Water Quality Parameters of Hyperspectral Remote Sensing Based on LBFGS-accelerated Multi-layer Perceptron Network[J]. National Remote Sensing Bulletin, 2024, 28(11):2970-2983. (in Chinese))
[26]
孙德勇, 李云梅, 王桥, 等. 基于实测高光谱的太湖水体悬浮物浓度遥感估算研究[J]. 红外与毫米波学报, 2009, 28(2): 124-128.
(Sun De-yong, Li Yun-mei, Wang Qiao, et al. Study on Remote Sensing Estimation of Suspended Matter Concentrations Based on in Situ Hyperspectral Data in Lake Tai Waters[J]. Journal of Infrared and Millimeter Waves, 2009, 28(2): 124-128. (in Chinese))
[27]
秦光铎. 基于无人机遥感的小微水体水质参数反演方法研究[D]. 郑州: 郑州大学, 2022.
(Qin Guang-duo. Research on Inversion Methods of Water Quaity Parameters of Small and Micro Waters Based on UAV Remote Sensing Technology[D]. Zhengzhou: Zhengzhou University, 2022. (in Chinese))

基金

国家自然科学基金项目(42101384)
湖泊与流域水安全重点实验室开放基金项目(2024SKL011)
江苏省青年科技人才托举工程项目(JSTJ-2024-090)
南京水利科学研究院研究生论文基金项目(Yy925011)
南京水利科学研究院设备研制类项目(102126253020010000027)

编辑: 陈敏
PDF(1492 KB)

Accesses

Citation

Detail

段落导航
相关文章

/