Abstract
The videos captured by the surveillance equipment in sand-dust weather will have poor visibility, color distortion, and low contrast, and the performance of surveillance systems is seriously interfered. To solve this problem, a real-time quality improvement method based on an adaptive dynamic screened Poisson equation for surveillance video in sand-dust weather is proposed in the paper. In the proposed method, the surveillance video collected in sand-dust weather is first divided into several segments using a keyframe extraction method, and then each segment of the surveillance video is processed according to the frame difference strategy to obtain the enhanced surveillance video. There are three steps in processing surveillance video segments, one is to extract the background frame using a multi-frame averaging method, the second is to enhance the background frame using an automatically improving frame quality method based on screened Poisson equation, and the third is to use the enhanced background image and the frame difference information to obtain the enhancement result of the frame image to be processed. Through qualitative and quantitative comprehensive experiments on sand-dust images and videos, the experimental results are compared with the existing related methods, the results of processing sand-dust images using our improving frame quality method have the best visual effect and the highest total scores in quantitative analysis. The results of the frame difference strategy show an average 11.36\(\times\) speed up as compared with the framewise quality improvement method and realize the goal of real-time processing surveillance video.
Similar content being viewed by others
Data availability
The raw/processed data required to reproduce these findings cannot be shared at this time as the data also forms part of an ongoing study.
References
Shen, W., et al.: An image enhancement algorithm of video surveillance scene based on deep learning. IET Image Process. 16, 681–690 (2022). https://doi.org/10.1049/ipr2.12286
Tsakanikas, V., Dagiuklas T.: Video surveillance systems-current status and future trends[J]. Computers & Electrical Engineering. 70, 736–753 (2018)
Agrawal, S.C., Agarwal, R.: A novel contrast and saturation prior for image dehazing. Vis. Comput. (2022). https://doi.org/10.1007/s00371-022-02694-w
Cai, B.L., Xu, X.M., Jia, K., et al.: Dehazenet: an end-to-end system for single image haze removal. IEEE Trans. Image Process. 25(11), 5187–5198 (2016)
Yang, J., Jiang, B., Lv, Z., et al.: A real-time image dehazing method considering dark channel and statistics features. J. Real Time Image Proc. 13, 479–490 (2017). https://doi.org/10.1007/s11554-017-0671-x
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)
Yang, Y., Zhang, C., Liu, L., et al.: Visibility restoration of single image captured in dust and haze weather conditions. Multidim. Syst. Sign Process. 31, 619–633 (2020). https://doi.org/10.1007/s11045-019-00678-z
Li, M., Liu, J., Yang, W., et al.: Structure-revealing lowlight image enhancement via robust retinex model. IEEE Trans. Image Process. 27(99), 1 (2018)
He, J., Zhang, V., Yang, R., Zhu, K.: Convex optimization for fast image dehazing. IEEE Int. Conf. Image Process. (ICIP), pp. 2246-2250, (2016). https://doi.org/10.1109/ICIP.2016.7532758
Salazar-Colores, S., Cabal-Yepez, E., Ramos Arreguin, J.M., Botella, G., Ledesma-Carrillo, L.M., Ledesma, S.: A fast image dehazing algorithm using morphological reconstruction. IEEE Trans. Image Process. 28(5), 2357–2366 (2019). https://doi.org/10.1109/TIP.2018.2885490
Vazquez-Corral, J., Galdran, A., Cyriac, P., et al.: A fast image dehazing method that does not introduce color artifacts. J. Real Time Image Proc. 17, 607–622 (2020). https://doi.org/10.1007/s11554-018-0816-6
Lee, H.: Efficient sandstorm image color correction using rank-based singular value recombination. Symmetry 14(8), 1501 (2022). https://doi.org/10.3390/sym14081501
Xu, G., Wang, X., Xu, X.: Single image enhancement in sandstorm weather via tensor least square. IEEE/CAA J. Autom. Sin. 7(6), 1649–1661 (2020). https://doi.org/10.1109/JAS.2020.1003423
Hua, Z., Qi, L., Guan, M., Su, H., Sun, Y.: Colour balance and contrast stretching for sand-dust image enhancement. IET Image Process. 16, 3768–3780 (2022). https://doi.org/10.1049/ipr2.12592
Zhang, Z., He, H.: A customized low-rank prior model for structured cartoon-texture image decomposition. Signal Process. Image Commun. 96(8), 116308 (2021)
Shi, Z., Feng, Y., Zhao, M., Zhang, E., He, L.: Let you see in sand dust weather: a method based on halo-reduced dark channel prior dehazing for sand-dust image enhancement. IEEE Access 7, 116722–116733 (2019). https://doi.org/10.1109/ACCESS.2019.2936444
Gao, G., Lai, H., Jia, Z., Liu, Y., Wang, Y.: Sand-dust image restoration based on reversing the blue channel prior. IEEE Photonics J. 12(2), 3900216 (2020). https://doi.org/10.1109/JPHOT.2020.2975833
Wang, B., Wei, B., Kang, Z., et al.: Fast color balance and multi-path fusion for sandstorm image enhancement. SIViP 15, 637–644 (2021). https://doi.org/10.1007/s11760-020-01786-1
Fu, X., Yue, H., Zeng, D., Zhang, X.P., Ding, X.: A fusionbased enhancing approach for single sandstorm image. IEEE 16th International Workshop on Multimedia Signal Processing (2014)
Cheng, Y., Jia, Z., Lai, H., Yang, J., Kasabov, N.K.: Blue channel and fusion for sandstorm image enhancement. IEEE Access 8, 66931–66940 (2020). https://doi.org/10.1109/ACCESS.2020.2985869
Ding, B., Chen, H., Xu, L., Zhang, R.: Restoration of single sand-dust image based on style transformation and unsupervised adversarial learning. IEEE Access 10, 90092–90100 (2022). https://doi.org/10.1109/ACCESS.2022.3200163
Liang, P., Dong, P., Wang, F., et al.: Learning to remove sandstorm for image enhancement. Vis. Comput. (2022). https://doi.org/10.1007/s00371-022-02448-8
Si, Y., Yang, F., Liu, Z.: Sand dust image visibility enhancement algorithm via fusion strategy. Sci. Rep. 12, 13226 (2022). https://doi.org/10.1038/s41598-022-17530-3
Si, Y., Yang, F., Guo, Y., et al.: A comprehensive benchmark analysis for sand dust image reconstruction[J]. J. Vis. Commun. Image Represent. 89, 103638 (2022)
Su, W., Zhang, Y., Peng, D., et al.: Fast automatic white balancing method by color histogram stretching. 2011 4th International Congress on Image and Signal Processing. IEEE (2011)
Morel, J.M., Petro, A.B., Sbert, C.: Screened Poisson equation for image contrast enhancement. Image Process. On Line 4, 16–29 (2014)
Shlens, J.: A tutorial on principal component analysis (2014). arXiv:1404.1100
Ni, D., Jia, Z., Yang, J., et al.: A fast sand-dust video quality improvement method based on adaptive dynamic guided filtering and interframe detection strategy[J]. J. Real-Time Image Proc. 19(6), 1181–1197 (2022)
Moore, B.E., Gao, C., Nadakuditi, R.R.: Panoramic robust PCA for foreground-background separation on noisy, free-motion camera video. IEEE Trans. Comput. Imaging 5(2), 195–211 (2019). https://doi.org/10.1109/TCI.2019.2891389
Liu, Q., Li, X.: Efficient low-rank matrix factorization based on l1,\(\epsilon\)-norm for online background subtraction. IEEE Trans. Circuits Syst. Video Technol. 32(7), 4900–4904 (2022). https://doi.org/10.1109/TCSVT.2021.3129503
Zhu, Z., Wei, H., Hu, G., et al.: A novel fast single image dehazing algorithm based on artificial multiexposure image fusion. IEEE Trans. Instrum. Meas. 70(99), 1 (2020)
Mittal, A., Soundararajan, R., Bovik, A.C.: Making a ‘completelyblind’ image quality analyzer. IEEE Signal Process 20, 209–212 (2013)
Halmaoui, H., Cord, A., Hautière, N.: Contrast restoration of road images taken in foggy weather. IEEE International Conference on Computer Vision Workshops, ICCV 2011 Workshops, Barcelona, Spain, November 6–13, 2011. IEEE (2011)
Hautiere, N., Tarel, J.P., Aubert, D., Dumont, E.: Blind contrast enhancement assessment by gradient rationing at visible edges. Image Anal. Stereol. 27(2), 87–95 (2011)
Author information
Authors and Affiliations
Contributions
ND wrote the main manuscript text. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was supported by the National Science Foundation of China under Grant 62261053, the International Science and Technology Cooperation Project of the Ministry of Education of the People’s Republic of China under Grant 2016-2196, and the Excellent Doctoral Research Innovation Program of Xinjiang University under Grant XJU2022BS067.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ni, D., Jia, Z., Yang, J. et al. A real-time quality improvement method based on an adaptive dynamic screened Poisson equation for surveillance video in sand-dust weather. J Real-Time Image Proc 20, 105 (2023). https://doi.org/10.1007/s11554-023-01361-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11554-023-01361-0