Journals / Atmospheric Pollution Research / 2019 / Cilt: 10 - Sayı: 4

Generalised linear model-based algorithm for detection of outliers in environmental data and comparison with semi-parametric outlier detection methods

Pages
1015–1023
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The simulations-based comparison of the performance of all three procedures showed that the procedure presented in this paper effectively detects outliers that deviate at least 5 standard deviations from the mean value of the neighbouring observations and outperforms both distribution-free outlier detection methods for time series.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Outliers are often present in large datasets of air pollutant concentrations.
📊
Key Findings & Data:Considering the known information about accompanying variables and using appropriate methods for detection of outliers in time series measured simultaneously with accompanying variables can be a significant improvement in outlier detection approaches.
💡
Conclusion & Impact:The simulations-based comparison of the performance of all three procedures showed that the procedure presented in this paper effectively detects outliers that deviate at least 5 standard deviations from the mean value of the neighbouring observations and outperforms both distribution-free outlier detection methods for time series.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Özet

Outliers are often present in large datasets of air pollutant concentrations. Existing methods for detection of outliers in environmental data can be divided as follows into three groups depending on the character of the data: methods for time series, methods for time series measured simultaneously with accompanying variables and methods for spatial data. A number of methods suggested for the automatic detection of outliers in time series data are limited by assumptions of known distribution of the analysed variable. Since the environmental variables are often influenced by accompanying factors their distribution is difficult to estimate. Considering the known information about accompanying variables and using appropriate methods for detection of outliers in time series measured simultaneously with accompanying variables can be a significant improvement in outlier detection approaches. This paper presents a method for the automatic detection of outliers in PM10 aerosols measured simultaneously with accompanying variables. The method is based on generalised linear model and subsequent analysis of the residuals. The method makes use of the benefits from the additional information included in the accessibility of accompanying variables. The results of the suggested procedure are compared with the results obtained using two distribution-free outlier detection methods for time series formerly suggested by the authors. The simulations-based comparison of the performance of all three procedures showed that the procedure presented in this paper effectively detects outliers that deviate at least 5 standard deviations from the mean value of the neighbouring observations and outperforms both distribution-free outlier detection methods for time series.

🔖

Cite This Article

Campulova, M., Michalek, J., MOUCKA, J. (2019). Generalised linear model-based algorithm for detection of outliers in environmental data and comparison with semi-parametric outlier detection methods. Atmospheric Pollution Research, Cilt: 10 - Sayı: 4, 1015–1023. https://ajindex.com/articles/166186

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (7)

  1. Abrutzky, R., Dawidowski, L., Matus, P., Lankao, P., 2012. Health effects of climate and air pollution in buenos aires: a first time series analysis. J. Environ. Protect. 3, 262–271.
  2. Agresti, A., 2002. Categorical Data Analysis. University of Florida. Akaike, H., 1974. A new look at the statistical model identification. IEEE Trans. Automat. Contr. 19 (6), 716–723.
  3. Araki, S., Shimadera, H., Yamamoto, K., Kondo, A., 2017. Effect of spatial outliers on the regression modelling of air pollutant concentrations: a case study in Japan. Atmos. Environ. 153, 83–93.
  4. Baffi, G., Martin, E.B., Morris, A.J., 1999. Non-linear projection to latent structures revisited (the neural network PLS algorithm). Comput. Chem. Eng. 23, 1293–1307.
  5. Bao, X., Dai, L., 2009. Partial least squares with outlier detection in spectral analysis: a tool to predict gasoline properties. Fuel 88, 1216–1222.
  6. Barnett, V., 2004. Environmental Statistics: Methods Nd Applications, first ed. Wiley Series in Probability and Statistics, Wiley. Barnett, V., Lewis, T., 1978. Outliers in Statistical Data. John Wiley, Chichester, New York. Beirlant, J., Goegebeur, Y., Segers, J., Teugels, J., de Waal, D., Ferro, C., 2004. Statistics of Extremes: Theory and Applications, first ed. Wiley, New York. Ben-Gal, 2005. Outlier detection. In: Mainon, O., Rokach, L. (Eds.), Data Mining and Knowledge Discovery Handbook, second ed. Springer, Boston, MA, pp. 117–130.
  7. Bobia, M., Misiti, M., Misiti, Y., Poggi, J.-M., Portier, B., 2015. Spatial outlier detection in the PM10 monitoring network of Normandy (France). Atmo. Pollut. Res. 6, 476–483. Brněnské komunikace, a.s, 2010. Ročenka Dopravy Brno 2009. Brno Municipality. Available online at: https://www.bkom.cz/informacni-centrum/rocenky-dopravybrno-15/rocenka-dopravy-brno-2009-pdf-55 (in Czech). Brněnské komunikace, a.s, 2011. Ročenka Dopravy Brno 2010. Brno Municipality. Available online at: https://www.bkom.cz/informacni-centrum/rocenky-dopravybrno-15/rocenka-dopravy-brno-2010-pdf-54 (in Czech). Brněnské komunikace, a.s, 2012. Ročenka Dopravy Brno 2011. Brno Municipality. Available online at: https://www.bkom.cz/informacni-centrum/rocenky-dopravybrno-15/rocenka-dopravy-brno-2011-pdf-53 (in Czech). Brněnské komunikace, a.s, 2013. Ročenka Dopravy Brno 2012. Brno Municipality. Available online at: https://www.bkom.cz/informacni-centrum/rocenky-dopravybrno-15/rocenka-dopravy-brno-2012-pdf-52 (in Czech). Brněnské komunikace, a.s, 2014. Ročenka Dopravy Brno 2013. Brno Municip