Journals / Atmospheric Pollution Research / 2017 / Cilt: 8 - Sayı: 4

Control chart and Six sigma based algorithms for identification of outliers in experimental data, with an application to particulate matter PM10

Pages
700–708
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

However, the methodology is general and can be applied to different type of data whose quality control is required.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Outliers, which can have significant effects on further analysis and modelling, occur between continuously measured environmental data.
📊
Key Findings & Data:Both methods are applied to problem of detection outliers in hourly PM10 measurements.
💡
Conclusion & Impact:However, the methodology is general and can be applied to different type of data whose quality control is required.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Özet

Outliers, which can have significant effects on further analysis and modelling, occur between continuously measured environmental data. Most methods for outlier detection depends on model or distribution of observed variable. However the distribution of environmental variables cannot be estimated quite often. This paper presents two procedures, which do not impose restrictions on the distribution of analysed variable, and which permit the intervals of the environmental observations, where the outliers occur, to be detected. The proposed procedures are based on smoothing original data and subsequent analysis of the residuals. The output of both methods is an interval of observations, where the residual process behaves substandard, and whose quality must be further manually assessed. Thus the value of the proposed methodology is that the number of observations for manual data control is reduced. Both methods are applied to problem of detection outliers in hourly PM10 measurements. However, the methodology is general and can be applied to different type of data whose quality control is required.

🔖

Cite This Article

Campulova, M., Veselík, P., Michalek, J. (2017). Control chart and Six sigma based algorithms for identification of outliers in experimental data, with an application to particulate matter PM10. Atmospheric Pollution Research, Cilt: 8 - Sayı: 4, 700–708. https://ajindex.com/articles/215470

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (1)

  1. Abrutzky, R., Dawidowski, L., Matus, P., Lankao, P.R., 2012. Health effects of climate and air pollution in Buenos Aires: a first time series analysis. J. Environ. Prot. 3, 262e271. Barnett, V., Lewis, T., 1978. Outliers in Statistical Data. John Wiley, Chichester. New York. Bobbia, M., Misiti, M., Misiti, Y., Poggi, J.-M., Portier, B., 2015. Spatial outlier detection in the PM10 monitoring network of Normandy (France). Atmos. Pollut. Res. 6, 476e483. Brockmann, M., Gasser, T., Herrmann, E., 1993. Locally adaptive bandwidth choice for kernel regression estimators. J. Am. Stat. Assoc. 88, 1302e1309. Brys, G., Hubert, M., Struyf, A., 2008. Goodness-of-fit tests based on a robust measure of skewness. Comput. Stat. 23, 429e442. Burman, J., Otto, M., 1988. Outliers in Time Series. Statistical Research Division Report Series CENSUS/SRD/RR-88/14, vol. 44. Bureau of the Census. Cao-Abad, R., Gonzalez-Manteiga, W., 1993. Bootstrap methods in regression smoothing. J. Nonparametr. Stat. 2, 379e388. Dupuis, D.J., Field, C.A., 2004. Large wind speeds: modeling and outlier detection. J. Agric. Biol. Environ. Stat. 9, 105e121. Fan, J., Gijbels, I.,1995. Data-driven bandwidth selection in local polynomial fitting: variable bandwidth and spatial adaptation. J. Roy. Stat. Soc. B 57, 371e394. Fan, J., Hall, P., Martin, M., Patil, P.,1996. On local smoothing of nonparametric curve estimators. J. Am. Stat. Assoc. 91, 258e266. Fox, A., 1972. Outliers in time series. J. Roy. Stat. Soc. B Met. 34, 350e363. Franchini, M., Mannuci, P.M., 2007. Short-term effects of air pollution on cardiovascular diseases: outcomes and mechanisms. J. Thromb. Haemost. 5, 2169e2174. Gasser, T., Müller, H.G., 1979. Kernel estimation of regression functions. In: Gasser, T., Rosenblatt, M. (Eds.), Smoothing Techniques for Curve Estimation, Lect. Notes Math., 757. Springer, pp. 23e67. Gupta, M., Gao, J., Aggarwal, C., 2014. Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data En. 26, 2250e2267. Henry, R., Norris,G.A., Vedantham, R.,Turner, J.R., 2009. Sourceregionidentification using kernel smoothing. Environ. Sci. Technol. 43, 4090e4097. Herrmann, E., 1997. Local bandwidth choice in kernel regression estimation. J. Comput. Grap. Stat. 6, 35e54. Keuken, M.P., Moerman, M., Voogt, M., Blom, M., Weijers, E.P., Rockmann, T., Dusek, U., 2013. Source contributions to PM2.5 and PM10 at an urban background and a street location. Atmos. Environ. 71, 26e35. Kim, K.H., Kabir, E., Kabir, S., 2015. A re