Censored random variable as a form of coping with missing data in studying the leachability of heavy metals from hardening slurries

Authors

DOI:

https://doi.org/10.24425/ace.2021.136471

Abstract

Missing data in test result tables can significantly impact the analysis quality, especially in relation to technical sciences, where the mechanism generating missing data is often non-random, and their presence depends on the non-observed part of studied variables. In such cases, the application of an inappropriate method for dealing with missing data will lead to bias in the estimated distribution parameters. The article presents a relatively simple method to implement in dealing with missing data generated as a result of the MNAR mechanism, which utilizes the censored random variable. This procedure does not modify the variable distribution form, which is why it ensures objective and efficient estimation of distribution parameters within studies affected by certain restrictions of technical or physical nature (censored distribution), with a relatively low workload. Furthermore, it does not require the application of specialized software. A prerequisite for using this method is the knowledge of the frequency and cause of missing data. The method for estimating the random variable censored distribution parameters was shown based on the example of studying the leachability of selected heavy metals from a hardening slurry. The analysis results were compared with classical methods for dealing with missing data, such as, ignoring missing data observations (listwise or pairwise deletion), single imputation and stochastic regressive imputation.

References

1. D. B. Rubin, “Inference and missing data,” Biometrika, vol. 63, no. 3, pp. 581-592, 1976.

2. J. W. Graham, “Missing data analysis: Making it work in the real world,” Annual review of psychology, vol. 60, pp. 549-576, 2009.

3. J. W. Graham, P. E. Cumsille, A. E. Shevock, “Methods for handling missing data,” Handbook of Psychology, Second Edition, vol. 2, pp. 109-138, 2012.

4. R. J. A. Little, D. B. Rubin, Statistical analysis with missing data, vol. 793. John Wiley & Sons, pp. 581-592, 2019.

5. A. Pokropek, “Wybrane statystyczne metody radzenia sobie z brakami danych,” Polskie Forum Psychologiczne, vol. 23, no. 2, pp. 291-310, 2018.

6. C. K. Enders, Applied missing data analysis. Guilford press, 2010.

7. A. Hald, “Statistical theory with engineering applications,” 1952.

8. E. L. Korn, “Censoring distributions as a measure of follow‐up in survival analysis,” Statistics in medicine, vol. 5, no. 3, pp. 255-260, 1986.

9. K. Hamada, N. Takayama, “Censored income distributions and the measurement of poverty,” Bulletin of the International Statistical Institute, vol. 47, pp. 617-630, 1977.

10. Z. Kledyński, Integracja i współzależność wybranych kryteriów oceny wodoszczelności betonu. Wydawnictwa Politechniki Warszawskiej, 1993.

11. A. C. Cohen, “Simplified estimators for the normal distribution when samples are singly censored or truncated,” Technometrics, vol. 1, no. 3, pp. 217-237, 1959.

12. J. Maksymiuk, F. Wohlmuth, Metody statystyczne w inżynierii elektrotechnicznej, Wyd. 2, Po. Warszawa: Wydawnictwo Politechniki Warszawskiej, 1984.

13. J. R. Benjamin, C. A. Cornell, Rachunek prawdopodobieństwa, statystyka matematyczna i teoria decyzji dla inżynierów. Wydawnictwa Naukowo-Techniczne, 1977.

14. Ł. Szarek, “Leachability of heavy metals from hardening slurries with the addition of fly ashes from thermal treatment of municipal sewage sludge,” Warsaw Univeristy of Technology, 2019.

15. W. Oktaba, “Elementy statystyki matematycznej i metodyka do wiadczalnictwa,” PWN, Warszawa (in Polish), 1980.

16. M. Matsumoto, T. Nishimura, “Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator,” ACM Transactions on Modeling and Computer Simulation (TOMACS), vol. 8, no. 1, pp. 3-30, 1998.

Downloads

Published

2021-03-30

How to Cite

Szarek, Łukasz, and Zbigniew Kledyński. “Censored Random Variable As a Form of Coping With Missing Data in Studying the Leachability of Heavy Metals from Hardening Slurries”. Archives of Civil Engineering, vol. 67, no. 1, Mar. 2021, pp. 233-47, doi:10.24425/ace.2021.136471.

Issue

Section

Articles

Similar Articles

<< < 18 19 20 21 22 23 24 25 26 27 > >> 

You may also start an advanced similarity search for this article.