References

ACP

Atmospheric Chemistry and Physics

ACP

1680-7324

Copernicus GmbH

Göttingen, Germany

10.5194/acp-11-439-2011

Using measurements for evaluation of black carbon modeling

Gilardoni

¹ Vignati

¹ Wilson

European Commission, Institute for Environment and Sustainability, Climate Change Unit, Ispra, Italy

17 01 2011

11 2 439 455

This is an open-access article ditributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

This article is available from http://www.atmos-chem-phys.net/11/439/2011/acp-11-439-2011.html

The full text article is available as a PDF file from http://www.atmos-chem-phys.net/11/439/2011/acp-11-439-2011.pdf

The ever increasing use of air quality and climate model assessments to underpin economic, public health, and environmental policy decisions makes effective model evaluation critical. This paper discusses the properties of black carbon and light attenuation and absorption observations that are the key to a reliable evaluation of black carbon model and compares parametric and nonparametric statistical tools for the quantification of the agreement between models and observations. Black carbon concentrations are simulated with TM5/M7 global model from July 2002 to June 2003 at four remote sites (Alert, Jungfraujoch, Mace Head, and Trinidad Head) and two regional background sites (Bondville and Ispra). Equivalent black carbon (EBC) concentrations are calculated using light attenuation measurements from January 2000 to December 2005. Seasonal trends in the measurements are determined by fitting sinusoidal functions and the representativeness of the period simulated by the model is verified based on the scatter of the experimental values relative to the fit curves. When the resolution of the model grid is larger than 1° × 1°, it is recommended to verify that the measurement site is representative of the grid cell. For this purpose, equivalent black carbon measurements at Alert, Bondville and Trinidad Head are compared to light absorption and elemental carbon measurements performed at different sites inside the same model grid cells. Comparison of these equivalent black carbon and elemental carbon measurements indicates that uncertainties in black carbon optical properties can compromise the comparison between model and observations. During model evaluation it is important to examine the extent to which a model is able to simulate the variability in the observations over different integration periods as this will help to identify the most appropriate timescales. The agreement between model and observation is accurately described by the overlap of probability distribution (PD) curves. Simple monthly median comparisons, the Student's t-test, and the Mann-Whitney test are discussed as alternative statistical tools to evaluate the model performance. The agreement measured by the Student's t-test, when applied to the logarithm of EBC concentrations, overestimates the higher PD agreements and underestimates the lower PD agreements; the Mann-Whitney test can be employed to evaluate model performance on a relative scale when the shape of model and experimental distributions are similar.

References 1

Alexander, M L., Crozier, P A., and Anderson, J R.: Brown carbon spheres in East Asia outflow and their optical properties, Science, 833–836, 2008.

Alfaro, S C., Lafon, S., Rajot, J L., Formenti, P., Gaudichet, A., and Maillei, M.: Iron oxides and light absorption by pure desert dust: An experimental study, J. Geophys. Res., 109, 08201–08209, 2004.

Andreae, M. O. and Gelencsér, A.: Black carbon or brown carbon? The nature of light-absorbing carbonaceous aerosols, Atmos. Chem. Phys., 6, 3131–3148, doi:10.5194/acp-6-3131-2006, 2006.

Andreae, M. and Merlet, P.: Emission of trace gases and trace gases and aerosols from biomass burning, Global Biogeochemi. Cy., 15, 955–966, 2001.

Baltensperger, U., Gaggeler, H W., Jost, D T., Lugauer, M., Schwikowski, M., Weingartner, E., and Seibert, P.: Aerosol climatology at the high-alpine site Jungfraujoch, Switzerland, J. Geophys. Res., 102, 19707–19715, 1997.

Barnard, J. C., Volkamer, R., and Kassianov, E. I.: Estimation of the mass absorption cross section of the organic carbon component of aerosols in the Mexico City Metropolitan Area, Atmos. Chem. Phys., 8, 6665–6679, doi:10.5194/acp-8-6665-2008, 2008.

Bergamaschi, P., Meirink, J F., Müller, J F., Körner, S., Heimann, M., Bousquet, P., Dlugokencky, E J., Kaminski, U., Vecchi, R., Marcazzan, G., Meinhardt, F., Ramonet, M., Sartorius, H., and Zahorowski, W.: Model Inter-comparison on Transport and Chemistry – report on model inter-comparison performed within European Commission FP5 project EVERGREEN, EUR 22241-EN, 2006.

Bond, T C. and Bergstrom, R W.: Light absorption by carbonaceous particles: An investigative review, Aerosol Sci. Technol., 40, 1–41, 2006.

Bond, T C., Anderson, T L., and Campbell, D.: Calibration and intercomparison of filter-based measurements of visible light absorption by aerosols, Aerosol Sci. Technol., 30, 582–600, 1999.

Bond, T C., Streets, D G., Yarber, K F., Nelson, S M., Woo, J.-H., and Kilmont, Z.: A technology-based inventory of black carbon and organic carbon emissions from combustion, J. Geophys. Res., 109, D14 203, 2004.

Boylan, J W. and Russell, A G.: PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models, Atmos. Environ., 40, 4946–4959, 2006.

Cachier, H.: Atmospheric particles, chap. Carbonaceous combustion aerosol, p 622, John Wiley & sons, Inc., 1998.

Chang, J C. and Hanna, S R.: Air quality model performance evaluation, Meteorol. Atmos. Phys., 87, 167–196, 2004.

Cooke, W F., Jennings, S G., and Spain, T G.: Black carbon measurements at Mace Head, 1989–1996, J. Geophys. Res., 102, 25339–25346, 1997.

Corrigan, C E., Ramanathan, V., and Schauer, J J.: Impact of monsoon transitions on the physical and optical properties of aerosols, J. Geophys. Res., 111, D18208, doi:10.1029/2005JD006, 2006.

Cozic, J., Verheggen, B., Weingartner, E., Crosier, J., Bower, K. N., Flynn, M., Coe, H., Henning, S., Steinbacher, M., Henne, S., Collaud Coen, M., Petzold, A., and Baltensperger, U.: Chemical composition of free tropospheric aerosol for PM1 and coarse mode at the high alpine site Jungfraujoch, Atmos. Chem. Phys., 8, 407–423, doi:10.5194/acp-8-407-2008, 2008.

Dana, M T. and Hales, J M.: Statistical aspects of the washout of polydisperse aerosols, Atmos. Environ., 10, 45–50, 1976.

Dentener, F., Kinne, S., Bond, T., Boucher, O., Cofala, J., Generoso, S., Ginoux, P., Gong, S., Hoelzemann, J. J., Ito, A., Marelli, L., Penner, J. E., Putaud, J.-P., Textor, C., Schulz, M., van der Werf, G. R., and Wilson, J.: Emissions of primary aerosol and precursor gases in the years 2000 and 1750 prescribed data-sets for AeroCom, Atmos. Chem. Phys., 6, 4321–4344, doi:10.5194/acp-6-4321-2006, 2006.

Derwent, R G., Ryall, D B., Jennings, S G., Spain, T G., and Simmonds, P G.: Black carbon aerosol and carbon monoxide in European regionally polluted air masses at Mace Head, Ireland during 1995-1998, Atmos. Environ., 35, 6371–6378, 2001.

Eleftheriadis, K., Vratolis, S., and Nyeki, S.: Aerosol black carbon in the European Arctic: Measurements at Zeppelin station, Ny-Ålesund, Svalbard from 1998–2007, Geophys. Res. Lett., 36, L02809, doi:10.1029/2008GL035741, 2009.

Ganzeveld, L. and Lelieveld, J.: Dry deposition parameterization in a chemistry general circulation model and its influence on the distribution of reactive trace gases, J. Geophys. Res., 100, 20999–21012, 1995.

Gery, M W.: Development and testing of the CBM-IV for urban and regional modelling, EPA, 1989.

Gery, M W., Whitten, G Z., Killus, J P., and Dodge, M C.: A photochemical kinetics mechanism for urban and regional scale computer modeling, J. Geophys. Res., 94, 12925–12956, 1989.

Goldstein, A H., Millet, D B., McKay, M., Jaegle, L., Horowitz, L., Cooper, O., Hudman, R., Jacob, D J., Oltmans, S., and Clarke, A.: Impact of Asian emissions on observations at Trinidad Head, California, during ITCT 2K2, J. Geophys. Res, 109, 1–13, 2004.

Guelle, W., Balkanski, Y J., Schulz, M., Dulac, F., and Monfray, P.: Wet deposition in a global size-dependent aerosol transport model. 1. Comparison of a 1 year 210Pb simulation with ground measurements, J. Geophys. Res., 103, 11429–11445, 1998.

Hansen, A. D A., Rosen, H., and Novakov, T.: The aethalometer – An instrument for the real-time measurement of optical absorption by aerosol particles, Sci. Total Environ., 36, 191–196, 1984.

Hansen, A. D A., Bodhaine, B A., Dutton, E G., and Schnell, R C.: Aerosol black carbon measurements at the South Pole: initial results, 1986–1987, Geophys. Res. Lett., 15, 1193–1196, 1988.

Hansen, J., Sato, M., Ruedy, R., Nazarenko, L., Lacis, A., Schmidt, G A., Russell, G., Aleinov, I., Bauer, M., Bauer, S., Bell, N., Cairns, B., Canuto, V., Chandler, M., Cheng, Y., Del~Genio, A., Faluvegi, G., Fleming, E., Friend, A., Hall, T., Jackman, C., Kelley, M., Kiang, N., Koch, D., Lean, J., Lerner, J., Lo, K., Menon, S., Miller, R., Minnis, P., Novakov, T., Oinas, V., Perlwitz, J., Perlwitz, J., Rind, D., Romanou, A., Shindell, D., Stone, P., Sun, S., Tausnev, N., Thresher, D., Wielicki, B., Wong, T., Yao, M., and Zhang, S.: Efficacy of climate forcings, J. Geophys. Res., 110, 1–45, 2005.

Hara, K., Osada, K., Yabuki, M., Hayashi, M., Yamanouchi, T., Shiobara, M., and Wada, M.: Measurement of black carbon at Syowa station, Antarctica: seasonal variation, transport processes and pathways, Atmos. Chem. Phys. Discuss., 8, 9883–9929, doi:10.5194/acpd-8-9883-2008, 2008.

Haywood, J M. and Shine, K P.: The effect of anthropogenic sulfate and soot aerosol on the clear sky planetary radiation budget, Geophys. Res. Lett., 22, 603–606, 1995.

Hertel, O., Berkowicz, R., Christensen, J., and Hov, O.: Test of two numerical schemes for use in atmospheric transport-chemistry models, Atmos. Environ., 27, 2591–2611, 1993.

Houweling, S., Dentener, F., and Lelieveld, J.: The impact of nonmethane hydrocarbon compounds on tropospheric photochemistry, J. Geophys. Res., 103, 10673–10696, 1998.

Huffman, H D.: Comparison of the light absorption coefficient and carbon measures for remote aerosols: An independent analysis of data from the improve network – I, Atmos. Environ., 30, 73–83, 1996.

Jacobson, M Z.: Global direct radiative forcing due to multicomponent anthropogenic and natural aerosols, J. Geophys. Res., 106, 1551–1568, 2001.

Jennings, S G. and Pinnick, R G.: Relationaships between visible extinction, absorption and mass concentration of carbonaceous smokes, Atmos. Environ., 14, 1123–1129, 1980.

Jennings, S G., Geever, M., McGovern, F M., Francis, J., Spain, T G., and Donaghy, T.: Microphysical and physico-chemical characterization of atmospheric marine and continental aerosol at Mace Head, Atmos. Environ., 31, 2795–2808, 1997.

Jeuken, A., Veefkind, J P., Dentener, F., Metzger, S., and Robles~Gonzalez, C.: Simulation of the aerosol optical depth over Europe for August 1997 and a comparison with observations, J. Geophys. Res., 106, 28295–28311, 2001.

Junker, C., Jennings, S. G., and Cachier, H.: Aerosol light absorption in the North Atlantic: trends and seasonal characteristics during the period 1989 to 2003, Atmos. Chem. Phys., 6, 1913–1925, doi:10.5194/acp-6-1913-2006, 2006.

Kim, E., Hopke, P K., Kenski, D M., and Koerber, M.: Sources of fine particles in a rural Midwestern US area, Environ. Sci. Technol., 39, 4953–4960, 2005.

Kirchstetter, T W., Novakov, T., and Hobbs, P V.: Evidence that the spectral dependence of light absorption by aerosols is affected by organic carbon, J. Geophys. Res., 109, 21201–21212, 2004.

Kleefeld, S., Hoffer, A., Krivácsy, Z., and Jennings, S G.: Importance of organic and black carbon in atmospheric aerosols at Mace Head, on the West Coast of Ireland (53°19 N, 9°54 W), Atmos. Environ., 36, 4479–4490, 2002.

Koch, D. and Hansen, J.: Distant origins of Arctic black carbon: A Goddard Institute for Space Studies ModelE experiment, J. Geophys. Res., 110, 1–14, 2005.

Koch, D., Schulz, M., Kinne, S., McNaughton, C., Spackman, J. R., Balkanski, Y., Bauer, S., Berntsen, T., Bond, T. C., Boucher, O., Chin, M., Clarke, A., De Luca, N., Dentener, F., Diehl, T., Dubovik, O., Easter, R., Fahey, D. W., Feichter, J., Fillmore, D., Freitag, S., Ghan, S., Ginoux, P., Gong, S., Horowitz, L., Iversen, T., Kirkevåg, A., Klimont, Z., Kondo, Y., Krol, M., Liu, X., Miller, R., Montanaro, V., Moteki, N., Myhre, G., Penner, J. E., Perlwitz, J., Pitari, G., Reddy, S., Sahu, L., Sakamoto, H., Schuster, G., Schwarz, J. P., Seland, Ø., Stier, P., Takegawa, N., Takemura, T., Textor, C., van Aardenne, J. A., and Zhao, Y.: Evaluation of black carbon estimations in global aerosol models, Atmos. Chem. Phys., 9, 9001–9026, doi:10.5194/acp-9-9001-2009, 2009.

Krol, M., Houweling, S., Bregman, B., van den Broek, M., Segers, A., van Velthoven, P., Peters, W., Dentener, F., and Bergamaschi, P.: The two-way nested global chemistry-transport zoom model TM5: algorithm and applications, Atmos. Chem. Phys., 5, 417–432, doi:10.5194/acp-5-417-2005, 2005.

Kulmala, M., Asmi, A., Lappalainen, H. K., Carslaw, K. S., Pöschl, U., Baltensperger, U., Hov, \O., Brenquier, J.-L., Pandis, S. N., Facchini, M. C., Hansson, H.-C., Wiedensohler, A., and O'Dowd, C. D.: Introduction: European Integrated Project on Aerosol Cloud Climate and Air Quality interactions (EUCAARI) - integrating aerosol research from nano to global scales, Atmos. Chem. Phys., 9, 2825–2841, doi:10.5194/acp-9-2825-2009, 2009.

Lavanchy, V. M H., Gaggeler, H W., Nyeki, S., and Baltensperger, U.: Elemental carbon (EC) and black carbon (BC) measurements with a thermal method and an aethalometer at the high-alpine research station Jungfraujoch, Atmos. Environ., 33, 2759–2769, 1999.

Lazaridis, M., Semb, A., Larssen, S., Hjellbrekke, A G., Hov, O., Hanssen, J E., Schaug, J., and Torseth, K.: Measurements of particulate matter within the framework of the European Monitoring and Evaluation Programme (EMEP) I. First results, Sci. Total Environ., 285, 209–235, 2002.

Liousse, C., Cachier, H., and Jennings, S G.: Optical and thermal measurements of black carbon aerosol content in different environments: Variation of the specific attenuation cross-section, sigma, Atmos. Environ., 27A, 1203–1211, 1993.

Malm, W C., Sisler, J F., Huffman, D., Eldred, R A., and Cahill, T A.: Spatial and seasonal trends in particle concentration and optical extinction in the United States, J. Geophys. Res., 99, 1347–1370, 1994.

Malm, W C., Pitchford, M L., McDade, C., and Ashbaugh, L L.: Coarse particle speciation at selected locations in the rural continental United States, Atmos. Environ., 41, 2225–2239, 2007.

Menon, S., Hansen, J., Nazarenko, L., and Luo, Y.: Climate effects of black carbon aerosols in China and India, Science, 297, 2250–2253, 2002.

Nyeki, S., Baltensperger, U., Colbeck, I., Jost, D T., Weingartner, E., and Gaggeler, H W.: The Jungfraujoch high-alpine research station (3454 m) as a background clean continental site for the measurement of aerosol parameters, J. Geophys. Res., 103, 6097–6107, 1998.

Ogren, J A., Andrews, E., Dutton, E G., Sheridan, P J., and Jefferson, A.: Aerosol optical properties at Trinidad Head – ITCT and beyond, in: American Gephysical Union, Fall meeting 2002, 2002.

Perry, K D., Cliff, S S., and Jimenez-Cruz, M P.: Evidence for hygroscopic mineral dust particles from the Intercontinental Transport and Chemical Transformation Experiment, J. Geophys. Res., 109, 1–9, 2004.

Peters, W., Krol, M C., Dlugokencky, E J., Dentener, F J., Bergamaschi, P., Dutton, G., Velthoven, P V., Miller, J B., Bruhwiler, L., and Tans, P P.: Toward regional-scale modeling using the two-way nested global model TM5: Characterization of transport using SF6, J. Geophys. Res., 109, D19314, doi:10.1029/2004JD005020, 2004.

Putaud, J P., Van~Dingenen, R., and Raes, F.: Submicron aerosol mass balance at urban and semirural sites in the Milan area (Italy), J. Geophys. Res., 107, 8198, doi:10.1029/2000JD000111, 2002.

Ramanathan, V. and Carmichael, G.: Global and regional climate changes due to black carbon, Nat. Geosci., 1, 221–227, 2008.

Ramanathan, V., Li, F., Ramana, M V., Praveen, P S., Kim, D., Corrigan, C E., Nguyen, H., Stone, E A., Schauer, J J., Carmichael, G R., Adhikary, B., and Yoon, S C.: Atmospheric brown clouds: Hemispherical and regional variations in long-range transport, absorption, and radiative forcing, J. Geophys. Res., 112, D22S21, doi:10.1029/2006JD008124, 2007.

Rosen, H. and Hansen, A. D A.: Role of combustion-generated carbon particles in the absorption of solar radiation in the Arctic haze, Geophys. Res. Lett., 11, 461–464, 1984.

Seigneur, C., Pun, B., Pai, P., Louis, J F., Solomon, P., Emery, C., Morris, R., Zahniser, M., Worsnop, D., Koutrakis, P., White, W., and Tombach, I.: Guidance for the performance evaluation of three-dimensional air quality modeling systems for particulate matter and visibility, J. Air Waste Manage., 50, 588–599, 2000.

Sharma, S., Brook, J R., Cachier, H., Chow, J., Gaudenzi, A., and Lu, G.: Light absorption and thermal measurements of black carbon in different regions of Canada, J. Geophys. Res., 107, 4771, doi:10.1029/2002JD002496, 2002.

Sharma, S., Lavoué, D., Chachier, H., Barrie, L A., and Gong, S L.: Long-term trends of the black carbon concentrations in the Canadian Arctic, J. Geophys. Res., 109, 15201–15210, 2004.

Sharma, S., Andrews, E., Barrie, L A., Ogren, J A., and Lavoué, D.: Variations and sources of the equivalent black carbon in the high Arctic revealed by long-term observations at Alert and Barrow: 1989–2003, J. Geophys. Res., 111, D14208, doi:10.1029/2005JD006581, 2006.

Sheridan, P J., Delene, D J., and Ogren, J A.: In situ measurement of aerosol light absorption and single-scattering albedo at the NSA and SGP CART sites, in: Tenth ARM Science Meeting Proceedings, 2000.

Snyder, D C. and Schauer, J J.: An inter-comparison of two black carbon aerosol instruments and a semi-continuous elemental carbon instrument in the urban environment, Aerosol Sci. Technol., 41, 463–474, 2007.

Sokolik, I N. and Toon, O B.: Incorporation of mineralogical composition into models of the radiative properties of mineral aerosol from UV to IR wavelengths, J. Geophys. Res., 104, 9423–9444, 1999.

Roelofs, G.-J., ten Brink, H., Kiendler-Scharr, A., de Leeuw, G., Mensah, A., Minikin, A., and Otjes, R.: Evaluation of simulated aerosol properties with the aerosol-climate model ECHAM5-HAM using observations from the IMPACT field campaign, Atmos. Chem. Phys., 10, 7709–7722, doi:10.5194/acp-10-7709-2010, 2010.

Stohl, A., Andrews, E., Burkhart, J F., Forster, C., Herber, A., Hoch, S W., Kowal, D., Lunder, C., Mefford, T., Ogren, J A., Sharma, S., Spichtinger, N., Stebel, K., Stone, R., Ström, J., Tørseth, K., Wehrli, C., and Yttri, K E.: Pan-Arctic enhancements of light absorbing aerosol concentrations due to North American boreal forest fires during summer 2004, J. Geophys. Res., 111, D22214, doi:10.1029/2006JD007216, 2006.

Tegen, I., Hollrig, P., Chin, M., Fung, I., Jacob, D., and Penner, J.: Contribution of different aerosol species to the global aerosol extinction optical thickness: Estimates from model results, J. Geophys. Res., 102, 23895–23915, 1997.

Textor, C., Schulz, M., Guibert, S., Kinne, S., Balkanski, Y., Bauer, S., Berntsen, T., Berglen, T., Boucher, O., Chin, M., Dentener, F., Diehl, T., Easter, R., Feichter, H., Fillmore, D., Ghan, S., Ginoux, P., Gong, S., Grini, A., Hendricks, J., Horowitz, L., Huang, P., Isaksen, I., Iversen, I., Kloster, S., Koch, D., Kirkevåg, A., Kristjansson, J. E., Krol, M., Lauer, A., Lamarque, J. F., Liu, X., Montanaro, V., Myhre, G., Penner, J., Pitari, G., Reddy, S., Seland, Ø., Stier, P., Takemura, T., and Tie, X.: Analysis and quantification of the diversities of aerosol life cycles within AeroCom, Atmos. Chem. Phys., 6, 1777–1813, doi:10.5194/acp-6-1777-2006, 2006.

van Der~Werf, G R., Randerson, J T., Collatz, G J., Giglio, L., Kasibhatla, P S., Arellano, A F., Olsen, S C., and Kasischke, E S.: Continental scale partitioning of fire emissions during the 1997 to 2001 El Niño/La Niña period, Science, 303, 73–76, 2004.

Vignati, E., Wilson, J., and Stier, P M.: An efficient size-resolved aerosol microphysics module for large-scale aerosol transport models, J. Geophys. Res., 109, 1–17, 2004.

Vignati, E., Facchini, M C., Rinaldi, M., Scannell, C., Ceburnis, D., Sciare, J., Kanakidou, M., Myriokefalitakis, S., Dentener, F., and O'Dowd, C D.: Global scale emission and distribution of sea spray aerosol: Sea–salt and organic enrichment, Atmos. Environ., 44, 670–677, 2010a.

Vignati, E., Karl, M., Krol, M., Wilson, J., Stier, P., and Cavalli, F.: Sources of uncertainties in modelling black carbon at the global scale, Atmos. Chem. Phys., 10, 2595–2611, doi:10.5194/acp-10-2595-2010, 2010b.

Watson, J G., Chow, J., and Cheng, L.-W A.: Summary of Organic and Elemental Carbon/Black Carbon Analysis Methods and Intercomparisons, Aerosol and Air Qual. Res., 5, 65–102, 2005.

Weingartner, E., Saathoff, H., Schnaiter, M., Streit, N., Bitnar, B., and Baltensperger, U.: Absorption of light by soot particles: Determination of the absorption coefficient by means of aethalometers, J. Aerosol Sci., 34, 1445–1463, 2003.

Wilson, J., Cuvelier, C., and Raes, F.: A modeling study of global mixed aerosol fields, J. Geophys. Res., 106, 34081–34108, 2001.

Yang, M., Howell, S. G., Zhuang, J., and Huebert, B. J.: Attribution of aerosol light absorption to black carbon, brown carbon, and dust in China - interpretations of atmospheric measurements during EAST-AIRE, Atmos. Chem. Phys., 9, 2035–2050, doi:10.5194/acp-9-2035-2009, 2009.

Yttri, K. E., Aas, W., Bjerke, A., Cape, J. N., Cavalli, F., Ceburnis, D., Dye, C., Emblico, L., Facchini, M. C., Forster, C., Hanssen, J. E., Hansson, H. C., Jennings, S. G., Maenhaut, W., Putaud, J. P., and T�rseth, K.: Elemental and organic carbon in PM$_10$: a one year measurement campaign within the European Monitoring and Evaluation Programme EMEP, Atmos. Chem. Phys., 7, 5711–5725, doi:10.5194/acp-7-5711-2007, 2007.

Yu, S., Eder, B., Dennis, R., Chu, S.-H., and Schwartz, E.: New unbiased symmetric metrics for evaluation of air quality model, Atmos. Sci. Lett., 7, 26–34, 2006.

Zhang, Y., Liu, P., Pun, B., and Seigneur, C.: A comprehensive performance evaluation of MM5-CMAQ for the Summer 1999 Southern Oxidants Study episode-Part I: Evaluation protocols, databases, and meteorological predictions, Atmos. Environ., 40, 4825–4838, 2006.

Zhao, T. L., Gong, S. L., Zhang, X. Y., and Jaffe, D. A.: Asian dust storm influence on North American ambient PM levels: observational evidence and controlling factors, Atmos. Chem. Phys., 8, 2717–2728, doi:10.5194/acp-8-2717-2008, 2008.