<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">ACP</journal-id>
<journal-title-group>
<journal-title>Atmospheric Chemistry and Physics</journal-title>
<abbrev-journal-title abbrev-type="publisher">ACP</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">1680-7324</issn>
<publisher><publisher-name>Copernicus GmbH</publisher-name>
<publisher-loc>GÃ¶ttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/acp-11-12253-2011</article-id>
<title-group>
<article-title>Emulation of a complex global aerosol model to quantify sensitivity to uncertain parameters</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Lee</surname>
<given-names>L. A.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Carslaw</surname>
<given-names>K. S.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Pringle</surname>
<given-names>K. J.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mann</surname>
<given-names>G. W.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Spracklen</surname>
<given-names>D. V.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>Institute for Climate and Atmospheric Science, University of Leeds, UK</addr-line>
</aff>
<pub-date pub-type="epub">
<day>08</day>
<month>12</month>
<year>2011</year>
</pub-date>
<volume>11</volume>
<issue>23</issue>
<fpage>12253</fpage>
<lpage>12273</lpage>
<permissions>
<license xlink:type="simple">
<license-p>This is an open-access article ditributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</license-p>
</license>
</permissions>
<self-uri xlink:href="http://www.atmos-chem-phys.net/11/12253/2011/acp-11-12253-2011.html">This article is available from http://www.atmos-chem-phys.net/11/12253/2011/acp-11-12253-2011.html</self-uri>
<self-uri xlink:href="http://www.atmos-chem-phys.net/11/12253/2011/acp-11-12253-2011.pdf">The full text article is available as a PDF file from http://www.atmos-chem-phys.net/11/12253/2011/acp-11-12253-2011.pdf</self-uri>
<abstract>
<p>Sensitivity analysis of atmospheric models is necessary to identify the
processes that lead to uncertainty in model predictions, to help understand
model diversity through comparison of driving processes, and to prioritise research. Assessing the effect of
parameter uncertainty in complex models is challenging and often limited by
CPU constraints. Here we present a cost-effective application of
variance-based sensitivity analysis to quantify the sensitivity of a 3-D
global aerosol model to uncertain parameters. A Gaussian process emulator is
used to estimate the model output across multi-dimensional parameter space,
using information from a small number of model runs at points chosen using a
Latin hypercube space-filling design. Gaussian process emulation is a
Bayesian approach that uses information from the model runs along with some
prior assumptions about the model behaviour to predict model output
everywhere in the uncertainty space. We use the Gaussian process emulator to
calculate the percentage of expected output variance explained by uncertainty
in global aerosol model parameters and their interactions. To demonstrate the
technique, we show examples of cloud condensation nuclei (CCN) sensitivity to
8 model parameters in polluted and remote marine environments as a function
of altitude. In the polluted environment 95 % of the variance of CCN
concentration is described by uncertainty in the 8 parameters (excluding
their interaction effects) and is dominated by the uncertainty in the sulphur
emissions, which explains 80 % of the variance. However, in the remote region
parameter interaction effects become important, accounting for up to 40 % of
the total variance. Some parameters are shown to have a negligible individual
effect but a substantial interaction effect. Such sensitivities would not be
detected in the commonly used single parameter perturbation experiments,
which would therefore underpredict total uncertainty. Gaussian process
emulation is shown to be an efficient and useful technique for quantifying
parameter sensitivity in complex global atmospheric models.</p>
</abstract>
<counts><page-count count="21"/></counts>
</article-meta>
</front>
<body/>
<back>
<ref-list>
<title>References</title>
<ref id="ref1">
<label>1</label><mixed-citation publication-type="other" xlink:type="simple"> Ackerley, D., Highwood, E., Frame, D., and Booth, B.: Changes in the global sulfate burden due to perturbations in global CO&lt;sub&gt;2&lt;/sub&gt; concentrations, J. Climate, 20, 5421â€“5432, 2009. </mixed-citation>
</ref>
<ref id="ref2">
<label>2</label><mixed-citation publication-type="other" xlink:type="simple"> Ackermann, I J., Hass, H., Memmesheimer, M., Ebel, A., Binkowski, F., and Shankar, U.: Modal aerosol dynamics model for Europe: Development and first applications, Atmos. Environ., 32, 17, 2981â€“2999, 1998. </mixed-citation>
</ref>
<ref id="ref3">
<label>3</label><mixed-citation publication-type="other" xlink:type="simple"> Adams, P J. and Seinfeld, J H.: Predicting global aerosol size distributions in general circulation models, J. Geophys. Res., 107(D19), 4370, http://dx.doi.org/10.1029/2001JD001010doi:10.1029/2001JD001010, 2002. </mixed-citation>
</ref>
<ref id="ref4">
<label>4</label><mixed-citation publication-type="other" xlink:type="simple"> Adams, P J. and Seinfeld, J H.: Disproportionate impact of particulate emissions on global cloud condensation nuclei concentrations, Geophys. Res. Lett., 30, 1239, http://dx.doi.org/10.1029/2002GL016303doi:10.1029/2002GL016303, 2003. </mixed-citation>
</ref>
<ref id="ref5">
<label>5</label><mixed-citation publication-type="other" xlink:type="simple"> Annan, J., Hargreaves, J., Ohgaito, R., Abe-Ouchi, A., and Emori, S.: Efficiently constraining climate sensitivity with ensembles of Paleoclimate simulations, SOLA, 1, 181â€“184, 2005. </mixed-citation>
</ref>
<ref id="ref6">
<label>6</label><mixed-citation publication-type="other" xlink:type="simple"> Bastos, L. and O&apos;Hagan, A.: Diagnostics for Gaussian Process Emulators, Technometrics, 4, 425â€“438, 2009. </mixed-citation>
</ref>
<ref id="ref7">
<label>7</label><mixed-citation publication-type="other" xlink:type="simple"> Bates, R A., Buck, R J., Riccomagno, E., and Wynn, H P.: Experimental design and observation for large systems, J. Roy. Stat. Soc. B, 58, 77â€“94, 1995. </mixed-citation>
</ref>
<ref id="ref8">
<label>8</label><mixed-citation publication-type="other" xlink:type="simple"> Binkowski, F S. and Shankar, U.: The Regional Particulate Matter Model: 1. Model description 30 and preliminary results, J. Geophys. Res., 100(D12), 26191â€“26209, 1995. </mixed-citation>
</ref>
<ref id="ref9">
<label>9</label><mixed-citation publication-type="other" xlink:type="simple"> Chipperfield, M.: New version of the TOMCAT/SLIMCAT off-line chemical transport model: Intercomparison of stratospheric tracer experiments, Q. J. Roy. Meteorol. Soc., 132, 1179â€“1203, http://dx.doi.org/10.1256/qj.05.51doi:10.1256/qj.05.51, 2006. </mixed-citation>
</ref>
<ref id="ref10">
<label>10</label><mixed-citation publication-type="other" xlink:type="simple"> Collins, M., Booth, B., Bhaskaran, B., Harris, G., Murphy, J., Sexton, D., and Webb, M.: A comparison of perturbed physics and multi-model ensembles: Model errors, feedbacks and forcings, Clim. Dynam., http://dx.doi.org/10.1007/s00382-010-0808-0doi:10.1007/s00382-010-0808-0, 2010. </mixed-citation>
</ref>
<ref id="ref11">
<label>11</label><mixed-citation publication-type="other" xlink:type="simple"> Cox, D.: An analytical method for uncertainty analysis of nonlinear output functions, with applications to fault-tree analysis, IEEE Trans. Reliab., 31, 265â€“268, 1982. </mixed-citation>
</ref>
<ref id="ref12">
<label>12</label><mixed-citation publication-type="other" xlink:type="simple"> Currin, C., Mitchell, T J., Morris, M., and Ylvisaker, D.: Bayesian prediction of deterministic functions with applications to the design and analysis of computer experiments, J. Am. Stat. Assoc., 86, 953â€“963, 1991. </mixed-citation>
</ref>
<ref id="ref13">
<label>13</label><mixed-citation publication-type="other" xlink:type="simple"> de~Leeuw, G., Andreas, E., Anguelova, M., Fairall, C., Lewis, E., O&apos;Dowd, C., Schulz, M., and Schwartz, S.: Production flux of sea spray aerosol, Rev. Geophys., 49, RG2001, http://dx.doi.org/10.1029/2010RG000349doi:10.1029/2010RG000349, 2011. </mixed-citation>
</ref>
<ref id="ref14">
<label>14</label><mixed-citation publication-type="other" xlink:type="simple"> Debry, E., Fahey, K., Sartelet, K., Sportisse, B., and Tombette, M.: Technical Note: A new SIze REsolved Aerosol Model (SIREAM), Atmos. Chem. Phys., 7, 1537â€“1547, http://dx.doi.org/10.5194/acp-7-1537-2007doi:10.5194/acp-7-1537-2007, 2007. </mixed-citation>
</ref>
<ref id="ref15">
<label>15</label><mixed-citation publication-type="other" xlink:type="simple"> Dentener, F., Kinne, S., Bond, T., Boucher, O., Cofala, J., Generoso, S., Ginoux, P., Gong, S., Hoelzemann, J. J., Ito, A., Marelli, L., Penner, J. E., Putaud, J.-P., Textor, C., Schulz, M., van der Werf, G. R., and Wilson, J.: Emissions of primary aerosol and precursor gases in the years 2000 and 1750 prescribed data-sets for AeroCom, Atmos. Chem. Phys., 6, 4321â€“4344, http://dx.doi.org/10.5194/acp-6-4321-2006doi:10.5194/acp-6-4321-2006, 2006. </mixed-citation>
</ref>
<ref id="ref16">
<label>16</label><mixed-citation publication-type="other" xlink:type="simple"> Fisher, R.: The arrangement of field experiments, Journal of the Ministry of Agriculture of Great Britain, 33, 503â€“513, 1926. </mixed-citation>
</ref>
<ref id="ref17">
<label>17</label><mixed-citation publication-type="other" xlink:type="simple"> Forster, P., Ramaswamy, V., Artaxo, P., Berntsen, T., Betts, R., Fahey, D., Haywood, J., Lean, J., Lowe, D., Myhre, G., Nganga, J., Prinn, R., Raga, G., Schulz, M., and Van~Dorland, R.: Changes in Atmospheric Constituents and in Radiative Forcing, in: Climate Change 2007: The Physical Science Basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Solomon, S., Qin, D., Manning, M., Chen, Z., Marquis, M., Averyt, K. B., Tignor, M., and Miller, H. L., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 2007. </mixed-citation>
</ref>
<ref id="ref18">
<label>18</label><mixed-citation publication-type="other" xlink:type="simple"> Gaber, N., Foley, G., Pascual, P., Stiber, N., Sunderland, E., Cope, B., Nold, A., and Zaleem, Z.: Guidance on the development, evaluation and application of environmental models., Tech. Rep. EPA/100/K-09/003, US Environmental Protection Agency, 2009. </mixed-citation>
</ref>
<ref id="ref19">
<label>19</label><mixed-citation publication-type="other" xlink:type="simple"> Ghan, S., Laulainen, N., Easter, R., Wagener, R., Nemesure, S., Chapman, E., Zhang, Y., and Leung, R.: Evaluation of aerosol direct radiative forcing in MIRAGE, J. Geophys. Res., 106(D6), 5295â€“5316, 2001. </mixed-citation>
</ref>
<ref id="ref20">
<label>20</label><mixed-citation publication-type="other" xlink:type="simple"> Goldstein, M. and Rougier, J.: Bayes linear calibrated prediction for complex systems, J. Am. Stat. Assoc., 101, 1132â€“1143, 2006. </mixed-citation>
</ref>
<ref id="ref21">
<label>21</label><mixed-citation publication-type="other" xlink:type="simple"> Gong, S.: A parameterization of sea-salt aerosol source function for sub and super-micron 10 particles, Global Biogeochem. Cy., 17(4), 1097, http://dx.doi.org/10.1029/2003GB002079doi:10.1029/2003GB002079, 2003. </mixed-citation>
</ref>
<ref id="ref22">
<label>22</label><mixed-citation publication-type="other" xlink:type="simple"> Haerter, J O., Roeckner, E., Tomassini, L., and von Storch J.-S.: Parametric uncertainty effects on aerosol radiative forcing, Geophys. Res. Lett., 36, L15707, http://dx.doi.org/10.1029/2009GL039050doi:10.1029/2009GL039050, 2009. </mixed-citation>
</ref>
<ref id="ref23">
<label>23</label><mixed-citation publication-type="other" xlink:type="simple"> Haylock, R G. and O&apos;Hagan, A.: On inference for outputs of computationally expensive algorithms with uncertainty on the inputs, in: Bayesian Statistics 5, edited by: Bernardo, J. M., Berger, J. O., Dawid, A. P., and Smith, A. F. M., Oxford: Oxford University Press, 629â€“637, 1996. </mixed-citation>
</ref>
<ref id="ref24">
<label>24</label><mixed-citation publication-type="other" xlink:type="simple"> Jacobson, M.: Development and application of a new air pollution modeling system II. Aerosol module structure and design, Atmos. Environ., 31(2), 131â€“144, 1997. </mixed-citation>
</ref>
<ref id="ref25">
<label>25</label><mixed-citation publication-type="other" xlink:type="simple"> Jensen, J. L. W V.: Sur les fonctions convexes et les inégalités entre les valeurs moyennes, Acta Mathematica, 30 (1), 175â€“193, http://dx.doi.org/10.1007/BF02418571doi:10.1007/BF02418571, 1906. </mixed-citation>
</ref>
<ref id="ref26">
<label>26</label><mixed-citation publication-type="other" xlink:type="simple"> Jones, B. and Johnson, R.: Design and analysis for the Gaussian process model, Quality and Reliability Engineering International, 25(5), 515â€“524, 2009. </mixed-citation>
</ref>
<ref id="ref27">
<label>27</label><mixed-citation publication-type="other" xlink:type="simple"> Kennedy, M.: The \textscGEM software project, Tech. Rep. http://www.ctcd.group.shef.ac.uk/gem.html, Centre for Terrestrial Carbon Dynamics (CTCD), 2004. </mixed-citation>
</ref>
<ref id="ref28">
<label>28</label><mixed-citation publication-type="other" xlink:type="simple"> Kennedy, M., Anderson, C., O&apos;Hagan, A., Lomas, M., Woodward, I., Gosling, J., and Heinemeyer, A.: Quantifying Uncertainty in the Biospheric Carbon Flux for England and Wales, J. Roy. Stat. Soc. A, 171, Part 1, 109â€“135, 2008. </mixed-citation>
</ref>
<ref id="ref29">
<label>29</label><mixed-citation publication-type="other" xlink:type="simple"> Kulmala, M., Laaksonen, A., and Pirjola, L.: Parameterizations for sulfuric acid/water nucleation rates, J. Geophys. Res., 103(D7), 8301â€“8307, 1998. </mixed-citation>
</ref>
<ref id="ref30">
<label>30</label><mixed-citation publication-type="other" xlink:type="simple"> Lauer, A., Hendricks, J., Ackermann, I., Schell, B., Hass, H., and Metzger, S.: Simulating aerosol microphysics with the ECHAM/MADE GCM â€“ Part I: Model description and comparison with observations, Atmos. Chem. Phys., 5, 3251â€“3276, http://dx.doi.org/10.5194/acp-5-3251-2005doi:10.5194/acp-5-3251-2005, 2005. </mixed-citation>
</ref>
<ref id="ref31">
<label>31</label><mixed-citation publication-type="other" xlink:type="simple"> Liu, X., Penner, J E., and Herzog, M.: Global modeling of aerosol dynamics: Model description, evaluation, and interactions between sulfate and nonsulfate aerosols, J. Geophys. Res., 110, D18206, http://dx.doi.org/10.1029/2004JD005674doi:10.1029/2004JD005674, 2005. </mixed-citation>
</ref>
<ref id="ref32">
<label>32</label><mixed-citation publication-type="other" xlink:type="simple"> Liu, X., Penner, J., Das, B., Bergmann, D., Rodriguez, J., Strahan, S., Wang, M., and Feng, Y.: Uncertainties in global aerosol simulations: Assessment using three meteorological data sets, J. Geophys. Res., 112, D11212, http://dx.doi.org/10.1029/2006JD008216doi:10.1029/2006JD008216, 2007. </mixed-citation>
</ref>
<ref id="ref33">
<label>33</label><mixed-citation publication-type="other" xlink:type="simple"> Loeppky, J., Sack, J., and Welch, W.: Choosing the Sample Size of a Computer Experiment: A Practical Guide, Technometrics, 51(4), 366â€“376, 2009. </mixed-citation>
</ref>
<ref id="ref34">
<label>34</label><mixed-citation publication-type="other" xlink:type="simple"> Lohmann, U. and Ferrachat, S.: Impact of parametric uncertainties on the present-day climate and on the anthropogenic aerosol effect, Atmos. Chem. Phys., 10, 11373â€“11383, http://dx.doi.org/10.5194/acp-10-11373-2010doi:10.5194/acp-10-11373-2010, 2010. </mixed-citation>
</ref>
<ref id="ref35">
<label>35</label><mixed-citation publication-type="other" xlink:type="simple"> Mann, G. W., Carslaw, K. S., Spracklen, D. V., Ridley, D. A., Manktelow, P. T., Chipperfield, M. P., Pickering, S. J., and Johnson, C. E.: Description and evaluation of GLOMAP-mode: a modal global aerosol microphysics model for the UKCA composition-climate model, Geosci. Model Dev., 3, 519â€“551, http://dx.doi.org/10.5194/gmd-3-519-2010doi:10.5194/gmd-3-519-2010, 2010. </mixed-citation>
</ref>
<ref id="ref36">
<label>36</label><mixed-citation publication-type="other" xlink:type="simple"> McKay, M., Conover, W., and Beckman, R.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 239â€“245, 1979. </mixed-citation>
</ref>
<ref id="ref37">
<label>37</label><mixed-citation publication-type="other" xlink:type="simple"> Meehl, G A., Covey, C., Delworth, T., Latif, M., McAvaney, B., Mitchell, J., Stouffer, R., and Taylor, K.: The WCRP CMIP3 multi-model dataset: A new era in climate change research, B. Am. Meteorol. Soc., 88, 1383â€“1394, 2007. </mixed-citation>
</ref>
<ref id="ref38">
<label>38</label><mixed-citation publication-type="other" xlink:type="simple"> Merikanto, J., Spracklen, D. V., Mann, G. W., Pickering, S. J., and Carslaw, K. S.: Impact of nucleation on global CCN, Atmos. Chem. Phys., 9, 8601â€“8616, http://dx.doi.org/10.5194/acp-9-8601-2009doi:10.5194/acp-9-8601-2009, 2009. </mixed-citation>
</ref>
<ref id="ref39">
<label>39</label><mixed-citation publication-type="other" xlink:type="simple"> Morgenstern, O., Braesicke, P., O&apos;Connor, F. M., Bushell, A. C., Johnson, C. E., Osprey, S. M., and Pyle, J. A.: Evaluation of the new UKCA climate-composition model â€“ Part 1: The stratosphere, Geosci. Model Dev., 2, 43â€“57, http://dx.doi.org/10.5194/gmd-2-43-2009doi:10.5194/gmd-2-43-2009, 2009. </mixed-citation>
</ref>
<ref id="ref40">
<label>40</label><mixed-citation publication-type="other" xlink:type="simple"> Morris, R., Kottas, A., Taddy, M., Furfaro, R., and Ganapol, B.: A Statistical Framework for the Sensitivity Analysis of Radiative Transfer Models, IEEE T. Geosci. Remote, 46(12), 4062â€“4074, 2008. </mixed-citation>
</ref>
<ref id="ref41">
<label>41</label><mixed-citation publication-type="other" xlink:type="simple"> Murphy, J., Sexton, D., Barnett, D., Jones, G., Webb, M., Collins, M., and Stainforth, D.: Quantification of modelling uncertainties in a large ensemble of climate change simulations, Nature, 430, 768â€“772, 2004. </mixed-citation>
</ref>
<ref id="ref42">
<label>42</label><mixed-citation publication-type="other" xlink:type="simple"> Neal, R.: Regression and classification using gaussian process priors, in: Bayesian Statistics 6, edited by: Bernardo, J. M., Berger, J. O., Dawid, A. P., and Smith, A. F. M., Oxford: Oxford University Press, 69â€“95, 1999. </mixed-citation>
</ref>
<ref id="ref43">
<label>43</label><mixed-citation publication-type="other" xlink:type="simple"> Nieh$\ddoto$rster, F., Spangehl, T., Fast, I., and Cubasch, U.: Quantification of model uncertainties: parameter sensitivities of the coupled model ECHO-G with middle atmosphere, Geophys. Res. Abstracts, 8, EGU06-A-08526, 2006. </mixed-citation>
</ref>
<ref id="ref44">
<label>44</label><mixed-citation publication-type="other" xlink:type="simple"> Oakley, J E.: Bayesian Uncertainty Analysis for Complex Computer Codes, Ph.D. thesis, Department of Probability and Statistics, University of Sheffield, 1999.  </mixed-citation>
</ref>
<ref id="ref45">
<label>45</label><mixed-citation publication-type="other" xlink:type="simple"> Oakley, J. and O&apos;Hagan, A.: Bayesian inference for the uncertainty distribution of computer model outputs, Biometrika, 89, 769â€“784, 2002. </mixed-citation>
</ref>
<ref id="ref46">
<label>46</label><mixed-citation publication-type="other" xlink:type="simple"> Oakley, J. and O&apos;Hagan, A.: Probabilistic sensitivity analysis of complex models: a Bayesian approach, J. Roy. Stat. Soc. B, 66, 751â€“769, 2004.  </mixed-citation>
</ref>
<ref id="ref47">
<label>47</label><mixed-citation publication-type="other" xlink:type="simple"> O&apos;Hagan, A.: Kendall&apos;s Advanced Theory of Statistics, vol. 2B, Bayesian Inference, London: Arnold, 1994. </mixed-citation>
</ref>
<ref id="ref48">
<label>48</label><mixed-citation publication-type="other" xlink:type="simple"> O&apos;Hagan, A.: Bayesian analysis of computer code outputs: A tutorial, Reliability Engineering and System Safety, 91, 1290â€“1300, 2006. </mixed-citation>
</ref>
<ref id="ref49">
<label>49</label><mixed-citation publication-type="other" xlink:type="simple"> O&apos;Hagan, A. and Haylock, R G.: Bayesian uncertainty analysis and radiological protection, in: Statistics for the Environment 3, Pollution Assessment and Control, edited by: Barnett, V. and Turkman, K. F., Wiley, Chichester, 1997. </mixed-citation>
</ref>
<ref id="ref50">
<label>50</label><mixed-citation publication-type="other" xlink:type="simple"> Pan, W., Tatang, M., McRae, G., and Prinn, R.: Uncertainty analysis of direct radiative forcing by anthropogenic sulfate aerosols, J. Geophys. Res., 102(D18), 21915â€“21924, 1997. </mixed-citation>
</ref>
<ref id="ref51">
<label>51</label><mixed-citation publication-type="other" xlink:type="simple"> Penner, J., Andreae, M., Annegarn, H., Barrie, L., Feichter, J., Hegg, D., Jayaraman, A., Leaitch, R., Murphy, D., Nganga, J., and Pitar, G.: Aerosols, their Direct and Indirect Effects. In Climate Change 2001: The Scientific Basis. Contribution of Working Group I to the Third Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Houghton, J. T., Ding, Y., Griggs, D. J., Noguer, M., van der Linden, P. J., Dai, X., Maskell, K., and Johnson, C. A., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 2001. </mixed-citation>
</ref>
<ref id="ref52">
<label>52</label><mixed-citation publication-type="other" xlink:type="simple"> Pringle, K. J., Tost, H., Message, S., Steil, B., Giannadaki, D., Nenes, A., Fountoukis, C., Stier, P., Vignati, E., and Lelieveld, J.: Description and evaluation of GMXe: a new aerosol submodel for global simulations (v1), Geosci. Model Dev., 3, 391â€“412, http://dx.doi.org/10.5194/gmd-3-391-2010doi:10.5194/gmd-3-391-2010, 2010. </mixed-citation>
</ref>
<ref id="ref53">
<label>53</label><mixed-citation publication-type="other" xlink:type="simple"> Rougier, J.C. and Sexton, D.M.H.: Inference in ensemble experiments, Philosophical Transactions of the Royal Society, Series A, 365, 2133â€“2143, 2007. </mixed-citation>
</ref>
<ref id="ref54">
<label>54</label><mixed-citation publication-type="other" xlink:type="simple"> Rougier, J., Sexton, D., Murphy, J., and Stainforth, D.: Analysing the climate sensitivity of the HadSM3 climate model using ensembles from different but related experiments, J. Climate, 22, 3540â€“3557, 2009. </mixed-citation>
</ref>
<ref id="ref55">
<label>55</label><mixed-citation publication-type="other" xlink:type="simple"> Sacks, J., Welch, W J., Mitchell, T J., and Wynn, H P.: Design and analysis of computer experiments, Statistical Science, 4, 409â€“435, 1989. </mixed-citation>
</ref>
<ref id="ref56">
<label>56</label><mixed-citation publication-type="other" xlink:type="simple"> Saltelli, A. and Annonia, P.: How to avoid a perfunctory sensitivity analysis, Environ. Modell. Softw., 25(12), 1508â€“1517, 2010. </mixed-citation>
</ref>
<ref id="ref57">
<label>57</label><mixed-citation publication-type="other" xlink:type="simple"> Saltelli, A., Chan, K., and Scott, M E.: Sensitivity Analysis, New York, Wiley, 2000. </mixed-citation>
</ref>
<ref id="ref58">
<label>58</label><mixed-citation publication-type="other" xlink:type="simple"> Sanderson, B., Knutti, R., Aina, T., Christensen, C., Faull, N., Frame, D., Ingram, W., Piani, C., Stainforth, D., Stone, D., and Allen, M.: Constraints on model response to greenhouse gas forcing and the role of subgrid-scale processes, J. Climate, 21, 2384â€“2400, 2008. </mixed-citation>
</ref>
<ref id="ref59">
<label>59</label><mixed-citation publication-type="other" xlink:type="simple"> Santner, T J., Williams, B., and Notz, W.: The Design and Analysis of Computer Experiments, New York, Springer-Verlag, 2003. </mixed-citation>
</ref>
<ref id="ref60">
<label>60</label><mixed-citation publication-type="other" xlink:type="simple"> Schimel, D., Alves, D., Enting, I., Heimann, M., Joos, F., Raynaud, D., Wigley, T., Prather, M., Derwent, R., Ehhalt, D., Fraser, P., Sanhueza, E., Zhou, X., Jonas, P., Charlson, R., Rodhe, H., Sadasivan, S., Shine, K., Fouquart, Y., Ramaswamy, V., Solomon, S., Srinivasan, J., Albritton, D., Derwent, R., Isaksen, I., Lal, M., and Wuebbles, D.: Radiative forcing of climate change, in: Climate Change 1996, Contribution of Working Group I to the 2nd Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Houghton, J. T., Meira Filho, L. G., Callander, B. A., Harris, N., Kattenberg, A., and Maskell, K., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 1996. </mixed-citation>
</ref>
<ref id="ref61">
<label>61</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D. V., Pringle, K. J., Carslaw, K. S., Chipperfield, M. P., and Mann, G. W.: A global off-line model of size-resolved aerosol microphysics: I. Model development and prediction of aerosol properties, Atmos. Chem. Phys., 5, 2227â€“2252, http://dx.doi.org/10.5194/acp-5-2227-2005doi:10.5194/acp-5-2227-2005, 2005a. </mixed-citation>
</ref>
<ref id="ref62">
<label>62</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D. V., Pringle, K. J., Carslaw, K. S., Chipperfield, M. P., and Mann, G. W.: A global off-line model of size-resolved aerosol microphysics: II. Identification of key uncertainties, Atmos. Chem. Phys., 5, 3233â€“3250, http://dx.doi.org/10.5194/acp-5-3233-2005doi:10.5194/acp-5-3233-2005, 2005b. </mixed-citation>
</ref>
<ref id="ref63">
<label>63</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D. V., Carslaw, K. S., Kulmala, M., Kerminen, V.-M., Mann, G. W., and Sihto, S.-L.: The contribution of boundary layer nucleation events to total particle concentrations on regional and global scales, Atmos. Chem. Phys., 6, 5631â€“5648, http://dx.doi.org/10.5194/acp-6-5631-2006doi:10.5194/acp-6-5631-2006, 2006.  </mixed-citation>
</ref>
<ref id="ref64">
<label>64</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D V., Carslaw, K S., Kulmala, M., Kerminen, V.-M., Sihto, S.-L., Riipinen, I Merikanto, J., Mann, G W., Chipperfield, M P., Wiedensohler, A., Birmili, W., and Lihavainen, H.: Contribution of particle formation to global cloud condensation nuclei concentrations, Geophys. Res. Lett., 35, L06808, http://dx.doi.org/10.1029/2007GL033038doi:10.1029/2007GL033038, 2008. </mixed-citation>
</ref>
<ref id="ref65">
<label>65</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D. V., Carslaw, K. S., Merikanto, J., Mann, G. W., Reddington, C. L., Pickering, S., Ogren, J. A., Andrews, E., Baltensperger, U., Weingartner, E., Boy, M., Kulmala, M., Laakso, L., Lihavainen, H., Kivekäs, N., Komppula, M., Mihalopoulos, N., Kouvarakis, G., Jennings, S. G., O&apos;Dowd, C., Birmili, W., Wiedensohler, A., Weller, R., Gras, J., Laj, P., Sellegri, K., Bonn, B., Krejci, R., Laaksonen, A., Hamed, A., Minikin, A., Harrison, R. M., Talbot, R., and Sun, J.: Explaining global surface aerosol number concentrations in terms of primary emissions and particle formation, Atmos. Chem. Phys., 10, 4775â€“4793, http://dx.doi.org/10.5194/acp-10-4775-2010doi:10.5194/acp-10-4775-2010, 2010.  </mixed-citation>
</ref>
<ref id="ref66">
<label>66</label><mixed-citation publication-type="other" xlink:type="simple"> Spracklen, D. V., Carslaw, K. S., PÃ¶schl, U., Rap, A., and Forster, P. M.: Global cloud condensation nuclei influenced by carbonaceous combustion aerosol, Atmos. Chem. Phys. Discuss., 11, 6999â€“7044, http://dx.doi.org/10.5194/acpd-11-6999-2011doi:10.5194/acpd-11-6999-2011, 2011. </mixed-citation>
</ref>
<ref id="ref67">
<label>67</label><mixed-citation publication-type="other" xlink:type="simple"> Stier, P., Feichter, J., Kinne, S., Kloster, S., Vignati, E., Wilson, J., Ganzeveld, L., Tegen, I., Werner, M., Balkanski, Y., Schulz, M., Boucher, O., Minikin, A., and Petzold, A.: The aerosol-climate model ECHAM5-HAM, Atmos. Chem. Phys., 5, 1125â€“1156, http://dx.doi.org/10.5194/acp-5-1125-2005doi:10.5194/acp-5-1125-2005, 2005. </mixed-citation>
</ref>
<ref id="ref68">
<label>68</label><mixed-citation publication-type="other" xlink:type="simple"> Stockwell, D. and Chipperfield, M.: The TOMCAT Offline Transport Model. Part III: Convection and vertical diffusion, Tech. Rep. 44c, UGAMP Internal Report, 1996. </mixed-citation>
</ref>
<ref id="ref69">
<label>69</label><mixed-citation publication-type="other" xlink:type="simple"> Textor, C., Schulz, M., Guibert, S., Kinne, S., Balkanski, Y., Bauer, S., Berntsen, T., Berglen, T., Boucher, O., Chin, M., Dentener, F., Diehl, T., Easter, R., Feichter, H., Fillmore, D., Ghan, S., Ginoux, P., Gong, S., Grini, A., Hendricks, J., Horowitz, L., Huang, P., Isaksen, I., Iversen, I., Kloster, S., Koch, D., KirkevÃ¥g, A., Kristjansson, J. E., Krol, M., Lauer, A., Lamarque, J. F., Liu, X., Montanaro, V., Myhre, G., Penner, J., Pitari, G., Reddy, S., Seland, Ã˜., Stier, P., Takemura, T., and Tie, X.: Analysis and quantification of the diversities of aerosol life cycles within AeroCom, Atmos. Chem. Phys., 6, 1777â€“1813, http://dx.doi.org/10.5194/acp-6-1777-2006doi:10.5194/acp-6-1777-2006, 2006. </mixed-citation>
</ref>
<ref id="ref70">
<label>70</label><mixed-citation publication-type="other" xlink:type="simple"> Textor, C., Schulz, M., Guibert, S., Kinne, S., Balkanski, Y., Bauer, S., Berntsen, T., Berglen, T., Boucher, O., Chin, M., Dentener, F., Diehl, T., Feichter, J., Fillmore, D., Ginoux, P., Gong, S., Grini, A., Hendricks, J., Horowitz, L., Huang, P., Isaksen, I. S. A., Iversen, T., Kloster, S., Koch, D., KirkevÃ¥g, A., Kristjansson, J. E., Krol, M., Lauer, A., Lamarque, J. F., Liu, X., Montanaro, V., Myhre, G., Penner, J. E., Pitari, G., Reddy, M. S., Seland, Ã˜., Stier, P., Takemura, T., and Tie, X.: The effect of harmonized emissions on aerosol properties in global models â€“ an AeroCom experiment, Atmos. Chem. Phys., 7, 4489â€“4501, http://dx.doi.org/10.5194/acp-7-4489-2007doi:10.5194/acp-7-4489-2007, 2007. </mixed-citation>
</ref>
<ref id="ref71">
<label>71</label><mixed-citation publication-type="other" xlink:type="simple"> Vignati, E., Karl, M., Krol, M., Wilson, J., Stier, P., and Cavalli, F.: Sources of uncertainties in modelling black carbon at the global scale, Atmos. Chem. Phys., 10, 2595â€“2611, http://dx.doi.org/10.5194/acp-10-2595-2010doi:10.5194/acp-10-2595-2010, 2010.  </mixed-citation>
</ref>
<ref id="ref72">
<label>72</label><mixed-citation publication-type="other" xlink:type="simple"> Whitby, E. and McMurry, P.: Modal aerosol dynamics modeling, Aerosol. Sci. Tech., 27, 673â€“688, 1997. </mixed-citation>
</ref>
<ref id="ref73">
<label>73</label><mixed-citation publication-type="other" xlink:type="simple"> Woodhouse, M T., Mann, G W., and Carslaw, K S.: The impact of oceanic iron fertilisation on cloud condensation nuclei, Atmos. Environ., 42, 5728â€“5730, 2008. </mixed-citation>
</ref>
<ref id="ref74">
<label>74</label><mixed-citation publication-type="other" xlink:type="simple"> Yokohata, T., Webb, M., Collins, M., Williams, K., Yoshimori, M., Hargreaves, J., and Annan, J.: Structural similarities and differences in climate responses to CO&lt;sub&gt;2&lt;/sub&gt; increase between two perturbed physics ensembles, J. Climate, 23, 1392â€“1410, 2010. </mixed-citation>
</ref>
</ref-list>
</back>
</article>