Lessons from a comprehensive validation of an agent based-model: the experience of the Pampas Model of Argentinean agricultural systems

Abstract

There are few published examples of comprehensively validated large-scale land-use agent-based models (ABMs). We present guidelines for doing so, and provide an example in the context of the Pampas Model (PM), an ABM aimed to explore the dynamics of structural and land use changes in the agricultural systems of the Argentine Pampas. Many complementary strategies are proposed for validation of ABM’s. We adopted a validation framework that relies on two main streams: (a) validation of model processes and components during model development, which involved a literature survey, design based on similar models, involvement of stakeholders, and focused test scenarios and (b) empirical validation, which involved comparisons of model outputs from multiple realistic simulations against real world data. The design process ensured a realistic model ontology and representative behavioral rules. As result, we obtained reasonable outcomes from a set of initial and simplified scenarios: the PM successfully reproduced the direction of the primary observed structural and land tenure patterns, even before calibration. The empirical validation process lead to tuning and further development of the PM. After this, the PM was able to reproduce not only the direction but also the magnitude of the observed changes. The main lesson from our validation process is the need for multiple validation strategies, including empirical validation. Approaches intended to validate model processes and components may lead to structurally realistic models. However, some kind of subsequent empirical validation is needed to assess the model’s ability to reproduce observed results.