Skip to content

LuneraysFlu_step6

RoiArthurB edited this page Sep 11, 2023 · 2 revisions

6. Exploration of the model

This final step illustrates how to explore the model through the introduction of batch experiments.

Formulation

  • Add an experiment to launch 10 simulations to analyze the sensitivity toward stochasticity.
  • Add an experiment to explore the impact of the proba_leave parameter.
  • Add an experiment to calibrate the model.

These 3 additions will add each a new experiment of type batch, more details about batch experiment on this page.

Model Definition

Sensitivity analysis toward stochasticity

The aim is to run many simulations with the default values for parameters to analyze the impact of stochasticity over the simulation results. We choose as indicator to compare the simulations the infected_rate value after 2hours of simulations. We will launch 10 simulations and display the mean and standard deviation values of this variable over the 10 simulations.

To this purpose we need to define a new experiment with the following facet values:

  • type: the type of the experiment, here we choose the batch mode to be able to launch many simulations in one launch.
  • until: the stop condition in the batch experiment, here time > 2#h.
  • repeat: the number of simulations to run with the same parameter values (number of replications), here 10.
experiment test_robustness type: batch until: time > 2#h repeat: 10 {
    reflex information {
	list<float> vals <- simulations collect each.infected_rate;
	write "mean: " + mean(vals) + " standard deviation: " + standard_deviation(vals);	
    }
}

Experiments are also a kind of species. They can thus have variables and behaviors. Here we use the simulations variable that is the list of the 10 simulations (for the 10 replications). In addition, in batch mode, a reflex is executed at the end of all the replication simulations. We can thus create the list of all the infected_rate values (with the collect operator) and compute the mean and standard_deviation.

Exploration

The aim here is to explore the impact of one parameter over the simulations' results. We keep the same indicator. We add the parameter to explore the experiment and specify the possibility it can take with either the among facet or the combination of min, max, and step facets.

experiment explore_model type: batch until: time > 2#h repeat: 2 {
    parameter "proba_leave" var: proba_leave among: [0, 0.01, 0.05, 0.1, 1.0];
	
    reflex save_results {
	ask simulations {
	    write "proba_leave: " + proba_leave + " infected_rate: " + self.infected_rate;
	    save [proba_leave, self.infected_rate] type: csv to:"results.csv" rewrite: (int(self) = 0) ? true : false header: true ;
	}
    }
}

In order to do a deeper investigation, in particular with an external tool, it could be useful to save the values in a file. For this purpose, we use the save statement. In our example, we save a list of values in the csv file (type: csv) specified in the to facet.

Calibration

The calibration process corresponds to the search of parameter values that maximize/minimize indicators. To this purpose, we need to define:

  • the parameters to explore, with their possible values,
  • the indicator to minimize/maximize,
  • the exploration method.

Here we choose to minimize the value abs(infected_rate - 0.5) (i.e. we want to find parameters' value that makes the simulation having an infected_rate as close as possible to 0.5) after 2hours of simulation. The chosen optimization method is a genetic algorithm (more details on this page).

experiment calibration_model type: batch until: time > 2#h repeat: 3 {
    parameter "infection distance" var: infection_distance min: 1.0 max: 20.0 step: 1;
    parameter "proba infection" var: proba_infection min: 0.01 max: 1.0 step: 0.01;
	
    method genetic pop_dim: 3 max_gen: 5 minimize: abs(infected_rate - 0.5);
}

Complete Model

https://github.com/gama-platform/gama/blob/GAMA_1.9.2/msi.gama.models/models/Tutorials/Luneray%20flu/models/model6.gaml
  1. What's new (Changelog)
  1. Installation and Launching
    1. Installation
    2. Launching GAMA
    3. Updating GAMA
    4. Installing Plugins
  2. Workspace, Projects and Models
    1. Navigating in the Workspace
    2. Changing Workspace
    3. Importing Models
  3. Editing Models
    1. GAML Editor (Generalities)
    2. GAML Editor Tools
    3. Validation of Models
  4. Running Experiments
    1. Launching Experiments
    2. Experiments User interface
    3. Controls of experiments
    4. Parameters view
    5. Inspectors and monitors
    6. Displays
    7. Batch Specific UI
    8. Errors View
  5. Running Headless
    1. Headless Batch
    2. Headless Server
    3. Headless Legacy
  6. Preferences
  7. Troubleshooting
  1. Introduction
    1. Start with GAML
    2. Organization of a Model
    3. Basic programming concepts in GAML
  2. Manipulate basic Species
  3. Global Species
    1. Regular Species
    2. Defining Actions and Behaviors
    3. Interaction between Agents
    4. Attaching Skills
    5. Inheritance
  4. Defining Advanced Species
    1. Grid Species
    2. Graph Species
    3. Mirror Species
    4. Multi-Level Architecture
  5. Defining GUI Experiment
    1. Defining Parameters
    2. Defining Displays Generalities
    3. Defining 3D Displays
    4. Defining Charts
    5. Defining Monitors and Inspectors
    6. Defining Export files
    7. Defining User Interaction
  6. Exploring Models
    1. Run Several Simulations
    2. Batch Experiments
    3. Exploration Methods
  7. Optimizing Model Section
    1. Runtime Concepts
    2. Optimizing Models
  8. Multi-Paradigm Modeling
    1. Control Architecture
    2. Defining Differential Equations
  1. Manipulate OSM Data
  2. Diffusion
  3. Using Database
  4. Using FIPA ACL
  5. Using BDI with BEN
  6. Using Driving Skill
  7. Manipulate dates
  8. Manipulate lights
  9. Using comodel
  10. Save and restore Simulations
  11. Using network
  12. Headless mode
  13. Using Headless
  14. Writing Unit Tests
  15. Ensure model's reproducibility
  16. Going further with extensions
    1. Calling R
    2. Using Graphical Editor
    3. Using Git from GAMA
  1. Built-in Species
  2. Built-in Skills
  3. Built-in Architecture
  4. Statements
  5. Data Type
  6. File Type
  7. Expressions
    1. Literals
    2. Units and Constants
    3. Pseudo Variables
    4. Variables And Attributes
    5. Operators [A-A]
    6. Operators [B-C]
    7. Operators [D-H]
    8. Operators [I-M]
    9. Operators [N-R]
    10. Operators [S-Z]
  8. Exhaustive list of GAMA Keywords
  1. Installing the GIT version
  2. Developing Extensions
    1. Developing Plugins
    2. Developing Skills
    3. Developing Statements
    4. Developing Operators
    5. Developing Types
    6. Developing Species
    7. Developing Control Architectures
    8. Index of annotations
  3. Introduction to GAMA Java API
    1. Architecture of GAMA
    2. IScope
  4. Using GAMA flags
  5. Creating a release of GAMA
  6. Documentation generation

  1. Predator Prey
  2. Road Traffic
  3. 3D Tutorial
  4. Incremental Model
  5. Luneray's flu
  6. BDI Agents

  1. Team
  2. Projects using GAMA
  3. Scientific References
  4. Training Sessions

Resources

  1. Videos
  2. Conferences
  3. Code Examples
  4. Pedagogical materials
Clone this wiki locally