necsim-rust is a Rust reimplementation of the C++ library necsim and its Python wrapper pycoalescence, which are used to run neutral coalescence biodiversity simulations.
necsim-rust aims to provide a smaller, more concise subset of the functionality of necsim and pycoalescence but be easier to use and extend. For instance, necsim-rust contains the classical coalescence algorithm. Additionally, it implements two Gillespie-based algorithms and a novel independent algorithm with a CPU and a CUDA variant. Furthermore, necsim-rust can use MPI to parallelise the simulation.
necsim-rust is built in a modular way to reduce code duplication and allow the user (and other programmers) to plug together different components to customise the simulated scenario, the algorithm it is simulated with as well as finer implementation details. Currently, necsim-rust supports four built-in scenarios:
- non-spatial model
- spatially implicit model with migration from a non-spatial metacommunity to a non-spatial local community
- spatially explicit (almost) infinite model with Gaussian Normal dispersal
- spatially-explicit simulation with habitat and dispersal maps
First, you need to clone the necsim-rust GitHub repository:
> git clone https://github.com/juntyr/necsim-rust.gitnecsim-rust is written in the Rust language, which must be installed in your PATH first. necsim-rust includes a rust-toolchain file that configures Rust to use a working nightly toolchain version and install all components required for compilation. If you want to use necsim-rust on a target different than x86_64-unknown-linux-gnu, please update the rust-toolchain config file accordingly.
If you also want to use the CUDA-based algorithm, it is required that you also install the following:
> cargo install ptx-linker --force --lockedTo install rustcoalescence, you need to decide which algorithms you want to compile with it. You can enable the provided algorithms by enabling their corresponding features. For instance, to compile all CPU-based algorithms, you can use
> cargo install --path rustcoalescence --locked --features rustcoalescence-algorithms-gillespie --features rustcoalescence-algorithms-independentTo install with CUDA support, you first need to ensure that the dynamic CUDA libraries are in the LD_LIBRARY_PATH and enable the rustcoalescence-algorithms-cuda feature:
> LIBRARY_PATH="$LD_LIBRARY_PATH" cargo install --path rustcoalescence --locked [...] --features rustcoalescence-algorithms-cudaTo compile with MPI support, you need to enable the necsim-partitioning-mpi feature:
> cargo install --path rustcoalescence --locked [...] --features necsim-partitioning-mpiAfter compilation, you can then run rustcoalescence using:
> rustcoalescence [...]If you want to use any of the provided reporter analysis plugins, you have to compile them manually. For instance, to compile the common plugin which includes the Biodiversity(), Counter(), Execution(), Progress() and Verbose() reporters, you can run:
> cargo build --release --manifest-path necsim/plugins/common/Cargo.tomlIf you want to compile the library for development, you can use any of the above installation commands, but replace
> cargo install --path rustcoalescence --locked [...]with
> cargo build --release [...]rustcoalescence has two subcommands: simulate and replay and accepts command-line arguments in the following format:
> rustcoalescence <SUBCOMMAND> args..Here, args.. is a configuration string in RON format, which can also directly be read from a configuration file:
> rustcoalescence <SUBCOMMAND> "$(<config.ron)"Please refer to docs/simulate.ron and docs/replay.ron for a detailed description of all configuration options. ./simulate.ron and ./replay.ron also provide example configurations.
necsim-rust consists of the following crates:
- necsim/: this folder contains the core declaration of the simulation and implementation of its components
- core/:
necsim-coredeclares the core structs, simulation cogs traits, as well as the genericSimulation.- maths/:
necsim-core-mathsdeclares the requiredf64intrinsics for simulating in ano-stdenvironment, and provides a default implementation. - bond/:
necsim-core-bonddeclares helper data types which guarantee a limited value range and are used for encoding preconditions through data types.
- maths/:
- impls/:
- no-std/:
necsim-impls-no-stdcontains the implementations of cogs that do not require the Rust standard library - std/:
necsim-impls-stdcontains the implementations of cogs that do require the Rust standard library - cuda/:
necsim-impls-cudacontains the implementations of CUDA specific cogs
- no-std/:
- plugins/:
- core/:
necsim-plugins-coreimplements the reporter plugin system and provides the functionality to export and load plugins - common/:
necsim-plugins-commonimplements common analysis reporters, e.g. to measure biodiversity, print a progress bar, etc. - metacommunity/:
necsim-plugins-metacommunityimplements a reporter which measures migrations to a static external metacommunity, which can be simulated separately using the non-spatial scenario - csv/:
necsim-plugins-csvimplements a reporter which records events in a CSV file - species/:
necsim-plugins-speciesproduces an SQLite database which lists the parent-child relationships of all simulated individuals as well as their species
- core/:
- partitioning/:
- core/:
necsim-partitioning-coredeclares the core partitioning traits - monolithic/:
necsim-partitioning-monolithicimplements monolithic, i.e. non-parallel partitioning - mpi/:
necsim-partitioning-mpiimplements the MPI-based partitioning backend
- core/:
- core/:
- rustcoalescence/:
rustcoalescenceprovides the command-line interface.- scenarios/:
rustcoalescence-scenarioscontains the glue code to put together the cogs for the built-in scenarios. It is specifically built only for reducing code duplication in rustcoalescence, not for giving a minimal example of how to construct a simulation. - algorithms/:
- gillespie/:
rustcoalescence-algorithms-gillespiecontains the glue code to put together the cogs for the two monolithic Gillespie coalescence algorithms. It is specifically built only for reducing code duplication in rustcoalescence, not for giving a minimal example of how to construct a simulation.- src/gillespie:
GillespieAlgorithm(also known as the classical algorithm) is a good allrounder that is built on Gillespie's "next-reaction" method. While it includes a specialised implementation for uniform turnover rates, it generally uses a dynamic alias method sampler (individual-based) to pick the next event. Therefore, it performs better on habitats with a high probability to disperse to a different location (i.e. small per-location demes). - src/event_skipping:
EventSkippingAlgorithmis a specialised mathematically correct algorithm that skips self-dispersal events without coalescence. It is built on Gillespie's "next-reaction" method and uses a dynamic alias method sampler (location-based) to pick the next event. Therefore, it is very fast on habitats with high self-dispersal probabilities (i.e. large per-location demes), or when the speciation probability is very small.
- src/gillespie:
- independent/:
rustcoalescence-algorithms-independentcontains the glue code to put together the cogs for the independent coalescence algorithm on the CPU. The algorithm treats the simulation as an embarrassingly parallel problem. It can also be used to simulate subdomains of the simulation separately and piece the results back afterwards without loss of consistency. - cuda/:
rustcoalescence-algorithms-cudacontains the glue code to put together the cogs for the independent coalescence algorithm on a CUDA 3.5 capable GPU. The algorithm treats the simulation as an embarrassingly parallel problem. It can also be used to simulate subdomains of the simulation separately and piece the results back afterwards without loss of consistency.
- gillespie/:
- scenarios/:
pycoalescence and necsim both used GDAL to load habitat, dispersal and turnover maps. As rustcoalescence is more strict about type checking the TIFF files, you can use the following commands to convert and compress your GeoTIFF files:
> gdalwarp -ot Uint32 -co "COMPRESS=LZW" -dstnodata 0 -to "SRC_METHOD=NO_GEOTRANSFORM" -to "DST_METHOD=NO_GEOTRANSFORM" input_habitat.tif output_habitat.tif
> gdalwarp -ot Float64 -co "COMPRESS=LZW" -dstnodata 0 -to "SRC_METHOD=NO_GEOTRANSFORM" -to "DST_METHOD=NO_GEOTRANSFORM" input_dispersal.tif output_dispersal.tif
> gdalwarp -ot Float64 -co "COMPRESS=LZW" -dstnodata 0 -to "SRC_METHOD=NO_GEOTRANSFORM" -to "DST_METHOD=NO_GEOTRANSFORM" input_turnover.tif output_turnover.tifLicensed under either of
- Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
- MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)
at your option.
Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.