How to Compile Kratos on the Acuario Cluster
The following tutorial is intended to facilitate the compilation of the Kratos on CIMNE's cluser "Acuario".
In the following we will assume that the new_user is a member of the "kratos" group defined on the server, which will provide him with the access to all of the libraries which are needed for a standard compilation.
Customarization needed for the user account
Edit the file ".bashrc" and add at the end of it the following code:
#OpenMPI use module load openmpi-x86_64 #adding kratos common libraries to the library path export LD_LIBRARY_PATH=/home/kratos_common/compiled_libraries/boost/lib:$LD_LIBRARY_PATH export PYTHONPATH=/home/kratos_common/compiled_libraries/boost/lib:PYTHONPATH #Trilinos libs export LD_LIBRARY_PATH=/home/kratos_common/compiled_libraries/trilinos-10.6.4/lib/:$LD_LIBRARY_PATH
Getting Kratos from repository
You can get the last version of kratos from repository using following command:
svn checkout http://kratos.cimne.upc.es/svn/kratos/kratos
Warning. Please, note that: You have to pay attention to the DOT at the end of the path you have to copy!!!!
Configuration file to be used in the compilation
A standard configuration file, which compiles all of the applications in the Kratos can be found in
You should copy this to your cmake_build kratos directory and use it for compilation. Changing to the Kratos/cmake_build directory in your account and type the following command:
The compiler that comes with the system is a rather old version of the gcc. Please compile the Kratos using the intel compiler using the compilation command:
bjam threading=multi intel -j4
Scalar or OpenMP parallel applications can be run "on-line" using the standard compilation commands. For longer jobs they have to be submitted to a queue. Full details on how to do this are given on the Cluster's wiki
The following example shows how to run (again in online mode) the MPI example "cantilever2d", which is contained in the directory
running 4 processes, distributed between 2 of the cluster nodes (pez001 and pez002) can be obtained as follows:
mpirun --np 4 --host pez001,pez002 python cantilever_aztec.py
A temporary wiki for the Cluster can be found on the web at the addess
updated information will be uploaded when available
The trilinos has been compiled and installed in
in principle the users should NOT recompile it. In any case the script used in configuring it is:
../configure \ --enable-mpi \ --enable-shared \ --with-mpi-compilers=/opt/openmpi/1.2.4/bin \ --with-incdirs="-I/opt/openmpi/1.2.4/include -I/home/kratos_common/SuperLU_DIST_2.3/SRC" \ --with-ldflags="-L/home/kratos_common/SuperLU_DIST_2.3/lib -L/home/kratos_common/ParMetis-3.1" \ --with-libs="-lsuperlu_dist_2.3 -lmetis -lparmetis" \ --prefix=/home/kratos_common/trilinos-9.0.0 \ FFLAGS="-O5 -funroll-all-loops -fPIC" \ CFLAGS="-O3 -fPIC -funroll-loops" \ CXXFLAGS="-O3 -fPIC -funroll-loops -ffast-math" \ --enable-amesos --enable-anasazi --enable-aztecoo \ --enable-epetra --enable-epetraext --enable-ifpack --enable-ml --enable-pytrilinos \ --enable-teuchos --enable-triutils --enable-galeri \ --enable-aztecoo-teuchos --enable-amesos-superludist