Last update: 09/11/2009

Libraries

Teragrid users may use the softenv command to customize their frost environment for consistency with their environment setup on other systems. Please see the information under the Compilers section for getting this command, plus others, in your path variable.

Mass

The BGL MASS libraries provide optimized scalar and vector intrinsic functions
Link line:
- -lmass -lmassv -Wl,-allow-multiple-definition

NetCDF

current version installed is 3.6.1
- -I/contrib/bgl/netcdf-3.6.1/include
  -L/contrib/bgl/netcdf-3.6.1/lib -lnetcdf

Parallel-NetCDF

installed in /contrib/bgl/pnetcdf

BLAS/LAPACK

/contrib/bgl/lib/libgoto.a (GotoBLAS)
/contrib/bgl/lib/libblas440.a (reference implementation)
/contrib/bgl/lib/liblapack440.a (reference implementation) (Note:order blas after lapack on link line)
/contrib/bgl/lib/
- {libessln.a,libscale.a,libcpuid.a}
- (experimental, incomplete ESSL)
- link in this order: libessln.a libscale.a libcpuid.a

Tips for building your own libraries

General information on third-party software on TeraGrid systems is available under the Documentation tab on the User Portal located on the TeraGrid Main Page

GotoBLAS

Patch to build version 1.02 on Blue Gene and test with Cobalt:
- GotoBLAS-1.02-bgl.patch

Patch GotoBLAS 1.02, compile and submit tests using Cobalt: cd GotoBLAS
patch -p1 < ../GotoBLAS-1.02-bgl.patch
make
cd test;make

PETSc

Normally, users build the Portable, Extensible Toolkit for Scientific Computation (PETSc) in their own directories and set it up with the desired auxiliary packages. Following are instructions for building on frost with the most commonly used utilities.

Download PETSc from Argonne National Laboratory: http://www.mcs.anl.gov/petsc/petsc-2/download/index.html

Uncompress and untar the package. Set environment variables:

setenv PETSC_DIR $PWD
setenv PETSC_ARCH bgl-ibm-goto-O3_440d

Run patch script:
patch -p0 < /contrib/bgl/petsc/petsc-3.0.0-p4/petsc-3.0.0-p4.patch
A Python build/configuration script is available on the system. Copy it to your config directory:
cp /contrib/bgl/petsc/contrib/bgl/petsc/petsc-3.0.0-p4/bgl-ibm-goto_lapack.py config/
Execute the configure/build script:
./config/bgl-ibm-goto_lapack.py

Trilinos

Example config

CC=mpxlc CXX=mpxlC CXXFLAGS="-DMPICH_IGNORE_CXX_SEEK" F77=mpxlf ./configure \

      --prefix=/home/voran/local/trilinos \
      --enable-triutils \
      --enable-teuchos \
      --enable-epetraext \
      --enable-epetra \
      --enable-aztecoo \
      --enable-ifpack \
      --enable-amesos \
      --enable-mpi \
      --with-blas=/contrib/bgl/lib/libblas440.a \
      --with-lapack=/contrib/bgl/lib/liblapack440.a \
      --with-gnumake

Comment these lines out in packages/triutils/src/Triutils_config.h:

      /* Define to 1 if you have the  header file. */
      /* #define HAVE_CSTDIO 1 / / Define to 1 if you have the  header file. */
      /* #define HAVE_CSTDLIB 1 */

Then execute these commands
- make
- make install

Next page | Table of contents - Frost user guide

If you have questions about this document, please contact us by any of the means shown on our Customer Support page.

Address of this page: http://www.cisl.ucar.edu/docs/frost/libs.jsp