research/Memo

Research Memo for LETKF implementation for IsoGSM †

↑

Installation of LETKF in fuyu. †

  • Install Intel fortran/C compiler 10.1 (/opt/intel/fc(cc)/10.1.015)
  • Install Intel MKL 9.1 (/opt/intel/mkl/9.1.023)
  • Install LETKF tool developed by MD-U/AZSt-U http://math.la.asu.edu/~eric/letkf/
    • install "support directory" (edit make.inc)
    • install "MPI version of the LETKF proper" (edit make.inc)
↑

Testdata run †

  • download "testdata" package from Eric's site.
  • cd to LETKF directory
  • modify "config" file (very hard)
  • modify scripts/beo_assim (very hard)
  • modify environ/beo.env
  • $ ./scripts/beo_assim 0

Currently the script above (MPI run) did not work, but single CPU run with following command lines worked.

  • $ setenv F_UFMTENDIAN 1,2
  • $ /home/kyoshimura/downloads/letkf/src/letkf -pall -A 2004010100 -L ./local.dat -n 4 -o /home/kyoshimura/downloads/letkf/testdata/obs.dat -T0 -t0 -b /home/kyoshimura/downloads/letkf/testdata/pnew%n.%h -a ./d2004010100/pnew%n.00 -m ./d2004010100/sigan.2004010100 -d ./d2004010100/diag.2004010100 -c observation -v 1 -l ./d2004010100/log.%n
    • The output is in d2004010100 directory. The sigma files are 4byte real.
↑

Junjie's version on bassi †

  • $LETKF/scripts/master
    is the main script and is calls sub scripts of
    • $LETKF/scripts/beo_assim ; run assimilation
    • $LETKF/scripts/runseq.sh ; run forecast
↑

Main job submission †

$ llsubmit master

In this file, a line of initialize -C config -s YYYYMMDDHH YYYYMMDDHH2 should be set accordingly, as well as config file.

↑

Sub job submission †

Create a script that contains execution line and job submission information. For example, tmp.sh is written as;

#!/bin/bash
#@ job_name = largerInfo
#@ output = ms.out
#@ error = ms.err
#@ notification = complete
#@ environment     = COPY_ALL
#@ job_type = parallel
#@ network.MPI = sn_all,not_shared,us
#@ bulkxfer = yes
#@ shell = /usr/bin/bash
#
#@ class= premium
#@ node = 5
#@ tasks_per_node = 8
#@ wall_clock_limit = 1:00:00
#@ queue

poe ./msw ./runseq.sh -C config -s 2000013100 
  ## for forecast
./beo_assim -v -C config 2000013100
  ## for assimilation
exit

And tmp.sh is submitted.

$ llsubmit tmp.sh