Swift WP4 training website - Testing the new configuration

Testing the new configuration

Running NWCSAF-GEO with the updated configuration

To start the software run the following command

SAFNWCTM

you should now see the following status message

========================================================

         Satellite Application Facility

                  on support to

     Nowcasting and Very Short-Range Forecasting

                    NWC/GEO v2018

                   15 December 2018

     Copyright 2018, EUMETSAT, All Rights Reserved

--------------------------------------------------------

   Visit our web site for information and support at

             http://nwc-saf.eumetsat.int

========================================================

Step 1: Remapping NWP data for the NWC/GEO

         This step can take several minutes ...

         Check the progress in /home/swift/safnwc/logs/safnwctm_2019-07-11T09:15:04Z.log

         AllMappingNWP safnwc.cfs ...

Step 2: Initiating the NWC/GEO Task-Manager Cycle

nohup: appending output to ‘nohup.out’

-----------------------------------------------------------

Task Manager for the NWC/GEO has been started successfully

-----------------------------------------------------------

Once again we will be set logs to print to the terminal. This will give you a better idea of what the program is doing while you are working through the new test dataset. To do this run the following command.

tm log printtty `tty`

Now navigate to the import directory and copy the files for the first available time into the Sat_data directory

cp Sat_data_archive/*201808011200* Sat_data/.

After a while you will see the following message

2019-07-11T09:17:33Z: New Satellite file found: >/path/to /home/directory/safnwc/import/Sat_data/H-000-MSG4__-MSG4________-_________-EPI______-201808011200-__<

This indicates that new slot has been received and the processing of the slot has started.

The messages will continue to show on your terminal and show you the progress of the various PGEs as the software runs through them. You should notice that in this list we now see that the L1SD PGE has also been run.

Eventually you will receive the message.

All PGEs for Slot 2018-08-01T12:00:00Z have concluded

Now run the following command to check the status of the processing.

tm status

you should see something similar to below

======================================================

 11 JUL 2019    NWC/GEO Task-Manager Status   09:19:55

======================================================

Beggining Time: 11 JUL 2019 09:15:33

Elapsed Time:          000d 00:04:22

Task Manager Status:

   REAL_TIME Mode:  ON

   Active Mode:     ON

Number of tasks in Schedule / in execution:    0/ 0 (Max: 1)

Region Priority / PGE:  CMA CT CTTH CMIC PC CRR PPh iSHAI HRW EXIM ASII ASII-TF ASII-GW RDT-CW CI PLAX L1SD

------------------------------------------------------------------------------------------------------------

Ghana           01:     XXX XX XXXX XXXX XX XXX XXX XXXXX XXX XXXX XXXX XXXXXXX XXXXXXX XXXXXX XX ---- XXXX

------------------------------------------------------------------------------------------------------------

Number of PGE executed/successfully/Total RunTime/Mean RunTime

----------------------------------

CMA:             1       1          1   1

CT:              1       1          2   2

CTTH:            1       1          3   3

CMIC:            1       1          2   2

PC:              1       1          1   1

CRR:             1       1          1   1

PPh:             1       1          1   1

iSHAI:           1       1         10  10

HRW:             1       1          5   5

EXIM:            1       0          0

ASII:            1       0          0

ASII-TF:         1       1          2   2

ASII-GW:         1       1          7   7

RDT-CW:          1       1          1   1

CI:              1       1          1   1

PLAX:            0       0          0

L1SD:            1       1          2   2

----------------------------------

Total:      16      14         39  39

Number of Slots completely processed : 1

Mean time employed by Task Manager Cycle:   0.00s

Maximun cycle time:                         0.00s

Now let's copy some more data into the sat_data directory

cp MSG/*201808011215* Sat_data/.

cp MSG/*201808011230* Sat_data/.

cp MSG/*201808011245* Sat_data/.

and finally

 cp MSG/*201808011300* Sat_data/.

You should have now processed all the entire test dataset, run the following command to get a summary of what it has produced.

tm status

Again this should give you a quick overview of the PGEs processed.

The software has produced a set of netcdf files for each PGE. The program puts all it's processed netcdf files in the export directory. If you run the following command you will see the files produced from the test data

ls -lR $SAFNWC/export/* | more

You can now use python to plot and visualise these netcdf files. More on this later.

Now quit the software using the following command.

tm quit

You can now copy your output for us to practice visualisation using python later on.

cp -r $SAFNWC/export $SAFNWC/testdata_output

You can now clean up all the files from the test dataset by running the following commands

rm $SAFNWC/import/NWP_data/*

rm $SAFNWC/import/Sat_data/*

rm $SAFNWC/export/*/*

rm -rf $SAFNWC/import/Sat_data_archive

rm $SAFNWC/logs/*

rm $SAFNWC/tmp/*

Report abuse