The mpi API on beowulf at Caltech-CIT

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for Caltech-CIT

06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP archiveLog file "/ldas_outgoing/logs/LDASmpi.log.html" already closed. (archived as /ldas_outgoing/logs/archive/mpiAPI/LDASmpi.834841999)
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP closeListenSock no cid registered for service 'data'
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP mpi::init unused data port 10021 closed
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP mpi::init port 10021 (jobstate) opened on beowulf as sock7
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP bgLoop Looping process watchlogs started
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP openListenSock port 10019 (operator) opened on beowulf as sock8
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP openListenSock port 10020 (emergency) opened on beowulf as sock9
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP leakLogger inital size of mpi API: 23096 kB
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 STARTUP bgLoop Looping process etchosts started
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 IDLE bgLoop Looping process statpagefile started
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 IDLE bgLoop Looping process killedjobreaper started
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 IDLE bgLoop Looping process logrotate started
06/20/06-05:33:09 PDT 06/20/06-12:33:09 GMT 834842003 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://131.215.114.9') (::FTPDIR '') (::HTTPURL 'http://131.215.114.9/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas-cit 131.215.114.9') (::LDAS_SYSTEM 'ldas-cit') (::RUNCODE 'LDAS-CIT')
06/20/06-05:33:13 PDT 06/20/06-12:33:13 GMT 834842007 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://131.215.114.9') (::FTPDIR '') (::HTTPURL 'http://131.215.114.9/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas-cit 131.215.114.9') (::LDAS_SYSTEM 'ldas-cit') (::RUNCODE 'LDAS-CIT')
06/20/06-05:33:14 PDT 06/20/06-12:33:14 GMT 834842008 STARTUP mpi::killAllMpirun cleaning up for user ldas
06/20/06-05:33:15 PDT 06/20/06-12:33:15 GMT 834842009 STARTUP mpi::killAllMpirun ran kill 10 times in 1.113 seconds
06/20/06-05:33:15 PDT 06/20/06-12:33:15 GMT 834842009 STARTUP mpi::prestartLamds running lamboot for user search01
06/20/06-05:33:16 PDT 06/20/06-12:33:16 GMT 834842010 STARTUP mpi::prestartLamds running lamboot for user search02
06/20/06-05:33:16 PDT 06/20/06-12:33:16 GMT 834842010 STARTUP mpi::prestartLamds running lamboot for user search03
06/20/06-05:33:17 PDT 06/20/06-12:33:17 GMT 834842011 STARTUP mpi::prestartLamds running lamboot for user search04
06/20/06-05:33:19 PDT 06/20/06-12:33:19 GMT 834842013 STARTUP mpi::prestartLamds STARTUP search01 beowulf ok!
06/20/06-05:33:19 PDT 06/20/06-12:33:19 GMT 834842013 STARTUP mpi::prestartLamds STARTUP search02 beowulf ok!
06/20/06-05:33:20 PDT 06/20/06-12:33:20 GMT 834842014 STARTUP mpi::prestartLamds STARTUP search03 beowulf ok!
06/20/06-05:33:21 PDT 06/20/06-12:33:21 GMT 834842015 STARTUP mpi::prestartLamds STARTUP search04 beowulf ok!
06/20/06-05:33:21 PDT 06/20/06-12:33:21 GMT 834842015 STARTUP mpi::killAllMpirun {ldas@beowulf:mpirun: child process exited abnormally} {ldas@beowulf:wrapperAPI: child process exited abnormally} {ldas@beowulf:lamd: child process exited abnormally}
06/20/06-05:33:29 PDT 06/20/06-12:33:29 GMT 834842023 IDLE mpi::updateCmonNodelist updated ::beowulfNodes in cntlmonAPI to 'beowulf beowulf beowulf beowulf beowulf beowulf beowulf beowulf beowulf'