DPE1_5 Operation Guide.
===================================================
The deployment of DPE1_5 Master Suite will creat a directory called IGT-tests
and several others below it, all references in this document are made w.r.t
IGT-tests,
commonOutDir [This is the directory where all "output"
files will be staored, generated at remote worker sites and transfered by
MOP-stage-out].
[Most of the time microDags and
minDags directories are also created here, and need to be deleted for cleanup
operartions].
[It should be writeable to incoming
grid-user, uscms01].
CVS
default-config [This is used by IGT-tests module]
McRunjob [McRunjob, the
directories below it McRunjob/py_sripts is where to run all the commands.].
mop_submitter [mop_submitter scripts, mop_submitter/site-info
contains all Worker site files]
setup.csh | Source
one of them to setup your environment
setup.sh |
testImpalaMOPDagGen.sh
testImpalaMOP.sh
testImpala.sh
testIMPLiteMOPDagGen.sh
testMcRunjob.sh
The whole operation is a 03 step process,
1. Creat jobs to be submitted,
- cd McRunjob/py_sripts
- python Linker.py script=ImpalaMOPOneStep.mcj
AssignmentType=CMKIN AssignmentID=2210 nloop=1 mopSite=ramen cmkinOutPath=$MOP_GUC_DIR
cmsimOutPath=$MOP_GUC_DIR dagOutPath=$MOP_GUC_DIR
$MOP_GUC_DIR points to 'commonOutDir', but you can chose any directory
you need, writeable to incoming grid-user, uscms01.
nloop is the number of jobs you need to create, for a normal
operation create ALL jobs, by NOT mentioning nloop.
ImpalaMOPOneStep.mcj is the McRunjob macrofile located in
McRunjob/mcj_scripts/IMPLite, its worth to see if you want to understand
how jobs being created.
mopSite is site for which you are creating MOP jobs, but it can
be CHANGED at the submission time as mentioned in next section.
This will create ImpalaLite jobs in $TrackingPath (which is normally
set to McRunjob/cms/ImpalaLite/cms_db ) and micro/mini Dags in commonOutDir.
2. Run jobs.
- python RunIMPLiteMOPJob.py <site> assignID
dagOutPath $TrackingPath
nJobs
where <site> is one of the MOP
sites, the available sites could be determined by running "mop_submitter/mop_sites.py
--list" do a --help to see other options. This command
could also be used to determine site parameters.
assignID is the assignment ID
dagOutPath is the path where DAGs are created, normally commonOutDir
nJobs is number of jobs to be submitted to this site.
A typical usage is,
python RunIMPLiteMOPJob.py ramen 2210 $MOP_GUC_DIR
$TrackingPath 10
3. If jobs run successfully, Output will start to appear in commonOutDir,
else you will need to debug for the reason.
This link gives a sight into debug operations (please node
that some of commands and/or parameters are changed and should be translated
for new environment accordingly).
Debug/Operation activity guide
Other Useful Resources:
Last update 06/16/2003
M. Anzar Afaq anzar@fnal.gov
Fermi National Accelerator Laboratory phone: (630) 840-6856
Computing Division - CMS Group fax : (630) 840-2783
P.O.Box 500, MS 234, Batavia, IL 60510 http://home.fnal.gov/~anzar