DPE 2.0 Production Operations Manual

(MOP-II)

Note: If you have already installed DPE-Master with pacman, Jump to step 7.

1. mkdir prod-ops (or whatever you call it "my-prod-test" ?)
2. cd prod-ops
3. mkdir commonOutDir

4. Check out "dev040803-MOP" version of McRunjob.

    Here is how you can access CVS Repository at CERN

        export CVSROOT=:ext:<<<your cern afs id>>@cmscvs.cern.ch:/cvs_server/repositories/OCTOPUS
        export CVS_RSH=ssh

        and you will need to give your CERN afs password.
cvs co -r dev040803-MOP McRunjob

5. Check out "pre5DPE2_0" version of mop_submitter from FNAL repository.

    export CVSROOT=:pserver:anonymous@cdcvs.fnal.gov:/cvs/cd_read_only
    cvs login
    (Logging in to anonymous@cdcvs.fnal.gov)
    CVS password: anoncvs
    cvs co -r pre5DPE2_0 mop_submitter


6. Create a setup.sh file for yourself in your prod-ops directory with these contents,
export PROD_OPS=`pwd`
export DPE_PATH=<DPEClientPath>
export GLOBUS_PATH=$DPE_PATH/globus
source $DPE_PATH/setup.sh
export MOP_DIR=$PROD_OPS
export MOP_LOG_STAGEOUT_HOST gyoza7.fnal.gov
export MOP_DATA_STAGEOUT_HOST gyoza7.fnal.gov
export MOP_MASTER_HOST `hostname`
export MOP_LOG_GUC_DIR /prod/PCP/validation/test/anzar/log        <------ pre-create this directory (in dCache mind mount point)
export MOP_DATA_GUC_DIR /prod/PCP/validation/test/anzar/data    <------ pre-create this directory (in dCache mind mount point)
export PROD_RESOURCES $PROD_OPS/McRunjob/cms/ImpalaLite
export TrackingPath $PROD_OPS/McRunjob/cms/ImpalaLite/cms_db
export MC_RUNJOB_PATH $PROD_OPS/McRunjob/mcj_scripts/IMPLite
export localCacheArea $PROD_OPS/McRunjob/mcj_scripts/IMPLite/localCache     <--------------- pre-create this directory
export PYTHONPATH $PROD_OPS/mop_submitter:$PROD_OPS/McRunjob/py_script
export commonOutDir $PROD_OPS/IGT-tests/commonOutDir

7. Source setup.sh

8.  Make sure site files are UPTO DATE, each site.vars file need to have only following variables,

    MOP_REMOTE_VDT_LOCATION=/DPE
    MOP_EXPORT_DIR=/home/anzar/MOPTMPAREA/flatfiles
    MOP_REMOTE_DAR_ROOT=/home/anzar/DAR

Running CMKIN Production assignments

   9. Edit McRunjob/cms/ImpalaLite/CMKIN.conf
Update following varibales as given here,

IfStageOutput=true
IfSaveLocal=false
IfSaveRemote=true
useBoss=0
useDAR=true
DARpath=$MOP_REMOTE_DAR_ROOT
EnvironmentType=MOP

  10.  To run jobs,
    i. cd McRunjob/py_script
    ii. Run Linker and create jobs
python Linker.py script=ImpalaMOPOneStep.mcj AssignmentID=2210 AssignmentType=CMKIN mopSite=tamura        cmkinOutPath=$commonOutDir
dagOutPath=$commonOutDir nloop=5
(Please note changes from the previous versions).
iii. Submit jobs.
python Linker.py script=IMPLRunJob_MOP.mcj Scheduler=MOP AssignmentID=2210 useBoss=0
mopSite=tamura  mopDagPath=$commonOutDir mopNumOfJobs=1

Running CMSIM Production assignments

   9. Edit McRunjob/cms/ImpalaLite/CMSIM.conf
Update following varibales as given here,

GeometryFile=insert_mopgeom_loc
LocalInputPath=/pnfs/cms/prod/PCP/validation/test/anzar/data            <---------------- input base-path of ntpl file(s)  (could be anywhere)
IfStageinLocal=true
IfStageinRemote=false
IfStageOutput=true
IfSaveLocal=false
IfSaveRemote=true
IfSaveHBOOK=true
useBoss=0
useDAR=true
DARpath=$MOP_REMOTE_DAR_ROOT
EnvironmentType=MOP
  10.  To run jobs,
    i. cd McRunjob/py_script
    ii. Run Linker and create jobs
python Linker.py script=ImpalaMOPOneStep.mcj AssignmentID=2788 AssignmentType=CMSIM mopSite=tamura cmsimInputPath=/home/anzar/TEMP/IGT-tests/commonOutDir/Validation_USMOP dagOutPath=$commonOutDir nloop=5
iii. Submit jobs.
python Linker.py script=IMPLRunJob_MOP.mcj Scheduler=MOP AssignmentID=2788 useBoss=0 mopSite=tamura mopDagPath=$commonOutDir mopNumOfJobs=1

Note: Please report errors, this is a unit tested version, and should be considered
 as pre-test. Changes will made through the final versions.



======================================================================
M. Anzar Afaq				 anzar[AT]fnal.gov
Fermi National Accelerator Laboratory    phone: (630) 840-6856
Computing Division - CMS Group           fax  : (630) 840-2783
P.O.Box 500, MS 234, Batavia, IL 60510   http://home.fnal.gov/~anzar