Skim2 Main Page     @UPR-RUM

 
 
Preliminary Skim2 Proposal (Harry Cheung)
 

 
 
Status of SKIM2
 
 
HARDWARE
 SOFTWARE 
 
 2 Stackers 
8 ALFAS 
  3   333 MHz - 128 MB RAM 
  2   433 MHz - 128 MB RAM 
  3   500 MHz - 256 MB RAM
3 RAID Arrays (75 GB Total) 
Fast-Ethernet 100 MBytes/sec
NON SHARED RESOURCES
 
 
 
DQS  3.1.3
Installed
Tested & Running
msql 2.0.4.1
Installed
Tested
Digester
compiled 
Tested & Running
 
SCRIPTS FOR RUNNING SKIM2 (via Semi-Auto)
Process
work done
scripts used
to be done
Input-Process 
75% 
perl 
no database
Analysis-Process 
75%
perl/csh 
no database
Output-Process 
25%
no script yet
 ------
 
 
 
 
 
 
 
 
 
 


Skim 2 summary process

via Semi-automatic

 
Input Process
Analysis Process
Output Process
Uses the Digester to download files from each tape in the Stacker, then compares against OUTPUT-SKIM1 database to check number of events & size; then it will update INPUT-SKIM2 database and will submit the file(s) to DQS to start the Analysis Process.  The Input Process will stop in the Semi-Auto after downloading all tapes form the Stacker, if Full-Auto then will wait until the Stacker is ready for downloading more tapes.
It will be started (queued in to DQS) by the Input Process if the file downloaded is marked OK.  When running the first thing to do will be to move the file from the PREIMPORT to the BATCH area, and then it will run the SKIM2 E831 analysis generating each output file in a different directory.  When finished it will check the logfile and if there are no erros it will delete the file analyzed, it will update the ANALYSIS-SKIM2 database.
The Output Process will go thru each directory (SUBSTREAM) and when it finds enough data it will start the process of writting to an empty tape using the Digester, when finish it will check the logfile, will update the OUTPUT-SKIM2 database and compare the events written and the size of the files against the ANALYSIS-SKIM2 database.  After finishing with one SUBSTREAM it will continue with the next one.  In Semi-Auto the process will stop after going thru all SUBSTREAMS.
 
 
 
 
 
 
 
 
 

 
via Full-automatic
 
 
Input Process
Analysis Process
Output Process
The Input Process will be an endless loop that downloads files from each tape on the Stacker, it will also clean the tape when needed and will request more tapes to read when finish all tapes from the Stacker.
The Main Diffrence is that the Input Process does not starts the Analysis Program, and now the Input Process after downloading each  file(s) it will  move them to IMPORT where they will be pick by the Analysis Process.
It will be also an endless loop script that will check periodically the IMPORT disk, when it found a new file it will submit it to DQS.  Then it will  run the SKIM2 E831 analysis generating each output file in a different directory.  When finished it will check the logfile and update the ANALYSIS-SKIM2 database. 
I will be another cyclic script that periodically go thru each directory (SUBSTREAM) and when it finds enough data it will start the process of writting to an empty tape using the Digester, when finish it will check the logfile, will update the OUTPUT-SKIM2 database and compare the events written and the size of the files against the ANALYSIS-SKIM2 database.  After finishing with one SUBSTREAM it will continue with the next one.
 
 
 
 
 
 
 
 

 

Questions:

We need:

Plan & next to be done:

 

Conclusions:

 We can start SKIM2 in Semi-Automatic way pretty soon
We need Skim1: tapes, codes & databases to start testing our scripts.
 
 
&
manual