Fix nameservice add persistency to naming service so when it crashes it will come back up with previous list. Sinisa sam_nameservice v3.2.1 Compile station with Kai Compile with gcc - first making new gcc and then all products like orbacus built with this new compiler. done Sinisa sam_station v3.2.1 ACL callback Look into ACL problem on online -some udp callback to fss (optimizer we think?) causing problem for online subnet isolation. Done Sinisa, Carmenita sam_station v3.2.1 SC2001 Mine the log files for SC2001 data done Sinisa sam_info_server v3.2.1 FBS/linux Help Chris with fbs/linux install and testing done Sinisa v3.2.1 Look for an unresolved project master bug Sinisa sam_station v3.2.1 sam_util Linux compile sam_util for linux Sinisa sam_util v3.2.1 possible sam_manager work that may be needed. Pingable client. Check restart option works with --CPID on command line.Also desire to cleanup Gabriele's api for ROOT. defer Sinisa sam_manager v3.2.1 standardizing builds defer requires a lot of design which is the bulk of the job. May not have completed by end of Oct. Benefit is anyone can build any piece of sam easily. Lauri D0 handholding ongoing Lauri NA NA sam_bbftp release new versions of bbftp, 512 char in/out file field change. done Lauri sam_bbftp v3.2.1 10/19 sam user start working on sam_user with Carmenita - taking over - cleanup, error messages, adding new commands Lauri sam_user v3.2.1 get run sam get run command -(needs further specification of course) Lauri sam_user,sam_db_server v3.2.1 diskcache samadmin remove diskcache command. Need uncache file, disk, group cache, station. in progress Mark disk and files on it as not available. Need to go over use cases. Lauri,Igor sam_admin v3.2.1 archiving of log files (waiting on sam on sun) Lauri sun sam build sam on SUN, probably with gcc. gcc needs to be compiled with sqangle. Sinisa, Igor sam_station Plots more work on plots, additional monitoring plots. Maybe move to new plot package. Lauri sam_admin v3.2.1 unit tests Produce unit tests for sam user interface Lauri,Chris,Carmenita sam_user v3.2.1 V3.2 build test Test v3.2 for central analysis environment Chris + help v3.2.1 V3.2 build test Test v3.2 for distributed Linux cluster environment, including FBS Chris + help v3.2.1 sam/farm get sam station on Farms Need to get the v3_2 of sam installed on the farms. Start in integration. needs new scripts to run with station features. Need way to communicate environment between FBS and sam. Hiedi will be here T,Th, and Fr. on the 6th floor. Igor,Sinisa,Chris,Heidi v3.2.1 quick station decrease station startup time (Matt picking up the ball on that, but will require station changes) Matt's top priority. week of SC Matt,Igor v3.2.2 fix change of params crashing station may be done Igor sam_station v3.2.1 sam_cp Needs to be able to recognize intra-node, intra-domain, and extra-domain transfers. Includes using rcp, kerborized rcp, bbrcp, and Gridftp. done, not tested Lauri sam_cp v3.2.1 10/19 batch queue management and restrictions to hold a single user to limited no of files Crummy Add crummy file status and needed support features. Could use more enduring name, like unofficial or suspect. Matt's second priority. storing of 'crummy' half finished files - proposal on how to use status of file. Investigation of what code would need to change in sam store (or whether it is just a little samadmin command you are allowed to do right after the store has succeeeded). Investigate how to deal with --resubmit which wants to overwrite a crummy file - needs to call another samadmin command to first delete the file in pnfs space. Additional thought and discussion indicates that the way we use the current file status is incorrect, and some current statuses should be moved to file@location status. Additional statuses discussed at d0 include :incomplete, obsolete, superseded, user-added, unofficial. May be more or others Matt + others v3.2.1 MC metadata Add and test new MC metadata to import classes, and db server. Meta data is there, need response from Dave concerning the MC_Runjob description files he has produced as examples. Need way to add support entries (might get Julie to do this with forms). Store works, but need to be able to initilaize request and get a request ID back, then validate attributes when processed data metadata returns from remote MC centers. Some of the server interfaces are there, need to build client part in sam user. Carmenita sam_db_server,sam_user v3.2.1 MC Request Add interface to add MC requests to MC request tables. write client side routines to access these things. Julie and Carmenita have been working on the db sever side. Carmenita sam_db_server,sam_user v3.2.1 Helpdesk Followup Need to follow up HD tickets assigned to sam and resolve and closeout Lauri,Carmenita ongoing Documentation Look through documentation and fix problems. Need sam quick reference page, to replace the quick start guide that is obsolete. after Thanksgiving sam get metadata,list definition --keywords, sam create dataset --keyword???, sam run project, sam submit may have problems, mc runjob new metadata, auto dest "sam store --descrip=...", add new phase needs to be documented. need to document metadata for luminosity and archive files, sam batch commands, psusp, files not delivered. python api, new dimensions and examples. Translation of status block . sam toonl should be documented. Sam station starting options through sam_bootstrap startup. new flags need to be documented. Questions about groups need to be answered in docmentation. sam_doc v3.2.3 dcoracle and fnorb are incompatible on solaris under py 2.1, need to understand, fix done steve v3.2.1 omniORB.py continue to understand issues of omniORB.py use with sam steve fnorb Jerry added code to get fresh pointer when dbserver or sewer drops off it will reconnect. This needs to be tested. Code is there, this python, need to set up tests. build on Fri 12, Jerry run tests next week. done on OSF1 Carmenita v3.2.1 fnorb understanding the voodoo that has been added to make it work with 2.1. only needed for the db server. she would like to understand this Carmenita v3.2.1 sam_common this is already rebuilt, need to make sure the idl does not break anything in the new version of sam_user, then the error messages will be in sync. Should not be a big thing, run through tests with declare and sam stores. done Carmenita sam_common v3.2.1 autodest autodestination with processed files needs to be resolved bug in the server in constructing the path, pulling info from the parent that it should not. next Carmenita sam_user,sam_db_server v3.2.1 get num copies get the number of copies for each file from the sam database need to decide where this is kept in sam. Carmenita sam_user v3.2.1 file_family Add code to sam autodest so that the proposed path string uses an optional entry for "file_family=..." to supersede the stream field. This has been requested by Gerry for the online direction of files to tape. Still some debate, but will provide flexibility for streaming decisions to be made later. Carmenita sam_user v3.2.1 user dbserver Make the seperate user db server function for central analysis done carmenita sam_config FSS re-reg and tr-try intervals need to make the time interval for the FSS to re-register with the naming service, and to re-try a store, adjustable parameters. done fix pin File pinning is broken and needs to be fixed. done samadmin mark entire station as down, also might want node down, station down, fss down. not critical Lauri sam_admin SC2001 Work with Gabrieli in preparation for SC2001 done /sam/cache Re-organize /sam/cache disks. Re-organize /sam/cache disks into following: 1. /sam/cache - used for sam station cache, 2. /sam/route - used for remote station routing to enstore, 3. /sam/remote - used for remote station access to fnal MSS, and 4. /sam/external - used as "external" locations (e.g. farm and online data). Would like to have following arrangement: as many 273GB disks as needed for /sam/cache, and /sam/external. Allocate one 273GB disk for each /sam/route, and /sam/remote. Under the covers, disks will be called /sam/generic, and have sym links that assign to a particular usage, and group. For example, /sam/route/uta -> /sam/generic05/A, /sam/cache28 -> /sam/generic06, /sam/remote/in2p3 -> /sam/generic07/A, /sam/cache25 -> /sam/generic08. Lee, Dave F. new robots Need to pass robot server as part of the location, and sam_cp needs to be able to parse, set env variable ENSTORE_CONFIG_HOST to stkensrv2 for stk robot, or d0ensrv2 for d0 aml/2 robot. Discussed format like FNAL:ENSTORE-stken:/pnfs/sam/dzero..., but maybe following would work? stkensrv2.fnal.gov:/pnfs/sam/dzero and d0ensrv2.fnal.gov:/pnfs/sam/dzero done carmenita,steve,lauri sam_user,sam_dbserver,sam_cp 3.2.1 Known issues/operations/testing stuff a) clueD0 and other linux stations strange things with PM, b) restarts - are they working - tell the users how to do it., c) writing out root-tuples at end of input file - tell users how to do it - Jim K was going to write a mail about this - root-tuple writer package needs to catch framework 'event' that input file has been closed, just like sam_manager catches it., d) remote stations getting files through from tape via their own stager need to test, e) stken need to test, f) routing and use of Gb interfaces - needs more discussion and a written, understanding of what we are going to do, g) sam submit - not allowing users to run in Farm-like mode, h) testing from Nikhef - running analysis project on d0mino to use files from SARA robot. Also the inverse - running project there and pulling files from d0mino with bbftp. Need to decide lto stk locations still needs autodestination map entries, testing for online need to enable ability to store to new robot locations. done on online lee