CDF dCache Configuration - June 2004 Version 2.0 02 June 2004 Rob Kennedy The CDF dCache Production system for May 2004 consists of 64 Linux-IDE file servers, hosting 6 read sub-caches. Each file server hosts 3 read or 3 write pools. The assignment of pools to sub-caches is as follows: N Fileservers Stripe1 Stripe2 Stripe3 -- ----------- ------- ------- ------- 3 009-011 GeneralWrite GeneralWrite GeneralWrite 2 017-018 RawStreamA BigBuffer RawOtherStreams 4 019-022 BigBuffer BigBuffer RawOtherStreams 2 023-024 BigBuffer BigBuffer RawOtherStreams 2 035-036 LittleBuffer LittleBuffer LittleBuffer 4 037-040 GOLDEN GOLDEN GOLDEN 3 052,054,056 GOLDEN GOLDEN GOLDEN 7 058-064 GOLDEN GOLDEN GOLDEN 11 065-075 GOLDEN GOLDEN GOLDEN 11 076-086 GOLDEN GOLDEN GOLDEN 2 087-088 General General General 8 093-100 General General General 6 105-110 General General General -- 65 fileservers hosting 186 read pools and 9 write pools. Read sub-caches nPools Space [GiB] Description ---------------- ------ ----------- --------------------------------------- RawStreamA 2 1230 Raw Stream A dataset ids RawOtherStreams 8 4920 All other raw dataset ids LittleBuffer 6 3690 No assigned datasets yet BigBuffer 14 8610 Dataset ids: hbhd08, hbhd09, hbhd0c GOLDEN 108 69120 Golden dataset ids General 48 66690 All other dataset ids ---------------- ------ ----------- --------------------------------------- 186 154260 GiB Write sub-caches nPools Space [GiB] Description ---------------- ------ ----------- --------------------------------------- GeneralWrite 9 5130 General write pools ---------------- ------ ----------- --------------------------------------- 9 5130 GiB There are in the production CDF dCache system: one primary admin node, 3 dcap door admin nodes and 1 monitoring node. Each dcap door admin node hosts 10 dCache doors. The primary admin node hosts the PNFS interface, the monitor web server, and the FTP and SRM doors. The monitoring node performs laborious monitoring tasks so that the primary admin node is not burdened by them. All admin and monitoring nodes are Dell 2650 servers (dual Intel, Linux). Note that the Golden sub-cache should always have at least one large file server (5 TB) of spare space in reserve in case of file server failures. This insures that it acts approximately like a static cache even with a single file server (large or small) out of the system, after lost files are restored into the spare space. DCACHE TEST STAND (NOT FOR USERS) ================================= The CDF dCache test stand for January 2004 consists of 3 Linux-IDE file servers, hosting 1 read sub-cache. Each file server hosts 3 read pools. All read pools #1 are referred to collectively as stripe 1. The assignment of pools to sub-caches is as follows: N Fileservers Stripe1 Stripe2 Stripe3 -- ----------- ------- ------- ------- 1 007(eventually) GeneralRead GeneralRead GeneralRead 1 008 GeneralRead GeneralRead GeneralRead 1 112 GeneralRead GeneralRead GeneralRead -- 3 fileservers hosting 6 read pools and 3 write pools. Read sub-caches nPools Space [GiB] Description ---------------- ------ ----------- --------------------------------------- General 6 6210 All dataset ids ---------------- ------ ----------- --------------------------------------- 6 6210 GiB Write sub-caches nPools Space [GiB] Description ---------------- ------ ----------- --------------------------------------- GeneralWrite 3 1710 General write pools ---------------- ------ ----------- --------------------------------------- 3 1710 GiB This configuration may change without warning as needed to server the interests of CDF DH and CCF dCache experts. The one admin/monitoring node in the CDF dCache test stand is a Dell 2650 servers (dual Intel, Linux). .the end.