Views
#251: **EXPERTS** get metadata clued0 versus d0minoxx
View
(Anonymous)
issuedata
Topic:
D0
Classification:
User Problem
Importance:
Medium
Assigned to:
Created by: nicholls
Created at: 2005-02-14
contact
Name:
Judith Nicholls
E-Mail:
nicholls@fnal.gov
Description:
Date: Mon, 14 Feb 2005 19:28:15 +0100 Reply-To: Catherine Biscarat <biscarat@IN2P3.FR> Dear experts, I'm the sam shifter and I'm in trouble. Steve Mrenna wishes to get the metadata of the file 0.W+0run1.1.io. Following a thread on the list (January) http://listserv.fnal.gov/scripts/wa.exe?A2=ind0501&L=sam- admin&T=0&F=&S=&X=721C842AB4F243F992&Y=biscarat%40in2p3.fr&P=174 I adviced him to set up the v6_0 SAM version: setup sam -t -q user_prd2 sam get metadata --filename=0.W+0run1.1.io It indeed works on the Clued0 cluster but Steve and myself can't manage to get the metadata from the d0minoxx nodes. I noticed that the CRC value is unknown. Could it be part of the problem? goodluck-clued0:~> setup sam -t -q user_prd2 goodluck-clued0:~> sam get metadata --filename=0.W+0run1.1.io PhysicsGenericFile({ 'fileName' : '0.W+0run1.1.io', 'fileId' : 5335995L, 'fileType' : 'physicsGeneric', 'fileFormat' : 'unknown', 'fileSize' : SamSize('642.00MB'), 'crc' : CRC('unknown crc value', 'unknown crc type'), 'fileContentStatus' : 'good', 'eventCount' : 25000L, 'dataTier' : 'generated', 'firstEvent' : 1L, 'lastEvent' : 25000L, 'startTime' : SamTime('SamTime("NULL")','InvalidTimeFormat'), 'endTime' : SamTime('SamTime("NULL")','InvalidTimeFormat'), 'group' : 'dzero', 'params' : Params({ 'dataset' : CaseInsensitiveDictionary({ 'dataid' : 48657, 'facility' : 'fixed-target-farm', 'groupname' : 'cd', 'last_user' : 'mrenna', 'num_events' : 25000, 'origin' : 'fnal', // I even tried with the example given in January but failed: <d0mino01> setup sam -t -q user_prd2 <d0mino01> sam get metadata --fileName=1.Z1run1.13.io Could somebody help/advice me? Thanks in advance, Catherine ---------- Forwarded message ---------- Date: Mon, 14 Feb 2005 11:44:18 -0600 From: Stephen Mrenna <mrenna@fnal.gov> To: Catherine Biscarat <biscarat@in2p3.fr> Subject: Re: can locate file, cannot get metadata Dear Catherine, Alas, it doesn't work for me. Here is the full printout, but the message at the end is: "Invalid Command: Invalid command: option --filename must not have an argument" Would it matter if I were logged onto d0mino01 or d0mino02??? This is where I am. <d0mino02> setup sam -t -q user_prd2 <d0mino02> sam get metadata --filename=0.W+0run1.1.io Command Description: Get the metadata associated with the specified file. The metadata is written to stdout. Usage: sam get metadata [--options] [-flags] Where: --options: --fileId=<value> # db ID number of the file --fileName # file about which you wish to receive metadata --retryInterval=<value> # retry interval in seconds for CORBA retries --retryMaxCount=<value> # number of times to retry CORBA calls for retriable exceptions -flags: -d # debug mode -v # verbose mode Synonymous Options: --file # synonym for --fileName --id=<value> # synonym for --fileId=<value> --name # synonym for --fileName Must specify at least one of: --fileName OR --fileId=<value> Required Data Types: fileId : long retryInterval : int retryMaxCount : int You may omit "--retryInterval=<value>" if the $SAM_PYAPI_RETRY_INTERVAL environmental variable is set. You may omit "--retryMaxCount=<value>" if the $SAM_PYAPI_RETRY_MAX_COUNT environmental variable is set. UNIX ExitStatus: Success : 0 Unhandled exceptions : 127 Invalid Command: Invalid command: option --filename must not have an argument Catherine Biscarat wrote: >Hi Stephen, > >It works with the newer version of SAM (not current though): > > 5 11:32 setup sam -t -q user_prd2 > 6 11:32 sam get metadata --filename=0.W+0run1.1.io > >Cheers, >Catherine >(SAM shifter) > > >On Mon, 14 Feb 2005, Stephen Mrenna wrote: > > > >>Hi, all, >> I cannot reconcile the following behavior. >>I can locate a file, but I cannot get the metadata for it. >>The metadata DID exist at one time. >> >><d0mino01> sam get metadata --file='0.W+0run1.1.io' >>Simple Status: >> Code: run not found in db (Category User) >> Severity level: ERROR >> Generated on Mon Feb 14 11:24:44 2005 by DB server >> In the context: FileImpl.getFileMetaDataWithCRC: local() >> Recommended action: Please check your data, contact sam-users@fnal.gov >> Additional information: Run id for Data File 0.W+0run1.1.io not found >>in DataFilesRuns. >> >><d0mino01> sam locate 0.W+0run1.1.io >>['/pnfs/patriot/W_jets/MEPS/0,vo3115'] >> >> >> >> > > > This message was processed by the mail server on Mon, 14 Feb 2005 12:28:19. --------------------------------------------------------------------------------[text/x-vcard] begin:vcard fn:Stephen Mrenna n:Mrenna;Stephen org:Fermilab;CD/CEPA/PSM adr:P.O. Box 500;;Kirk and Pine Sts.;Batavia;IL;60510;USA email;internet:mrenna@fnal.gov title:Associate Scientist tel;work:6308402556 tel;fax:6308402783 url:http://cepa.fnal.gov/personal/mrenna/ version:2.1 end:vcard
Transcript
#4:
2005-02-14 02:02 PM (nicholls)
status: "accepted" ->
"resolved"
Date: Mon, 14 Feb 2005 19:47:15 +0100 Reply-To: Catherine Biscarat <biscarat@in2p3.fr> Yep! For me also now! Thanks Lauri! Stephen, I guess your problem is solved now. Cheers, Catherine (sam shifter)
#3:
2005-02-14 02:02 PM (nicholls)
Date: Mon, 14 Feb 2005 12:41:06 -0600 Reply-To: Sinisa Veseli <veseli@FNAL.GOV> Hi, I just tried this on d0mino01, and it worked... Sinisa <d0mino01.fnal.gov> setup sam -t -q user_prd2 <d0mino01.fnal.gov> sam get metadata --filename=0.W+0run1.1.io PhysicsGenericFile({ 'fileName' : '0.W+0run1.1.io', 'fileId' : 5335995L, 'fileType' : 'physicsGeneric', 'fileFormat' : 'unknown', 'fileSize' : SamSize('642.00MB'), 'crc' : CRC('unknown crc value', 'unknown crc type'), 'fileContentStatus' : 'good', 'eventCount' : 25000L, 'dataTier' : 'generated', 'firstEvent' : 1L, ...
#2:
2005-02-14 02:02 PM (nicholls)
Date: Mon, 14 Feb 2005 12:40:33 -0600 Reply-To: Lauri Loebel Carpenter <lauri@FNAL.GOV> This should work on d0mino0X now. (I upgraded sam_user_pyapi and sam_common_pylib). - lauri
#1:
2005-02-14 02:01 PM (nicholls)
status: "pending" ->
"accepted"
assignees: "[]" ->
"['listserv1']"
title: "" ->
"**EXPERTS** get metadata clued0 versus d0minoxx"
description: "" ->
"Date: Mon, 14 Feb 2005 19:28:15 +0100
Reply-To: Catherine Biscarat <biscarat@IN2P3.FR>
Dear experts,
I'm the sam shifter and I'm in trouble.
Steve Mrenna wishes to get the metadata of the file 0.W+0run1.1.io.
Following a thread on the list (January)
http://listserv.fnal.gov/scripts/wa.exe?A2=ind0501&L=sam-admin&T=0&F=&S=&X=721C842AB4F243F992&Y=biscarat%40in2p3.fr&P=174
I adviced him to set up the v6_0 SAM version:
setup sam -t -q user_prd2
sam get metadata --filename=0.W+0run1.1.io
It indeed works on the Clued0 cluster but Steve and myself can't manage to
get the metadata from the d0minoxx nodes. I noticed that the CRC value is
unknown. Could it be part of the problem?
goodluck-clued0:~> setup sam -t -q user_prd2
goodluck-clued0:~> sam get metadata --filename=0.W+0run1.1.io
PhysicsGenericFile({
'fileName' : '0.W+0run1.1.io',
'fileId' : 5335995L,
'fileType' : 'physicsGeneric',
'fileFormat' : 'unknown',
'fileSize' : SamSize('642.00MB'),
'crc' : CRC('unknown crc value', 'unknown crc
type'),
'fileContentStatus' : 'good',
'eventCount' : 25000L,
'dataTier' : 'generated',
'firstEvent' : 1L,
'lastEvent' : 25000L,
'startTime' :
SamTime('SamTime("NULL")','InvalidTimeFormat'),
'endTime' :
SamTime('SamTime("NULL")','InvalidTimeFormat'),
'group' : 'dzero',
'params' : Params({
'dataset' : CaseInsensitiveDictionary({
'dataid' : 48657,
'facility' : 'fixed-target-farm',
'groupname' : 'cd',
'last_user' : 'mrenna',
'num_events' : 25000,
'origin' : 'fnal',
//
I even tried with the example given in January but failed:
<d0mino01> setup sam -t -q user_prd2
<d0mino01> sam get metadata --fileName=1.Z1run1.13.io
Could somebody help/advice me?
Thanks in advance,
Catherine
---------- Forwarded message ----------
Date: Mon, 14 Feb 2005 11:44:18 -0600
From: Stephen Mrenna <mrenna@fnal.gov>
To: Catherine Biscarat <biscarat@in2p3.fr>
Subject: Re: can locate file, cannot get metadata
Dear Catherine,
Alas, it doesn't work for me. Here is the full printout, but
the message at the end is:
"Invalid Command:
Invalid command: option --filename must not have an argument"
Would it matter if I were logged onto d0mino01 or d0mino02???
This is where I am.
<d0mino02> setup sam -t -q user_prd2
<d0mino02> sam get metadata --filename=0.W+0run1.1.io
Command Description:
Get the metadata associated with the specified file. The metadata is
written
to stdout.
Usage:
sam get metadata [--options] [-flags]
Where:
--options:
--fileId=<value> # db ID number of the file
--fileName # file about which you wish to
receive metadata
--retryInterval=<value> # retry interval in seconds for
CORBA retries
--retryMaxCount=<value> # number of times to retry CORBA
calls for retriable exceptions
-flags:
-d # debug mode
-v # verbose mode
Synonymous Options:
--file # synonym for --fileName
--id=<value> # synonym for --fileId=<value>
--name # synonym for --fileName
Must specify at least one of:
--fileName OR --fileId=<value>
Required Data Types:
fileId : long
retryInterval : int
retryMaxCount : int
You may omit "--retryInterval=<value>" if the $SAM_PYAPI_RETRY_INTERVAL
environmental variable is set.
You may omit "--retryMaxCount=<value>" if the $SAM_PYAPI_RETRY_MAX_COUNT
environmental variable is set.
UNIX ExitStatus:
Success : 0
Unhandled exceptions : 127
Invalid Command:
Invalid command: option --filename must not have an argument
Catherine Biscarat wrote:
>Hi Stephen,
>
>It works with the newer version of SAM (not current though):
>
> 5 11:32 setup sam -t -q user_prd2
> 6 11:32 sam get metadata --filename=0.W+0run1.1.io
>
>Cheers,
>Catherine
>(SAM shifter)
>
>
>On Mon, 14 Feb 2005, Stephen Mrenna wrote:
>
>
>
>>Hi, all,
>> I cannot reconcile the following behavior.
>>I can locate a file, but I cannot get the metadata for it.
>>The metadata DID exist at one time.
>>
>><d0mino01> sam get metadata --file='0.W+0run1.1.io'
>>Simple Status:
>> Code: run not found in db (Category User)
>> Severity level: ERROR
>> Generated on Mon Feb 14 11:24:44 2005 by DB server
>> In the context: FileImpl.getFileMetaDataWithCRC: local()
>> Recommended action: Please check your data, contact sam-users@fnal.gov
>> Additional information: Run id for Data File 0.W+0run1.1.io not found
>>in DataFilesRuns.
>>
>><d0mino01> sam locate 0.W+0run1.1.io
>>['/pnfs/patriot/W_jets/MEPS/0,vo3115']
>>
>>
>>
>>
>
>
>
This message was processed by the mail server on Mon, 14 Feb 2005 12:28:19.
--------------------------------------------------------------------------------[text/x-vcard]
begin:vcard
fn:Stephen Mrenna
n:Mrenna;Stephen
org:Fermilab;CD/CEPA/PSM
adr:P.O. Box 500;;Kirk and Pine Sts.;Batavia;IL;60510;USA
email;internet:mrenna@fnal.gov
title:Associate Scientist
tel;work:6308402556
tel;fax:6308402783
url:http://cepa.fnal.gov/personal/mrenna/
version:2.1
end:vcard
"
PloneCollectorNG (C) 2003-2004 by ZOPYX - Software Development and Consulting Andreas Jung