Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Sat Apr 2 11:13:46 2005 56robl 36~robl@63.170.133.110 has joined #pvfs2 Topic 36#pvfs2 50): Try the mailing lists if we're not around! http://www.pvfs.org/pvfs2/lists.html Topic 36#pvfs2 50): set by 36robl at 36Mon Jan 17 16:55:20 2005 52Users 32#pvfs2 50)] 54 robl 54ChanServ Channel #pvfs2 was created at Mon Mar 1 12:46:26 2004 BitchX : Join to #pvfs2 was synched in 0.248 secs!! 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56rross 36~rross@visitor120147.mcs.anl-external.org has joined #pvfs2 pcarns ~pcarns@adsl-218-105-167.asm.bellsouth.net has left #pvfs2 SignOff 57rross : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection Ignoring QUITS from parts!*@* BitchX : You must specify one of the following: ALL MSGS PUBLIC WALLS WALLOPS INVITES NOTICES NOTES CTCPS CDCC KICKS MODES SMODES JOINS TOPICS QUITS PARTS NICKS PONGS SQUITS CRAP NONE Ignoring PARTS from #pvfs2 Ignoring QUITS from #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56kraken 36~kraken@takealook.conwaycorp.net has joined #pvfs2 10:56PM 53kraken robl: have you guys had any exposure to ibrix? robl kraken: hey, nope robl kraken: i think neillm heard one of their sales pitches at sc03 11:05PM kraken hrm. I've been down for the last few days talking to the dell hpcc folks 11:05PM kraken and I heard an ibrix pitch from their cto 11:06PM kraken it got pretty technical since we were asking hard questions, and at one point he said that pvfs was stuck with a single metadata server 11:07PM kraken so of course I said, "well, not in pvfs2 - in pvfs2 you can have multiple metadata servers, and it just divides up the inode space and assigns a range to each server 11:07PM kraken and he said, "oh, that's interesting... that's how we do it, and we have a patent on that" 11:10PM kraken I actually marked 3 times in his talk where he discussed something that he said was patented and I thought, "pvfs2 basically does that" robl oh man. patents suck 11:11PM kraken there was the splitting of inode space, one on "the amount of metadata exchanged between servers is of fixed size" 11:12PM kraken and one that was on "allocation policies for writes" which boiled down to the same thing as writing your own distribution (start on a random node, round-robin the start node, put the file on one node, across all, in some other pattern, etc) 11:13PM kraken it seems that they've focused on the small random I/O, because their "WHOA" graphs that they show are bonnie++ of PVFS vs. IBRIX robl well, that's a fair thing to hit pvfs/pvfs2 on robl i'll have to see if i can find neillm's notes or pick his brain for what he learned robl but that was so long ago that i bet ibrix is a lot differnt not robl now 11:23PM kraken they talked about one of their customers going from pvfs to ibrix and dropping their processing time for a certain kind of seismic processing from 3 days to 3 hours 11:24PM kraken I _highly_ suspect that the app was a pretty poor match to pvfs in the first place 11:25PM kraken the patent in question I think is http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F6023706 robl ah, network attached storage in that patent 11:30PM kraken it's got a lot of generic stuff 11:30PM kraken stupid patents 11:36PM kraken anyway, thought it was 'interesting'. sleep time now :) robl yeah, walk the dog time and then sleep robl thanks for the url 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:58am BitchX : Press to see who left to change to [irc.freenode.net] 56kraken 36~kraken@takealook.conwaycorp.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56rross 36~rross@adsl-67-121-7-14.dsl.mtry01.pacbell.net has joined #pvfs2 robl hey 53#pvfs2 57rross 36H ~rross adsl-67-121-7-14.dsl.mtry01.pacbell.net (gaim) 53#pvfs2 57pcarns 36H ~pcarns adsl-218-105-167.asm.bellsouth.net (gaim) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl rross: you missed kraken on sunday talking about ibrix and their patents robl patent # 6,023,706 " Parallel file system and method for multiple node file access" robl and that was the last conversation in this channel 03:40PM rross yeah, i've heard that they have patented something or another. they had better hope that it is something we didn't implement 10 years ago. 03:40PM rross some times it's good to work for the man. robl make good use of your new friends in Argonne Legal, huh? 03:48PM pcarns btw, the copyright thing is slowly getting resolved here- should be able to submit patches again once I get back from vacation later this month 03:48PM pcarns I wrote up a little document outlining what our procedure will be, legal guys want to make some minor changes though 03:55PM rross ok. let me know if there is anything that i can do. 03:55PM kraken silly legal guys 03:55PM rross pcarns: is the reception going to be a late-night thing btw? 03:56PM pcarns it is nominally scheduled for 4pm-8pm 03:58PM rross ok. i guess us alcoholics will have to retire to some other venue. 03:59PM pcarns robl rross: hip flask? 04:06PM rross we'll figure something out i'm sure. 04:10PM kraken hip flasks are dangerous. one greedy bum and it's all gone 04:11PM rross sip sip give! robl ok, a camel pack robl 3 liters should be more than enough for anyone 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl kraken: http://www.googlism.com/index.htm?ism=lustre&type=1 robl kraken: compare with http://www.googlism.com/index.htm?ism=pvfs&type=1 07:00PM kraken wow, that's pretty darn accurate for pvfs 07:01PM kraken I like how the 3rd lustre one is "lustre is not stable" :) 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56rross 36~rross@207-177-224-62.dsl.redshift.com has joined #pvfs2 53#pvfs2 57rross 36H ~rross 207-177-224-62.dsl.redshift.com (gaim) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl rross: howdy 01:01PM rross hey. dean is about to give his pnfs talk. 01:22PM rross pretty good talk all around. 53#pvfs2 57kraken 36G ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl yay! it's our favorite install-pvfs2-on-ancient-machines user 09:45AM kraken wow 09:45AM kraken now with bonus engrish! 56yftty 36~chatzilla@61.49.188.119 has joined #pvfs2 robl yftty: hi 53#pvfs2 57yftty 36H ~chatzilla 61.49.188.119 (New Now Know How) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 10:19AM yftty 10:19AM 53yftty robl: how do you do robl yftty: fine over here 10:20AM 53yftty robl: hehe robl yftty: been using pvfs2 much or just curious? 10:21AM 53yftty robl: I'm also a fs developer 10:21AM yftty join this to see if get some ideas 10:21AM yftty now I'm working on design a new distributed fs for my company robl yftty: cool. truth be told, not a lot of development happens over irc. the mailing lists are were most of the action happens 10:21AM yftty and you ? robl i'm one of the argonne PVFS2 developers robl kraken is one of our earliest users and bug finder/fixer 10:22AM yftty oh, great 10:22AM yftty all cool guys 10:23AM yftty before I'm a developer of www.lustre.org 10:23AM yftty and now lead a team to develop a fs as Google.com's googlefs 10:23AM yftty and it'll has the same features as Mogilefs robl ooh, a lustre developer. we don't get to hear much from those guys 53#pvfs2 57yftty 36H ~chatzilla 61.49.188.119 (New Now Know How) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 10:24AM yftty oh, I've heard the Lustre is somewhat famous in the cluster world tglx1_gone 50] [ tgall_foo 50] [ tlbmiss 50] [ tnt__ 10:24AM yftty or maybe I'm too close to it ;) robl yftty: yes, plenty famous...but since they are kind of our competition, we don't work too closely with them :> 10:25AM 55kraken 35~kraken@takealook.conwaycorp.net 50)] haha, is that typical lustre arrogance? :) robl yftty: hey, thanks for the pointer to mogilefs. first i've heard of it 10:25AM yftty hehe, yes 10:26AM yftty have you find its link, or I'll post here robl http://www.danga.com/mogilefs/ 10:26AM yftty yes, that's it 10:26AM yftty you really know how to punch the net ;) robl so one could imagine PVFS2 having a mogilefs back end, givning us replication w/o much development effort robl but since the files are suposes to be write-once, we'd need some caching 10:28AM yftty sorry, I need a little to know what's PVFS2's mechnism robl oh, yeah, got ahead of myself there 10:28AM yftty is PVFS2 also a assymetric arch ? 10:29AM yftty or it is the same arch as Redhat's GFS ? robl yftty: no, assymetric. userspace servers which write to files and databases on a filesystem (in some ways, similar ot mogilefs) 10:30AM kraken You should probably read http://www.pvfs.org/pvfs2/pvfs2-guide.html 10:30AM kraken it explains a lot about the architecture robl yftty: and there's a paper in the works as well (shooting for cluster 2005 ) 10:30AM yftty ok, I'll read it 10:31AM yftty the fs design work makes me always headache 10:31AM yftty maybe the pvfs2 can meet our requirements 10:32AM yftty then I need not to do it from scracth ;) 10:32AM yftty the work is for a website company robl yftty: yeah, check out the web page documents and ask some questions on pvfs2-devel 10:33AM yftty and the files I/O is featured as very very large small file read/write robl usually website compaines have workloads that don't match well for pvfs2, in all honesty, but maybe with some work robl yftty: what work did you do for lustre? 10:34AM yftty and my fs should give much efforts on low latency than high bandwidth 10:34AM yftty and seems there are no at-hand fs fight with it. so google.com develop it themself 10:35AM yftty they need to splitting the big files to pieces, but we need to splicing many small files together robl yftty: true.. every file system worries more about bandwith than latency robl well it's possible that pvfs2 might help. i'd be interested in hearing how that goes, and we can help out as time permits 10:35AM yftty but how should we do a fs with GB connection but the files are typical 100 KBs 10:36AM yftty and the product will save our company for about 10 billion per year, hehe 10:37AM yftty the file writing seems can packed as logfs writing, but I don't know how to do the file reading ? robl yeah, 100 KB files are not our strong suit 10:38AM yftty yes, seems no fs give efforts on it 10:39AM yftty now I need figure out a good mechnism to suit the very little file I/O mode 10:41AM yftty and I have read almost all design papers about (d)fs, but seems few to no fighting on that mode robl i suppose if you had one server per file, and tried to distribute files as evenly as possible, that's how you'd get PVFS2 to meet that need robl but that hasn't been a primary concern for us, so it's not likely to be super-fast 10:46AM yftty hehe, the bad condition is that we are in china, and can't lay pcs there as we want 10:46AM yftty the space is very limited 10:47AM yftty oh, does PVFS2 has a mechenims to sync the files among the servers if I put one server per file ? 10:48AM yftty that seems too expensive for us 10:48AM yftty we have about 7 billions users, and every users has a one GB diskspace, plus one server per file 10:48AM yftty which would be a disaster for the company ;) 56rross 36~rross@p221.n-sfpop07.stsn.com has joined #pvfs2 53#pvfs2 57rross 36H ~rross p221.n-sfpop07.stsn.com (gaim) 53#pvfs2 57yftty 36H ~chatzilla 61.49.188.119 (New Now Know How) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl rross: hey. i put in the mpi-like pseudocode, but i don't know enough latex magic to make it fit in 1/2 a page *and* look good, so maybe we can work on that before submitting? 56rros1 36~rross@p221.n-sfpop07.stsn.com has joined #pvfs2 56rros1 36~rross@p221.n-sfpop07.stsn.com has joined #pvfs2 01:44PM 53rros1 robl: re: shared fp paper right? 01:44PM rros1 (dropped for some reason) robl rross: sharedfp, right robl kraken: woo! robl kraken: read david's email. that's great on both counts! 03:14PM kraken what email? robl kraken: oh, the "we're going to use pvfs2, and now you don't need to be shy about telling people acxiom uses it" 03:24PM kraken ooh, neat 03:24PM kraken I didn't get copied on that unfortunately 53#pvfs2 57yftty 36H ~chatzilla 61.49.188.119 (New Now Know How) 53#pvfs2 57kraken 36H ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56yftty 36~chatzilla@61.49.188.119 has joined #pvfs2 56yftt1 36~yf@61.49.188.119 has joined #pvfs2 56yftty 36~yf@61.49.188.119 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftt1 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.189.162 has joined #pvfs2 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56yftt1 36~yf@61.49.133.115 has joined #pvfs2 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36~yf@61.49.133.115 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftt1 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56alban_ 36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr has joined #pvfs2 11:37AM alban_ Does PVFS2 support open(2) with O_DIRECT ? robl alban_: hm. good question... i don't know off the top of my head 53#pvfs2 57alban_ 36H ~acrequy AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy) 53#pvfs2 57yftty 36G 61.49.103.240 (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl alban_: you should email the pvfs2-users list, where i'm sure someone more knowledgable about the kernel interface than i will answer 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftt1 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 03:11AM 53alban_ robl: thanks... I've just emailed the list 56alban_ 36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr has joined #pvfs2 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56kraken 36~kraken@takealook.conwaycorp.net has joined #pvfs2 56yftty 36~yf@61.49.103.240 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56snitm 36~snitm@msnitzer.dsl.xmission.com has joined #pvfs2 04:37PM 53snitm robl, you around? robl snitm: hey! 04:54PM snitm hola 04:54PM snitm how've you been?> robl been alright. doing the househunting thing lately robl man, what a process 04:55PM snitm yeah, no fun 04:56PM snitm so you going to make it to laz's wedding? 04:57PM snitm well actually finding the house for you is fun; its the tedious process leading up to that diamond in the rough robl snitm: heh. we're definitly seeing a lot of "rough" so far robl snitm: yeah, kaitlyn and I are going to be there, but just for the weekend, not the whole week 04:58PM kraken I thought I was done with all the paperwork of homeownership after closing 04:58PM kraken but in the last few days I've added about another inch to my stack! robl kraken: crap! 04:59PM snitm kraken, did you actually read it all? I just signed where they told me.. I may not even _really_ own my house for all I know 04:59PM kraken snitm: I tried, I really tried. 05:00PM kraken but mostly I just listened to what they said it was and scanned to make sure it looked similar 05:01PM snitm yeah, same here... so in that you guys are at ANL; have you heard anything about talks between Peter Braam and Pete Beckman? 05:01PM snitm I just got a mail through the new lustre user's group ML (lugheads) from a guy at LLNL 05:02PM snitm On Thu, Apr 21 2005 at 14:40, 05:02PM snitm Bill Boas wrote: 05:02PM snitm 05:02PM snitm > Have you seen the latest exchange between PeterBs (Beckman and Braam) - 05:02PM snitm > causing some soul searching at the Tri-labs about the long term viability 05:02PM snitm > of CFS...... when can we talk? robl snitm: heh, yeah. it's been entertaining robl http://www.clusterfs.com/lustre_is_oss.html 05:06PM snitm yeah, I saw that; it got sent out to lustre-discuss robl oh, right. 05:07PM snitm that seems passive agressive; Bill Boas seemed to indicate actual open discussions robl sure are robl braam maintains lustre is open source and that's good enough robl the tri labs and argonne maintain that open source is the letter of what they asked for, but not the spirit 05:08PM snitm yes, and that is when CFS starts talking about CFS needing to eat too, correct? robl the tri-labs wanted an open development model where they can pay CFS to take care of lustre, but if IBM, apple, or university researchser want to contribute something, they'll be welomed robl i think the tri-labs don't really care if CFS has a shitty business model :> 05:09PM snitm yeah, thats not going to happen; I attended the Lustre user's group at Snowbird, Utah.. this very topic came up and got fairly heated robl no doubt robl what the tri-labs want is for colaborators to be able to make improvmensts an not have to transfer copyright to CFS 05:10PM snitm their business model isn't all that shitty; but it falls on its face when others, like the tri-labs, had different expectations robl i'm biased but PVFS2 has the develoment model the tri-labs wanted 05:11PM snitm yes, but I can see CFS's point too; did the tri-labs want CFS to be a flash in the pan or be able to be around for a while? robl absollutely. so take a look at panasas robl tons of money from DoE (probably their only customer for a while) robl commercial product. no one has any problem with them 05:12PM snitm sure, but its all closed 05:12PM snitm can't get their FS without their hardware robl right. close source soutions aren't a problem if that's clear from the beginning 05:13PM snitm ok, so it all comes down to management of expectations robl taking several millions of gov't dollars and hoarding the resulting softare when the deal was that in exchange for those several million dollars you share the software.... yeah, you got it robl the anl guys think this is going to in the end not result in a whole lot of actual change 53#pvfs2 57snitm 36H ~snitm msnitzer.dsl.xmission.com (Mike Snitzer) 53#pvfs2 57kraken 36G ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57alban_ 36H ~acrequy AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 05:14PM snitm yes, it won't 05:15PM snitm hearing peter first hand it is clear they have no intention of changing their model 05:17PM snitm so just so I'm clear; is beckman trying to push for PVFS to be what the tri-labs use? doesn't seem to mesh well with what they intend to do.. campus-wide filesystems et al robl yeah that would suck for us! 05:17PM snitm or is beckman just saying it shouldn't be Lustre, but not offering an alternative? robl well beckman was one of the people who wrote the lustre contract robl he's dissapointed with himself for not specifying both open source and open development robl the tri-labs are dissapointed that they can't fund university research to improve lustre 05:19PM snitm ok, yeah that does suck; its not fun to beat yourself up about it.. so its best to call CFS out ;) robl so after a couple years everyone is kinda salty and now they vent 05:19PM snitm well they could subvert lustre 05:19PM snitm it is open source; they'd just have to fork it robl there's been talk of it. i guess you could say it's the nuclear option 05:20PM snitm braam and CFS are just looking out for #1 robl because CFS realy does provide a valuable service to the tri-labs robl file systems are bitch-hard to get right robl we hand-wave a lot in pvfs2 land 05:20PM snitm definitely. 05:20PM snitm bah, I doubt that 05:21PM snitm how is pvfs2 going? robl oh, it's going great for target applications robl but if you wanted to, say, use shared writeable mmap to a file, that's not gonna fly :> robl and if you want to compile the linux kernel on it, be preparied to wait 4 days for vmlinux to show up robl (i exaggerate) 05:23PM snitm so what is the reason for the lengthy kernel compile? 05:23PM snitm naive question but I don't have my pvfs hat on; lost that when I left plogic ;) 05:24PM snitm shared writeable mmap is just cause there aren't any locks right? robl to answer both questions: no locking, so simutaenous writes to the same region of a file is undefined. also there is no client side cache, so writes to pvfs go straight to the server robl in the future we will evaluate how you can cache, but not screw over scientific applications (like NFS does) robl (NFS screws scientific apps, i mean) robl i think gcc mmaps files. read-only mmap does work on pvfs2, but we don't do readahead (neillm couldn't find and fix the bug before taking off) robl so it's slow but functional 05:28PM snitm gotcha, brb.. someone is at the door 05:29PM snitm didn't need a "free" deep cleaning of one room 05:30PM snitm neillm left pvfs for good? robl he works at anl still, but on a different project. got a little burned out i think 05:35PM snitm gotcha 05:35PM 55snitm 35~snitm@msnitzer.dsl.xmission.com 50)] so my Xilo project is on "hold" 56yftty 36~yf@61.135.152.194 has joined #pvfs2 53#pvfs2 57kraken 36G ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57alban_ 36H ~acrequy AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3611:17am BitchX : Press to see who left to change to [irc.freenode.net] 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.49.188.97 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-218-105-167.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken takealook.conwaycorp.net (I am Jack's $IRCNAME) 53#pvfs2 57alban_ 36H ~acrequy AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: woah, back from the honeymoon already? 10:36AM 53pcarns robl: yeah, back to the grind :) 10:36AM 53pcarns robl: the temptation to stay and work from maui was pretty high robl pcarns: see if you can get a job with maui supercomputing center robl i bet those guys pay crap and still have no problem hiring eople robl people even 10:37AM 53pcarns robl: I saw where it was on a map, but somehow taking a tour there didn't make it onto our agenda robl good for you! 01:40PM kraken welcome back pcarns 01:40PM pcarns kraken: thanks! 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56yftty 36~yf@221.216.130.95 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 Netjoined: 57irc.freenode.net zelazny.freenode.net 56kraken 36~kraken@takealook.conwaycorp.net has joined #pvfs2 56kraken 36~kraken@takealook.conwaycorp.net has joined #pvfs2 56kraken_ 36~kraken@takealook.conwaycorp.net has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-218-105-167.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57alban_ 36H ~acrequy AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56yftty 36~yf@61.135.152.194 has joined #pvfs2 56alban_ 36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-167.asm.bellsouth.net has joined #pvfs2 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 03:25PM elliot so i don't guess anyone uses the irc channel robl hi elliot robl i'm always here (often idle) robl but yes, as for real communication, it's mostly drive-bys lately 03:41PM elliot I was wondering if its possible to mount tcp://testhost:3334/pvfs2-fs/users/$USERNAME like with nfs SWAP: Window 3 is not hidden! 03:44PM elliot if users and $USERNAME were directories in the file system robl robl well, let me check robl wait, i don't have to check robl sorry, a bit out of it robl the part after the port number is the pvfs2 "file system id" robl it *looks* like a directory on the remote server, but it's not. it's just an identifier (one server could have multiple pvfs2 file systems, but that's rare) 04:18PM elliot right 04:19PM elliot it would be handy to be able to automount things directly like that rather than having a mount on the box for the pvfs2 files system and the automounting out of that 04:27PM elliot also I was wondering how about to make mutli homing work since it just mentions that it should work in the docs robl elliot: i'll add it to the list of "things users like" but I don't know when we'll be able to implement it 04:31PM elliot not really a big thing, it would just be nice robl elliot: as for the multihome, definitely drop an email to pvfs2-users and the guy who did the multi-home stuff will answer any questions you've got robl (and then i'll add it to the faq) 04:32PM elliot ok..thanks Netjoined: 57irc.freenode.net zelazny.freenode.net 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 56yftty 36~yf@61.49.189.133 has joined #pvfs2 56yftty 36~yf@61.48.130.23 has joined #pvfs2 56yftty 36~yf@61.48.130.23 has joined #pvfs2 56yftty 36~yf@61.48.130.23 has joined #pvfs2 56yftty 36~yf@61.48.130.23 has joined #pvfs2 56snitm_ 36~snitm@208.177.141.226.ptr.us.xo.net has joined #pvfs2 03:13PM 53snitm_ robl: hey rob, quick question... so what's mpich2's license? it says to me that you are free to do anything (closed or open); am I mistaken? 03:14PM 53snitm_ robl: "Permission is hereby granted to use, reproduce, prepare derivative works, and to redistribute to others." 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56rross 36~rross@host217-37-28-180.in-addr.btopenworld.com has joined #pvfs2 07:53AM 53rross robl: you on here? 07:54AM rross elliot: hey -- we're in cardiff this week; weird time schedule. 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 07:56AM rross pcarns: hey! how was the honeymoon? 07:59AM pcarns rross: absolutely fantastic 07:59AM pcarns rross: we have approximately 5 billion photos to put online when I have time 08:00AM rross heh, nice! thx for the comments on the paper too; i've got to knock all that out this week i guess. 08:00AM pcarns yeah, that deadline is coming in a hurry 08:00AM rross i'm really glad that i was able to come and participate in the festivities btw. i still owe you guys a gift... 08:01AM pcarns eh- don't sweat the gift- we were really happy to have you there and to get to hang out 08:01AM rross ah, the deadline has moved to 5/21! 08:02AM pcarns oh, excellent 08:02AM rross we really have to get this stupid noncontig thing worked out :(. 08:03AM pcarns where is the src for that version of noncontig you guys are running? 08:04AM pcarns this is something from joachim or someone? 08:04AM rross good question. i think that robl has a tar file he can send you. yes, it's from joachim. 08:05AM rross i think that if we get the piobench consortium pages up and running that NEC will be comfortable having the code available on that site. 08:06AM rross it sounds like someone is driving a r/c car around in the adjacent room. 08:07AM pcarns what's the relationship between nec and joachim's code? is his sort of a clone or is it something different entirely? 08:08AM rross joachim works for nec. the code is a modified version of rajeev's original noncontig test in the romio test suite. 08:08AM pcarns ohohoh 08:08AM pcarns 08:08AM rross 08:09AM pcarns I live under a rock 08:09AM rross he has a copy of btio in C also, which would be very nice to be able to distribute. well, you knew it was from joachim, so it must not be a very big rock. 08:10AM pcarns it is a semi-opaque rock 08:10AM pcarns btio in c would be nice 08:10AM pcarns seems like every 2 years or so we have to dig out notes on how to compile the fortran one 08:11AM rross i see :). yes (btio)! this measly 6-hour time change has kinda screwed me up; i am weak! 08:11AM pcarns oh yeah- other good news! 08:11AM pcarns I am all clear on the patch front now 08:11AM rross that's great to hear. 08:12AM pcarns will probably be no sooner than late this week before I start feeding stuff back, but I have a easy approval path and a green light to give patches now 08:12AM rross excellent. 08:12AM pcarns I'll try to pick out the most important ones first, we have a few interesting things to contribute 08:12AM pcarns nothing related to noncontig problems though 08:13AM rross heh. that's too bad :). 08:14AM rross sam is getting up to speed this week hopefully -- sucks that robl and i had to be out of town his second week on the job. 08:14AM pcarns oh, you guys have a new hire? 08:14AM rross yes; acquired from the dsl. i think he's quite good. 08:15AM pcarns excellent! 08:15AM rross and murali starts with us mid-june also. 08:15AM rross since we couldn't get you :). 08:16AM pcarns heh- glad murali is aboard too 08:16AM pcarns Sam Lang? 08:16AM rross yes. 08:16AM rross i think maybe you met him. 08:16AM rross and i'm sure you saw him join the lists or something. 08:17AM pcarns nah, I handed off lists to Brad 08:17AM pcarns I don't think I met him- just found name on mcs page 08:19AM rross ok. anyway, that's him. 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 08:44AM rross kraken: werd. 08:47AM kraken howdy 08:48AM rross thx again for all your pvfs2-users responses. that guy jason kills me. 09:00AM kraken if I were him I would have started including some you know, debug information, by now 09:03AM rross he's special. 09:04AM rross we've gotten emails from him off and on for the last couple of years i think. 09:09AM kraken lucky you! 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 09:14AM rross hey jeff 09:16AM laytonj rross: Hey back at you. 09:16AM laytonj rross: Who is usually on IRC? 09:17AM rross i'm usually not. 09:17AM 53rross robl often is. 09:17AM rross this is probably the biggest crowd in a while, but i wouldn't know for sure. 09:18AM laytonj Well I wanted to mention a couple of things I learned from ORNL this past week. 09:21AM elliot rross: its the most people i've ever seen 09:22AM rross laytonj: what's up? 09:24AM rross elliot: so did we finally get pnetcdf working for you guys on the cray? 09:25AM laytonj rross: Well I went to a Lustre "workshop" sponsored by Scott Studham at ORNL. While we were there, there was some mention of a similiar PVFS2 workshop. 09:25AM laytonj The goal of the workshop is to produce a "dummies" handbook. 09:25AM laytonj I'm guessing, but it sounded like there was some interest in PVFS2 at ORNL. 09:26AM rross that's funny. studham must have mentioned that? he likes workshops. 09:26AM laytonj Just thought I would mention that. I don't know the politics in DOE at all, but just thought I would pass it along. 09:26AM rross thanks. what was the lustre workshop about? installation and admin? 09:27AM laytonj rross: The goal of the workshop was to produce a "dummies" handbook because the documentation from CFS stinks and is wrong in many places. 09:27AM rross weird. ok. so were there a lot of lustre experts there? are you a lustre expert? didn't know that. 09:28AM laytonj rross: NO :) The group were decent Linux admins, but didn't know Lustre at all. 09:28AM laytonj They wanted a totally novice group to write some docs on how to get Lustre installed and working. 09:28AM rross that seems like a poor choice of people to get together to write a handbook on how to use lustre. 09:29AM rross i hope he doesn't do the same thing for pvfs2. 09:30AM laytonj Well that's what he was talking about. I mentioned that PVFS2 was pretty easy to install - infinitely easier than Lustre - so a workshop might not be too useful. 09:30AM rross our quickstart could definitely use more work, and having some novice people walk through it would be helpful, but you should have people that know what they're doing write things like that. 09:31AM rross was the workshop a success? was such a handbook written? 09:31AM laytonj rross: Well, it's good to get the perspective of a novice. Everyone in the workshop were pretty good Linux admins in general. 09:32AM laytonj Yep. A handbook was written (51 pages in 5 days). I thought it was a pretty good effort especially because CFS doesn't tell you everything. 09:32AM laytonj We're still trying to figure out how to distribute the handbook. 09:38AM rross ok. what resources were used for testing installation etc? 09:40AM laytonj That is the main reason I went :) It was one of our clusters with 16 nodes and FastE. We knew there would be performance limits. We just wanted to get it installed and running. 09:40AM laytonj The cluster had 16 ndoes of single Xeon with 512 MB and FastE. 09:41AM rross who are you working for now? 09:42AM laytonj Didn't you know? I work for Linux Networx as a Field Sale Engineer. 09:42AM laytonj (I can hear the laughter in Chicago from here) 09:42AM rross didn't know that. how long have you been doing that? 09:43AM rross i'm in cardiff btw. 09:43AM laytonj rross: Full-time? 09:43AM rross nah, just this week. 09:44AM rross yeah, how long have you been doing that full time. 09:44AM rross (one of those two was the answer you were looking for...) 09:45AM laytonj I started on Dec. 1. I finally got burned out at Lockheed. I was there almost 7 years and that was about 6.5 years too long. 09:49AM rross ok, so it's not like you've been working there 5 years w/out me knowing it or anything :). 09:52AM laytonj rross: Naahh. So what's going on in Cardiff? 09:55AM rross CCGrid. RobL and I are giving a tutorial, I'm giving a talk, RobL is chairing a session. But that's all tomorrow and the next day. Today I'm hanging out and reviewing tutorial material. 09:55AM laytonj I lived in England when I was 15 and I remember traveling to Cardiff. This was a long time ago, but it was really nice. I think Alan Cox lives around there somewhere. 09:56AM rross the weather is a little cool, but otherwise it's quite nice. 09:59AM laytonj Enjoy! 10:00AM rross thx robl aw man i missed the party 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl laytonj: hey, congrats on leaving lm! and no laughing about field engineers. it seems like something you'd be good at with your background of both technical and teaching 03:42PM 53laytonj robl: It's fun, but very, very, stressful. :) How do you like Cardiff? robl laytonj: small. nice place to visit, but a week here might be a few days too long robl laytonj: not sure how much fun the ol' fiance is having while i'm off conferencing, but she's a trooper 03:44PM 53laytonj robl: Always an issue with travel. I travel about 50% of the time and it really wears on the family. robl laytonj: oh, she's here in town i mean 03:47PM 53laytonj robl: Gotcha. Lucky girl. I love Cardiff although it's been a few years (like 28). 10:37PM kraken how does he recompile his VB to use in PVFS? robl poor guy 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 01:39PM kraken I was a faq-linking machine this morning. where 'machine' is 'two emails' 01:45PM laytonj kraken: I saw that. Good responses to the emails :) 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: hey, did my way-too-fast email make any sense? 08:43AM 53pcarns robl: about the noncontig test? yeah, I think it made perfect sense actually 08:44AM 53pcarns robl: I still haven't tried on a different box yet, but your test cases and the patch that walt sent me monday seemed to get along fine on my laptop robl pcarns: ok, i'm going to very carefully re-apply walt's patch and make 100% sure i didn't rush things robl i don't know if maybe it's an aio-callback difference? robl on leela, we should be exercising the aio-callback path robl not sure if that's the case on rhel 08:56AM pcarns my laptop (gentoo) is using aio callbacks, I just don't have nptl 08:56AM pcarns maybe tonight or tomorrow I can run it on a gentoo or rhel3 with nptl 08:56AM pcarns leela still crashing with Walt's patch from monday? robl yeah, but like i said, i might have been in a rush 09:01AM pcarns oh sorry, didn't see that line in my irc for some reason 09:03AM pcarns sorry I can't help right this second- got another pain in the &*^% pvfs1-related problem I have to work on today robl hey, no worry. i'm in @#$ cardiff and getting an interrupt every few minutes :> robl ok, it definitley doesn't work for me. i'll have to re-read walt's and neill's exchange when i have time to see if all code paths are being checked 09:12AM kraken is that the reason you guys are bouncing devpvfs so often? robl yeah, trying to get a noncontiguous io benchmark working so we can collect data so we can talk about it in a paper due in 10 days :> robl ok, back to the conference 09:13AM 55dsp 35~dsp@volans.c-60.org 50)] are you going to laz's bachelor party thing? 09:16AM pcarns kraken: have a production problem showing on pvfs1, having a heck of a time replicating 09:19AM kraken bummer 01:55PM elliot anyone around? 02:00PM pcarns hi elliot 02:01PM elliot at the root of my pvfs2 tree I have a directory called users 02:01PM elliot in that directory I have a directory for each of my users 02:02PM elliot running ls in the "/users" directory as root works fine 02:02PM elliot but as a normal user ls takes a long time 02:02PM elliot as in a few minutes to get a directory listing of 25 or so directories 02:03PM elliot is this normal behavior 02:05PM pcarns no, I don't think so 02:05PM pcarns each of the 25 directories has a different user? 02:06PM elliot yes 02:06PM elliot all have 0755 permissions and a different user and group 02:07PM pcarns on the server side, it probably short circuits most permission checking for root users 02:07PM pcarns is it possible that your server is being slow to retrieve user/group information from nis or ldap? 02:08PM elliot the server is the nis master 02:12PM pcarns I would maybe try setting the EventLogging on the server to include "server" and watch the logs while you do one of those listings 02:12PM pcarns if you could see a consistent place where it stalled we might be able to tell what's going on 02:58PM kraken pcarns: you guys just installed a new rpm, right? 03:05PM pcarns kraken: I dropped a new pvfs-lib rpm earlier today 03:05PM pcarns on 12 03:06PM kraken hrm, my iods died about 15 minutes ago, must have just gotten around to croaking. 03:07PM pcarns must be yesterday's change- I'm not sure what exactly about putting a new rpm makes them die so I don't know how long it takes NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3603:43pm BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 11:21AM kraken pcarns: congrats :) 11:21AM pcarns kraken: thanks! 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Global Notice] Hi all. We're experiencing the user summer spammer infestation. If you get klined by mistake, please email staff at freenode dot net. Apologies in advance for any problems, and thank you for using freenode! 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56yftty 36~yf@61.51.110.81 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56Paganist_ 36~pierre@h-66-167-173-104.cmbrmaor.dynamic.covad.net has joined #pvfs2 53#pvfs2 57Paganist_ 36H ~pierre h-66-167-173-104.cmbrmaor.dynamic.covad.net (pierre) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 10:46AM Paganist_ Hi ! I'm reading the faq and am wondering if pvfs2 does a real mirroring of every file on every node.... Other question is when i shutdown a node and put it up like an hour later, will it automaticaly get the modifications and apply them to the files it has localy ? robl Paganist_: hey. pvfs2 does no mirroring robl lots of people ask for it. ther are some people working on it, but they are in early stages robl in the default configuration, when you shut down a node, the whole pvfs2 volume is taken out of service, so there's not really any concept of integrating modifications 10:57AM Paganist_ 10:57AM Paganist_ thank you 10:59AM kraken well, that was easy enough, eh? 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 11:04AM pcarns didn't even make it to the kraken faq machine this time 56yftty 36~yf@61.49.189.147 has joined #pvfs2 11:10AM kraken that's ok, I just linked someone on the mailing list instead robl kraken: i've got this one 11:21AM kraken good :) 12:06PM yftty robl kraken: you need to make the mountpoint? robl kraken: news to me robl kraken: it's just a key into a database robl kraken: where the 'database' is the flatfile $PVFS2TAB_FILE 01:37PM kraken oh ho, I thought it needed to be there 01:37PM kraken but if he'd read the "notes on running without root access" and done what it said, he should have been able to make it work :) 01:37PM kraken he still seems to think that he can access the data files by just looking under the storage space 53#pvfs2 57yftty 36G 61.49.189.147 (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56slang 36~slang@visitor120164.mcs.anl-external.org has joined #PVFS2 robl yay 53#pvfs2 57slang 36H ~slang visitor120164.mcs.anl-external.org (slang) 53#pvfs2 57yftty 36G 61.49.189.147 (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 05:01PM slang hey 05:01PM slang cool 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 robl kraken: harsh dude! he did ask -users :> robl oh! pvfs *1* hah 08:49AM kraken he's asked a couple of questiones recently that mentioned "pvfs" and not "pvfs2", so I suspected quietly that he was actually needing pvfs1 help 08:49AM kraken but asking about pvfs-test is a dead giveaway robl missed that. must be too early for me 56slang 36~slang@visitor120164.mcs.anl-external.org has joined #PVFS2 56slang 36~slang@visitor120164.mcs.anl-external.org has joined #PVFS2 53#pvfs2 57slang 36H ~slang visitor120164.mcs.anl-external.org (slang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 10:05AM kraken I don't want to reply to that last email, because it honestly doesn't sound like he needs PVFS2 for what he wants to do 10:06AM kraken I shudder to think of the poor performance that running a berkeley db (for subversion) on top of pvfs2 could lead to 10:15AM pcarns that first goal is kind of vague too (aside from the hardware description) 10:30AM kraken yeah, and I think his goal of a highly available distributed filesystem is a bit misplaced, if he only wants to use 5 machines 56slang_ 36~slang@harley.mcs.anl.gov has joined #PVFS2 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: hey. just in time. remember anything about trove? robl pcarns: just kidding. i'm not seriously asking about trove... yet 02:53PM 53pcarns robl: depends: if it is broken, I don't know nuthin robl aw yeah 02:54PM 53pcarns robl: what you working on? 02:55PM 53pcarns robl: bet its more fun that what I'm doing - staring at sys_rename() trying to make it less dangerous :) robl pcarns: noncontig is still broken with 2 or more servers 02:55PM pcarns doh robl only need one client to trigger, but i never like debugging if it takes two servers to show the bug 02:56PM pcarns send me the command line when you get a chance robl pcarns: i think i already did 02:57PM pcarns not that I don't certify the flow code to be 100% bug free already robl yup. sent it to wastedcycles robl sent it to the whole gang, in fact 02:59PM pcarns oh ok, got it 02:59PM pcarns what is testcase.c 02:59PM pcarns robl pcarns: it's noncontig, but only with noncontig_mem_noncongig_file robl and a lot of command line processing hard-coded in 03:01PM pcarns 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: hm. it might be that this access pattern is just *really* bad for pvfs2 04:17PM pcarns does it eventually finish? 04:17PM pcarns I haven't run it yet robl pcarns: i've given it several minutes robl pcarns: it doesn't *appear* to finish, but when i look at the logs i see lines like this robl [16:12:10.737001] ATTRIB: retrieved attributes from DISK for key 2863311532 robl uid = 0, mode = 0, type = 2, dfile_count = 0, dist_size = 0 robl b_size = 2556, k_size = 0 robl and b_size increases robl (slowly) robl ok, never mind robl it does fail. takes about 5 minutes 04:22PM pcarns I wonder how many trove operations are being posted 04:23PM pcarns is each trove operation taking a long time, or are there just a ton of little ones 04:23PM pcarns might be hard to tell from the logs, though robl when i fire it up in gdb i can see that there are lots of short lived threads robl but not sure what those threads come from 04:24PM pcarns probably aio 04:25PM pcarns but one trove job could potentially make several threads, depends on what its asked to do I think 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 05:14PM 53pcarns robl: you still there? robl pc: hey! robl guess phill left BitchX : Unknown command: WOH 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@68.211.217.174 has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns 68.211.217.174 (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: your email rocked 09:01AM 53pcarns robl: thanks! 09:02AM pcarns now I just have to figure out what in the world Avery's code is triggering :) robl pcarns: the good news is valgrind reports several errors robl pcarns: the bad news is i don't understand the code at all in those parts :> (but i will) robl ERROR SUMMARY: 30000 errors from 11 contexts robl yeah, that's not a good sign :> 09:36AM pcarns eek 50* 57robl gets to work robl heh. here's a new one: robl Syscall param writev(vector[...]) points to unaddressable byte(s) robl not "1 byte after a block.." but flat out unaddressable :> robl pcarns: if you run with -veclen 64 -elmtcount 64, it's much faster and still fails 10:43AM 53pcarns robl: that's good that you found a smaller test case 10:44AM 53pcarns robl: isn't there some mpi datatype call you can make to get the upper and lower bound on a datatype? 10:44AM 53pcarns robl: maybe do that before each mpi-io call and see if any of the bounds go beyond the buffer? robl pcarns: well, it's just one mpi-io call 10:49AM pcarns all the better robl man, if there's one part of mpi i'm weak on, it's datatypes 10:57AM pcarns doh! same here 10:57AM 50* 53pcarns/#pvfs2 eyes the irc room attendees hoping for a datatype expert robl it's cool. i'll go bug robr if i get stuck 11:02AM pcarns maybe MPI_Type_ub() and MPI_Type_lb()? robl that should be pretty close. will give values in terms of relative offsets 11:08AM pcarns ah, ok 11:08AM pcarns might be enough- if ub is greater than size of buffer 11:08AM pcarns would indicate if bug was in the datatype constructed in the application or not robl rob has a good helper routine robl MPIU_Datatype_debug robl MPIDU_Datatype_debug(MPI_Datatype type, int array_ct) robl if you call that and also set MPICH_DBG_OUTPUT, you get a dump of the datatype to stdiout (or a file, i presume) 11:10AM pcarns oooo- that's good to know about 11:11AM pcarns I think I'll put that in my notes... robl pcarns: i'm quite proude of my entry for that one: robl . MPIDU_Datatype_debug(MPI_Datatype type, int array_ct) robl array_ct has to be "big enough" for the data type. 32 is a good number robl for simple datatypes. no harm in making it bigger, though robl . the environment variable MPICH_DBG_OUTPUT must be set to something (usu. robl stdout) or you won't see anything and you'll go insane wondering why robl (because i really did waste half a day wondering why i wasn't getting output) 11:12AM 53pcarns robl: nice- thanks for the tip robl so that call says we have robl Size = 16384, Extent = 16384, LB = 0(sticky), UB = 16384(sticky), Extent = 16384 11:13AM 53pcarns robl: that doesn't seem right robl yeah, i know... i'm totally puzzled 11:14AM 53pcarns robl: looks like the description of a single contiguous region 11:15AM 53pcarns robl: since the size, extent, and ub all match robl it's a (and i don't get it...) "contig of vectors of contig" robl wierd! robl MPI_Type_get_extent says the extent is 0 and the lb is 16384 robl i have no idea what that means 11:26AM pcarns I got nuthin' 01:21PM kraken on a side note, naming cats is not easy 01:39PM pcarns naming cats? 01:47PM kraken I got a pair of kittens, and for now they're "littler one" and "bigger one" robl friend of mine named his 'five' robl "here's my cat five" 01:49PM kraken haha 01:49PM kraken someone suggested I name them 5 and 5e robl it doesn't really matter what you call them because it's not like they'll respond to any name you give them 01:50PM kraken that is true 01:54PM pcarns I always thought it would be fun to name something (pets, children, whatever) after HP Lovecraft creatures 01:54PM pcarns Cthulhu, Yog-Sothoth, etc. 01:56PM kraken ooh 01:56PM kraken one of my friends names his cats after dictators. he has a benito and a joseph (mussolini and stalin, respectively) 01:56PM pcarns not that I have a clue how to pronounce... robl "what's your cat's name?" "to pronounce it correctly i would have to rip out your tounge" 01:57PM pcarns "he who is not to be named" 01:57PM kraken look out for Phil's first child, Cthulhu Carns 01:58PM kraken it's alliterative even 01:59PM pcarns ha! 02:00PM pcarns you see some fun things searching on google for how to spell that sort of thing 02:01PM pcarns http://catalog.chaosium.com/images/CHA0087.gif robl aw, damn "who will be eaten first" got taken down robl ah, sweet sweet internet robl http://www.geocities.com/tribhis/cthulhutract.html 02:12PM kraken the cthulhu for president stuff was great... "why settle for the lesser evil?" robl pcarns: oh, hey! valgrinid reports memory overruns in ADIOI_GEN_WriteStrided as well! robl pvfs2 is off the hoook.... for now robl pcarns: oh balls and a half robl pcarns: the datatype constructed is bunk for 1 proc but is a-ok for 2 procs or more 02:27PM pcarns noncontig.c doing something wrong in the 1 proc case? robl pcarns: yeah, but that's all i know robl pcarns: ==27492== ERROR SUMMARY: 67 errors from 12 contexts (suppressed: 23 from 1) robl pcarns: and thoese 12 contexts are all "uninitialzed memory regions" robl pcarns: will respond to the ml robl er, your last email robl that might only be true with 64/64 SWAP: Window 3 is not hidden! robl pcarns: sucks about patch beaurocracy robl pcarns: oh, hey, have you met slang? 53#pvfs2 57pcarns 36H ~pcarns 68.211.217.174 (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 03:03PM 53pcarns robl: no, I haven't 03:05PM pcarns Sam is it? robl pcarns: yeah, Sam Lang. He's currently looking at ways to profile what the pvfs2-server is doing when all these requests come in from clients robl slang_: phil and neill wrote most of pvfs2 03:07PM pcarns very cool about the profiling 03:08PM pcarns that patch was good, with the state machine names 03:08PM pcarns could be used to eliminate those debug messages at the beginning of each state machine function 03:22PM slang_ pcarns: yeah 03:22PM slang_ pcarns: didn't know if it made sense to replace those or just leave them 03:23PM pcarns IMHO it would be neat to remove all those PINT_STATE_DEBUG() lines in the .sm files altogether, and instead print the exact same information from one centralized location in the state machine infrastructure code 03:24PM pcarns if the state machine unions have the string name, then it seems like it wouldn't be too hard, and it would remove a lot of clutter (and a few incorrect gossip messages) from the .sm files 03:24PM slang_ pcarns: so do PINT_STATE_DEBUG_START/STOP w/ the start/stop event calls? 03:24PM pcarns ditto for both the client and server 03:25PM slang_ pcarns: I can go ahead and do that 03:26PM pcarns well... there are events, then there are log messages- both are probably needed 03:26PM slang_ yes 03:27PM slang_ macros would end up being called in the same place 03:27PM pcarns yep, you're right 03:28PM slang_ there's a couple state_action calls in pvfs2-server.c instead of state-machine-fns.h ... i'd almost like to make a PINT_state_machine_invoke_state call in state-machine-fns.h for consistency.. 03:29PM pcarns slang: you just blew past the amount of state machine architecture that is present in my short term memory :) 03:29PM pcarns slang: but anything to make hte code organization nicer is always good :) 03:29PM slang_ :-) 03:30PM pcarns by the way- if you are playing with (or will be in the future) the event logging stuff, 03:30PM pcarns I suspect there might be a bug in there but I never got around to trying it out for sure, 03:30PM pcarns I don't think the event logs are rotating right- supposed to be a ring buffer 03:31PM pcarns but it seems like I did some runs late last year that just filled up and stopped 03:31PM slang_ hmm ok 03:31PM pcarns at the time I couldn't really stop to look at it, was more worried about what I was measuring 03:31PM pcarns but just a heads up 03:32PM slang_ cool thanks 03:32PM pcarns robl pcarns: 1 server, 2 clients, no problems. 2 servers, 2 clients, read back bad data. progress of a sorts, i suppose robl pcarns: ok, i haven't fixed anything on my end robl pcarns: but your suggetion to sync up the dbpf and flow offset lenghts seems to help a lot robl pcarns: now if you have 2 servers, 2 cliens, and use a minimum element count of 2, things work robl that should be enough to start getting some benchmark data, then next week when walt's in town look more closely at the failure cases 04:11PM 53pcarns robl: ok, let me know if anything comes up that i can help with robl pcarns: sure thing. on my end i need to figure out what's wrong with the single-processor version of the data type, then see if i can learn what's up with the "2 servers and a 1024x1 vector" case robl pcarns: after i have a better idea what's broken, maybe you can help me fix it if it's tricky. but don't worry, i'm good about pretending you still live at clemson :> 04:16PM pcarns 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 01:41PM elliot anyone around? robl elliot: hi. what's u? robl 01:54PM elliot somehow one of my users managed to create a file on my pvfs2 filesystem that neither he nor root can get to 01:55PM elliot if I try to get any of the files attributes as root it just gives me permission denied errors 02:01PM elliot also I have noticed that my pvfs2 server daemons are getting a lot of connection timeout errors robl hm. ok, do the pvfs2-* tools grok the file? 02:20PM elliot yep 02:21PM kraken have you tried unmounting, killing the pvfs2-client, rmmod'ing the pvfs2 kernel module 02:21PM kraken then redoing the modprobe, starting the client, and mounting 02:22PM elliot 02:22PM kraken it'd be nice to know if it was a state issue on the client or something that persists (i.e. something on the server side that the kernel module isn't expecting) 02:22PM elliot well it is affecting all of my clients 02:23PM kraken ahh 02:23PM kraken hrm 02:23PM kraken still might be worth a shot to cycle the stuff on one 02:25PM elliot so pvfs2-ls will list the file, but pvfs2-ls -al hangs when trying to get the attributes for the file 02:27PM elliot kraken: and I still get permission denied as root even after cycling through everything 02:29PM kraken interesting 02:41PM elliot so anyone have any ideas as to what is going on? I have people that would like to be able to use this data. 02:44PM kraken I'm light on ideas about what's going on, but have you tried setting the perms manually with pvfs2-chmod/chown to see if that 'fixes' it or if they hang as well? robl elliot: nothing comes to mind immediately. nobody's reported anything like that for months and months now. robl might be interesting to bounce the pvfs2 servers robl would tell us if it's a problem with state or with the file system itself 02:45PM kraken and if it persists after that, maybe pvfs2-fs-dump could help 02:45PM kraken can you do a pvfs2-ls -i on that file? 02:47PM elliot kraken: pvfs2-chmod/chown doesn't seem to help 02:48PM elliot neet...pvfs2-ls segfaults now that I chmod/chown the file 02:48PM kraken ooh 02:48PM elliot -rw-r--r-- 1 blondin blondin 256005068 2005-04-17 19:24 SasnzD1010.nc 02:48PM elliot free(): invalid pointer 0x80c22cc! 02:48PM elliot Segmentation fault 02:48PM elliot the next file in the list is the one with problems 02:51PM 50* 53elliot/#pvfs2 starts taking down the fs 02:59PM elliot got everything back up and still have the same problem 02:59PM kraken does pvfs2-ls still segfault? 03:00PM elliot yes 03:02PM kraken can you ulimit -c unlimited and get a core dump? that might be useful 03:02PM kraken having a pvfs2-ls with debugging symbols and running it from within gdb would be even better 03:03PM elliot getattr_object_getattr_failure : Input/output error 03:03PM elliot Failed to get attributes on handle 1073741766,1322993734 03:03PM elliot Getattr failure: Input/output error 03:04PM kraken hrm, and nothing in the logs on any of the servers? 03:04PM elliot i changed the ulimit and got an error rather than a segfault 03:04PM elliot and now it segfaults again 03:06PM elliot yea...this seems to be the only error that i can see in the metadata server log: 03:06PM elliot The requested dfile count of 0 is invalid; aborting operation. 03:06PM elliot + attrs read from dspace: (owner = 7268, group = 7268, perms = 644, type = 1 03:06PM elliot atime = 1116372293, mtime = 1116372293, ctime = 1116372293 | 03:06PM elliot dfile_count = 0 | dist_size = 0) 03:06PM elliot but there is a lot more output robl sounds like pvfs2-fsck might be needed... but i can't gaurantee it's bug-free 03:08PM elliot http://rudi.ncren.net/~elliot/pvfs2log.txt robl (we've tested what we can, but it hasn't see a lot of in-the-wild situations) 03:10PM kraken ooh, robl do you remember the evil evil dfile count problems I hit long long ago? 03:10PM elliot and if you want to core from pvfs2-ls http://rudi.ncren.net/~elliot/core.13110 robl kraken: yeah, i do 03:16PM 53elliot robl: pvfs2-fsck segfaults robl dangit SWAP: Window 3 is not hidden! robl elliot: i can't work on this too much today... or tomorrow... but maybe monday? robl i could maybe log in and see how things look 03:21PM elliot i think what happend was the use canceled there job, causing the process to get killed, and not properly closing the file maybe 03:22PM 53elliot robl: sure 03:22PM elliot any help would be appriciated robl elliot: in the meantime, take it up on the mailing list to see if anybody else has any idea Topic 36#pvfs2 50): Try the mailing lists if we're not around! http://www.pvfs.org/pvfs2/lists.html Topic 36#pvfs2 50): set by 36robl at 36Mon Jan 17 16:55:20 2005 03:30PM elliot 03:30PM elliot let me know when you are available on monday 56rross 36~rross@216-80-31-74.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 04:42PM 53rross robl: you 'round? robl rross: hey 04:46PM 53rross robl: two questions. (1) how many files total is the osc metadata test working with, and (2) what size does it resize the files to? 04:47PM rross i'm not going to make dinner btw; just a little too much to get done between paper completion and prepping for weekend. would like to though :(. robl (1): 2560 files total across all processors. each process operates on 2560/nprocs files robl (2) 2^20 (2<<20) 04:52PM rross 1MB. 04:52PM rross ok. thanks! robl er, 2^21 (missed a bit) 04:53PM rross i skipped the noncontig section for the moment. i'll knock it out after you've had a chance to finish up the data. pretty close i think. the paper isn't a glowing endorsement of pvfs2, but i think that's a strong point actually. 04:54PM rross you sure? wanna run it real quick like and look at the file size :)? robl (gdb) p maxsize robl $1 = 2097152 04:56PM rross right now. thanks. 04:56PM rross i dunno what i'm typing. robl i had to double-check in gdb m'self 04:56PM rross weather outside sucks. robl here too 05:30PM rross crap, back up to 27 pages. 05:30PM rross can't wait for the extended director's cut. robl http://www-unix.mcs.anl.gov/~robl/pvfs2/noncontig/ robl couldn't come up with a better way to present the data 05:42PM rross the top lines are short because the file gets too big? just haven't run the points yet? robl rross: top lines are short because ... wait, now i forget robl ah, noncontig wants the vector blocklen to be a multiple of nprocs 05:44PM rross i think that a better way to show it might be in terms of a fixed file size, with # of pieces/process as the different lines (1 being a contiguous block). we don't have to show the really terrible cases here; they will be much better with the datatype code, so 1, 4, 8, 16, 32, 64 pieces would be great points i think. sorry i didn't think about this more sooner. robl and in these runs, as vector blocken decreases, element count increases 05:44PM rross needed to see the graphs to think about what would be best, as usual. sucks that it took so long to get the bugs out. 05:45PM rross just do the contig mem/noncontig file if you can select just that. robl sure can robl need to think a second for how to get noncontig to do that 05:49PM rross ok. start with a 128MB/process total size, and work back from there. then the top line in the graph should basically be the same as the one in the contig tests. 05:50PM rross we can get troy to run the same tests on the OSC cluster later on, before the final paper version. robl er, wait, 128mb/process means variable file size? 05:56PM rross right. sorry. fixed amount of data per process, as in the contig tests. just varying # of regions. that make sense? robl yeah, i think so. just trying to convert it into terms of veclen and elmtcount 05:57PM rross what's the difference between veclen and elmtcount? 05:58PM rross veclen is the # of regions, elmtcount is the size of the region? robl veclen: blocksize of vector elmtcount: number of in each block robl right 05:58PM rross aren't papers fun :)? 05:58PM rross veclen is not the # of regions then. what is the # of regions? 05:59PM rross is there a count? robl ah, i see. 'veccount' robl either you give it a file size or a vec count robl and one is derrived from the other (depending on which you passed to noncontig) robl great 06:02PM rross file size = vec count * veclen * elmtcount, i'd guess. 06:02PM rross 06:02PM rross file size = vec count * veclen * elmtcount * nprocs 06:03PM rross we want vec count * vec len * elmtcount = 128MB, and to vary vec count from 1 to 64. 06:03PM rross i think. 06:03PM rross robl yay datatypes 06:03PM rross sure! 06:04PM rross just fix veclen at 1, so vec count * elmtcount = 128MB 06:04PM rross that'll get you an elmtcount from 128MB to 2MB. 06:07PM rross cool? robl think so robl submit a bunch of jobs with a variable number of processors robl each job runs noncontig, varying the veccount (and reducing the elmtcount appropriately) robl take the output, plot it up robl ok, in the queue robl will let you know what' sup after dinner 06:12PM rross thanks much. i should have everything else knocked out tonight. i can finish this up tomorrow if necessary. only thing that sucks is that i may not get much done on the romio front prior to bill's tagging on monday :(. 06:32PM rross ha, we have until may 28th now :). 06:32PM 50* 53rross/#pvfs2 tries to wrap up for now, switch to romio, do the rest of this next week. NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3607:04pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3607:37pm BitchX : Press to see who left to change to [irc.freenode.net] robl rross: extention! robl rross: ok 09:21PM rross yeah, that makes it easier. robl robl (dur) robl esp. because jazz is packed tonight robl get of my cluster, you ..... scientists! robl off BitchX : No Banned Words on list 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3601:09am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Global Notice] Good evening, all. News up on the freenode website: (1) Major downtime on Sunday. (2) Status of fundraiser. Please take a look at http://freenode.net/news.shtml ! Thank you for your support for freenode, and have a great evening! 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 56pcarns 36~pcarns@adsl-211-217-174.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-211-217-174.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl hi phil 03:11PM pcarns howdy 55deedra 35dmwaters@dmwaters-osuosl.staff.freenode 50)- {global notice} Hi all! In a little more then 12 hours, I will begin major maintenence on the network. For more information, please see 'http://www.freenode.net/news.shtml' Thank you for your patience, and thank you for using freenode! 56elliot_ 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 Signon time : Sat Apr 2 11:10:48 2005 Signoff time : Sun May 22 10:20:36 2005 Total uptime : 49d 22h 9m 48s SignOff: 57robl Mike Tyson says BitchX BITES! Do you HEAR what I'm saying?! Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Sun May 22 10:21:33 2005 56robl 36~robl@63.170.133.110 has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 slang_ 54ChanServ 54 elliot Channel #pvfs2 was created at Sun May 22 02:20:25 2005 BitchX : Join to #pvfs2 was synched in 5.918 secs!! 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-209-12-241.asm.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-209-12-241.asm.bellsouth.net has left #pvfs2 56pcarns 36~pcarns@adsl-209-12-241.asm.bellsouth.net has joined #pvfs2 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57pcarns 36H ~pcarns adsl-209-12-241.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57pcarns 36G ~pcarns adsl-209-12-241.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) SignOff 57kraken : #pvfs2 "leaving" 53#pvfs2 57pcarns 36H ~pcarns adsl-209-12-241.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57slang_ 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) pcarns ~pcarns@adsl-209-12-241.asm.bellsouth.net has left #pvfs2 05:55PM slang_ 05:55PM slang_ quit SignOff 57slang_ : #pvfs2 "leaving" 50* 57robl has days like that NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3607:12pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-209-12-241.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-209-12-241.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 robl hello #pvfs2 robl elliot: haven't forgotten about you. just didn't have time yesterday 11:53AM 53elliot robl: today maybe? SignOff 57slang : #pvfs2 Remote closed the connection 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 03:03PM 53elliot robl: poke poke robl elliot: today is not looking so good either. 03:06PM elliot i can reinitialize the filesystem to fix it, but I would like to figure out whats going on in case it happens again robl elliot: stil trying to finish a few rounds of tests for a paper due imminently 03:07PM elliot robl elliot: and i would love to get my hands on a file system that causes pvfs2-fsck to segfault 03:07PM elliot tomorrow maybe? robl yeah, tomorrow looks good 03:08PM elliot ok, ping me whenever you have time tomorrow robl you got it 03:40PM pcarns elliot: I think I know what the story is on your problem, or at least what got it to that state 03:41PM pcarns I'll respond to your mailing list posting in a minute 03:59PM 53pcarns robl: my email shows how to trigger this bug so you can reproduce a scenario that makes pvfs2-fsck segfault, if you guys want to work on that aspect of the problem robl pcarns: ok, good robl pcarns: the bad news is that the only reason elliot ran pvfs2-chmod was because we (kraken and i) told him to :> 04:11PM pcarns it wasn't necessarily the pvfs2-chmod command itself that broke it the first time though 04:12PM pcarns the error was server side- any setattr could have done it robl pcarns: and pvfs2-ls -al would certainly hang if dfile and distro are zeroed out SWAP: Window 3 is not hidden! pcarns ~pcarns@adsl-209-12-241.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" Netjoined: 57irc.freenode.net brown.freenode.net 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-224-172.aep.bellsouth.net has joined #pvfs2 10:10AM slang pcarns: hi 10:10AM pcarns 10:11AM slang pcarns: wanted to ask you a quick question, what are the setparam requests that happen every second? 10:11AM pcarns every second? 10:11AM slang yeah 10:11AM pcarns when the server is idle? 10:11AM slang appears to be on a second interval 10:11AM slang yes 10:12AM pcarns there is a state machine running (gets started in servers main()) that rotates performance counters and stuff like that, I don't think it should show up as a setparam, though 10:12AM slang hmm 10:13AM slang its getting logged as mgmt_setparam:do_work 10:13AM slang I think the do_work is from another state though 10:13AM slang err... state machine 10:13AM slang a nested machine possibly 10:14AM pcarns ah, there are actually two constantly running sm's 10:14AM pcarns neither should have that name though, IIRC 10:14AM pcarns look for hte server_state_machine_start_noreq() calls in pvfs2-server.c 10:14AM slang 10:14AM pcarns those are kicking off those state machines, one for perf updates, and one for job timers 10:14AM slang maybe my operation index->name mapping is off 10:17AM slang so all the requests from clients are handled in main with the server_state_machine_start 10:17AM slang call 10:17AM slang 10:18AM pcarns yeah 10:18AM pcarns when it gets unexpected bmi requests 10:18AM pcarns the _noreq flavor of that function is to kick off state machines that didn't originate from a bmi request 10:20AM slang is it used for anything else besides perf updates and job timers at present? 10:21AM pcarns not that I know of, but you might want to grep around to make sure 10:21AM slang 10:21AM slang pcarns: cool thanks 10:21AM pcarns those state machines don't have the usual server state log macros in them, because it makes the output too noisy 10:21AM slang right 10:22AM pcarns you maybe could set a flag or something during the _noreq call that turns them off it becomes automatic 10:22AM slang well - with the log macros happening outside..right 53#pvfs2 57pcarns 36H ~pcarns adsl-215-224-172.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 01:31PM elliot "Moderate alcohol consumption, described by Dr. Longwell as "enough booze to get her to say yes," does not inhibit rabbitrol's performance" 01:31PM elliot grr...wrong window robl elliot: heh. happens to all of us 01:34PM 53elliot robl: so want to take at my pvfs2 problems? robl elliot: hey, it sounds like phil found the problem for your file system, right? at this point (since the dfile_count and dist_size are zero) you'll have to rebuild pvfs2 01:34PM elliot he said thats fixed in cvs right? 01:35PM pcarns maybe you could use that pvfs2-remove-object to snipe out the busted meta file without rebuilding? 01:35PM pcarns I don't think its in cvs robl it is now robl (like just 30 seconds ago now) 01:36PM pcarns ah ;) 01:38PM 53pcarns robl: don't forget the flowproto bytemax fix if you happen to get into a cvs fixin' mood 01:38PM 53pcarns robl: that particular one I don't have checked into any of my stuff either, so its not really recorded except for in that email robl pcarns: huh. i think i did that already robl nope, guess not robl wierd 01:45PM pcarns mm, yeah, I don't think its in there 01:45PM pcarns the change to make MAX_REGIONS match romio is in there, though robl pcarns: i don't understand it well enough to make a menaningful changelog robl "reflect work we've already done on a request" ? 50* 57robl goes with that robl pcarns: just have two insure patches you sent back in feburary that i need to understand before committing. 01:48PM pcarns yeah, pretty much 01:49PM 53pcarns robl: those still aren't very high priority, IIRC, since they weren't really the result of observed bugs 01:49PM 53pcarns robl, or maybe the one dealing with locking might be interesting robl pcarns: yeah, i committed all the boring ones already 01:50PM 53pcarns robl: if it helps any, we have been running with those patches in place since then without any obvious side effects 01:50PM 53pcarns robl: but just in testing and such, not much production beat-down 01:51PM 53pcarns robl: I never did come back and finish "insuring" the code, too many more obvious tasks to worry about 01:52PM 53pcarns robl: but one day I shall return robl pcarns: that's cool. it's definitely more important to get the acxiom code contribution policy squared away 01:56PM 53pcarns robl: my boss is trying hard to get it squared away, we talked about it the other day and he is putting priority on it as best he can 01:57PM pcarns you guys will get a patch avalanche sooner or later, we've been doing some fairly substantial correctness testing and production polish robl pcarns: heh. can't handle an avalanche just yet. getting there 01:58PM 53pcarns robl: thanks for dropping those in the tree! 02:00PM pcarns hopefully the approval process will be pretty lightweight here in the end, or else we won't be able to output in an avalanche anyway pcarns ~pcarns@adsl-215-224-172.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 Netjoined: 57irc.freenode.net brown.freenode.net 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 02:51PM elliot anyone around? robl elliot: hi 02:55PM elliot when trying to build from cvs it isn't building pvfs2-client and pvfs2-client-core 02:55PM elliot everything else seems to be there robl elliot: we had to make a small change to help out the cross-compile situations robl elliot: pvfs2-client and pvfs2-client-core are part of 'make kmod' and 'make kmod24' 04:30PM 53elliot robl: make doesn't respect a DESTDIR variable for kmod_install robl yeah... just prefix for pvfs2-client-core and pvfs2-client. hm robl elliot: looking for a way to install the kernel module somewhere else? 04:33PM elliot no, just packaging things, which requires installing things into a destdir robl elliot: looks like in that case you could set the KMOD_DIR to something robl elliot: ok, yeah.. we probably need to do a bit of work to be packager friendly 04:34PM elliot everything else seems to work except for that and there are a couple of files that end up with the wrong paths in them robl which files? 04:50PM elliot pvfs2-server.rc 04:52PM elliot thats really the only one that i have found 06:20PM elliot anyone around? 06:20PM elliot [root@compute-0-0 root]# mount -t pvfs2 tcp://controller-0:3334/data /mnt/pvfs2/mount: Protocol not supported 06:25PM elliot nevermind...needed to restart the servers SignOff 57laytonj : #pvfs2 "Leaving" 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 56kraken_ 36~kraken@24.144.40.22 has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-215-228-78.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net kraken_ ~kraken@24.144.40.22 has left #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.cpe.ga.charter.com has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" pcarns ~pcarns@adsl-215-228-78.aep.bellsouth.net has left #pvfs2 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 56Jeff_Layton 36~chatzilla@66.239.25.73.ptr.us.xo.net has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3602:19pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net brown.freenode.net 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 pcarns ~pcarns@adsl-215-228-78.aep.bellsouth.net has left #pvfs2 SignOff 57Jeff_Layton : #pvfs2 "no reason" 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-215-228-78.aep.bellsouth.net has left #pvfs2 56pcarns 36~pcarns@adsl-215-228-78.aep.bellsouth.net has joined #pvfs2 56Jeff_Layton 36~chatzilla@63.80.253.131 has joined #pvfs2 SignOff 57Jeff_Layton : #pvfs2 "no reason" 56Jeff_Layton 36~chatzilla@66.239.25.72.ptr.us.xo.net has joined #pvfs2 56yftty 36~yf@221.216.130.169 has joined #pvfs2 SignOff 57Jeff_Layton : #pvfs2 Read error: 110 (Connection timed out) 56Jeff_Layton 36~chatzilla@66.239.25.72.ptr.us.xo.net has joined #pvfs2 SignOff 57Jeff_Layton : #pvfs2 Read error: 145 (Connection timed out) 56Jeff_Layton 36~chatzilla@66.239.25.72.ptr.us.xo.net has joined #pvfs2 pcarns ~pcarns@adsl-215-228-78.aep.bellsouth.net has left #pvfs2 SignOff 57Jeff_Layton : #pvfs2 "no reason" 56Jeff_Layton 36~chatzilla@63.80.253.131 has joined #pvfs2 yftty ~yf@221.216.130.169 has left #pvfs2 Ignoring QUITS from parts!*@* BitchX : You must specify one of the following: ALL MSGS PUBLIC WALLS WALLOPS INVITES NOTICES NOTES CTCPS CDCC KICKS MODES SMODES JOINS TOPICS QUITS PARTS NICKS PONGS SQUITS CRAP NONE Ignoring JOINS from #pvfs2 Ignoring PARTS from #pvfs2 Ignoring QUITS from #pvfs2 SWAP: Window 3 is not hidden! 53#pvfs2 57pcarns 36G ~pcarns adsl-215-228-78.aep.bellsouth.net (gaim) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) SWAP: Window 3 is not hidden! Netjoined: 57irc.freenode.net brown.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 03:23PM 53kraken robl: so the note on pvfs-users is one of our users who is a huge pain in the butt robl kraken: horray for end-uers! robl kraken: it sounds like he's been back and fort with you a few times 03:25PM kraken yeah 03:25PM kraken someone was asking about a faster way to copy files than cp, and I mentioned using dd with a large blocksize 03:26PM kraken and he posted this big long missive about how he "doesn't trust that Linux dd" 03:26PM kraken he had some crazy-ass piping an awk script to dd example where the output wasn't the same every time, and claimed that he'd gotten a patch to fix it on Tru64 03:27PM kraken my thought was, "if it'd shut you up, I'd fake a patch too" 03:27PM kraken 03:31PM kraken I thnk I'm going to reply and mention that the 4 seconds from local disk isn't realistic since he'd just copied it to local disk and it was in cache robl how big is this file? 03:32PM kraken he's never said 03:33PM kraken I maintain that any file that's so big you can't just copy it locally, you shouldn't be running diff on anyway 03:34PM kraken I like how he says he "has" to use a Linux system. he's such a tru64 bigot :) robl gotta hold onto those 64 bit big endian systems while they still run robl wait, alpha is LE robl ok, nevermind robl kraken: thanks for fielding that one 04:28PM kraken robl hm. did anybody ever respond to that guy who was running pvfs2 on a raw device? robl how did that ever work? 04:38PM kraken sounded kinda crazy to me 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl drat. where'd phil go? 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-69.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl kraken: i've got this one robl kraken: apps guys are kinda funny when they talk with systems software folks. the two worlds see things just differently enough to be humorous 09:05AM kraken heh 09:06AM kraken so I saw that LANL is going to be part privately-run now 09:14AM pcarns whoa- I just looked on news.google for information on that (LANL), looks like things are getting rough and tumble out there: 09:14AM pcarns http://www.kobtv.com/index.cfm?viewer=storyviewer&id=19678 09:15AM kraken I heard a story on NPR a few days ago 09:16AM kraken wow, that story is scary robl wow BitchX : Unknown command: WOH 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-69.aep.bellsouth.net (gaim) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl elliot: hey, i've got a way to make 'make kmod_install' packager-friendly robl elliot: you ok with something like "make kmod_path=/blah/blah/blah" kmod_install ? robl elliot: even though lars already responded there's still time to put your 2 cents in if you've got comments 04:12PM 53elliot robl: how about make DESTDIR=/blah/blah/blah kmod_install 04:15PM elliot ooo....lightning robl i guess that's a bit more standard 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net robl elliot: hey, i can't convinc myself that DESTDIR is any better than kmod_dir if nothing else honors DESTDIR 07:35PM 53elliot robl: you could fix that everywhere else as well :) 10:16AM kraken pcarns: you and david are patching fools these days :) robl yeah, i just might make pcarns take back his cvs commit privs :> robl i wonder if we'll ever do another pvfs1 release 10:35AM pcarns phhh 10:35AM pcarns you ain't seen nothing yet 10:37AM 53pcarns robl: at least the pvfs1 patches will be archived on the list in case any other lost souls are dragging it along in production robl pcarns: what does [associate:artf11671] mean in your changesets? 10:51AM pcarns oh, that's a special tag we use to automagically associate commit sets our tasks lists here 10:51AM pcarns we use sourceforge enterprise- has bug trackers and task lists built in 10:51AM pcarns and integrates with cvs 10:52AM pcarns so for anyone besides us it is pretty much garbage :) 11:02AM kraken I'm just amazed that we've already broken 10k artifacts :) 11:03AM pcarns kraken: I hope VA used big integers for those things :) robl 32 bits is enoguh for anyone! robl pcarns: hey, can you tell me more about the setattr patch (kernel side) robl pcarns: i don't see how convert_attribute_mode_to_pvfs_sys_attr modifies anyting robl pcarns: to my eye it looks like it's read-only robl (probably lunchtime) 11:13AM pcarns ok, I think the code path goes something like this: 11:14AM pcarns pvfs2_inode_setattr() is called, and it has an inode filled in with whatever attributes it thinks should be pushed to disk 11:14AM pcarns it calls copy_attributes_from_inode() to copy those attributes into a PVFS2 specific upcall 11:14AM pcarns copy_attribute_from_inode() calls convert_attribute_mode_to_pvfs_sys_attr() 11:15AM pcarns the latter is in turn responsible for setting the attribute mask in the setattr upcall that gets shipped off to pvfs2 by the client daemon robl so you end up with an attr->objtype that might not be correct? 11:17AM pcarns I think the patch effects what it puts in the objtype field and what it puts in the attr mask, 11:17AM pcarns the objtype shouldn't be set ever really, robl 11:18AM pcarns oh yeah, sorry, I got ahead of myself, I guess that's all the function did is set the obj type and the mask to go along with it 11:18AM pcarns but the point is still the same; it can't really be allowed to change that on setattr robl ok, i think i get it 11:19AM pcarns these things have been happening (thus far) to always overwrite with the same value (so no blood no foul) but it gives me the jeebies 11:19AM pcarns if a client's inode cache gets out of whack with that's actually on the server (due to a race with another client) you could have big trouble robl makes sense robl pcarns: also, i don't like leaving commented-out code around, so i'm just leaving explanatory comments 11:27AM 53pcarns robl: that's cool- I'm confident in ditching the old code now, just wasn't able to put together a new patch robl excellent 11:31AM 53pcarns robl: I'm about to grab some lunch, but I'll be back shortly robl ultimate soon for us, so that'll work out a-ok 01:20PM slang valgrind is still showing some memleaks 01:21PM slang looks like the biggest one is allocation of the server ops for the 50 unexpected requests 01:22PM slang leaks about 50K 01:22PM slang is it worth keeping track of the s_op pointers for server shutdown? 01:28PM pcarns may be a little tricky 01:28PM pcarns I suspect that if the s_op's actually get used, then they are free'd when the state machine completes 01:29PM pcarns in state_machine_complete() 01:32PM pcarns maybe state_machine_complete() and server_post_unexpected_recv() could work together and maintain a linked list or something, so at the end you have a list of the ones that were associated with an unexp recv that never came through 01:33PM pcarns hopefully its bounded, though (the number of s_ops that could be leaked at the end) 01:39PM kraken is there a max number of outstanding unexp recvs that can be pending at one time? 01:42PM pcarns I think the "UnexpectedRequests" field in the config sets the max 01:43PM pcarns its 50 by default robl kraken: yeah, what phil said 01:43PM pcarns but I haven't looked at the logic in a long time to confirm robl pcarns: looks like it still holds robl pvfs2-genconfig creates a config file with 50 unexpected requests 02:01PM slang pcarns: its not a huge deal since the leak is constant over the lifetime of the server process robl i'd put it low on the list but it'd be nice to have valgrind run w/o any errors 02:02PM slang true 02:04PM slang ==9894== 20 bytes in 1 blocks are definitely lost in loss record 7 of 25 02:04PM slang ==9894== at 0x1B90459D: malloc (vg_replace_malloc.c:130) 02:04PM slang ==9894== by 0x806753E: __job_time_mgr_add (job-time-mgr.c:126) 02:04PM slang ==9894== by 0x8067676: job_time_mgr_add (job-time-mgr.c:171) 02:04PM slang ==9894== by 0x8075FFA: io_start_flow (io.sm:241) 02:04PM slang ==9894== by 0x8054388: PINT_state_machine_next (state-machine-fns.h:140) 02:04PM slang ==9894== by 0x8051DE2: main (pvfs2-server.c:360) 02:04PM slang ==9894== 02:04PM slang ==9894== 02:04PM slang ==9894== 54 bytes in 1 blocks are definitely lost in loss record 13 of 25 02:04PM slang ==9894== at 0x1B90459D: malloc (vg_replace_malloc.c:130) 02:04PM slang ==9894== by 0x1BA8E08F: strdup (in /lib/tls/libc-2.3.2.so) 02:04PM slang ==9894== by 0x808DB59: dbpf_attr_cache_do_initialize (dbpf-attr-cache.c:86) 02:05PM slang ==9894== by 0x80923A2: dbpf_collection_setinfo (dbpf-mgmt.c:154) 02:05PM slang ==9894== by 0x8068BEE: trove_collection_setinfo (trove.c:885) 02:05PM slang ==9894== by 0x8052A97: server_initialize_subsystems (pvfs2-server.c:759) 02:05PM slang ==9894== by 0x805212C: server_initialize (pvfs2-server.c:449) 02:05PM slang ==9894== by 0x8051C4E: main (pvfs2-server.c:251) 02:05PM slang ==9894== 02:05PM slang ==9894== 02:05PM slang ==9894== 64 bytes in 3 blocks are definitely lost in loss record 14 of 25 02:05PM slang ==9894== at 0x1B90459D: malloc (vg_replace_malloc.c:130) 02:05PM slang ==9894== by 0x808E6BB: dbpf_attr_cache_elem_set_data_based_on_key (dbpf-attr-ca 02:05PM slang che.c:448) 02:05PM slang ==9894== by 0x808C9B2: dbpf_keyval_read_op_svc (dbpf-keyval.c:139) 02:05PM slang ==9894== by 0x8091F28: dbpf_do_one_work_cycle (dbpf-thread.c:172) 02:05PM slang ==9894== by 0x8091DB4: dbpf_thread_function (dbpf-thread.c:91) 02:05PM slang ==9894== by 0x1B925B62: start_thread (in /lib/tls/libpthread-0.60.so) 02:05PM slang ==9894== by 0x1BAEE189: clone (in /lib/tls/libc-2.3.2.so) 02:05PM slang ==9894== 02:05PM slang ==9894== 02:05PM slang ==9894== 340 bytes in 5 blocks are possibly lost in loss record 18 of 25 02:05PM slang ==9894== at 0x1B904F75: calloc (vg_replace_malloc.c:175) 02:05PM slang ==9894== by 0x1B8F2588: (within /lib/ld-2.3.2.so) 02:05PM slang ==9894== by 0x1B8F285B: _dl_allocate_tls (in /lib/ld-2.3.2.so) 02:05PM slang ==9894== by 0x1B92624A: allocate_stack (in /lib/tls/libpthread-0.60.so) 02:05PM slang ==9894== by 0x1B925C54: pthread_create@@GLIBC_2.1 (in /lib/tls/libpthread-0.60.so) 02:06PM slang ==9894== by 0x8091BC8: dbpf_thread_initialize (dbpf-thread.c:43) 02:06PM slang ==9894== by 0x8092641: dbpf_initialize (dbpf-mgmt.c:295) 02:06PM slang ==9894== by 0x8067AF2: trove_initialize (trove-mgmt.c:77) 02:06PM slang ==9894== by 0x805250E: server_initialize_subsystems (pvfs2-server.c:617) 02:06PM slang ==9894== by 0x805212C: server_initialize (pvfs2-server.c:449) 02:06PM slang ==9894== by 0x8051C4E: main (pvfs2-server.c:251) 02:06PM slang ==9894== 02:06PM slang ==9894== 02:06PM slang ==9894== 47600 bytes in 50 blocks are definitely lost in loss record 25 of 25 02:06PM slang ==9894== at 0x1B90459D: malloc (vg_replace_malloc.c:130) 02:06PM slang ==9894== by 0x80538F6: server_post_unexpected_recv (pvfs2-server.c:1247) 02:06PM slang ==9894== by 0x8051D69: main (pvfs2-server.c:376) 02:06PM slang ==9894== 02:06PM slang that's the complete list 02:07PM slang sounds like irc rate-limits my inputs so that paste was really painful for everyone 02:07PM slang sorry about that 02:08PM pcarns slang: no problem- more dramatic/suspenseful that way ;-) 02:09PM slang pcarns: heh 02:13PM kraken pcarns: it should be fixed now robl it's nice to see some traffic in #pvfs2 at least 02:14PM pcarns kraken: thanks! robl pcarns: heh, i just noticed you stuffed a real copyright symbol in the file robl pcarns: how'd you do that? 50* 57robl doesn't know how to do anything more complicated than (C) 02:17PM pcarns I have no idea- just cut 'n paste 02:17PM pcarns some guy figured it out in the 60s and everyone has cut and pasted since robl yeah, probably :> 02:25PM slang programmers cared about copyrights in the 60s? ;-) robl pcarns: ok, there you go. a one-day turnaround instead of 4 months like last time :> robl pcarns: we've definitely had at least one user ask about how we handle secondary groups, so thanks for kicking that out! 02:33PM 53pcarns robl: woohoo! thanks for merging those in robl slang: http://www-unix.mcs.anl.gov/~robl/pvfs2/benchmarking/mpi-io-test.txt robl slang: on jazz: ~robl/bin/my_emerge is my "update pvfs2 and mpich2, build the whole mess, and install it" robl slang: color cvs is in ~robl/bin, on any system i've got an acct 03:10PM 53slang robl: cool thanks 03:12PM slang all the test programs get installed in /bin 03:12PM slang would it make sense to put them in /test? robl i'd go along with that, sure robl pcarns: hey, do you have an answer for http://www.parl.clemson.edu/pipermail/pvfs2-developers/2005-March/001106.html ? 03:20PM 53pcarns robl: eek- march 10- think he still needs an answer? 03:22PM 53pcarns robl: not sure what he means by contents, bmi header? request protocol? encoder stuff? robl pcarns: yeah, i was ondering if he wanted tcpdump output or something like that? 03:24PM 53pcarns robl: I have no idea, maybe get him to be more specific what the problem is? 03:24PM pcarns he's writing his own bmi module- he shouldn't really care what the payload is as long as his module works... robl ==14734== LEAK SUMMARY: robl ==14734== definitely lost: 0 bytes in 0 blocks. robl ==14734== possibly lost: 0 bytes in 0 blocks. robl that's nice to see 04:44PM 53slang robl: woo! robl (that's client side, btw) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3606:52pm BitchX : Press to see who left to change to [irc.freenode.net] 09:19AM 55pcarns 35~pcarns@adsl-218-106-58.asm.bellsouth.net 50)] hey rob, you in yet this morning? 09:20AM 55pcarns 35~pcarns@adsl-218-106-58.asm.bellsouth.net 50)] ping me when you get a chance- I need to get a feel for when you guys want to cut a final release 09:20AM 55pcarns 35~pcarns@adsl-218-106-58.asm.bellsouth.net 50)] we may be able to get a couple more patches out, depending 10:02AM 53pcarns robl: so I think there is actually still a permission bug in the current cvs snapshot 10:02AM 53pcarns robl: I don't _think_ I introduced it, maybe just didn't notice it was there before 10:02AM pcarns to recreate: 10:02AM pcarns (through vfs) 10:03AM pcarns 1) create a file as one user 10:03AM pcarns 2) change the group to a non-primary group 10:03AM pcarns 3) set permissions to turn off read for user and group, but turn on read for other 10:04AM pcarns 4) try to access the file as another user who also doesn't have that primary group 10:04AM pcarns you get permission denied, despite the o+r 10:05AM pcarns but from what I can tell, seems to be something wrong on client side; server never denies permission robl pcarns: we've always had issues with secondary groups robl pcarns: your patches improve the situation, but it sounds like there's a little more tweaking we need to do 10:06AM 53pcarns robl: could be 10:07AM 53pcarns robl: something may have been coded on the client to balk at non-primary groups and I just missed it before 10:08AM 53pcarns robl: ahh, more clues- this bug isn't present when using admin utilities 10:08AM 53pcarns robl: must be something in the kernel module 10:08AM pcarns or pvfs2-client 10:09AM 53pcarns robl: I'm going to double check and make sure this happens the same way in our tree robl pcarns: huh. WORKSFORME robl [joetest2@gil foodir]$ id robl uid=503(joetest2) gid=503(joetest2) groups=503(joetest2) context=user_u:system_r:unconfined_t robl [joetest2@gil foodir]$ ls -l testfile robl --w----r-- 1 robl users 23 Jun 9 10:13 testfile robl [joetest2@gil foodir]$ cat testfile robl here is some test data 10:20AM pcarns whoa, weird 10:21AM 50* 53pcarns/#pvfs2 thinks his laptop needs more coffee 10:22AM pcarns I assume that you can also cat it as robl, right? robl pcarns: i cannot robl pcarns: because it's o-r robl pcarns: that's true for both pvfs2 and ext3 robl "er, user -r robl let me try that again 10:26AM pcarns maybe I just confused myself on permission semantics this morning... robl becasuse it's u-r, i cannot cat the file as robl on either pvfs2 or ext3 robl i know it's soemthing we (pvfs2) need to take a very close look at robl this is on a fedora 3 machine robl hardly a trustworthy source for a reference implementation 10:28AM pcarns crud- the case I outlined originally does the same thing on ext3 10:28AM pcarns I'm a dingbat 10:29AM pcarns I guess false alarm on the permission bug (not that there probably aren't others), I just got confused robl that's cool and totally understandable robl we've been saying forever that we need to sit down with whatever "permissions semantics" documents we can find and make sure we follow all the rules.. but of course it's a low-priority issue 10:33AM pcarns so probably the biggest problem at this point is that the client library (and thus admin utilities and mpi-io) probably aren't strict enough 10:34AM pcarns it looks like the combination of the kernel's permission checking plus the servers's makes things ok through the vfs robl i tend to think that's good enough for now 11:16AM pcarns I think I'm going to send an email to the list about that permissions issue, I see roughly where its going amiss 11:16AM pcarns maybe someone will look at it 11:17AM pcarns the same basic flaw was in old code and I continued it in my patch 11:17AM rross pcarns: can you recap for us late-comers? 11:18AM pcarns rross: realized something is still up with permissions this morning (after getting myself and anyone listening to me confused for a bit), 11:19AM pcarns rross: the new permissions stuff is still not restrictive enough, 11:19AM pcarns rross: but you can't tell through vfs, because it adds its own permission checking and gets it right, 11:19AM rross ah. what specifically isn't being enforced? 11:20AM pcarns rross: problem is that both the old code and the new code keeps dropping through each level of permission bits (user, group, other) trying to find one that allows the access you want, 11:20AM pcarns when really, for example, if the uid matches, but the group read bit is not set, then read access should be denied- no matter what the other bits are 11:20AM pcarns this page explains in simple terms: 11:20AM rross gotcha 11:20AM pcarns http://www.ientry.com/oracle_ad.html 11:21AM pcarns whoops I said wrong: "group read bit" -> "user read bit" 11:21AM rross ok. i don't think that this should be something that we worry about fixing for this release. 11:22AM pcarns I think robl was of the same opinion 11:22AM pcarns good news is that I don't know of anything off when you go through the kernel 11:22AM pcarns its just that in some odd cases the admin utilities or library will let you bypass when it shouldn't robl well it's bug 68 now 11:25AM rross cool. 11:25AM pcarns I'll record it here too, but we likewise probably have more pressing priorities 11:26AM rross is there anything left that is a real show-stopper? robl haven't found anything today yet 11:27AM pcarns my testing looks ok 11:28AM pcarns rross: I was telling robl that's all the patches coming from us for this release 11:28AM rross robl rross: and also told phil that we're going to try for monthly releases 11:29AM pcarns thats good news for us 11:29AM pcarns we'll have some more contributions for the next release, and they won't be so last minute next time :) robl rross: we pass pvfs2-shelltest on gil, for what that's worth robl lunch train. choo choo 11:36AM rross pcarns: sounds good :) 11:37AM rross lunch it is. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:33pm BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3610:43pm BitchX : Press to see who left to change to [irc.freenode.net] #pvfs2 There isn't a topic. 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl huh. where'd our topic go? Topic 36#pvfs2 50): changed by 36robl pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html 05:46PM elliot_ anyone around that could help with building mpich2 robl elliot: perhaps i can. what's up? 10:47PM 53elliot robl: i keep getting errors like this one when trying to build without enabling any of the extra features 10:47PM elliot icc -DHAVE_CONFIG_H -I. -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll -I../../../../include -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/include -O2 -march=i686 -g -I/home/elliot/conary/build/mpich2/mpich2-1.0.2src/mpid/common/sock/poll -c sock.c 10:47PM elliot sock.c(8): catastrophic error: could not open source file "mpidu_sock.h" 10:47PM elliot #include "mpidu_sock.h" 10:47PM elliot this include file is part of mpich2 so the make file should be taking care of seting the correct include paths 10:48PM elliot s/include file/header file/ robl hm. looks like it should be including /home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/, and not /home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll robl drop a mail to mpich2-maint@mcs.anl.gov and one of the mpich2 guys will be able to help out, i'm sure. me, i've never seen that kind of error before, but i don't use icc ever 12:13AM 53elliot robl: I get the same error using gcc 12:13AM elliot gcc -DHAVE_CONFIG_H -I. -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll -I../../../../include -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/include -O2 -march=i686 -g -I/home/elliot/conary/build/mpich2/mpich2-1.0.2src/mpid/common/sock/poll -c sock.c 12:13AM elliot sock.c:8:24: mpidu_sock.h: No such file or directory 12:14AM elliot i'm guessing that someone actualy built this on some platform before releasing it 08:30AM 53pcarns robl: thanks for getting the new release out the door last week! robl elliot: yeah, that doesn't exactly inspire confidence, but i did build (CVS) a day before the release robl pcarns: no problem. you and the davids did all the work. i was just a patch monkey last week :> robl elliot: wierd man robl elliot: wget, tar, configure, make, and it seems to work for me robl elliot: and my compile line is a jillion time longer than your robl gcc -DHAVE_CONFIG_H -I. -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpi robl d/common/sock/poll -I../../../../include -I/sandbox/robl/build/foodir/mpich2-1.0 robl .2/src/include -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/binding/f77 -I/san robl dbox/robl/build/foodir/mpich2-1.0.2/src/binding/f77 -I/sandbox/robl/build/foodir robl /mpich2-1.0.2/src/mpid/ch3/include -I/sandbox/robl/build/foodir/mpich2-1.0.2/src robl /mpid/ch3/include -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/data robl type -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/datatype -I/sandb robl ox/robl/build/foodir/mpich2-1.0.2/src/mpid/ch3/channels/sock/include -I/sandbox/ robl robl/build/foodir/mpich2-1.0.2/src/mpid/ch3/channels/sock/include -I/sandbox/rob robl l/build/foodir/mpich2-1.0.2/src/mpid/common/sock -I/sandbox/robl/build/foodir/mp robl ich2-1.0.2/src/mpid/common/sock -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mp robl id/common/sock/poll -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/so robl ck/poll -c sock.c robl (sorry about that) 09:05AM 53elliot robl: what flags are you passing configure/ 09:05AM elliot s/\//?/ robl elliot: nothing robl cflags, ldflags, libs all empty env vars robl (cppflags too) robl i have no idea why you are missing all the ch3, datatype, and channel includes robl i can understand missing the fortran includes if you don't have one installed robl (one == one fortran compiler) 09:09AM 50* 53elliot/#pvfs2 wonders if the configure.in might be broken 09:14AM elliot i'm running configure with these options and it breaks 09:14AM elliot ./configure --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/usr/com --mandir=/usr/share/man --infodir=/usr/share/info 09:14AM elliot CFLAGS="-O2 -march=i686 -g" CXXFLAGS="-O2 -march=i686 -g " CPPFLAGS="" LDFLAGS="-g" CC=gcc CXX=g++ FC=ifort 09:16AM 53elliot robl: if you don't mind could you try to build using those vars and configure options and see if it breaks for you NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:37am BitchX : Press to see who left to change to [irc.freenode.net] robl elliot: sure will robl elliot: are you building out-of-tree or in-tree 10:07AM 53elliot robl: out of tree robl elliot: ok, cool, i get an error now robl i'm suspecting it's the null CPPFLAGS robl yeah robl that's stupid of us robl when i "unset CPPFLAGS" then i can configure and build SWAP: Window 3 is not hidden! 11:43AM elliot *sigh* 11:59AM 53elliot robl: where in the makefiles/configure is causing the problem? robl elliot: not sure yet robl top-level configure.in always appends to CPPFLAGS robl src/mpid/common/sock does too 03:43PM robl_gaim (the gaim irc interface is .... bizzare) 53#pvfs2 57pcarns 36H ~pcarns adsl-19-120-225.asm.bellsouth.net (gaim) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl huh. i sent a message to pvfs2-devel 4 hours ago and it hasn't shown up yet 02:23PM 53pcarns robl: might have to do with firewall changes down there today robl ah, sure. ok 02:33PM pcarns I have no idea how that's going 02:33PM pcarns Walt may need to know about mailing list problem if it doesn't work out shortly robl there it goes robl yay robl hm. 6pm in ATL robl bet phil's asleep robl pc: nitpick on post-error.patch robl pc: i'm going to go with "posted_op" instead of 'post_only', since it makes the logic after the switch make more sense to me robl ( if posted_op == 1 && ret < 0 ) ---> we posted the opertaion but it failed immediately 10:20PM 53elliot robl: trying to build mpich2 with romio with pvfs2 support get the following errors/warnings 10:20PM elliot ad_pvfs_open.c: In function `ADIOI_PVFS_Open': 10:20PM elliot ad_pvfs_open.c:16: error: variable `pstat' has initializer but incomplete type 10:20PM elliot ad_pvfs_open.c:16: warning: excess elements in struct initializer 10:20PM elliot ad_pvfs_open.c:16: warning: (near initialization for `pstat') 10:20PM elliot ad_pvfs_open.c:16: warning: excess elements in struct initializer 10:20PM elliot ad_pvfs_open.c:16: warning: (near initialization for `pstat') 10:20PM elliot ad_pvfs_open.c:16: warning: excess elements in struct initializer 10:20PM elliot ad_pvfs_open.c:16: warning: (near initialization for `pstat') 10:20PM elliot ad_pvfs_open.c:16: error: storage size of `pstat' isn't known 10:20PM elliot ad_pvfs_open.c:26: error: `O_META' undeclared (first use in this function) 10:20PM elliot ad_pvfs_open.c:26: error: (Each undeclared identifier is reported only once 10:20PM elliot ad_pvfs_open.c:26: error: for each function it appears in.) 10:25PM 53elliot robl: nevermind....typo in the configure....was trying to build with support for pvfs not pvfs2 robl elliot: gar! we should fix that NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3610:39pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net brown.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@connect.utility.freenode 32 requested VERSION from robl 53#pvfs2 57pcarns 36G ~pcarns adsl-19-120-225.asm.bellsouth.net (gaim) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) robl pcarns: in kernel-revalidation.patch, why do you PVFS2_LOOKUP_LINK_NO_FOLLOW? robl pcarns: i know you're checking out the parent robl i would have thought that if the parrent directory is a symlink you'd want to follow it to the destination? 12:04PM 53pcarns robl: you are doing a lookup from the parent to the child, not the other way around, 12:04PM 53pcarns robl: so the NO_FOLLOW option affects what it does when it hits the child 12:05PM 53pcarns robl: I think it is ok if the child is a symlink, doesn't really matter as long as its there robl pcarns: ah! that makes sense. thanks 12:13PM 53pcarns robl: np 02:39PM bradles phil 02:39PM pcarns hey 02:39PM pcarns bradles: so I am kind of torn about how those client params should work 02:40PM bradles well I don't even see how they would affect the clients 02:40PM pcarns 02:40PM bradles I mean, clearly you could add proto for them 02:40PM pcarns the clients pull the config files in their entirety from servers and parse them 02:40PM bradles but, yuck 02:40PM bradles how bout that 02:40PM pcarns the getconfig request already grabs the whole shebang 02:40PM bradles live and learn 02:41PM bradles so yea, stick em in there then 02:41PM pcarns if you really want to be afraid, look at how clients write those config files out in /tmp then parse them in and delete them :) 02:41PM bradles oh yeah -- that does suck 02:42PM bradles oh well 02:42PM pcarns the dotconf parser doesn't have hooks to operate on mem buf instead of fd, should probably fix one day 02:42PM bradles heh, I had assumed it was xml until yesterday 02:42PM pcarns doesn't seem like it would be that hard, but then again, hasn't really seemed to be a problem for anyone 02:43PM bradles yea, diskless clients suck :) 02:43PM bradles we're still playing the game over who reigns supreme on options tho 02:43PM bradles right now, romio is getting the last word on dfile entries 02:44PM bradles maybe hints continue to reign supreme 02:44PM pcarns hehehe - add a new "TrumpCard" option to config file 02:44PM bradles followed by config files 02:44PM bradles yeah 02:44PM bradles followed by code 02:44PM pcarns yeah, I generally tend to lean towards runtime options always winning over config files 02:45PM bradles sure 02:45PM bradles (tho there may be fairshare issues to consider on some options) 02:45PM bradles client retry limit pops to mind 02:46PM bradles and should default to 1 02:46PM bradles but I digress 02:46PM bradles actually should default 0 02:46PM pcarns for retries? 02:46PM bradles in my opinion 02:46PM bradles but no biggie -- they are off in my tree 02:47PM pcarns not all of us have redundancy in our tree- we like to retry :) 02:47PM bradles perhaps 02:47PM pcarns its actually handy to be able to get through server restarts, failovers, switch reboots, ... 02:48PM bradles well that is how I think of that mechanism 02:48PM pcarns but at least when its a config option everyone will get to have their way 02:48PM bradles once failover is there 02:48PM bradles then retries get cool 02:48PM bradles but I suppose ofr other transient errors they are ok 02:48PM bradles 02:48PM bradles I'm cool with doing the dist stuff 02:48PM bradles it will be like this I think: 02:50PM bradles 02:50PM bradles 02:50PM bradles param stuff 02:50PM bradles 02:50PM bradles param stuff 02:50PM bradles 02:50PM bradles 02:50PM bradles simple_Stripe 02:50PM bradles 02:50PM bradles 02:50PM bradles default_num_dfiles x 02:50PM bradles 02:50PM bradles obviously changed to however we spell stuff (humpltyback, etc) 02:51PM bradles cool? 02:53PM pcarns are you comfortable with the parser (server-config.c) needing to know names of supported dists? 02:53PM pcarns I guess really there aren't ever going to be all that many 02:53PM bradles oh, the parser would have to know the names in that case? 02:53PM bradles screw that 02:54PM pcarns beyond that looks good, though you will probably need to end sections for dists, (ala 02:54PM bradles I'll figure out a way of avoinding that 02:54PM bradles I've got all the names in strings 02:54PM bradles I assumed I could hunt them down 02:54PM pcarns you could just give those sections a generic name, then have a param that says name 02:54PM pcarns like the FileSystem block 02:54PM bradles yeah, that will probably do 02:54PM bradles no way am I putting names in the parser 02:55PM bradles I may actually want to use this someday :) 02:55PM pcarns it just has a followed by "Name foo" 02:55PM pcarns heh, ok 02:55PM pcarns yeah, the keyword (first word on line) has to be known by parser so it knows what to do when it encounters it 02:55PM bradles yeah, maybe multiple dist sections? 02:55PM pcarns beyond that it is free reign- you can pull value in as string and just chunk it somewhere 02:55PM bradles is that kosher 02:55PM pcarns yeah 02:56PM bradles yep, then that will be fine 02:56PM bradles 02:56PM bradles name simple_stripe 02:56PM bradles ... 02:56PM bradles good, now no one touches my dist code 02:56PM pcarns 02:56PM bradles my precious 02:57PM bradles (and I can make sure it really works ) 02:57PM bradles alright 02:57PM bradles later 02:57PM pcarns sweet 02:58PM pcarns I'll wait a few days for everyone's 2c, then start on the other config options if no objections 02:59PM 53pcarns robl: we have rest of our patches (lower priority ones) generated now, I suspect we can unload them maybe in a week or so 03:00PM bradles oh wait 03:00PM bradles there is an annoying catch 03:00PM bradles types 03:00PM bradles uggh 03:00PM pcarns you mean types on the way into dist interface? 03:00PM bradles maybe I should stick type information in the distribution, and then cast with a macro 03:00PM bradles uggh 03:00PM bradles yeah 03:01PM pcarns maybe let them ride as strings into dist functions? 03:01PM pcarns and do appropriate sscanf in each dist? 03:01PM bradles oh yeah, thats not bad 03:01PM pcarns instead of working type out outside? 03:01PM bradles I have the info (for encoding) anyway 03:02PM pcarns that actually hit me the other day after robr asked something on the list about the strip_size type problem 03:02PM bradles can sscanf core dump? 03:02PM pcarns but I forgot to email again 03:02PM bradles that would be my only serious concern 03:02PM pcarns core dump? 03:02PM pcarns I guess if it gets a string pointing at a not-happy memory location 03:03PM bradles yeah, if I read "xhgrft" into an unsigned int 03:03PM pcarns oh, no that won't core dump 03:03PM bradles then this will be safe 03:03PM pcarns you just need to check return code of sscanf to see how many items matched 03:03PM bradles yeah, thats no prob 03:03PM bradles tho now I have to write more dist code (uggh, and a macro at that) 03:03PM bradles no biggie 03:03PM pcarns just steer clear of the temptations of atoi and friends ;-) 03:03PM bradles I'll do it sometime next week 03:04PM bradles stoll 03:04PM bradles strtoll 03:04PM bradles I mean 03:04PM pcarns hehehe 03:04PM pcarns those are fun for the whole family 03:04PM bradles yeah, that sucker is no fun 03:04PM pcarns like a box of chocolates- never know what you end up with in your memory 03:04PM bradles I have to write test program every frickin time 03:04PM bradles the doc for that func is atrocious 03:05PM pcarns pete added a macro to help with scanf'ing 64 bit integers too 03:05PM bradles oh, is that hard? 03:05PM bradles no long long support? 03:05PM bradles %lld 03:05PM bradles %llu 03:06PM pcarns no, its just that scanf doesn't have a native type qualifier for 64 bit int- you just have to know to choose either long or long long depending on whether you have big words or small words on your architecture 03:06PM bradles 03:06PM pcarns so one arch or the other will warn, unless you have a macro that switches the qualifier 03:06PM bradles all are types are typedef'd from specific lengths I thought int32_t uint64_t 03:06PM bradles oh yeah 03:06PM bradles I see the prob 03:06PM bradles fucking word sizes 03:07PM bradles excuse my french 03:07PM bradles (since you left my vocab has taken a distinct downturn) 03:07PM pcarns hmm, where is that macro, I know I saw it on cvs log... 03:08PM pcarns that's what happens when clemson fellas go to the big city 03:08PM bradles Pint_util.h (please let it be pint-util and not pvfs2-req-proto) 03:08PM pcarns ah, SCANF_Ld, example is in pvfs2-cp.c now 03:09PM bradles cool 03:09PM pcarns its in pvfs2-types.h, the definition 03:09PM bradles ah, sweet 03:10PM bradles just the %Ld thing 03:10PM bradles 03:11PM pcarns basically just use SCANF_Ld if you want to read a signed 64 bit int 03:12PM pcarns need to make a SCANF_Lu if occasion arises to want to scan an unsigned one 03:12PM pcarns kind of like those Ld(...) and Lu(...) macros in reverse 03:12PM bradles so now hang on, are you sure that;s portable 03:13PM bradles what size is a long long on a 64 bit platform 03:13PM bradles I really have no idea 03:13PM pcarns i think the choice of types is portable, 03:13PM pcarns but not so sure that scanf/printf qualifiers are- I don't know if everyone outside of linux handles L or not 03:13PM bradles but we never use long longs 03:14PM bradles we use int64_t 03:14PM bradles scanf uses long longsx 03:14PM bradles whatever, if it breaks, it will break the same in cp and pete will fix it 03:14PM bradles or tell me how to fix it 03:15PM pcarns I think it will be ok 03:15PM bradles me to 03:15PM bradles cool 03:15PM pcarns at any rate, blame it on pw if not ;) 03:16PM pcarns I don't even have a 64 bit login anywhere that I know of, so I don't see what the hubbub is :) 03:16PM pcarns always works when I compile... 03:17PM bradles exactly 03:17PM bradles 32bits should be good enough for anyone 03:17PM bradles elitist jerks robl holly conversation! robl pcarns: that's cool about the patches. 03:27PM pcarns actually, just realized we probably need to get a patch in before any further fiddling with config file options 03:28PM pcarns cleans up parser, makes it stop on errors, show line numbers, check types.... 03:28PM pcarns I'll get on that robl pcarns: thanks for fielding jonh paris's question robl pcarns: i was still trying to figure out where dfile_count was being set in the kerenel interface :> 09:41AM pcarns heh- I'll probably get something useful out of it 09:42AM pcarns I need to figure out how to make small files work better too, so if he does a little testing it will be worth it :) robl pcarns: cool 11:07AM 53slang robl: /var/www/cgi-bin/tinderbox2/processmail_builds 11:07AM 53slang robl: /usr/local/tinderbox2/local_conf/BuildStatus.pm 11:09AM 53slang robl: lain:80/tinderbox2/ 02:42PM rross yeah fake tinderbox! robl rross: hey stranger 02:51PM rross i'll probably be on here more in the next couple of weeks. 53#pvfs2 57freat 36H ~freat h-69-3-229-184.chcgilgm.covad.net (ron s) 53#pvfs2 57bradles 36G ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57rross 36H ~rross hermit-10.mcs.anl.gov (gaim) 53#pvfs2 57pcarns 36H ~pcarns adsl-19-120-225.asm.bellsouth.net (gaim) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 53#pvfs2 57freat 36H ~freat h-69-3-229-184.chcgilgm.covad.net (ron s) 53#pvfs2 57pcarns 36H ~pcarns adsl-19-120-225.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.cpe.ga.charter.com (laytonj) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 11:31AM 53slang robl: www-data:/var/www/cgi-bin/tinderbox2/tinder.cgi 11:59AM freat hello 11:59AM freat besides the obviously googlable resources... can anyone point me to some other web resources on getting up to speed on PVFS2? 12:00PM freat got some university research lining up to implement pvfs2 on a linux cluster... 12:01PM freat also, I'm in Chicago... any of the Argonne people involved with the project here in Chicago? sure would be cool to get a discussion going as Loyola already has some relationship with Argonne... :) 12:35PM slang freat: hi - the www.pvfs.org/pvfs2 site is the main area for doc 12:35PM slang freat: the user and dev mailing lists might have some info for particular questions you have as well 12:39PM freat slang: thanks 12:39PM slang freat: I'm not aware of any other web resources .. sorry 12:42PM slang freat: the main contact at argonne for pvfs2 is rob ross (rross@mcs.anl.gov) -- best to email him with collaboration ideas 02:17PM slang Failure: lookup returned 376 when it should've returned 376. 02:17PM slang "that's a funny failure robl slang: someitmes i'll get "0 when should've retured 0", but I don't know how to reprocuce that 53#pvfs2 57freat 36H ~freat h-69-3-229-184.chcgilgm.covad.net (ron s) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl 63.170.133.110 (Rob Latham) 01:47PM bradles Here is a question for anyone: why by default do we build with -O2 ? robl bradles: not sure. i don't think anyone has quantitavitvely (too many ts and vs there) studied the effects of various CFLAGS 01:51PM bradles I believe I recall a day when it was not set, but I cannot be certain 02:11PM slang_ bradles: AC_PROG_CC adds -O2 by default if the compiler is gcc 02:11PM slang_ bradles: adds it to CFLAGS 02:12PM slang_ I'd be game for turning that off actually 02:13PM slang_ bradles: you can get around it by setting CFLAGS=-g before configure 02:15PM bradles hmm, I may try setting it in my environ then 02:17PM slang_ it makes sense that people will just do ./configure;make;make install so its good to have -O2 for performance, but removing -O2 from CFLAGS is harder than adding it in for the default case 02:18PM slang_ also, --enable-strict seems to be doing strange things (like adding -O2 to CFLAGS so that its there twice) 02:19PM slang_ is that carryover from mpich land? 02:22PM slang_ in any case I don't see how strict debugging should include compiler optimizations 50* 57robl didn't even know pvfs2 /had/ --enable-strict robl heh. the comment says "strict debugging" but we don't pass -g 02:23PM 53slang_ robl: right, but its already in CFLAGS anyway 02:24PM 53slang_ robl: AC_PROG_CC adds -g to CFLAGS if the compiler supports it 02:24PM 53slang_ robl: and then adds -O2 if its gcc.. 02:30PM bradles see, now here is my guess -- you can call me crazy -- the way the mechanism was chosen is someone worked on it, until it compiled. And then they quit. 02:30PM bradles no one at any point actually chose the flags that made sense 02:31PM bradles now I reserve the right to be totally wrong on that 02:39PM slang_ bradles: you're crazy! 02:39PM slang_ bradles: jk ;-) 02:39PM slang_ bradles: I hope that's not how it happened 02:41PM slang_ I can fire off an email to the developer's list with some suggested changes 02:41PM slang_ give everyone something to iterate on 02:42PM bradles it seems to me you know alot about this stuff, so I defer to your judgement 02:43PM bradles as long as you don't start moving up the -On ladder 02:43PM bradles at which point I will curse you 02:43PM slang_ bradles: ah, but you haven't tried -O12 yet have you.. 02:43PM slang_ bradles: you don't know what you're missing ;-) 02:43PM bradles I have not, its true 02:44PM bradles I would suspect that specifying things like march would give alot more mileage than O2 02:44PM freat uhhh... I used -03 on my gentoo install and thought that was pushing it 02:45PM bradles I would rather we explicitly turn inlining on, and O2 off 02:45PM bradles as I don't think O2 is doing me any favors the rest of the time robl give us another couple weeks and we can get a performance profile of optimized and un-optimized builds 02:46PM bradles (I know it does, I just don't think modest loop unrolling and reordering is going to gain us that much) robl considering we're usually disk bound, i think we could compile in the stupidest way possible and still be ok 02:47PM freat yeah but then my cluster of pentium pros would become the bottleneck (jk) 02:47PM bradles and that we are system call machines 04:06PM bradles slang_: +1 on your email 09:37AM slang_ Netjoined: 57irc.freenode.net brown.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 03:22PM elliot anyone around? robl? robl always robl elliot: what's up? 03:27PM elliot trying to build mpich2 with smpd and for some reason i'm missing smpd_version.h 03:28PM elliot it doesn't look like it gets generated by anything, at least not in the smpd directory 03:29PM elliot it is referenced by smpd.h robl that's a bug in the release. see http://www.mcs.anl.gov/web-mail-archive/lists/mpich-discuss/2005/06/msg00050.html and follow-up messages 04:16PM 53elliot robl: thanks...seems to be working now robl cool. no idea when a new release will come out, so you'll have to remember to make that patch yourself Connection closed from solar.clustermonkey.org: Success BitchX : Servers exhausted. Restarting. Connecting to port 20000 of server solar.clustermonkey.org [refnum 0] Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Tue Jun 28 10:06:18 2005 56localhost 36~robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Fri Jun 10 10:01:39 2005 52Users 32#pvfs2 50)] 54 localhost 54 robl_gaim 54 freat 54 pcarns 54ChanServ 54 slang_ 54 bougyman 54 elliot Channel #pvfs2 was created at Sun May 22 02:20:25 2005 BitchX : Join to #pvfs2 was synched in 0.176 secs!! robl_gaim ~robl@crushinator-57.mcs.anl.gov has left #pvfs2 SWAP: No such window: 4 SWAP: Window 3 is not hidden! 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 02:21PM bradles pcarns: is default num dfiles a StorageHint in the config 02:21PM bradles pcarns: or is it just under filesystem SWAP: Window 3 is not hidden! 02:30PM pcarns bradles: I think under filesystem 02:41PM bradles cool 02:51PM bradles pcarns: If I lookup a fs_config thru the hash in pint_cached_config, should I get the fully loaded config (it doesn't have my new default_num_dfiles struct member :( ) 02:52PM bradles but it does have trove_sync_meta!? 02:55PM pcarns bradles: I guess so- is the member missing altogether, or it just doesn't have the value in it? 02:56PM bradles it just doesn't ahve the value 02:56PM bradles tho it is set 02:57PM bradles or at least it is set during dotconf parsing I should say 02:58PM bradles where does the client parse the darn config -- at least then I can follow to the config being cached 03:00PM pcarns I really don't understand the flow of that code so well to be honest with you- I just gdb break on stuff to follow it 03:00PM bradles no prob 03:01PM bradles will do 03:01PM pcarns you setting a default value somewhere, in case the option isn't specified in the config file? 03:02PM pcarns I think that part happens in DOTCONF_CB(enter_filesystem_context) 04:07PM bradles pcarns: the config that the client receives and parses from the server is diffierent than the one stored in pint_cached_config calls 04:07PM bradles pcarns: now I know 04:07PM bradles mind you, I haven't figured out what config is in there yet, but it has a different address than the one parsed 04:08PM bradles (rebuilding without -O2 to find it now) 04:08PM bradles damn -O2 04:23PM pcarns ohhh, yeah 04:23PM pcarns the cached config thing is what keeps up with the handle mappings and such 04:23PM pcarns I think it has a "load" function of some sort that pulls the information it wants from the server config file 04:24PM bradles yeah, I'm on the trail 04:25PM bradles there is some weird stuff in the guts of the dot conf -- you know 04:25PM bradles not the parser, I mean the stuff we've added 04:25PM bradles but such is life 04:26PM bradles it seems like every time I make a 2 second change, it always takes me 2 hours to learn that soemthing isn't what I expected 04:26PM bradles its alot to memorize 04:27PM pcarns yeah, I know what you mean 04:27PM pcarns the config parsing stuff layered on top of dotconf usually throws me for a loop too 04:29PM bradles okay, found it 04:30PM bradles so what is the policy on the cached config 04:30PM bradles what should be in it? 04:30PM bradles if I make sure my config info is in there, is it safe? 04:30PM pcarns policy? whahahahahahaaa 04:31PM pcarns nah, seriously, I think thats a fine place to put it 04:31PM bradles well trove_sync_meta is set correctly in there, so I'm gonna do the same for mine then too 04:31PM pcarns there are already functions in that api like get_num_dfiles that are vaguely related 04:32PM bradles that is the function I'm chanign 04:32PM bradles it will check to see if the server overrides before letting dists have a shot at overriding 04:32PM pcarns ahhh, ok 04:32PM pcarns good 04:32PM bradles (this will make having as an fstab option easy I think too) 04:32PM bradles cool, its late in EDT 04:33PM bradles have a beer 04:33PM bradles heck, its late in CDT, I may have a beer 04:33PM bradles 04:34PM pcarns not a bad idea 04:34PM pcarns heh- look for the PINT_bucker_get_num_dfiles comment 04:34PM bradles its fixed 04:34PM bradles 04:34PM bradles don't worry 04:34PM bradles but yeah, pathetic typo from long ago 04:34PM bradles there's a hole in the bucket 04:36PM bradles so there is a new eclipse, can I finally get rid of emacs and use an IDE 04:36PM bradles anybody tried it, do I need a Cray to run it on still? 04:37PM pcarns Nathan actually works on it 04:37PM pcarns debardeleben, that is 04:38PM bradles yeah, he's apparently building plugins 04:38PM bradles rt? 04:38PM pcarns I've never tried it 04:38PM bradles I wonder if they have plugins named like nuclear_warhead or soemthing 04:38PM bradles all top secret and what not 04:39PM pcarns so far in this decade I have switched to a gui email reader- that's enough change for now 04:39PM bradles yes, and I remember the cursing 04:39PM bradles but your still using IMAP, so I'm not sure it counts 04:40PM bradles you should tell Nate to build a FrESH plugin for eclipse 04:40PM bradles or the EmulaSHun plugin perhaps 04:40PM pcarns hahaha- he probably would robl pcarns: wow, no more pine? 04:42PM pcarns robl: nope, I'm pimpin the thunderbird now robl cool. dunno what it'll take to get me off of mutt but the graphical mail readers are a lot better than netscape 4 (last one i used) 04:47PM pcarns it took having webmail access to get me off- that way I have a fallback from other computers 04:47PM pcarns well, imap and web mail 04:49PM bradles you guys need to recognize that red hat and gnu have decided that you should use gnome and read mail with evolution 04:50PM bradles if you keep trying to run other apps they're gonna make you take 1000 line config files with you everywhere you go 04:50PM pcarns red hat? those guys aren't out of business yet? :) robl i only use evolution because its calendar can sync with my phone robl and i don't care about 1000 line config files if i can access my cvs dotfile repository 04:50PM bradles oh dear god 04:50PM pcarns I only use thunderbird because it looks vaguely like firefox 50* 57robl loves his cross-platform, cross-host .zsh directory 04:51PM bradles no, I've almost retired my .Xdefaults, and I like it that way 04:51PM bradles it used to be enormous, now I'm not even sure my xterm setting even work anymore 04:51PM pcarns robl: man, not a bad idea- having to copy my .vimrc and .cshrc is almost enough to make me want to never switch jobs again 04:51PM bradles I just press buttons like a monkey to get things to work 04:52PM pcarns I still bugger up indentation sometimes because of some nether-computer that didn't get my vimrc robl pcarns: it's the only way to fly 04:53PM bradles see if I switch from emacs to eclipse, that's a whole lisp dialect I no longer have to remember 04:53PM bradles and 1 less config file 04:53PM bradles you guys are figting a losing battle 04:53PM bradles red hat will crush you both 04:54PM pcarns bradles: just because your config files aren't in text format doesn't mean they aren't there :) 04:54PM bradles all hail binary packages and configurations 04:54PM bradles really, I'm just a few wasted afternoons from just giving in and using windows pcarns ~pcarns@adsl-19-120-225.asm.bellsouth.net has left #pvfs2 bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Fri Jun 10 10:01:39 2005 52Users 32#pvfs2 50)] 54 robl 54 bougyman 54 elliot 54 slang_ 54 freat 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Channel #pvfs2 was created at Sun May 22 02:20:25 2005 BitchX : Join to #pvfs2 was synched in 20.873 secs!! Netjoined: 57irc.freenode.net brown.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang_ 36~slang@harley.mcs.anl.gov has joined #pvfs2 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 56bougyman 36bougyman@bougyman.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36~pcarns@adsl-19-120-225.asm.bellsouth.net has joined #pvfs2 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 10:24AM bradles I guess I'm going to add a field to PVFS_sys_mntent for the default_num_dfiles 10:25AM bradles any objections -- it is a system interface change technically 10:25AM bradles 10:27AM pcarns fine w/ me- I guess it will be an option in tab file? 10:28AM bradles yeah, robr wants it as both types of option 10:28AM pcarns sweet 10:28AM bradles num_dfiles=x in the tabfile will override the server setting 10:28AM bradles it "speeds" up metadata 10:28AM bradles which is the point I suppose 10:28AM pcarns sounds good to me- would be very useful to us too 10:29AM bradles setting distribution params is gonna be tricky, let me tell you 10:29AM bradles you set them in the server, but the changes have to be made on the client 10:29AM bradles uggh 10:29AM bradles ok, well phil's vote is enough for me, I'm changing sysint 12:47PM bradles all: is adding PVFS_util_get_mntent(fsid) to pvfs2-util.h (a global header) okay, or is there already a way to retrieve mntents? bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 pcarns ~pcarns@adsl-19-120-225.asm.bellsouth.net has left #pvfs2 09:38AM elliot anyone around? robl hey 09:48AM elliot trying to get mpich2 working with smpd 09:48AM elliot I get: unable to connect mpiexec tree, socket connection failed, error stack: 09:48AM elliot MPIDU_Socki_handle_connect(815): connection failure (set=1,sock=16777216,errno=111:Connection refused). 09:48AM elliot unable to post a write for the next command, 09:48AM elliot sock error: socket operation in progress, error stack: 09:48AM elliot MPIDU_Sock_post_writev(657): sock is in the process of being closed locally (set=1,sock=16777216) 09:49AM elliot unable to post a write of the close command to tear down the job tree as part of the abort process. 09:49AM elliot which I'm guessing that its trying to use the wrong rsh robl elliot: there's been a lot of discussion about smpd on mpich-discuss, but i've got no experience with it myself. i use mpd (even if it does introduce a python dependency) 09:51AM elliot i'm using smpd so that I can use mpich2 with sge robl elliot: you might be able to find something useful at http://www-unix.mcs.anl.gov/web-mail-archive/lists/mpich-discuss/threads.html , or failing that, dropping a line to mpich2-maint@mcs.anl.gov robl oh, i'm sure smpd is a good process manager for lots of situations. just saying i haven't played with it much 09:53AM elliot 56pcarns 36~pcarns@adsl-19-120-225.asm.bellsouth.net has joined #pvfs2 robl pcarns: thanks for the patches 12:05PM pcarns robl: you're welcome- I've got several more ready to send, but I'll probably group into a few emails 55christel 35christel@christel.staff.freenode 50)- [Global Notice] Hi again, Thanks for using freenode! As you are all aware today is the last day of the fiscal year, and also of the PDPC fundraiser. We are so close to hitting target. You can help us get there! Dig deep and help us raise the last $1200. If this is your first time making a donation, please read http://freenode.net/fundraiser.shtml . Thanks for the support and have a great day! 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Server Notice] Hi all.... please bear with us, christel's message will be repeating, to your server only 55christel 35christel@christel.staff.freenode 50)- [Global Notice] Hi again, Thanks for using freenode! As you are all aware today is the last day of the fiscal year, and also of the PDPC fundraiser. We are so close to hitting target. You can help us get there! Dig deep and help us raise the last $1200. If this is your first time making a donation, please read http://freenode.net/fundraiser.shtml . Thanks for the support and have a great day! robl pcarns: oooh, mounted-fs-detection.patch sounds very nice 01:19PM pcarns robl: I really like it :) not sure if you guys would or not robl i'm going to mull it over a bit but it seems like at the very least it'd be good to have as an undocumented feature' 01:21PM pcarns robl: make sure to catch the changes to quickstart if you want it to remain undocumented ;) robl holy crap! a documentation update patch too! 01:22PM pcarns I must have been bored that day, what can I say 01:26PM pcarns did someone trip over the power cord to BGL at Argonne? 01:26PM pcarns robl pcarns: big fat power outage last night robl pcarns: we get to find out this morning a: which machines are not on a UPS and b: which machines had hard drives on the verge of death (hint: they're now dead) 01:30PM pcarns ah, I remember b: being an issue up there in previous outages 01:30PM pcarns robl: you guys need little mini-ups's just for the hard drive motors robl i always forget about "unscheduled outages" when debating the merrits of solid state disks 01:34PM slang_ 02:06PM pcarns whew, that's all my patches 02:06PM pcarns David may have a couple more today or monday 02:07PM pcarns robl: that was a backlog of a few months, now I should be caught up and can turn the fire hose off 02:08PM pcarns well, actually there are a few more in the pipe for those config options we talked about on list, but it will be a bit before those come out robl ok, cool. if i'm going to meet the goal of pvfs2 releases every month, we'll probably roll all these in for a release july 10th and do a 1.1.1 robl or a 1.2.0. version numbers seem like such a silly thing to worry about pcarns ~pcarns@adsl-19-120-225.asm.bellsouth.net has left #pvfs2 56rross 36~rross@m010f36d0.tmodns.net has joined #pvfs2 robl rross: hey 05:17PM rross robl: hey. 05:17PM rross stuck in SFO airport for a few more hours. 05:18PM rross maybe i've got the bird flu; that would be notable. robl rross: yeah, that bird flu is all over germany... 05:19PM rross heh. you never know with these international conferences :). 05:19PM rross elliot: john's talk was really good. 05:23PM rross robl: someone's going to have to tell me how to read this tinderbox stuff when i get back.. 05:23PM rross slang_: you around? 05:23PM slang_ rross: yep 05:23PM rross whatcha been up to? 05:23PM slang_ rross: sittin in the kiddie pool right now.. 05:23PM slang_ rross: :-) robl rross: i'm trying to maek it more readable robl it's better now 05:23PM rross nice one! i'm sitting in the airport. not the same. 05:24PM slang_ rross: looking at attribute cache stuff 05:24PM rross robl: cool. seems like things are moving along. i've got some comments from users (on PVFS2 in general) all stored up for when i get back. 05:24PM slang_ rross: I think io is caching correctly now 05:25PM slang_ rross: the change I made is kind of..small 05:25PM rross slang_: was that "it"? Or are you talking about the readahead cache? Or am I missing something? 05:26PM slang_ rross: err.. 05:26PM slang_ rross: was that all I've been working on? 05:26PM slang_ rross: more or less yeah 05:27PM rross no, you said "I think io is caching ...", and I was making sure that was a typo, that's all. 05:27PM rross not trying to belittle your fine work :). 05:27PM slang_ pff 05:27PM rross dunno that acronym. 05:28PM slang_ pff? 05:28PM rross heh robl it means IT'S GO TIME! 05:28PM rross this is an unusually awkward conversation :). is neill here? 05:28PM slang_ that's just the sound my mouth wanted to make when I read that 05:29PM slang_ my understanding was that the io operation wasn't using the attribute cache correctly 05:29PM slang_ so that each io op had to do a getattr first 05:29PM slang_ and we wanted to fix that if possible 05:30PM slang_ so its true that it wasn't caching correctly 05:30PM rross ok, so you knocked that out then? 05:31PM slang_ I think so 05:31PM slang_ writing a test now that verifies 05:31PM rross excellent. there's a clear separation now between the distro stuff that doesn't need to be constantly updated and the other things that do? 05:31PM slang_ uh.. 05:32PM rross 05:33PM slang_ rross: no but I can look into doing that robl slang_: he does that all the time 05:33PM rross ok, how do we avoid the getattr? robl "hey, i did something cool!" "did you do ____ " "oh.... yeah, i'll fix that" :> 05:35PM slang_ rross: let me say what I understand to be happening and then you can clarify 05:35PM rross perhaps i do not show my appreciation as well as i should :)... robl hah! nah, it's all good 05:37PM rross slang_: ok... 05:37PM slang_ rross: flush,io,readdir and truncate all do a getattr-acache first and if there's a hit, that attr is used, if there's a miss, the getattr op happens 05:38PM slang_ a 'hit' right now is determined by the requested attr masks set and the cached attr masks set (if the attr exists in the cache at all) 05:39PM slang_ so as long as requested == cached for the masks, the cached attr is used 05:39PM slang_ I basically changed it to requested <= cached 05:39PM rross ok. that sounds like a good idea. 05:40PM rross (of course, we're not even turning it on by default right now, but we'll address that once we have our tests in place) 05:41PM slang_ how do you mean turning it on? 05:41PM slang_ decent timeouts? 05:42PM rross the acache is disabled at the moment, as i understand it. hold off on that for a second. the thing that i was referring to in the comment after the "excellent." was this: there is a timeout associated with the entry. that timeout only needs to apply to attributes that can change. ones that cannot, like the distro info, should not need to be re-read due to the attr cache timeout, but only often enough to ensure that the handle is still a valid one. 05:43PM slang_ hmmm...right 05:44PM rross that make sense? 05:44PM slang_ so you really want per-group timeouts 05:45PM slang_ groups being common, meta, data, sys 05:46PM rross hmm. well, there are two timeouts: the timeout that the user/admin requested (how long we're willing to let the mutable data go before updating), and a timeout related to the handle reuse timeout that ensures that we're not referring to a totally different object. everything that is mutable falls under the first timeout, the rest fall under the second timeout. the first timeout value can never be bigger than the second timeout value. 05:47PM rross i'm happy for you to implement it however you think is best :). 05:48PM rross hey we got the r&d100 for mpich2 btw. 05:48PM slang_ yeah ok robl rross: oh wow, that's pretty cool 05:49PM slang_ nice 05:49PM rross it seems reasonable to do per-group timeouts, yes. but i haven't really looked at it enough to make a good assessment of that. 05:50PM slang_ well I think you're right 05:51PM rross anyway, what you've done so far is a great first step, because it gets the io path in line with the rest and will reduce the number of getattrs. this stuff will just further reduce them. 05:51PM slang_ it seems like the requested mask is really only ever set to two values: COMMON_ALL|META_ALL and SYS_ALL 05:51PM slang_ the first being set by all the 'other' ops (io,truncate,readdir,etc.) 05:51PM slang_ the second being set by user calls to PVFS_sys_getattr 05:52PM rross what gets the distro information? 05:52PM slang_ META_ALL 05:52PM slang_ #define PVFS_ATTR_META_DIST (1 << 10) 05:52PM slang_ #define PVFS_ATTR_META_DFILES (1 << 11) 05:52PM slang_ #define PVFS_ATTR_META_ALL \ 05:53PM slang_ I guess the timestamps in COMMON are mutable 05:53PM slang_ and the perms 05:54PM slang_ hmm 05:54PM slang_ maybe just a different timout for META 05:54PM 50* 53rross/#pvfs2 resizes his window to see all slang's stuff 05:54PM rross yeah, i think you're right. 05:55PM slang_ the problem is that META is never requested by itself 05:55PM slang_ so we'll have to change that for that cases where only the distro info is needed 05:55PM slang_ for the cases 05:56PM rross right. i don't think that we really need anything else for the IO cases...that was the idea anyway. 05:57PM slang_ really? don't they need the COMMON stuff? ownership and perms and what not? 05:58PM slang_ dump access rights in the name of speed? 05:58PM rross hmm. well, that depends on how you look at it. the server is going to check permissions anyway. do we check permissions at io operations on the client too? 06:00PM slang_ dunno if the code checks client side at present 06:01PM rross yeah, i'm tempted to eschew (i like that word) getattrs at io time to boost performance. if we don't we are going to be checking permissions all the damn time. 06:01PM slang_ fine with me 06:02PM rross is there any reason why we shouldn't do that? actually it isn't the case that the server is going to check -- it cannot check permissions on datafiles. 06:02PM rross (there are no permissions stored for datafiles) 06:03PM rross so we would be implementing a policy where it is possible for a user to grab the datafile handles with a getattr and then do IO even if the permissions are changed. that's ok. 06:04PM rross we would want to check permissions at least once in there though! 06:05PM slang_ how tested is this stuff in multiuser environments? 06:06PM rross some. phil and them test it pretty thoroughly i think, particularly permission issues. it might be worth bringing this up on developers and see if they have any input on this? 06:07PM slang_ rross: ok 06:08PM rross i asked him today what tests they're using; i think maybe some of the linux fs tests. hopefully he'll point us to something. 06:09PM rross ok, i'm gonna go find some water and take some medicine. being sick in airports (and planes for that matter) sucks. robl drop some tests in test/automated/vfs-tests.d robl that'll be a good meta test... can we take phil's tests and w/o much work drop them into this testing infrastructure 06:10PM rross hope we can! see ya all either on sunday or on tuesday. later. rross ~rross@m010f36d0.tmodns.net has left #pvfs2 06:10PM slang_ ciao 56bougyman_ 36bougyman@bougyman.com has joined #pvfs2 SignOff 57bougyman : #pvfs2 Read error: 131 (Connection reset by peer) SignOff 57freat : #pvfs2 Read error: 110 (Connection timed out) 57slang_ is now known as 36slang 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 10:25AM bradles robl: 10:25AM bradles slang: 10:26AM bradles It looks like the remove mntent is only used when unmounting a filesystem 10:26AM bradles which is good, as you unmount it and then try to create a file on it, well screw you 10:28AM bradles I am still going to have to mutex util_get_mntent (the add function effectively does a realloc), but I don't guess that's a major deal 10:29AM bradles (and during initialization if there was an error during init) 10:44AM bradles Nope, even as written, its unsafe -- darnit 02:27PM elliot when running nc_test from pNetCDF should I have to pass it any arguments? robl first you run nc_test -c to create 'test.nc' robl then you can run nc_test (yep, with no args) robl you have to run it with only one processor. we did port it from serial netcdf but didn't add any parallelism to it bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 57bougyman_ is now known as 36bougyman 56pcarns 36~pcarns@adsl-34-59-151.asm.bellsouth.net has joined #pvfs2 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57pcarns 36H ~pcarns adsl-34-59-151.asm.bellsouth.net (gaim) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) pcarns ~pcarns@adsl-34-59-151.asm.bellsouth.net has left #pvfs2 bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Tue Jul 5 22:54:27 2005 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Fri Jun 10 10:01:39 2005 52Users 32#pvfs2 50)] 54 robl 54 bougyman 54ChanServ 54 elliot 54 slang Channel #pvfs2 was created at Sun May 22 02:20:25 2005 BitchX : Join to #pvfs2 was synched in 0.286 secs!! #pvfs2 [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 56pcarns 36~pcarns@adsl-34-59-151.asm.bellsouth.net has joined #pvfs2 robl pcarns: got any more patches in the pipeline? robl pcarns: i realized last night that if i want to keep my "montly releases" plan, we'll have to make a release monday 09:29AM 53pcarns robl: we have some more, but we won't get them to you in time robl (i think that's gonna slip at this point) robl cool 09:29AM 53pcarns robl: you've got the biggest chunk already robl excellent. man, it's great to have you guys contributing 09:30AM pcarns thanks SignOff 57bougyman : #pvfs2 Read error: 131 (Connection reset by peer) 56bougyman 36bougyman@bougyman.com has joined #pvfs2 09:33AM slang pcarns: hey 09:33AM slang pcarns: how goes? 09:35AM 50* 53slang/#pvfs2 | That way the compiler lets you know if you forget to fill in a parameter 09:35AM slang pcarns: how do the PINT_SERVREQ_*_FILL macros do that? 09:39AM pcarns slang: hey 09:39AM pcarns slang: can we talk about the state organization real quick first? 09:39AM pcarns slang: I think we are thinking the same thing but maybe I am saying it wrong :) 09:40AM slang pcarns: sure 09:40AM pcarns slang: so suppose I am in a state machine (say sys_truncate) 09:40AM pcarns slang: what would that state machine do to retrieve the attributes for the object it wants to operate on? 09:40AM pcarns slang: what does it call/jump to/whatever? 09:41AM slang it would first jump to the getattr nested sm 09:42AM pcarns slang: does it have to do anything after that, or is that it? 09:42AM slang if that fails, it would go to truncate_cleanup 09:42AM pcarns ok, cool 09:42AM pcarns sounds good, sorry about confusion on last email 09:43AM slang but I was going to remove the acache set valid stuff from truncate_cleanup 09:43AM pcarns I wasn't sure what the diagrams were of- nested machine or sys_getattr, or what 09:43AM pcarns awesome 09:43AM slang as that would happen in.. 09:43AM slang yeah - I guess I didn't make that clear..sorry 09:43AM pcarns no prob 09:43AM slang its a nested state machine .. call it getattr-dowork 09:43AM pcarns ok, back to macro thing? 09:44AM slang and the getattr sm would just jump to the getattr-dowork 09:44AM pcarns cool 09:45AM slang right - so the *_FILL macros push variable init checking to compile time somehow? 09:46AM pcarns I'm making that issue more complicated than it should be :) , 09:46AM pcarns so I was originally thinking, that probably you have some fields you need to set in sm structure before jumping to nested machine 09:46AM slang yes 09:46AM pcarns I dunno, like s_op->getattr_handle, or s_op->getattr-dowork.handle, etc. 09:47AM pcarns and maybe if there are a couple of things, then someone using it just needs to remmember to fill in the various fields 09:47AM slang ok.. 09:47AM pcarns the alternative is to have a macro, like FILL_GETATTR_DOWORK_FIELDS(handle, fsid, mask ...) 09:48AM pcarns that way, if you decide later that you need another parameter, then macro must change 09:48AM pcarns and all instances calling macro will break at compile time because lacking argument 09:48AM slang ah ok 09:48AM pcarns wheras if setting fields directly, it will be less obvious where instances need to change, some places just will have an uninitialized fields 09:48AM slang right 09:49AM pcarns I dunno if that's really a good idea or not, the reason its on my mind 09:49AM pcarns is in a pvfs2 tree I hacked on for my dissertation I had a ton of nested machines 09:49AM pcarns and it was confusing to remember what needed to be set on the way in, and what could be read on the way out 09:50AM pcarns your case isn't as big a deal since we are just talking about a fairly consistently used sm when you are done, 09:50AM pcarns but it might set a precedent for future nested machines to follow :) 09:50AM slang the client_sm struct has the union of different operation handles, but that doesn't seem to take care of nested machines well 09:51AM slang or 'nested operations' I guess is what I mean 09:51AM pcarns yeah, nested sm's like msgpair have gotten around that so far by sticking things outside of the union 09:51AM slang as in the getattr case 09:52AM pcarns just putting a little struct in the s_op structure but outside of the union is about the only short term way to do it 09:52AM slang yeah 09:53AM slang seems like it clutters it up 09:53AM pcarns yeah, pretty much 09:53AM slang heh 09:53AM pcarns one possible solution, but would take a lot of work 09:53AM pcarns I had an issue where I had server state machines that needed to call nested machines from other operations 09:54AM pcarns where those nested machines were accessing things in the union already, and I didn't really want to change 09:54AM pcarns what you end up wanting to do is make a copy of the whole sm structure and put it in a stack 09:54AM pcarns then modify what you want, run nested sm, grab outputs, and switch back to old sm structure 09:55AM pcarns sort of like a function call in a programming language or something 09:55AM slang hmm 09:55AM slang I guess that would get expensive? 09:56AM pcarns IMHO I don't think so 09:56AM pcarns the sm struct is big, but not ridiculous, especially if more things coudl be put in union after the change 09:57AM slang what about just copying the union and putting that on the stack? 09:57AM pcarns that would work 09:57AM pcarns probably- most likely any change like this will break some state machine or another, but fixable 09:58AM slang I like the idea 09:58AM pcarns IMHO its ok to just go with seperate struct for now and then come back later and tackle this general purpose stack of unions issue 09:59AM slang that sounds like a good plan 09:59AM pcarns something like this is one of the pieces that would help towards being able to merge in some of my dissertation stuff (server to server communicating operations) 10:00AM pcarns the other piece would be having parallel steps/transitions in a state machine, but that's another whole tangent :) 10:01AM pcarns both of those things I did in my hacked tree, but in a very non-elegant way to get by- I think it could be done cleanly with some changes to the state machine infrastructure 10:01AM slang 10:02AM slang pcarns: is that a branch of the main pvfs2 repos or your own archive? 10:03AM pcarns seperate archive 10:04AM pcarns pretty far out of date now 10:04AM pcarns I was just mirroring the tree and doing occasional vendor merges at the time 10:04AM slang ok cool 10:05AM slang I'll add those things to a todo list we have going 10:05AM pcarns I think the project is called pvfs2-pcarns, in parl repository 10:05AM pcarns great! 10:06AM slang pcarns: thanks for your help! 10:06AM pcarns slang: no, thank you! SWAP: No such window: 4 SWAP: Window 3 is not hidden! 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57pcarns 36H ~pcarns adsl-34-59-151.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24.196.226.167 (laytonj) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57pcarns 36H ~pcarns adsl-34-59-151.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24.196.226.167 (laytonj) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 03:50PM slang if (trimmed_mask & PVFS_ATTR_DATA_SIZE) 03:50PM slang { 03:50PM slang trimmed_mask &= (PVFS_ATTR_META_ALL | 03:50PM slang PVFS_ATTR_DATA_SIZE | 03:50PM slang PVFS_ATTR_COMMON_ALL); 03:50PM slang } 03:50PM slang else 03:50PM slang { 03:50PM slang trimmed_mask &= (PVFS_ATTR_META_ALL | 03:50PM slang PVFS_ATTR_COMMON_ALL); 03:50PM slang } pcarns ~pcarns@adsl-34-59-151.asm.bellsouth.net has left #pvfs2 05:23PM slang am I missing something or is that equiv to: 05:23PM slang trimmed_mask &= (PVFS_ATTR_META_ALL | PVFS_ATTR_COMMON_ALL); 05:27PM slang /* 05:27PM slang if a size was requested, we also need to match 05:27PM slang the data size related bits when checking attrs; 05:27PM slang PVFS_ATTR_DATA_SIZE was specially added by 05:27PM slang sys-getattr.sm setup msgpair if size is requested. 05:27PM slang */ 05:27PM slang that's the comment above the if/else 05:31PM slang # version control systems 05:31PM slang # 'TinderDB::VC_CVS', 05:31PM slang # 'TinderDB::VC_Bonsai', 05:31PM slang # 'TinderDB::VC_PVCSDimensions', 05:31PM slang # 'TinderDB::VC_Perforce', 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57laytonj 36H ~laytonj 24.196.226.167 (laytonj) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) SignOff 57laytonj : #pvfs2 "Leaving" 08:21PM 32christel:* Hi everyone, I just wanted to share with everyone that I am currently the luckiest woman alive, and on November 5th I will become Mrs. McBratney 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 56pcarns 36~pcarns@adsl-34-59-151.asm.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-34-59-151.asm.bellsouth.net has left #pvfs2 56pcarns 36~pcarns@adsl-34-59-151.asm.bellsouth.net has joined #pvfs2 11:38AM slang /* 11:38AM slang if a size was requested, we also need to match 11:38AM slang the data size related bits when checking attrs; 11:38AM slang PVFS_ATTR_DATA_SIZE was specially added by 11:38AM slang sys-getattr.sm setup msgpair if size is requested. 11:38AM slang */ 11:38AM slang if (trimmed_mask & PVFS_ATTR_DATA_SIZE) 11:38AM slang { 11:38AM slang trimmed_mask &= (PVFS_ATTR_META_ALL | 11:38AM slang PVFS_ATTR_DATA_SIZE | 11:38AM slang PVFS_ATTR_COMMON_ALL); 11:38AM slang } 11:38AM slang else 11:38AM slang { 11:38AM slang trimmed_mask &= (PVFS_ATTR_META_ALL | 11:38AM slang PVFS_ATTR_COMMON_ALL); 11:38AM slang } 11:39AM slang pcarns: thats from getattr-acache.sm 11:39AM slang pcarns: it seems like that if/else block is equivalent to: 11:39AM slang trimmed_mask &= (PVFS_ATTR_META_ALL | PVFS_ATTR_COMMON_ALL); 11:39AM slang pcarns: but the comment suggests otherwise.. 11:40AM slang pcarns: I guess i'm confused what the desired goal is 11:40AM slang pcarns: any idea? SignOff 57pcarns : #pvfs2 Read error: 113 (No route to host) SignOff 57laytonj : #pvfs2 "Leaving" 31ctcp 51me 50)] PING 57me No such nick/channel 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-80.asm.bellsouth.net has joined #pvfs2 03:22PM pcarns slang: you there? 03:22PM pcarns slang: just looked at that "trimmed_mask" stuff from yesterday 03:22PM pcarns slang: I have no idea what its trying to accomplish 03:23PM pcarns slang: DATA_SIZE mask doesn't go together with META masks 03:23PM pcarns those are masks for two different types of objects robl pcarns: i think it's going to take me a week or so to get the release out robl i'd like to get all acxiom patches in 04:01PM pcarns okdoke 04:02PM pcarns we've posted all we will have until at least late next week 04:04PM slang pcarns: replied via email 04:05PM pcarns slang: yep, gotcha 04:05PM pcarns I don't think I have any extra insight on the intention, really 04:05PM pcarns but I'll be happy to help test when you have something that should mostly replicate the right behavior 04:06PM slang :-) 04:06PM slang pcarns: cool, thanks pcarns ~pcarns@adsl-218-105-80.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3608:16pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3608:20pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3608:24pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57elliot : #pvfs2 Remote closed the connection 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 Netjoined: 57irc.freenode.net tolkien.freenode.net 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 Netjoined: 57irc.freenode.net tolkien.freenode.net 56bougyman 36bougyman@bougyman.com has joined #pvfs2 56elliot 36~elliot@babylon.physics.ncsu.edu has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-80.asm.bellsouth.net has joined #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57pcarns 36G ~pcarns adsl-218-105-80.asm.bellsouth.net (gaim) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) pcarns ~pcarns@adsl-218-105-80.asm.bellsouth.net has left #pvfs2 robl dang 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57bougyman 36H bougyman bougyman.com (IT Specialist) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) bougyman bougyman@bougyman.com has left #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36~pcarns@adsl-218-105-80.asm.bellsouth.net has joined #pvfs2 robl pcarns: hey, got any ideas about find(1) and st_nlink? 09:48AM pcarns hmm 09:48AM pcarns I don't know, actually 09:48AM pcarns I guess we need to try it and see 09:49AM pcarns I can test that out tonight or tomorrow robl pcarns: ok, cool. didn't know if you had something set up already 09:52AM 53pcarns robl: nah, I didn't think to look at that robl pcarns: ok, cool. i'll test it here 09:52AM pcarns I wonder what happens on pvfs1 since it keeps the link count at 1 09:53AM pcarns it might actually be better, maybe find ignores st_nlink if it doesn't make sense :) robl we'll find out soon enough. gonna run through metheney's mkdir patch and then i'll test on our beater boxes 10:11AM 53pcarns robl: thanks for working on all these patches! robl well it's not like robr's gonna do it. he's too busy chillin' with the president :> NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3610:26am BitchX : Press to see who left to change to [irc.freenode.net] 10:31AM pcarns chillin' with the president? robl http://www.prnewswire.com/cgi-bin/stories.pl?ACCT=104&STORY=/www/story/06-14-2005/0003870975&EDATE= robl so he got to meet george bush for a little bit 10:38AM pcarns ahh, neat- I had heard about award but didn't no he got to meet bush robl pcarns: any damage from the edge-of-dennis rains? 10:53AM 53pcarns robl: not much where I live, except my tomato plant is a little crooked :) 10:54AM 53pcarns robl: the one before dennis hit a few things though, atlanta motor speedway actually had a tornado or something tear it up 10:55AM pcarns I guess that was "Cindy" robl tomato plant? dang man, you got all domestic-like real fast robl (but hey, fresh tomatos!) 10:58AM pcarns robl pcarns: ok, so with st_nlink at 2, find won't work as expected w/o -noleaf robl trying now w/ st_nlink held at 1 robl yeah, that seems to work better 12:35PM 53pcarns robl: hunh, that's interesting robl indeed! SignOff 57ChanServ : #pvfs2 ACK! SIGSEGV! 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net robl pcarns: hey, so rob was ok w/ your safe rename patch, even though it added a couple extra operations in the worst case, right? 01:16PM pcarns I think so 01:16PM pcarns I think its worth it to make that operation less scary 01:17PM pcarns we'll get spanked when somone publishes the pvfs2 vs. lustre rename paper 01:17PM pcarns robl hm. we don't have any rename tests really robl pcarns: heh, with your safer-rename patch, the dot representation of sys-rename.sm is pretty crazy 01:36PM pcarns muahahahha robl pcarns: hey, do you remember if viewcvs was ever running on parl? 01:49PM pcarns I don't think so 01:49PM pcarns it might have been once as a trial run or something, but we never had anything like that up permanently robl pcarns: totally unrelated, i'm really digging paper mario on the gamecube 02:12PM 53pcarns robl: cool! 02:12PM 53pcarns robl: I started playing res. evil 4 the other day 02:13PM 53pcarns robl: its really fun too, but completely different kind of fun of course :) robl pcarns: i'm waiting for it to hit players choice pricing, but it's defintiely on my list pcarns ~pcarns@adsl-218-105-80.asm.bellsouth.net has left #pvfs2 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 07:31AM nextgens hi :) robl hello 08:48AM 50* 53nextgens/#pvfs2 is fighting against the bmi_ib module 08:48AM nextgens I can t get it compiling with Topspin s includes :/ 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 robl nextgens: hey, you should mail pvfs2-users@beowulf-underground.org w/ the errors you're seeing robl slang: http://www.sueandpaul.com/gmapPedometer/ 11:35AM 53slang robl: that's really cool 50* 57robl is a big ol' mapping nerd nextgens ~nextgens@jabber.hst.ru has left #pvfs2 SWAP: Window 3 is not hidden! 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elliot 36H ~elliot babylon.physics.ncsu.edu (Elliot Peele) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl slang: you're missing out, man... anthony and thomas are chillin' out in d-247 04:56PM 53slang robl: is that our office numba? 04:56PM 50* 53slang/#pvfs2 can never remember robl slang: yeah, our office 04:58PM 53slang robl: dont let them eat all the candy! robl slang: they only got away with a little robl but next time i'll be ready! 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 04:07AM nextgens 05:46AM nextgens [11:45:23.733565] Error: bad magic in BMI TCP message. 05:46AM nextgens do you know what does it mean? 56pcarns 36~pcarns@adsl-218-105-80.asm.bellsouth.net has joined #pvfs2 09:00AM 53pcarns robl: hey, sorry about that patch 09:00AM 53pcarns robl: I'm about to start looking at it here 09:53AM 53pcarns robl: I see the problem, I'll post a fix on the list in a few minutes 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 nextgens ~nextgens@jabber.hst.ru has left #pvfs2 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 SignOff 57nextgens : #pvfs2 Remote closed the connection pcarns ~pcarns@adsl-218-105-80.asm.bellsouth.net has left #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36~laytonj@24.196.226.167 has joined #pvfs2 robl pc: wow, that was fast robl pc: been away today. closed on a house robl of course phil's not online SignOff 57laytonj : #pvfs2 "Leaving" 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 56synchro 36~defseg@athe730i-4291.otenet.gr has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56synchro_ 36~defseg@athe730i-4291.otenet.gr has joined #pvfs2 nextgens ~nextgens@jabber.hst.ru has left #pvfs2 SignOff 57synchro : #pvfs2 Nick collision from services. 57synchro_ is now known as 36synchro SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) SignOff 57laytonj : #pvfs2 "Leaving" 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 SignOff 57nextgens : #pvfs2 Remote closed the connection SignOff 57slang : #pvfs2 Remote closed the connection 56nextgens 36~nextgens@jabber.hst.ru has joined #pvfs2 09:11AM nextgens nextgens ~nextgens@jabber.hst.ru has left #pvfs2 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 56pcarns 36~pcarns@adsl-218-105-80.asm.bellsouth.net has joined #pvfs2 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) pcarns ~pcarns@adsl-218-105-80.asm.bellsouth.net has left #pvfs2 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3611:50am BitchX : Press to see who left to change to [irc.freenode.net] 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) SignOff 57elliot : #pvfs2 "reboot" 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 60 (Operation timed out) 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 57synchro_ is now known as 36synchro 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 110 (Connection timed out) 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 110 (Connection timed out) 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 110 (Connection timed out) 56sadleder 36~sadleder@p54A230D8.dip0.t-ipconnect.de has joined #pvfs2 56K1 36~K1@D857a.d.pppool.de has joined #pvfs2 06:32AM sadleder Hi guys SignOff 57K1 : #pvfs2 "You will soon forget this." 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 56synchro 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 SignOff 57synchro_ : #pvfs2 Read error: 110 (Connection timed out) 53#pvfs2 57synchro 36H ~synchro athe730i-4303.otenet.gr (obscure spectre) 53#pvfs2 57sadleder 36H ~sadleder p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl sadleder: hi 09:59AM 53sadleder robl: hi, i think i was writing while you were still asleep ;-) 10:01AM 53sadleder robl: what about exposing distribution information and parameters through vfs extended attributes? this would the possibily to set such params even while posix file access 10:14AM sadleder do you think this is a reasonable feature request? 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 robl sadleder: it's a good idea, and now that walt comitted his extended attribute stuff the first part is in place robl sadleder: but i don't think we have the manpower for that just now. once we get mpi-io stuff in place and exercised, then we can focus on vfs robl sadleder: but you should bring it up on the mailing lists and see if it gets someone fired up 10:33AM 53sadleder robl: ok. now as you mention vfs: maybe it would be way easier to use fuse for the vfs layer robl sadleder: we've thought about it robl sadleder: our kernelspace-userspace bridge is tailored for pvfs2, so doesn't have some of the overhead of the more general purpose fuse. robl sadleder: however, fuse has see a *lot* of developent over the last year, so it might be worth comparing robl sadleder: like everything else, it's manpower... if someone wants to write a fuse plugin for pvfs2 and benchmark fuse against our pvfs2-client stuff, that would be very interesting to see 10:35AM 53bradles robl: how does seteattr relate to distribution info? 10:35AM 53sadleder robl: i think it could be easier to use for userspace installations of pvfs2 robl bradles: sadleder suggested eattrs might be a way to get/set distribution information robl bradles: but since i know not much about etiehr eattrs or distribution stuff, i can't evaluate if that's practial 10:37AM bradles personally, I can't see how they are related, but that might just be my own limitation :) 10:39AM sadleder bradles: i thougth you could expose distribution information as xattrs. there is now relation, but i suggested to build one up ;-) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57synchro 36H ~synchro athe730i-4303.otenet.gr (obscure spectre) 53#pvfs2 57sadleder 36H ~sadleder p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 10:40AM bradles sadleder: I'm weaker on the real fs stuff than the distribution stuff, but file attributes can be modified at any time, correct? 10:43AM bradles sadleder: well at any rate, modifying the distribution after the file is created is a tricky business. Walt and I have discussed that as a research topic before. 10:43AM bradles but I defer to other's more informed judgements 10:44AM bradles 10:44AM sadleder bradles: yes, sure. 10:45AM sadleder bradles: what das walt's eattr stuff do atm? 10:46AM bradles sadleder: allows you to set extended attributes and delete them for a file 10:46AM bradles sadleder: just name value pairs, no relevance to how the file behaves 10:47AM sadleder bradles: ah, and where do you store such information? 10:47AM bradles sadleder: In my replication code I use the eattrs to maintain consistency info -- but that code isn't in the main tree. TMK that is the only example thus far of eattrs changing system behavior 10:49AM bradles sadleder: in the berkeley db for each object 10:49AM bradles sadleder: hmm, I have no idea how they get looked up 10:49AM bradles I'll have to ask walt this afternoon 10:51AM sadleder bradles: ok, maybe it could be of use to be able to set dist settings through the VFS, at least it would be nice 10:51AM bradles sadleder: no doubt about that 10:52AM bradles sadleder: just not sure if eattrs are exactly what you want since distribution is set at file creation time 10:55AM sadleder bradles: ok, i see. 10:59AM sadleder bradles: will eattrs get exposed through the kernel module? 10:59AM bradles sadleder: I'm not so much involved on the VFS stuff, so I don't know 11:00AM bradles sadleder: a quick perusal of the code seems to indicate that file wide eattrs are set on the metaserver -- which makes sense I think, will get a confirm later 11:00AM sadleder bradles: ok, cu. 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57synchro 36H ~synchro athe730i-4303.otenet.gr (obscure spectre) 53#pvfs2 57sadleder 36H ~sadleder p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 11:01AM bradles sadleder: you can set the default distribution and params in the server config file now (in CVS) 11:03AM sadleder bradles: this is a major step forward. 11:08AM bradles sadleder: well i hope it helps some people -- you can also set the default number of objects created per file 11:09AM bradles I've not seen any careful studies of how these options affect performance, but hopefully they help someone robl bradles: hey, is everything ok at clemson? robl cvs [checkout aborted]: connect to cvs.parl.clemson.edu(130.127.210.68):2401 failed: Connection timed out 11:10AM 53sadleder robl: Same at my site 11:11AM bradles No, clemson is down 11:11AM bradles 11:11AM bradles I'll tell walt 56synchro_ 36~synchro@athe730i-4303.otenet.gr has joined #pvfs2 11:13AM bradles so, all the outlets in the lab are currently putting out 55 volts 11:13AM bradles thus all the machines are not really working robl oh man that can't be good 11:14AM bradles Will is currently moving a machine to see if our new router is currently able to handle machine reloc 11:14AM bradles if so, we may have cvs by end of today 11:15AM bradles yeah, somehow I don't think our cluster is running so well withonly 55 volts 11:16AM bradles but hopefully just moving the fileservers is no big deal 11:16AM bradles so probably no mailing lists or CVS until this afternoon SignOff 57synchro : #pvfs2 Read error: 110 (Connection timed out) 11:16AM bradles sorry! SignOff 57sadleder : #pvfs2 "Verlassend" SignOff 57synchro_ : #pvfs2 "traveling without moving" 03:09PM bradles cvs is available again 03:09PM bradles no mailing lists yet 03:10PM bradles if cvs breaks again, let me know and I'll try to find out why 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl bradles: cool, thanks for the update 03:27PM slang bradles: thanks 03:46PM bradles the mailing lists should be available as well 03:48PM bradles well, maybe I better not get ahead of myself just yet 03:49PM bradles Okay yes, the mailing lists are back SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 56freat 36~freat@h-69-3-229-184.chcgilgm.covad.net has joined #pvfs2 SignOff 57freat : #pvfs2 Remote closed the connection SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36~yf@61.149.48.36 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 56sadleder 36~sadleder@p54A22958.dip0.t-ipconnect.de has joined #pvfs2 SignOff 57sadleder : #pvfs2 Client Quit 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl kraken: you've got a lot of patience with that dude robl http://catandgirl.com/view.php?loc=270 01:24PM kraken it's sad to explain fread over and over again 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56sadleder 36~sadleder@p54A23AAD.dip0.t-ipconnect.de has joined #pvfs2 SignOff 57sadleder : #pvfs2 Client Quit 56sadleder 36~sadleder@p54A23AAD.dip0.t-ipconnect.de has joined #pvfs2 sadleder ~sadleder@p54A23AAD.dip0.t-ipconnect.de has left #pvfs2 57"Verlassend" robl 1,who robl dur 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 01:13PM 53laytonj robl: Are you around? robl laytonj: hey 01:41PM 53laytonj robl: Got a couple of questions for an article. 01:41PM laytonj If I run PVFS over GigE on a single node to 8 clients, will I see better throughput than using NFS? 01:42PM kraken I can answer that 01:42PM kraken Nope! 01:43PM bradles What if the clients were doing really large reads and writes? 01:44PM laytonj How many data servers would I need so that PVFS was faster than NFS? 01:44PM kraken in my experience, it depends more on the number of clients you're hitting it with 01:44PM kraken but you can't really consider PVFS a PVFS without multiple servers 01:44PM kraken since the P is missing in that case 01:45PM kraken I had some graphs at one point of PVFS vs. NFS performance, and once you passed 10 clients (100mbit, servers on gige) PVFS started blowing away NFS 01:46PM laytonj how many servers? 01:46PM kraken I'd think that even if you only had 2 PVFS servers, once the bandwidth of clients exceed the bandwidth of your server(s) you get wins with PVFS 01:46PM kraken 16 I think 01:47PM kraken but as I said, it really depends more on how much your clients can pull 01:47PM kraken if everything is gigE, 1 NFS server and 10 clients, your aggregate bandwidth can't exceed 1gbit 01:48PM laytonj I've got to run. Can you send an email to me with these numbers? laytonjb@charter.net 01:48PM laytonj Thanks! 01:48PM kraken if you put pVFS even on 2 servers, you just doubled that aggregate bandwidth robl uh.. yeah, what kraken said :> 02:05PM bradles shouldn't pvfs have less overhead than nfs on large reads and writes? (I guess you could crank rsize and wsize thru the roof -- but no one does) 02:08PM kraken most likely... the highest you can go with r/wsize on Linux is 32kb, I think 02:09PM kraken (and only on NFS over TCP, iirc) 02:10PM kraken buuuut 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 02:10PM kraken since NFS is going to act the same way as PVFS in the generic case (VFS caching on the server-side) 02:11PM kraken you probably won't notice that much of a difference 02:12PM bradles do you guys use mpi-io to access pvfs (or is that need to know type stuff)? 02:13PM bradles I would guess without mpi-io, the number of clients and servers needed to see improvement with PVFS is much greater 02:13PM bradles but with mpi-io, probably not so much 02:14PM bradles (I recognize that laytonj was probably not talking about parallel access) 02:14PM kraken no mpi here robl bradles: in the single server case we can pretty easily saturate the network link (i think) robl so you need multi servers and then you're limited by bisection bandwidth of the switch 02:15PM kraken that's what I've seen - with a single server you pretty much max it out just as much as NFS does robl there was that one dude who was doing 10 gig e to the switch and gig e to the clients. *that's* an interesting situation 02:15PM bradles I haven't tried GigE, so I can't comment emphatically, but I think it depends on the interconnect 02:16PM kraken I'd start to wonder about disk speeds at that point :) 02:16PM bradles PCI bus 02:16PM kraken the interconnect makes a big difference in the sense of "how many clients does it take to saturate the combined server bandwidth" 02:17PM kraken if clients are 100mbit, it takes a lot more of them to saturate gigE connected servers 02:17PM kraken but if everything's gigE, you max out the servers a lot sooner 02:17PM bradles I can say from my own testing, that at 100mbit, yes, the link is toast 02:18PM kraken and I can speak for gigE :) 02:18PM bradles at Myrinet (which is a different can of worms I know), the link is not the problem if you sync the filesystem after reads and writes 02:19PM bradles (and actually for the way we do writes -- in myrinet the link still isn't the bottleneck on writes, even if you don't sync) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 02:20PM bradles (in other words we could go even faster without syncing if we so chose) robl bradles: myrinet is great. clos routing means everyone's got a nice fat connection to everyone else 02:21PM bradles well its academic anyway, Nathan has used GigE, I have not SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56vilayann 36~vilayann@barbados.cse.psu.edu has joined #pvfs2 SignOff 57vilayann : #pvfs2 "Leaving" SignOff 57laytonj : #pvfs2 "Leaving" 56kraken_ 36~kraken@24.144.40.22 has joined #pvfs2 SignOff 57kraken : #pvfs2 Read error: 110 (Connection timed out) 56K1 36~silvestre@D9a7e.d.pppool.de has joined #pvfs2 56sadleder 36~sadleder@p54A204E6.dip0.t-ipconnect.de has joined #pvfs2 sadleder ~sadleder@p54A204E6.dip0.t-ipconnect.de has left #pvfs2 K1 ~silvestre@D9a7e.d.pppool.de has left #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57slang : #pvfs2 "leaving" 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 # 4OP : ABORT ABOUT ADDFORWARD ADDIDLE ADDLAMENICK ADDNOFLOOD ADDSHIT ADDUSER ADDWORD ADMIN AJOIN AJOINLIST ALIAS ASSIGN AWAY AWAYLOG AWAYMSG B BACK BAN BANSTAT BANTYPE BANWORDS BEEP BHELP BIND BK BKI BLESS BREAK BYE C CALL CBOOT CD CDCC CHANNEL CHANST CHAT CHATOPS CHGAOP CHGCHAN CHGLEVEL CHGPASS CHGPROT CHGUH CHOPS CLEAR CLEARAUTO CLEARLOCK CLEARTAB CLINK CLONES CMSG CONNECT CONTINUE CSAY CSET CTCP CTOGGLE CWHO CWHOM CYCLE D DATE DBAN DC DCA DCC DCG DCS DCX DEBUG DEBUGFUNC DEBUGHASH DEBUGMSG DEBUGUSER DEOP DEOPER DESCRIBE DETACH DEVOICE DF DIE DIGRAPH DISCONNECT DLINE DME DNS DO DOP DS DUMP ECHO EHELP ENCRYPT EVAL EVALSERVER EXEC EXIT FE FEC FINGER FK FLUSH FOR FOREACH FORWARD FPORTS FPROT FSET FTP FUCK FUCKEM GONE HASH HELP HISTORY HOOK HOST HOSTNAME I IF IG IGH IGHT IGNORE IGT INFO INPUT INPUT_CHAR INVITE IRCHOST IRCNAME IRCUSER ISON J JNW JOIN K KB KBI KICK KICKIDLE KILL KLINE KNOCK L LAMENICKLIST LASTLOG LEAVE LINKS LIST LISTDLL LK LKW LLOOK LOAD LOADDLL LOCAL LOCOPS LS LUSERS M MAP MB MD MDOP MDVOICE ME MESG MK MKB MKNU MODE MODELOCK MOP MORE MOTD MSAY MSG MTOPIC MUB MULT MVOICE N NAMES NEWNICK NEWUSER NICK NOCHAT NOPS NOTE NOTICE NOTIFY NSLOOKUP NWHOIS NWHOWAS OFFERS ON OOPS OP OPER OPERWALL ORIGNICK OSTAT OV P PARSEKEY PART PARTALL PASTE PAUSE PING POP PRETEND PS PURGE PUSH Q QME QUERY QUEUE QUIT QUOTE RANDOMNICK RBIND READLOG RECONNECT REDIRECT REHASH REINIT REINITSTAT REL RELC RELCR RELCRT RELCT RELD RELDT RELI RELIT RELM RELMT RELN RELNT RELOAD RELS RELSD RELSDT RELSM RELSMT RELSN RELSNT RELST RELSTT RELSW RELSWT RELT RELTT RELW RELWT REMLOG REPEAT REQUEST RESET RESTART RETURN REVISIONS RMAP RPING SAVE SAVEIRC SAVELIST SAY SC SCAN SCANF SCANI SCANN SCANO SCANS SCANV SEND SENDLINE SERVER SERVLIST SET SETAR SETENV SHIFT SHITLIST SHOOK SHOWIDLE SHOWLOCK SHOWSPLIT SHOWWORDKICK SLEEP SPAM SPING SQUERY SQUIT STACK STATS STUB SUMMON SV SWALLOP SWATCH SWITCH T TBAN TBK TCL TIGNORE TIME TIMER TKB TKLINE TLOCK TOGGLE TOPIC TRACE TRACEKILL TRACESERV TYPE U UB UMODE UNAJOIN UNBAN UNBANWORD UNFORWARD UNIDLE UNIG UNIGH UNKEY UNKLINE UNLAMENICK UNLESS UNLOAD UNLOADDLL UNSCREW UNSHIFT UNSHIT UNTIL UNTOPIC UNUSER UNVOICE UNWORDKICK UPING UPTIME URL USER USERHOST USERINFO USERIP USERLIST USERS USERSHOW USLEEP USRIP VER VERSION VOICE W WAIT WALL WALLCHOPS WALLMSG WALLOPS WATCH WHICH WHILE WHO WHOIS WHOKILL WHOLEFT WHOWAS WI WII WILC WILCR WILM WILN WINDOW WORDLIST WSET WW XDEBUG XECHO XEVAL XQUOTE XTRA XTYPE Usage: /help command or /command -help to get help on specific commands 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57kraken_ 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57kraken_ 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 02:51PM slang weirdness 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 04:40PM bradles lots netsplits on freenode lately SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 57kraken_ is now known as 36kraken 01:24PM 53kraken robl: psst 01:25PM kraken I think line 376 of src/io/description/dist-varstrip.c should be changed from 01:25PM kraken PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH) 01:25PM kraken 01:26PM kraken PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH - 1) NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3601:27pm BitchX : Press to see who left to change to [irc.freenode.net] robl kraken: oh? i didn't write that code. why - 1? 01:28PM kraken because it's checking to see if the sprintf following it will fit in the static buffer 01:28PM kraken and strlen doesn't count the needed null 01:29PM kraken dist-varstrip-parser.c has a similar check, and it uses -1 01:29PM kraken er, not a sprintf, strcpy 01:30PM kraken if you give it a string exactly PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH it'll lead to segfaults later when it uses an unterminated string :) 56rross 36~rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl rross: hey 02:42PM 53rross robl: hey! 02:45PM rross still working on these talks. was sort of hoping that phil would be around to chat with about the acxiom one. ah well. 02:52PM kraken want me to poke him with email? :) SignOff 57rross : #pvfs2 Read error: 104 (Connection reset by peer) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl kraken: so... you got some sort of lint tool running over pvfs2? you were pretty fast with that varstrip thing? 03:34PM kraken nah, I caught it when doing the strcpy/sprintf pass last week robl 03:35PM kraken the good thing is that nearly all the uses of sprintf/strcpy are safe in that they're either copying in static/const information or doing their bounds checking elsewhere 03:36PM kraken src/io/bmi/bmi_ib/util.c has several vsprintf's that should probably be changed to vsnprintf for safety 03:36PM kraken - vsprintf(s, fmt, ap); 03:36PM kraken + if (vsnprintf(s, 2048, fmt, ap) >= 2048) { 03:36PM kraken + gossip_err("%s: Format string too large.\n", __func__); 03:36PM kraken + va_end(ap); 03:36PM kraken + exit(1); 03:36PM kraken + } 03:37PM kraken that same thing in 6 places 03:37PM kraken got a patch for that one if you want :) robl kraken: yeah, or even better dust off your bugzilla acct :> robl i just know i'm going to drop these fixes 03:41PM kraken hrm, where is bugzilla? 03:41PM kraken I knew at one point 03:45PM kraken nevermind, found it 03:54PM kraken bugs submitted :) robl i see! thanks SignOff 57laytonj : #pvfs2 "Leaving" 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: gcc-2.95 doesn't expand '__LINE__,' it will expand '__LINE__ ,' apparently 10:15AM kraken that's .... interesting robl is it even worth getting pvfs2 to build with 2.95? even debian ships with gcc-3.2 now robl make that 3.3.5 10:22AM kraken and unstable is on 4.x now 10:28AM pcarns personally, I don't care too much about 2.95 :) 10:29AM pcarns it would be nice though if we detected at configure time and insisted people upgrade if its not corrected, though 10:29AM pcarns there's always going to be that one guy trying to compile on redhat 6.2 or something robl darn. no AC_CHECK_GCC_VERSION macro 10:36AM bradles if you're running gcc 2.95, then chances are you're running an ancienct version of threads and DB anyway. PVFS2 is unlikely to be alot of fun there 10:37AM bradles just more bug reports for crap we don't care about bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 10:49AM bradles hey, does the topic message need to be changed in here? 10:49AM bradles The topic for #pvfs2 is: pvfs2-1.1.0 is out! Topic 36#pvfs2 50): changed by 36kraken pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html2~ 10:50AM kraken no +t so anyone can change it :) 10:50AM bradles oh, there you go robl kraken: whats' up with your url? Topic 36#pvfs2 50): pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html2~ Topic 36#pvfs2 50): set by 36kraken at 36Mon Aug 1 10:50:02 2005 Topic 36#pvfs2 50): changed by 36robl pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html 10:52AM kraken oops robl ok, well, making pvfs2 gcc-2.95 friendly wasn't too hard robl probably a waste of time robl but only a little time pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 08:22AM kraken Thank you for your reply. 08:22AM kraken I changed my program from fwrite() and fread() 08:22AM kraken to write() and read(). 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 robl pcarns: nice set of patches there! robl pcarns: the "pvfs2-client logs to file" in particular could have saved me some frustration on bgl :> 08:44AM pcarns yeah, I had about enough of "stop everything and restart pvfs2-client-core in foreground" to see error messages 08:45AM pcarns 08:46AM pcarns kraken: is that a reply off list from that guy about buffering? 08:46AM pcarns kraken: bound to sink in sooner or later I guess :) 09:20AM kraken he keeps replying off-list, constantly :) robl pcarns: hey, can you think of any reason to not turn on pvfs2-client logging by default? 09:54AM kraken can pvfs1 be told to only bind to a specific interface? 09:54AM 53pcarns robl: no, not really 09:55AM pcarns kraken: no, I don't think so 09:56AM pcarns kraken: you can force a given iod to always be accessed on a particular interface just by putting that hostname or ip in the iodtab file though 09:57AM kraken that's what I thought 09:57AM kraken pcarns: you've got a meeting at 1 :) robl wow, i haven't thought about setting up pvfs1 in years! 09:58AM pcarns kraken and I are stuck in a bad episode of "quantum leap" 09:58AM kraken which one of us is Al? robl that's a show sci-fi should carry more often robl pcarns: ok, i'm going to make -l always be the on. if someone wants to disable logging for some reason they can -L /dev/null 10:01AM pcarns I'm afraid I'm not up on my quantum lore 10:03AM pcarns but it was on my mind because I noticed my tivo decided I should watch it 10:03AM 53pcarns robl: works for me robl kraken: hm. if you're feeding pcarns info, i guess that makes you Al 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 10:14AM kraken neat 10:14AM kraken I want a little gizmo that makes me disappear 10:14AM bradles but the real question is: who is ziggy? 10:15AM kraken robr? 10:17AM bradles Oh, a quick google shows that ziggy was just a program -- I always assumed it was a person -- darn robl bradles: ziggy was the program, gushi was the admin robl sorry, Gooshie 10:19AM bradles I always assumed it was supposed to be god or something 10:19AM bradles omniscient as it was robl well, that's how they eneded the series 10:20AM bradles oh, did he get home -- or just die robl nope, never got home. met some kinda god-like being and then kept on leaping, altering the past 10:22AM bradles I nominate RobL as Gushie then 10:22AM bradles (I mean to be God's programmer, that's a pretty big deal) 10:22AM bradles (maybe a significant pay raise in there for you or something) robl dammit, now you've got me googling for quantum leap stuff 10:28AM bradles Yes, we should ban Nathan 10:28AM bradles but then he explains read/write, so maybe its a wash :) 10:29AM kraken ooover and oooover again 10:29AM bradles you should make your sig: setvbuf( ... ) 10:33AM bradles oh, yea, here is a fun intro to perpendicular storage for anyone interested: 10:33AM bradles http://www.hitachigst.com/hdd/research/recording_head/pr/PerpendicularAnimation.html 10:34AM bradles you can thank me for wasting your morning later 10:35AM kraken hahah 10:35AM kraken the scary thing is that I've seen that 10:37AM bradles Instead of slide based presentations, conference presenters should have to produce animation and songs 10:37AM bradles supercomputing would be really cool then 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 11:03AM slang bradles: nice robl it alway annoys me when torage capacity is given in "number of sogns" robl what if i like to encode stuff to FLAC? robl slang: now i've got 'dancing queen' in my head, as sung by perpinduclar magnetic bits 11:10AM 53slang robl: heh robl pcarns: on a system like bluegene, we don't have netdb.h and gethostbyname. other than that, access-logging.patch looks ok to me 11:37AM kraken bgl sounds like such a freaky weird system :) 11:49AM pcarns ah, do you guys have any configure/ifdef majick that we can wrap that stuff in? robl pcarns: sure do. it'll be no problem robl pcarns: i know exactly what to change. will take me mere moments robl kraken: bgl is indeed an oddball robl kraken: but it introduces supercomputer architecture components that will quite likely be the way we attain petaflop computers robl (especially if you want high hp-linpack scores) SWAP: Window 3 is not hidden! robl pcarns: so i'm going to have BMI_tcp_addr_rev_lookup_unexpected return "UNKNOWN" if the system fails a configure-time test for gethostbyaddr robl pcarns: i tried to come up with a good string to return, but kept comming back to "UNKNOWN" 12:59PM pcarns yeah, that's about all I could come up with robl cool 01:32PM kraken sometimes I think I make phil and david sad pandas\ 01:34PM pcarns heh- 30 minutes was enough time for us to talk about anything we were thinking about :) 01:34PM pcarns but its all good 01:35PM kraken I'm so disillusioned, can you tell? pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36H ~kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 SignOff 57kraken : #pvfs2 Read error: 104 (Connection reset by peer) SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56Inkedfx 36~gerald@217.164.251.223 has joined #pvfs2 SignOff 57Inkedfx : #pvfs2 Read error: 110 (Connection timed out) 56Inkedfx 36~gerald@217.164.251.223 has joined #pvfs2 SignOff 57Inkedfx : #pvfs2 bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57tolkien.freenode.net 3610:30pm BitchX : Press to see who left to change to [irc.freenode.net] 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57slang : #pvfs2 Read error: 104 (Connection reset by peer) 56slang 36~slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36~pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 08:03AM laytonj Good morning sports fans. I need help with a quick concise definition of data server and metadata server for an article I'm writing. 08:42AM pcarns data servers: store file contents, usually striped across servers in 64KB increments 08:42AM pcarns meta servers: store information _about_ files and directories, such as ownership, permissions, and location of data servers 08:43AM pcarns *shrug* 08:58AM laytonj pcarns: That's about what I wrote. Just checking to see if anyone had anything better or more consice. Thanks! 56bradles 36~bsettlem@ogo.mcs.anl.gov has joined #pvfs2 53#pvfs2 57bradles 36H ~bsettlem ogo.mcs.anl.gov (gaim) 53#pvfs2 57pcarns 36H ~pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H ~laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H ~slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 11:05AM kraken David just pointed out to me that the guy I was explaining fread() to had referred to me as Dr. Poznick bradles ~bsettlem@ogo.mcs.anl.gov has left #pvfs2 02:41PM pcarns kraken: someone should tell Don its much quicker to get a phd just by answering mailing list questions :) 03:25PM kraken indeed! 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Global Notice] Hi all. I'll be posting something later, but I wanted to mention this while people are still around for Friday.... if all goes well, we may do final testing of Hyperion 1.0RC* on the production freenode network on Monday morning around 9am UTC. Testing will last from about 30 minutes up through, well, permanent cutover, depending on how well it goes. 8) 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Global Notice] Please let us know if this presents any insurmountable difficulties; feel free to /msg me. Thanks. pcarns ~pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56ChanServ 36ChanServ@services. has joined #pvfs2 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35lilo@levin-pdpc.staff.freenode 50)- [Global Notice] Hi all. There's a news item up on http://freenode.net/news.shtml .... we'll be experiencing some network disruption Monday morning, and we'll be doing our first test upgrade of the production system to Hyperion around that time. Please take a look at the news item for more detail, and have a great morning! :) 56ChanServ 36ChanServ@services. has joined #pvfs2 56kraken 36~kraken@24.144.40.22 has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+n by 57calvino.freenode.net 52Users 32#pvfs2 50)] 54 robl Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.030 secs!! 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56kraken 36N=kraken@24.144.40.22 has joined #pvfs2 56robl 36N=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 kraken 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.128 secs!! SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56robl 36N=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54ChanServ 54 kraken Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.253 secs!! 56kraken 36N=kraken@24.144.40.22 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36N=yf@61.49.205.219 has joined #pvfs2 53#pvfs2 57yftty 36H N=yf 61.49.205.219 (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57kraken 36G N=kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H N=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57yftty : #pvfs2 Remote closed the connection 56yftty 36N=yf@61.49.205.219 has joined #pvfs2 SignOff 57yftty : #pvfs2 Read error: 110 (Connection timed out) 56slang 36N=slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36N=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36N=pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 pcarns N=pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 56slang 36N=slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36N=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 09:21AM 53kraken robl: so apparently RobR and Walt are here today and tomorrow robl kraken: oh, that's today? cool robl kraken: we gotta get you guys contributing more... since you know, you phil and david don't really say much or send any patches or anything... 09:59AM kraken bunch of slackers, I tell you what SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SWAP: Window 3 is not hidden! robl kraken: how's the robr and walting? robl 02:56PM kraken going good I suppose 02:57PM kraken there was beer last night 02:57PM kraken I think this morning they went on a datacenter tour 02:57PM kraken (they called to ask me to do it, but I'm working from home today so I pointed them at someone else) SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-215-227-48.aep.bellsouth.net has joined #pvfs2 robl pcarns: did you get to hang w/ walt and rob in arkansas? 09:15AM 53pcarns robl: yep- we had a good time 09:17AM 53pcarns robl: I wish we could have gotten all of you down, 09:17AM 53pcarns robl: but maybe David and I can make it up to ANL sometime eventually 53#pvfs2 57pcarns 36H n=pcarns adsl-215-227-48.aep.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H N=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57kraken 36H N=kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57robl 36H N=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: cool. rob's actually in town today so i guess slang and i will get filled in on what went down 09:33AM 53pcarns robl: yeah, I think we've got some good stuff to coordinate on, but he can probably tell you quicker in person :) 56yftty 36n=yf@61.149.48.87 has joined #pvfs2 yftty n=yf@61.149.48.87 has left #pvfs2 pcarns n=pcarns@adsl-215-227-48.aep.bellsouth.net has left #pvfs2 56yftty 36n=yf@61.51.37.170 has joined #pvfs2 SignOff 57yftty : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-219-47-240.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-219-47-240.asm.bellsouth.net has left #pvfs2 robl someone tell pcarns when he shows up that i really appreciate the pvfs2-genconfig patches he contributed last month. i'm using the --fsid option heavily right now SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 03:58PM slang [D 15:58:07.757623] dbpf_open_cache_get: called 03:58PM slang [D 15:58:07.757685] dbpf_open_cache_get: type: 2 | create_flag: 0 03:58PM slang [D 15:58:07.757734] dbpf_open_cache_get: found entry in unused list. 03:58PM slang [D 15:58:07.757775] dbpf_open_cache_get: moving to (or reordering in) used list. 03:58PM slang [D 15:58:07.757892] dbpf_cache_elem_lookup: cache elem matching 4 returned (num_elems=2) 03:58PM slang [D 15:58:07.757966] ** CANNOT cache data retrieved (key is lost+found) 03:59PM slang [D 15:58:07.758013] dbpf_open_cache_put: cached entry. 03:59PM slang [D 15:58:07.758051] dbpf_open_cache_put: move to unused list. 03:59PM slang [D 15:58:07.758175] (0x8110b18) lookup_path state: read_object_metadata 03:59PM slang [D 15:58:07.758274] dbpf_open_cache_get: called 03:59PM slang [D 15:58:07.758349] dbpf_open_cache_get: type: 2 | create_flag: 0 03:59PM slang [D 15:58:07.758397] dbpf_open_cache_get: found entry in unused list. 03:59PM slang [D 15:58:07.758432] dbpf_open_cache_get: moving to (or reordering in) used list. 03:59PM slang [D 15:58:07.758471] dbpf_open_cache_get: called 03:59PM slang [D 15:58:07.758510] dbpf_open_cache_get: type: 1 | create_flag: 0 03:59PM slang [D 15:58:07.758550] dbpf_open_cache_get: resetting entry from free list. 03:59PM slang [D 15:58:07.758598] dbpf_open_cache open_fd: opening fd 1048577, create: 0 03:59PM 53slang robl: seems to be stuck there 03:59PM 53slang robl: strace output loops on gettimeofday.. 03:59PM slang futex(0x80d10b0, FUTEX_WAKE, 1) = 0 03:59PM slang gettimeofday({1124139241, 780104}, NULL) = 0 03:59PM slang gettimeofday({1124139241, 780863}, NULL) = 0 03:59PM slang clock_gettime(CLOCK_REALTIME, {1124139241, 781616000}) = 0 03:59PM slang futex(0x80cf050, FUTEX_WAIT, 6614, {0, 99247000}) = -1 ETIMEDOUT (Connection timed out) 03:59PM slang futex(0x80d10b0, FUTEX_WAKE, 1) = 0 03:59PM slang gettimeofday({1124139241, 885103}, NULL) = 0 03:59PM slang gettimeofday({1124139241, 885648}, NULL) = 0 03:59PM slang clock_gettime(CLOCK_REALTIME, {1124139241, 886015000}) = 0 03:59PM slang futex(0x80cf050, FUTEX_WAIT, 6615, {0, 99633000}) = -1 ETIMEDOUT (Connection timed out) BitchX : Ambiguous command: WH SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24.196.226.167 has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@24.196.226.167 has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3605:21pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57kraken : #pvfs2 "Lost terminal" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36N=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36N=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-24.mia.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-24.mia.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) pcarns n=pcarns@adsl-61-120-24.mia.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-24.mia.bellsouth.net has joined #pvfs2 56yftty 36n=yf@221.219.60.230 has joined #pvfs2 56Martyn 36n=martinb@gateway.penguincomputing.com has joined #pvfs2 10:35AM Martyn hey all. 10:35AM Martyn Anyone awake? 53#pvfs2 57Martyn 36H n=martinb gateway.penguincomputing.com (who?) 53#pvfs2 57yftty 36H n=yf 221.219.60.230 (gaim) 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-24.mia.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl Martyn: hey robl most of us are on CDT or EDT so yeah, we're awake :> 12:01PM Martyn Heh .. 12:01PM Martyn thanks. I have a pvfs1 vs 2 question 12:02PM Martyn I've got a problem involving linux 2.4. I have a 7Tb disk array I would like to use as a single contiguous filesystem. due to the inherent limitations of the 2.4.21 RedHat kernel, I cannot mount it as a single volume. 12:03PM Martyn I have therefore formatted the array into 7 fiberchannel scsi LUNs, which 2.4 sees as "/dev/sdb,c,d,e,f,g,h" 12:04PM Martyn The LUNS are formatted with a single partition each, using the ext3 filesystem 12:04PM Martyn So "/dev/sdb1, sdc1 ... sdh1" 12:04PM Martyn I would like to use PVFS to stitch the seven filesystems into one large filesystem using seven IOD's on different ports. Is this approach both sane and practical? robl wow robl ok, it's *possible* robl but not exactly what pvfs1 or 2 was meant to do robl what you want is what LVM would provide 12:18PM Martyn I know, but unfortunately LVM is subject to the same block-device limitation robl but if there's a 2TB device limit, then yeah, i can see that would be a problem 12:18PM Martyn yep :} 12:19PM Martyn And yes, I know that this is a TOTAL bastardization of what PVFS is meant to do. 12:19PM Martyn -heh- 12:19PM Martyn I mean it would be nice to be using PVFS/mpio via ROMEO :} robl well... ok, so start off playing with things this way 12:19PM Martyn but that's not what's needed in this case .. the application that's running isn't inherently MPI :P robl but soon down the road you should bring on more servers who can see the same remote scsi device robl 12:20PM Martyn heh, yes .. I know .. Bad Martyn, no donut. -sigh- :} 12:20PM Martyn On the other hand, PVFS could solve the problem nicely, because the authors are good software writers who's documentation let me figure this out :} robl well.. hey, give it a shot and let us know :> robl it all sounds like it should work, though you'll incur a bit of overhead 12:22PM Martyn *nod* robl (in the parallell case the overall speedup dwarfs the overhead, but in this case i don't think that will happen) 12:22PM pcarns I can vouch for the fact that this scenario does actually work, at least robl in short, i know of no reason why it should *not* work :> 12:22PM pcarns not sure about the speed implications, though 12:23PM Martyn The underlying block devices are talking over fiberchannel .. and iSCSI over InfiniBand .. so the real overhead will be PVFS doing write/read shuffles between IOD's 12:23PM pcarns I've seen setups that do that with PVFS1 12:23PM pcarns (multiple iod's per node to get over 2TB limit) 12:23PM Martyn Right, I intend to use PVFS1 for the purpose. It looks like it will work. 12:24PM Martyn Oh! One other thing .. if I have seven IOD's running on one machine, but small files are being written .. do the writes get shuffled between the various IOD's? 12:24PM Martyn ie.. does PVFS1 manage to avoid writing them all to iodaemon0? 12:24PM Martyn (where the files are .. say .. 128K->1M) robl Martyn: i think you have to make a few tweaks to a config file... it's somewhere in the mailing list archives 12:28PM 53Martyn robl : Already there and reading 12:30PM pcarns there is a command line option to the mgr to make sure they start on random servers, I think 12:30PM pcarns oh yeah, "-r" is what you want 12:31PM pcarns that will make it pick a random starting iod for each new file that is created 12:31PM Martyn pcarns : Just use -r when spawning the meta server? 12:31PM pcarns yeah, I think so 12:32PM pcarns the mgr unfortunately doesn't have a config file- so you have to tell it things like that on the command line 01:17PM Martyn 01:18PM Martyn It's easy enough to do in the init script 53#pvfs2 57Martyn 36H n=martinb gateway.penguincomputing.com (who?) 53#pvfs2 57yftty 36H n=yf 221.219.60.230 (gaim) 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-24.mia.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57Martyn : #pvfs2 "Leaving" pcarns n=pcarns@adsl-61-120-24.mia.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57yftty : #pvfs2 Remote closed the connection 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36n=yf@221.219.52.28 has joined #pvfs2 SignOff 57yftty : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-61-120-24.mia.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-61-120-24.mia.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SWAP: Window 3 is not hidden! SignOff 57laytonj : #pvfs2 "Leaving" 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.593 secs!! SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.339 secs!! 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36n=pcarns@adsl-34-55-141.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 Netjoined: 57irc.freenode.net zelazny.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57pcarns 36H n=pcarns adsl-34-55-141.asm.bellsouth.net (gaim) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Thank you for your patience during this test. You may need to reidentify to services, as it will have been offline during some of the server reups. ( http://freenode.net/news.shtml ) 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 pcarns n=pcarns@adsl-34-55-141.asm.bellsouth.net has left #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.225 secs!! 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-55-141.asm.bellsouth.net has joined #pvfs2 robl our BoF submission was accepted robl see you in seattle 53#pvfs2 57pcarns 36H n=pcarns adsl-34-55-141.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57pcarns 36H n=pcarns adsl-34-55-141.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 09:39AM 53slang robl: woo! SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 56Martyn 36n=martinb@gateway.penguincomputing.com has joined #pvfs2 02:52PM Martyn Hey all. 02:52PM Martyn Anyone awake? robl Martyn: hey 03:12PM Martyn hey there robl 03:12PM Martyn I want to make sure I can fail over pvfs between two nodes 03:12PM Martyn (head node, pvfs-meta) 03:12PM Martyn Now, I have a directory on the main head node called "/pvfs-meta" which contains the .iodtab and .pvfsdir 03:13PM Martyn I have replicated that dir onto the second (failover) node .. is there any other data I need to move? 03:13PM Martyn (in a failover scenario) robl yes, that directory is the only thing the pvfs1 metadata server needs robl so as long as you replicate that entire directory tree, you're cool 03:20PM Martyn are there any other dot-files in there? 03:20PM Martyn Or just those two? robl each directory has two dotfiles in it robl each subdirectory, i mean robl (boy, it's been a while. i *think* that's the case) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Good evening, all. We've resolved our segfault problems with 1.0.1 and will be upgrading to a new version which should be missing those problems. The high-impact part of the upgrade will be done early morning UTC. For more information, please see http://freenode.net/news.shtml .... thanks, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3603:45pm BitchX : Press to see who left to change to [irc.freenode.net] 03:48PM 32lilo:* Two small server upgrades; affected users, about 60 SignOff 57Martyn : #pvfs2 "Leaving" pcarns n=pcarns@adsl-34-55-141.asm.bellsouth.net has left #pvfs2 SWAP: Window 3 is not hidden! 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.898 secs!! 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56yftty 36n=yf@61.49.205.210 has joined #pvfs2 yftty n=yf@61.49.205.210 has left #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57laytonj : #pvfs2 "Leaving" 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-55-141.asm.bellsouth.net has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 05:01PM 32lilo:* A problem exists with the NickServ 'SET UNFILTERED ON' flag, in connection with cloaking. If you have a cloak, this UNFILTERED may be set on as well. We're working on a patch and should have something fairly soon. Thanks. SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Netjoined: 57irc.freenode.net zelazny.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3609:22am BitchX : Press to see who left to change to [irc.freenode.net] 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54ChanServ 54 slang Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 20.805 secs!! 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36G n=pcarns adsl-61-120-81.mia.bellsouth.net (gaim) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 10:53AM 32lilo:* Hi all. Hints: with services, server crashes can remove your identification to nickserv, and you may have to reidentify ("/msg nickserv identify yourpasswordhere") by hand in this case. We're working on solutions that will solve that problem, though we're not quite there yet. 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 56robl 36n=robl@66.139.79.169 has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 pcarns 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 56slang 36n=slang@140.221.11.69 has joined #pvfs2 BitchX : Join to #pvfs2 was synched in 23.008 secs!! 56laytonj 36n=laytonj@24.196.226.167 has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 24.196.226.167 (laytonj) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-81.mia.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:41pm BitchX : Press to see who left to change to [irc.freenode.net] 56kraken 36n=kraken@24.144.40.22 has joined #pvfs2 SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 12:43PM 53kraken robl: psst robl kraken: hi 12:46PM kraken I was poking around the kernel code, and it looks like the changes to support -o noatime are fairly minimal 12:47PM kraken the kernel module already uses the vfs layer update_atime option which automatically checks for S_NOATIME in inode->i_flags 12:48PM kraken the way ext2 does it is to have a function, ext2_set_inode_flags(), which sets the inode->i_flags accordingly, which is then called at the end of ext2_inode_read() 12:48PM kraken er, ext2_read_inode() NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:49pm BitchX : Press to see who left to change to [irc.freenode.net] 12:50PM kraken anyway, it's a bit beyond my casual kernel experience but I bet Murali could handle it somewhat easily, especially given ext2 as an example :) 53#pvfs2 57kraken 36H n=kraken 24.144.40.22 (I am Jack's $IRCNAME) 53#pvfs2 57laytonj 36H n=laytonj 24.196.226.167 (laytonj) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) robl kraken: yeah, good to know that the VFS does a lot of our work SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 55christel 35i=christel@freenode/staff/christel 50)- [Global Notice] Hi all! Are you waiting for a group contact form to be verified and approved? I have a large number of forms with incomplete contact details, if you believe one of these might belong to your group/project please re-submit. Also, remember that you can bump your priority by "squeeky wheeling" me either by PM or e-mail (christel@freenode.net). Thank you and have a great day! 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 kraken n=kraken@24.144.40.22 has left #pvfs2 pcarns n=pcarns@adsl-61-120-81.mia.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-61-120-81.mia.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-61-120-81.mia.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 56pcarns 36n=pcarns@adsl-61-120-81.mia.bellsouth.net has joined #pvfs2 robl pcarns: welcome back, patch monster 12:11PM pcarns when it rains it pours :) 12:11PM pcarns I didn't realize we had that many; David and I have been stuck testing SAN deployments for a while now robl pcarns: you poor guys... i'm forever scarrd from SANs after slogging through them in 2001 robl vixel makes a horrible FC switch, and emulex HBAs are garbage! 12:42PM pcarns ours seem to work ok 12:42PM pcarns all emc stuff I think 12:43PM pcarns but someone else has already done the hard part of configuring and setting up everything 12:43PM pcarns so easy for me to say I guess 01:40PM 32lilo:* Hi all. A new, unofficial channel has been set up for discussion and support of grsecurity; access lists, features, etc. If you're interested and/or would like to help, please stop by ##grsecurity, idle a bit, discuss related topics. Thanks! robl pcarns: i love having systems folks to worry about hardware pcarns n=pcarns@adsl-61-120-81.mia.bellsouth.net has left #pvfs2 56yftty 36n=yf@221.219.56.111 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 11:23AM 50* 53slang/#pvfs2 pings clemson 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 10:10AM pcarns slang: did you forget part of your cvs commit the other day? 10:11AM pcarns slang: I saw something on cvs mailing list about the flow_clear issue, but the patch only had a whitespace change to sys-io.sm 01:58PM pcarns slang: oh, I see the list messages now, nvrmind 02:44PM slang pcarns: hey 02:44PM slang pcarns: you around? 02:44PM pcarns slang: yep, I'm here 02:46PM slang pcarns: it looks to me like FLOW_CLEANUP is cleaning up stuff that PINT_flow_clear tries to cleanup as well 02:46PM pcarns you talking about Pete's problem? 02:46PM slang yeah 02:48PM pcarns what stuff are the conflicting on? (sorry, haven't dug through Pete's last emails yet) 02:52PM slang maybe not 02:52PM slang its hard to tell 02:52PM slang the flow_data->parent stuff confuses me 03:13PM pcarns I haven't stepped through to see what happens in those EOF cases in the sys-io state machine, 03:13PM pcarns maybe it isn't really following a good error path? 03:14PM slang pcarns: maybe 03:14PM slang pcarns: pete's debugging seems to suggest that the context array is getting freed elsewhere pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 05:01PM 32christel:* : Happy 16th birthday to HauntedUnix! He'd be most thrilled if you congratulated him in ##trivia pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 56yftty 36n=yf@221.222.219.214 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 56bress 36n=bress@redhat/bress has joined #c-60 bress n=bress@redhat/bress has left #c-60 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56Martyn 36n=martinb@adsl-63-203-69-169.dsl.snfc21.pacbell.net has joined #pvfs2 02:16AM Martyn Anyone nutty enough to be awake right now? SignOff 57Martyn : #pvfs2 "Leaving" 56slang 36n=slang@140.221.11.69 has joined #pvfs2 56slang 36n=slang@140.221.11.69 has joined #pvfs2 56hamza 36n=hamza@81.214.142.180 has joined #pvfs2 05:59AM hamza 05:59AM hamza anyone out there? SignOff 57hamza : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 56Martyn 36n=martinb@gateway.penguincomputing.com has joined #pvfs2 03:55PM Martyn Quick PVFS v1 question 03:56PM Martyn Symbolic links are supported in version 1.6.3 ... if I installed a filesystem using 1.5.3, will I have to recreate the metadata to use them? 03:56PM Martyn Or can I just upgrade from 1.5->1.6.3 with no issues? pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 53#pvfs2 57Martyn 36H n=martinb gateway.penguincomputing.com (who?) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) robl Martyn: there have been several metadata changes (1.5.4, 1.5.6). you can upgrade the metadata with the tools in pvfs1 (migrate--to-.c) robl so you need to convert 1.5.6 to 1.5.7, then 1.6.2 to 1.6.3 06:24PM Martyn Thanks. 06:24PM Martyn I knew waiting in channel would be worth it :] 06:25PM Martyn Also, running executables from pvfs v1 mounted filesystems .. solved, not solved, or something best left to pvfs2? SignOff 57Martyn : #pvfs2 "Oh no! I've gone POOF!" 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 56hamza 36n=hamza@81.214.142.180 has joined #pvfs2 SignOff 57hamza : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-218-104-183.asm.bellsouth.net has joined #pvfs2 robl pcarns: you still on -internal? 09:21AM 53pcarns robl: yep robl pcarns: ok, cool. then you probably know my next question: any more patches pending from your end? 11:49AM 53pcarns robl: sorry, was out for a bit 11:49AM 53pcarns robl: we do have two more patches, but they aren't important enough to wait for 11:49AM 53pcarns robl: no bugs or anything robl pcarns: ok. rross wants the zero fill bug fixed by the next release... might take a bit of time to track things down robl pcarns: hey robl pcarns: we're looking at devpvfs2-req.c robl pcarns: i just committed a fix for a possible memory leak in pvfs2_devreq_write robl pcarns: the platofrm guys found a case where in an error condition, kmem_cache_free wasn't being called robl pcarns: do you know if that's a real fix, or is that an error path where we don't want to free that memroy for some reason? 04:20PM 53pcarns robl: hey, I'm pretty much in meetings today, but I will look at that cvs commit later robl pcarns: no problem. just wanted to let you know i'm messing wit your code pcarns n=pcarns@adsl-218-104-183.asm.bellsouth.net has left #pvfs2 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 56`fdog 36n=go_away@211.97.205.68.cfl.res.rr.com has joined #pvfs2 robl frank? 08:47PM `fdog 08:47PM `fdog this place is pretty dead these days 08:48PM `fdog not a large need for irc support I see robl no way, hoss. we have people hopping in here all the time. robl well, i guess relatively speaking it's dead robl people hop in at 3am Chicago time, ask a question, and split 09:00PM `fdog 09:00PM `fdog I thought you were working on terragrid stuff for the most part anyways these days? robl me? no way, tg is the suxors robl bluegene 09:01PM `fdog I thought I saw something on /. about MCS getting a bunch of funding to do more terragrid stuff or something robl heh. probably. what a clusterfuck 09:02PM `fdog so you're not at mcs anymore? robl oh, yeah. i mean the teragrid is a clusterfuck robl mcs still rocks most of the time 09:05PM `fdog cool 09:05PM `fdog have you seen the pictures of the old bridges getting torn down? 09:08PM `fdog http://www.parl.clemson.edu/~fshorte/cooper_river_bridge/demolition/ 09:08PM `fdog couple shots from about a month ago robl aw, sorry i missed it robl kinda forgot about it robl `fdog: holy crap! 09:13PM `fdog yea, it looks weird 09:13PM `fdog they're really taking them down fast robl round holiday inn! 09:14PM `fdog can you see that in those pictures? robl 0155.jpg 09:14PM `fdog ha, off in the distance robl cool. you did the first walk across the new bridge thing? 09:16PM `fdog yea, those pics should be one dir up robl wow, tall bridge 09:17PM `fdog yea, its enormous 09:17PM `fdog 1689.jpg shows how high up it is 53#pvfs2 57`fdog 36H n=go_away 211.97.205.68.cfl.res.rr.com (0690) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 09:18PM `fdog that the road surface is level with the top of the superstructures of the old bridges robl astounding robl maybe i'll get over there during thanksgiving 08:39PM 50* 53`fdog/#pvfs2 blinks 08:39PM 53`fdog robl hey, does robr still fool around with mythtv at all? robl `fdog: not much. i don't think he's ever home long enough to play with it 10:07PM `fdog hrm 10:07PM `fdog did sarah say anything about being pissed at me? 10:08PM 50* 53`fdog/#pvfs2 gets ignored robl `fdog: i didn't think anyone could make sarah pissed 10:28PM 50* 53`fdog/#pvfs2 bows 10:28PM `fdog ... 53#pvfs2 57`fdog 36H n=go_away 211.97.205.68.cfl.res.rr.com (0690) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 56yftty 36n=yf@61.51.39.30 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection SignOff 57`fdog : #pvfs2 "rebooting" 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 robl pcarns: hey robl pcarns: i'm about to commit a patch to the flow code that a guy in germany says prevents a segfault. i've never seen a seg fault from this part of the code, and i'm not sure how to trigger immeidate completion of a write or read. robl just a heads up 01:09PM 53pcarns robl: hey, I looked at that patch earlier today, I think- 01:09PM 53pcarns robl: I sent an updated version to robr 01:10PM 53pcarns robl: I think he was going to ask them to try it out, you might want to check on that before committing patch pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 03:14PM 53pcarns robl: any new guess on when you guys plan to release? pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 robl pcarns: hey robl pcarns: release plans... well, now that sam has zero fill fixed (we think), we'll probably release friday or early next week 08:26AM 53pcarns robl: cool- if you guys get to a potential code freeze point, let us know and I will merge into our tree and test a little too robl pcarns: wow, you're making me maybe be more legit and start a release branch :> robl pcarns: i'm in raleigh today and tomorrow. i'll tag a -pre on friday for you guys 08:28AM 53pcarns robl: oh, you don't have to tag or anything 08:29AM 53pcarns robl: you can just let us know when you guys think the patching etc. is kind of settled down 08:29AM pcarns I can merge anytime robl pcarns: oh :> ok, then go ahead and merge now...no wait robl pcarns: still have to apply your protocol versioning patch. will do that at the break 08:59AM 53pcarns robl: ok, no rush 08:59AM 53pcarns robl: we aren't in a hurry or anything, just figured once you got whatever patches in we may as well start working with it before the release robl pcarns: cool. our testing is barely adequate, so i'm eager to get you guys to bang on it NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3604:02pm BitchX : Press to see who left to change to [irc.freenode.net] pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 robl pcarns: thanks. that explanation helps a lot 08:37AM 53pcarns robl: np robl pcarns: ok, every outstanding patch i know about is in the tree robl pcarns: we'll probably make some portablity fixes to the kernel module so we can build on suse's 2.6.5 kernel, but aside from that and bugfixes, that's the 1.3.0 release 08:44AM 53pcarns robl: great! 08:45AM 53pcarns robl: I'll probably do a vendor merge sometime today- I'll let you know if we run into anything between now and release time robl pcarns: cool. looking for monday/tuesday time frame 10:55AM 53pcarns robl: heads up- there is a problem building the 2.4 kernel driver in the current cvs tree 10:56AM 53pcarns robl: I'm looking at it now, I will communicate a fix or patch when I figure out how to fix it 10:56AM 53pcarns robl: something to do with the new acl stuff 53#pvfs2 57pcarns 36H n=pcarns adsl-34-57-242.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) robl pcarns: at one point it owrked against 2.4.31 11:00AM pcarns pcarns: that's what I am trying to build against 11:12AM 53pcarns robl: also fails on redhat 2.4.21 robl dang. ok, i can get this working friday. murali is looking at 2.6.5 today. can you email him and me with your findings/patches? robl (i'm still in raleigh and allegedly paying attention to this SDM meeting) 11:23AM pcarns sure thing pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56rross 36n=rross@r910-sheratoncc.fu.nc.windchannel.com has joined #pvfs2 09:19AM rross anyone home? 09:23AM rross guess not so much rross n=rross@r910-sheratoncc.fu.nc.windchannel.com has left #pvfs2 robl just missed him 10:07AM 53slang robl: here and gone in 4 mins 10:07AM 53slang robl: maybe we can setup an alert system when rob shows up ;-) robl slang: not very patient robl heh. an irc bot that calls our phones robl slang: working from home todya? 10:08AM 53slang robl: exactly! 10:08AM 53slang robl: looks like it 10:08AM 53slang robl: you're at the lab? robl cool 10:09AM 53slang robl: gotta go pickup my race packet at some point today robl slang: yeah! just 2 more days robl slang: do you know when you expect to hit mile 25? robl slang: couldn't find any "track a runner" feature on the website 10:13AM 53slang robl: I'm going to shoot for 7.5 mins/mile 10:13AM 53slang robl: but its highly dependent on the temp robl slang: cooler == faster? 10:13AM 53slang robl: yeah 10:14AM 53slang robl: last year was ~ 70, I did the first 20 miles @ 7:20 10:14AM 53slang robl: then I hit the wall 10:14AM 53slang robl: ended up with 3:30 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 10:15AM 53slang robl: I think you can get runner updates sent to your cellphone somehow 10:16AM slang http://www.doitsports.com/results/MSG-signup.tcl?sub_event_id=2161 robl slang: cool. now i'm going to get splits sent to rlatham@gmail.com robl wonder how laggy it'll be 10:21AM 53slang robl: last year it was ~ 5 mins off or so iirc 10:21AM 53slang robl: not too bad 10:22AM 53slang robl: I think there are only 2 splits though robl slang: really? they wouldn't report every mile? 10:23AM slang heh. 40k*26 is too many messages for their little servers I guess robl heh. good point robl wait! no that's not a lot over 4 hours! 10:32AM 53slang robl: so you say mr. hpc robl slang: so changing topics, did you get tickets to the alcs? 10:44AM 53slang robl: nope 10:44AM 53slang robl: I tried but all lines (and web portals) were busy robl slang: stinktastic man robl pro sports need to do better about encouraging the individual fan robl some lamer scalper has a giant block, no doubt robl only 6 for ultimate robl must be too cold SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 11:16AM 53slang robl: well - I could have had postseason tix if I had gotten the 13 game plan instead of the 9 game plan :-< 11:18AM 53slang robl: no one has responded to my operation id email...does it not make sense? robl slang: i forgot about it, actually :< 11:34AM 53slang robl: I tried to modify my procmailrc to redirect spam to /dev/null and I'm a little wary that I've screwed it up somehow 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 01:44PM 53pcarns robl: hey, you around? robl pcarns: howdy 01:45PM 53pcarns robl: I worked up a patch that adds a configure test for the setxattr() prototype in the kernel robl pcarns: pvfs2 is all messed up! robl pcarns: oh, cool 01:45PM 53pcarns robl: just giving you a heads up, I'll try to get it approved to get to you guys shortly robl thanks. sounds great 01:46PM 53pcarns robl: what's messed up? robl pcarns: pvfs2-cp hasn't worked since monday apparently 01:52PM pcarns phhh- who needs I/O anyway robl yeah, we should just short-circuit that routine anyway 02:14PM 53slang robl: that pvfs2-cp error 02:14PM 53slang robl: looks like its caused by the zero-fill commits I made 02:14PM 53slang robl: is the automated test stuff just catching that now? robl slang: no, caught it october 4th robl slang: /i/ didn't catch it until today though :> 02:20PM pcarns what is the tinderbox url, by the way? robl pcarns: http://lain.mcs.anl.gov/tinderbox2/PVFS2/status.html robl pcarns: unfortunatly it's behind the anl firewall 02:21PM 53pcarns robl: oh yeah, that's right 02:22PM 53pcarns robl: I forgot robl slang: so you're on the pvfs2-cp case? 02:27PM 53slang robl: sorry my connection flamed out on me 02:28PM 53slang robl: yeah looking at it 02:28PM 53slang robl: I guess I shouldn't use the autobuilds as verification that my commits didn't break anything if I'm not going to look at the webpage :-| robl slang: i'm lax about it too 02:31PM 53slang robl: we need more bots! robl i are a bot! robl how do i tell gcc to not use /usr/include ? robl i feel like there's a flag specifically for that 02:47PM 53slang robl: -nostdinc? 50* 57robl hugs slang 02:47PM pcarns telling gcc something is easy 02:47PM pcarns getting it to listen is hte hard part 02:54PM 50* 53slang/#pvfs2 thwaps himself 02:55PM slang we don't really need to do writes, do we? 02:56PM 50* 53slang/#pvfs2 fixes zero-fill reads 02:56PM 50* 53slang/#pvfs2 breaks writes in the process robl we can have reads or writes but not both! robl "oh, you want to build pvfs2 with the --enable-writes option. one warning, though... it disables reads" 02:58PM slang heh 02:58PM slang writes are overrated 02:58PM slang overwrited too! 02:58PM 50* 53slang/#pvfs2 eyes himself warily robl hm. so, -nostdinc was great, except some of the kernel headers bring in stdarg.h robl which is burried away in some compiler-specific directory robl all this because some systems have xattr_acl.h in /usr/include/linux... 03:00PM 53slang robl: do we really need xattr support? 03:00PM 53slang robl: I mean we don't even have write support at the moment.. robl pvfs-1.3.0 -- if it's all disabled, there can't be any bugs! 03:04PM pcarns hehehe 03:04PM pcarns you guys have fun with that 03:04PM pcarns I'm starting my weekend pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 03:10PM 53slang robl: hmm 03:12PM 53slang robl: I have a question about the semantics of PVFS_sys_read robl slang: o...k 03:13PM 53slang robl: (well PVFS_sys_io in the case of reads anyway) 03:15PM 53slang robl: pvfs2-cp just passes in PVFS_BYTE as the file_req 03:15PM 53slang robl: which obviously has an aggregate size of 1 03:19PM slang hmm..I need to think about this some more SignOff 57laytonj : #pvfs2 "Leaving" robl slang: ok, i'll be around :> robl ok, 2.6.13.3, 2.6.12.5, 2.6.11.10, 2.6.5, 2.4.31, and 2.4.19 now all configure/compile robl no idea if the resulting kernel modules actually load... robl -nostdinc +isysdir NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3604:24pm BitchX : Press to see who left to change to [irc.freenode.net] robl slang: oh man, for your sake i hope the sox don't win tonight, but it'd be great if they did 06:04PM 53slang robl: why don't win tonight? robl slang: so you can see them play 06:10PM 53slang robl: ah 06:10PM 53slang robl: I probably won't go on sunday if it gets that far anyway 06:10PM 53slang robl: I'd just end up falling asleep :-) 06:11PM 53slang robl: I won't mind if they win tonight anyway ;-) robl right on robl 4-3 in the 8th robl slang: sweep! NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3611:50pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3604:09am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3607:46am BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57pcarns 36H n=pcarns adsl-34-57-242.asm.bellsouth.net (gaim) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 01:17PM 53pcarns robl: hey, what version of tinderbox are you guys using? 01:18PM 53pcarns robl: David is trying to find something to kick around with a little bit 01:35PM 53pcarns robl: nevermind, we found it in mozilla's cvs 01:51PM slang pcarns: we're using tinderbox2 01:52PM slang pcarns: I think I checked it out from mozilla's cvs 01:52PM pcarns slang: thanks- that's what we are trying 01:52PM slang pcarns: the TinderConfig.pm file has rcs revision 1.52 so you can get an idea of how old that is pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 56kraken 36n=kraken@24.144.40.22 has joined #pvfs2 robl kraken: hey. thanks for the suggestion, but that's not enough robl kraken: the client tries to bind to the first address, which is not routable from that client, then gives up 12:55PM kraken ahh robl kraken: i should clarify that on the ml 12:55PM kraken well, even if you get past that, the server will be confused due to the INADDR_ANY binding robl kraken: really? i'm not convinced about that 12:56PM kraken yeah. 12:56PM kraken well... 12:57PM kraken so long as the bmi layer properly decides which home it's talking to, I suppose it's ok 12:57PM kraken what I'd be worried about is the server getting confused by trying to bind to the same port twice 12:58PM kraken it wouldn't necessarily be a bad thing though to be able to force pvfs2-server to only bind to a specific IP 12:59PM kraken for situations where you want to force all pvfs2 traffic through a specific interface 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 kraken n=kraken@24.144.40.22 has left #pvfs2 NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3604:48am BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57pcarns : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-34-57-242.asm.bellsouth.net (gaim) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 56yftty 36n=yf@61.51.63.238 has joined #pvfs2 pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 55alindeman 35i=adml@freenode/staff/gallery.alindeman 50)- {Global Notice} Hi all. We are aware that some channels were cleared and are currently inaccessible. We are isolating a cause currently and are correcting cmodes on channels that were affected. If you are still having trouble joining an affected channel, let a freenode staffer ( /stats p ) know. Thank you. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're having issues with an attack. We're restoring a previous services backup. Please bear with us. 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. As you are now aware, services are back up. This would be a good time to change your channel password if you can. Please check with first level support (/stats p) if you need help, and bear with us, as we might be a bit bogged down. Thank. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] This would be a good time to mention that freenode needs help with out 'freenode-registry' project, which would certainly help us avoid some compromises and recover more effectively. If you're interested in helping out, stop by #freenode-registry. I may have spotty availability for the next few hours or day, but will want to talk to you personally. Thanks. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] (and by the way, that channel name is #freenode-registry without the dots, thanks!) SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56yftty 36n=yf@61.49.205.227 has joined #pvfs2 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- You have already identified NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3605:13pm BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57yftty 36H n=yf 61.49.205.227 (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 56yftt1 36n=yf@221.219.58.194 has joined #pvfs2 SignOff 57yftty : #pvfs2 Read error: 110 (Connection timed out) yftt1 n=yf@221.219.58.194 has left #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56yftty 36n=yf@221.217.50.182 has joined #pvfs2 56jak 36n=jak@81-86-122-65.dsl.pipex.com has joined #pvfs2 11:51AM I'm going to be configuring a cluster of three machines, 2 with disk arrays 11:51AM So two of the machines will have a disk-array directly attached 11:51AM is it possible to configure PVFS2, so that the data is duplicated on each disk array 11:51AM so that the machines with direct-attached storage are able to read more quickly from their local copies? robl jak: pvfs2 doesn't do that sort of replication (yet). people are working on it, but it's still a year away robl jak: if you want that sort of replication, look into some of the distributed network block device efforts 04:11PM interesting 04:11PM i'll google that, thanks SignOff 57jak : #pvfs2 "Leaving" SignOff 57yftty : #pvfs2 Remote closed the connection SignOff 57laytonj : #pvfs2 "Leaving" 56yftty 36n=yf@221.217.50.182 has joined #pvfs2 yftty n=yf@221.217.50.182 has left #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 01:49PM slang http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang 140.221.11.69 (Samuel Lang) 53#pvfs2 57robl 36H n=robl 66.139.79.169 (Rob Latham) 02:44PM slang http://www.pvfs.org/cgi-bin/pvfs2/viewcvs/viewcvs.cgi/ NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3611:42pm BitchX : Press to see who left to change to [irc.freenode.net] 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 22.747 secs!! 56slang 36n=slang@140.221.11.69 has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net #pvfs2 [freenode-info] if you need to send private messages, please register: http://freenode.net/faq.shtml#nicksetup 56slang 36n=slang@140.221.11.69 has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-57-242.asm.bellsouth.net has joined #pvfs2 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) pcarns n=pcarns@adsl-34-57-242.asm.bellsouth.net has left #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 01:52PM 32lilo:* Hi all. We seem to have a new sports-related channel courtesy of Hawkwind.... there's a Nascar race going on right now, and of course, bring your favorite sport. You're invited to stop by ##sports .... 56jak 36n=jak@laptop74.dynip.doc.ic.ac.uk has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 104 (Connection reset by peer) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57jak : #pvfs2 Connection timed out 56jak_ 36n=jak@81-86-122-65.dsl.pipex.com has joined #pvfs2 SignOff 57jak_ : #pvfs2 Client Quit 56jak_ 36n=jak@81-86-122-65.dsl.pipex.com has joined #pvfs2 SignOff 57jak_ : #pvfs2 Remote closed the connection SignOff 57laytonj : #pvfs2 "Leaving" 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl quiet quiet 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-145-178-137.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-145-178-137.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 104 (Connection reset by peer) SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-145-178-137.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-145-178-137.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl 3 people! a local maximum 09:47AM 53slang robl: harley appears to be off the fritz robl slang: heh. that took me a whle to parse. 09:56AM 53slang robl: you gunna be alright gettin back? 09:56AM 53slang robl: maybe we'll end up doing that road trip to boston/ny after all? robl slang: yeah. two thanksgivings ago i left my d/l in the car and made it to south carolina and back w/o any id robl slang: oddly enough, the SC airport cared more than o'hare, but i made it through robl should be a lot easier this time as i've actually got photo id robl pcarns: somewhere betweeen o'hare security and the white plains rental car counter i lost my drivers license 10:30AM 53slang robl: you think that's gunna work? robl slang: i do robl slang: but i might be too optimistic 10:31AM 50* 53slang/#pvfs2 crosses his fingers robl slang: i figure if someone gives me a hard time, i'll yell at them and say stuff like "i should shoot you right now with this gun!" robl that'll speed things up 11:26AM 53slang robl: heh 11:27AM 53slang robl: kaitlyn was saying you could print out a copy of your passport if you could get access to a printer robl slang: i thought i could but now i can't find my passport image robl apparently word gets out pretty fast aobut dumb ol' me.. robr sent me email too :> 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57pcarns 36G n=pcarns adsl-145-178-137.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 11:28AM 53slang robl: heh - I just told him 11:29AM 53slang robl: I thought there might be something we could do to help you out 11:29AM 53slang robl: at this end 11:29AM 53slang robl: I guess working at a govt. lab doesn't help much pcarns n=pcarns@adsl-145-178-137.asm.bellsouth.net has left #pvfs2 robl aggregate statistics: robl --------------------------------------- robl fs_id: 690151926 robl total number of servers (meta and I/O): 33 robl handles available (meta and I/O): 4294967288 robl handles total (meta and I/O): 4294967292 robl bytes available: 22265.4G robl bytes total: 22265.4G robl so we've got 22+ TB up and running at watson 02:33PM 53slang robl: holly smokes! 02:33PM slang holy 02:38PM 53slang robl: i've been looking for a good place to store my dvd collection robl slang: no kidding. the hardware performs somewhat underwhelmingly, thouhg robl slang: bonnie++ reports 70MB/sec block sequential I/O robl slang: we kinda need 10x that robl well, if we saturate the storage servers, that'll be kinda impressive too 02:52PM 53slang robl: looks like pvfs.org is accepting tinderbox status submits again 02:53PM 53slang robl: oh 02:53PM 53slang robl: maybe you know this though robl slang: ? 02:56PM 53slang robl: remember the perms problems last week? 02:56PM 53slang robl: I didn't know they had been resolved 02:56PM 53slang robl: but it looks like they have robl slang: cool. i don't have the url on my laptop robl slang: paste please? 03:00PM 53slang robl: http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html NetSplit: 57irc.freenode.net split from 57clarke.freenode.net 3604:04pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57slang : #pvfs2 "Lost terminal" 50* 57robl made it home NetSplit: 57irc.freenode.net split from 57clarke.freenode.net 3611:30pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net clarke.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55ChanServ 35ChanServ@services. 50)- [#c-60] ATTN: this channel has moved to EFnet. please visit us there 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl NetSplit: 57irc.freenode.net split from 57clarke.freenode.net 3611:45pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net clarke.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55ChanServ 35ChanServ@services. 50)- [#c-60] ATTN: this channel has moved to EFnet. please visit us there 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 11:46PM 32alindeman:* Hi all. Looks like a server previously in main rotation is having some connection issues; it's been removed from main rotation for a while, but still has over 3000 users on it. We'll try to track down the problem. Thanks! 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) NetSplit: 57irc.freenode.net split from 57clarke.freenode.net 3607:41am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-145-178-137.asm.bellsouth.net has joined #pvfs2 robl pcarns: hey 08:15AM 53pcarns robl: hey there robl pcarns: it's crazy benchmarkinmg day ... we've got time on a 20*1024 node BGL system 10:01AM 53pcarns robl: wow! 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 "Lost terminal" 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 pcarns n=pcarns@adsl-145-178-137.asm.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57clarke.freenode.net 3605:32pm BitchX : Press to see who left to change to [irc.freenode.net] 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 22.066 secs!! 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Thu Oct 27 19:37:58 2005 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 0.337 secs!! 07:43PM 32lilo:* Shutting down our poor former main rotation server that's stuck behind cogent. Shutting off new connects first. 07:50PM 32lilo:* Shutting down the server now.... 07:57PM 32lilo:* restarting services; please bear with us SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3608:38pm BitchX : Press to see who left to change to [irc.freenode.net] 10:28PM 32lilo:* Well, inadvertently-major upgrade in process on http://freenode.net/ 8) 11:09PM 32lilo:* Btw, http://freenode.net/ is back up, though it may be up and down while I scratch my head and figure out the new config file layouts 8) 56yftty 36n=yf@221.216.29.206 has joined #pvfs2 56pcarns 36n=pcarns@adsl-145-178-137.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57yftty : #pvfs2 Remote closed the connection 56yftty 36n=yf@221.216.29.206 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 03:11PM ronnocol Anyone here? robl ronnocol: hey robl for a bit 03:13PM ronnocol Hey... I'm trying to get pvfs2 deployed, and Im having a bit of a problem 03:13PM ronnocol If I create a directory on the pvfs2 mounted FS... it shoes up, but I can't use it 03:14PM ronnocol mkdir /pvfs2-fs/bt_torrents robl fedora 3 or rhel 3 ? 03:14PM ronnocol gentoo for the client and ubuntu for the servers 03:14PM ronnocol ls /pvfs2-fs/bt_torrents 03:14PM ronnocol ls: /pvfs2-fs/bt_torrents/: No such file or directory 03:15PM ronnocol pvfs2 v. 1.2.0 03:15PM ronnocol I tried turning SyncData and SyncMeta on, but that didn't seem to help 03:17PM ronnocol root@pvfs0:~# /usr/local/sbin/pvfs2-server -v 03:17PM ronnocol 1.2.0 (mode: aio-threaded) robl hm. sounds kinda similar to a problem some others have been having. can you write this up to pvfs2-users@beowulf-underground.org? 03:17PM ronnocol uhm sure 03:48PM ronnocol sent 03:48PM ronnocol I tried to include all of the data and config files that someone would ask for. 56yftty 36n=yf@221.216.29.206 has joined #pvfs2 10:50PM 32lilo:* US users: "Spring forward, fall back." Before you go to sleep, set your non-computer clocks back one hour. We'll assume you've all got computer clocks configured to UTC and set to skip back on their own. Well, we hope. :) 10:51PM 32lilo:* (I'm told Canadian users "fall back" at the same time. Thanks!) 10:53PM 32lilo:* (parts of Western Europe have apparently switched as well.... apologies for not keeping on top of this; I guess it's easier to think about just your local timezones, because you have to go wind the clocks locally 8) 10:56PM 32lilo:* For further information on daylight savings time transitions: http://www.timeanddate.com/time/dst2005b.html 56yftt1 36n=yf@221.219.62.240 has joined #pvfs2 SignOff 57yftt1 : #pvfs2 Remote closed the connection SignOff 57yftty : #pvfs2 Read error: 110 (Connection timed out) 56yftty 36n=yf@221.219.62.240 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 56yftty 36n=yf@221.219.62.240 has joined #pvfs2 SignOff 57yftty : #pvfs2 Remote closed the connection 56yftty 36n=yf@61.51.37.43 has joined #pvfs2 11:05PM ronnocol evening all 02:47AM yftty evening 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-145-178-137.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection yftty n=yf@61.51.37.43 has left #pvfs2 56yftty 36n=yf@221.222.219.83 has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57yftty : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:57am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-57-70.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-34-57-70.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) pcarns n=pcarns@adsl-34-57-70.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl i will strive to say at least one sentence every day in this channel. 02:10PM 53slang robl: maybe it should at least have pvfs2 in it? robl i am putting together pvfs2 patches SignOff 57laytonj : #pvfs2 "Leaving" 10:47PM ronnocol evening all robl hi ronnocol 10:52PM ronnocol hey 10:52PM ronnocol so... we determined what was causing the weird issues with being able to make a dirctory but not use it.... 10:53PM ronnocol I had the guy working for me post the data to the users email list 10:53PM ronnocol but essentially he was trying to add new servers to the cluster by hand by manually changing which handles were assigned to which servers 10:53PM ronnocol That didn't work so well 10:54PM ronnocol So... the question is... if you need more space... how do you add a new server to the cluster 10:56PM ronnocol 1.08T 10:56PM ronnocol err.. wrong window robl ronnocol: the handle space is 64 bits but we only assign 32 bits through genconfig robl so... if you add a server, you keep all the existing handles th esame, and assign handle 4billion-5billion (roughly) to it 11:00PM ronnocol He thought that's what he did... he posted the configs to the users list robl ronnocol: i can't find his message. what's his name? 11:10PM ronnocol Uday 11:11PM ronnocol Sent at 11:24 this morning 11:11PM ronnocol Uday Shingwekar robl ah, ok, got it robl ok, sounds like maybe theory doesn't match practice? i'll take a look at it on our test machines 11:14PM ronnocol I'd really appreciate that 11:20PM ronnocol I do however like this output (from df -h): 11:20PM ronnocol tcp://pvfs00:3334/pvfs2-fs 11:20PM ronnocol 8.5T 1.1G 8.5T 1% /mnt/pvfs2 robl always fun to have a TB or so to play with :> 11:25PM ronnocol With pvfs2, it cost us about $25K for servers and man-hours... For a 8.5T netapp solution it would have been closer to $160K robl wow, didn't realize netapp was so expensive robl what are you going to ue all the space for anyway? robl (often nice to hear what apps people toss at our file system) 11:31PM ronnocol I work at Macrovision, our clients are movie studios, recording studios, game publishers, etc. 11:32PM ronnocol We need somewhere to put CD-rips, DVD rips, etc. 11:32PM ronnocol We have a 900 node diskless netbooted cluster that needs access to the data 11:32PM ronnocol Pointing 900 nodes at a single NFS server was killing the box 11:33PM ronnocol (and we couldn't scale the diskspace in any cost-effective way) and having multiple mount points (for multiple nfs servers) wasn't practical for the application 11:34PM ronnocol luckily we have no need to backup the data, just have it readilly avaialable to all of the nodes robl cool. sounds like a decent app for pvfs2, as long as you read/write in big chunks 11:35PM ronnocol only 1 node really has any need to write, everything else is read-only essentially 11:35PM ronnocol Are there any optimizations we should know about to optimize for reads? 11:36PM ronnocol We couldn't find any documentation on the Attr* keywords for example robl ronnocol: none really yet. lots of ideas, nothing in practice at this time 11:41PM ronnocol ah; ok robl hey, i'm off to bed. see you later 11:42PM ronnocol ok; thanks for all your help 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 01:32PM 32lilo:* A small EU server was just split, affected users, 240.... it's just rejoined 01:34PM 32lilo:* We've lost a couple more small servers, they're coming and going.... 04:06PM 53slang robl: ... 04:08PM slang why did the pvfs2 server cross the road? robl slang: i don't know slang. why did the pvfs2 server cross the road? 04:11PM 53slang robl: I can't think of anything remotely funny robl haha. 'remote' like 'remote file system' like distributed storage? 04:11PM 53slang robl: yeah like that kind of not funny 04:16PM 53slang robl: that's where the u-stor-it was maybe? robl slang: knock knock 04:35PM ronnocol Hey Rob... how goes it? 05:03PM slang ronnocol: hey! 05:03PM 53slang robl: who's there? robl slang: pvfs 05:05PM 53slang robl: ...pvfs...who? robl ronnocol: no news yet, but i'm just about to dive in robl slang: pvfs who is the next generation parallel file system! 05:07PM 50* 53slang/#pvfs2 eyes robl warily robl WHO == 2 ! 05:10PM 53slang robl: heh! robl ronnocol: hey so i started w/ one server, did some stuff, shut down that server, added a new handle range, copied the "fs.conf" file to a 2nd server, made a storage space on that 2nd server (pvfs2-server -f ...), then started the 1st and 2nd servers robl ronnocol: that worked ok for me robl ronnocol: i'll double-check your emails to see if there's a step missing in there (on either your end or my end) SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3609:10pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3609:17pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 55dmwaters 35i=dmwaters@freenode/staff/gentoo.dmwaters 50)- {global notice} Hi all! one of our sponsors is doing some router maintenence, this is scheduled maintenence. In the process, I'm going to upgrade one of the main rotation servers. this won't effect anyone, since the server has already dropped it's users. Thank you for your patience, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3609:53pm BitchX : Press to see who left to change to [irc.freenode.net] 11:12PM 53slang robl: welcome back 11:12PM 53slang robl: or maybe its me that's back robl slang: i think we're both back 12:12AM 53ronnocol robl: not sure what we did wrong then... essentially what happened, both times we manually added a server, we encountered the problem where we could create a directory, but not use it. 56pcarns 36n=pcarns@adsl-215-229-136.aep.bellsouth.net has joined #pvfs2 robl ah, direcotries. forgot about that one. will get back to you 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SWAP: Window 3 is not hidden! SWAP: No such window: 4 SWAP: No such window: 5 SWAP: Window 3 is not hidden! robl ronnocol: i don't know what to tell you. we did have a lot of permissions bugs that we have fixed since 1.2.0 (we also introduced a few, but we've fixed those in CVS) robl ronnocol: as uday found, re-creating the storage space is one way to get things working again robl ronnocol: and in the future (like with the upcomming 1.3.1 release) it should all "just work" 56Deedee 36n=Didi@center.shumen.spnet.net has joined #pvfs2 57Deedee is now known as 36Dafny 57Dafny is now known as 36SwEeTesT_KisS SwEeTesT_KisS n=Didi@center.shumen.spnet.net has left #pvfs2 robl wierd 12:33PM pcarns unhunh pcarns n=pcarns@adsl-215-229-136.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3608:12pm BitchX : Press to see who left to change to [irc.freenode.net] 01:05AM 53ronnocol robl: Thanks for looking into it. We are at 8.5T of storage and hope that should last us for a little while. (meaning we shouldn't have to add any servers anytime soon) We saw a couple I/O Errors today but we will continue forward and see how things go 01:06AM 53ronnocol robl: but so far, things look good. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3612:10am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're experiencing some hub <-> hub routing problems, we're looking at it now 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] We're going to experiment with a bit of latency reduction, please bear with us. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3612:22am BitchX : Press to see who left to change to [irc.freenode.net] 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Please bear with us while we rehub to complete the resolution of a routing problem we experienced earlier in the day. Thanks for your patience, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3607:20am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Our rehubbing should be complete, barring any other problems.... thanks again for your patience, and thank you for using freenode! 56pcarns 36n=pcarns@adsl-215-229-109.aep.bellsouth.net has joined #pvfs2 robl pcarns: hey. after all the bugs in 1.3.0, i think i'm going to put out a 1.3.1 w/ just bug fixes robl pcarns: i'll deal with the feature patches you sent after the release robl pcarns: er, after sc 10:10AM 53pcarns robl: that sounds like a great idea 10:11AM 53pcarns robl: I think taking the feature patches at this point would just break everything again before SC :) 56owen 36n=owen@S010600095bdadbc7.gv.shawcable.net has joined #pvfs2 02:13PM owen so, is there a pvfs2 tutorial at sc05 guys? robl owen: not pvfs2 by itself, but a more general "high performance i/o" tutorial on sunday robl owen: there's also the birds of a feathe session tuesday evening 02:30PM 53owen robl: yeah, double booked for that BOF 02:30PM owen i need to go to the eclipse bof 02:30PM owen what tutorial? 02:30PM owen the IB tutorial? robl owen: uh, hold on 02:31PM owen nope 02:31PM owen it isnt 02:31PM owen shit robl http://sc05.supercomputing.org/schedule/event_detail.php?evid=5124 02:32PM owen double booked on that one too :( 02:32PM owen shoulda just searched for latham :P 03:31PM 53slang robl: or maybe its me that's back robl slang: gonna guess you, since i only saw the 'maybe its me' robl slang: you've got a lot of pvfs2 messages scrolling by on lain pcarns n=pcarns@adsl-215-229-109.aep.bellsouth.net has left #pvfs2 06:46PM ronnocol w00t 06:46PM ronnocol wrong channel... sorry 53#pvfs2 57owen 36H n=owen S010600095bdadbc7.gv.shawcable.net (Owen Stampflee) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl heh. it's cool. w00t for 50 people signed up for my tutorial robl (well 'our', but the other 3 guys aren't in this channel) 11:57PM owen lol #pvfs2 There isn't a topic. Topic 36#pvfs2 50): changed by 36robl SC2005 events: I/O tutorial Sunday (8-5); BoF Tuesday (17:15-18:45) SignOff 57owen : #mklinux,#pvfs2 "Client exiting" SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SWAP: No such window: 4 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57ronnocol : #pvfs2 Remote closed the connection 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): SC2005 events: I/O tutorial Sunday (8-5); BoF Tuesday (17:15-18:45) Topic 36#pvfs2 50): set by 36robl at 36Wed Nov 9 07:18:58 2005 robl slang: i had no idea why the jazz tests were failing. thanks 12:13PM 53slang robl: heh - yep 12:13PM 53slang robl: hopefully its all good now :-) 12:38PM slang robl slang: you feeling ok about a release in thenext 10 mins? robl slang: the last week hasn't been confidence inspiring :> guess that's why we should sit on this stuff NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3611:58pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're experiencing some routing problems between Europe and the US. We may need to reroute. Please bear with us. 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 12:04AM 32dmwaters:* Hi all! looks like we've got some routing trouble between 2 major hubs. Got to love level3! Mode change 57-w for user 36robl 01:13AM 53slang robl: I thought I had removed that include .. sorry robl slang: that's why we're testing this release :> 56pcarns 36n=pcarns@adsl-61-120-183.mia.bellsouth.net has joined #pvfs2 01:58PM pcarns slang: I am trying to remember- did you work on something at one point that would associate a string name with each state machine transition, so you could print out what state a state machine is on? 02:26PM slang pcarns: yes 02:27PM slang pcarns: I originally made those changes to a branch that never got merged to trunk 02:28PM slang pcarns: I've gone back and redone them in my small I/O branch 02:28PM slang pcarns: slang-sio-branch 02:28PM pcarns slang: excellent! 02:28PM slang pcarns: that version will most likely get merged 02:28PM pcarns slang: I was just pondering how to implement something like that 02:28PM slang pcarns: I can send you a diff of the changes to the statecomp and state machine code if you'd like to have a look 02:29PM pcarns slang: that would be great if you don't mind 02:29PM slang pcarns: no problem 02:29PM pcarns slang: what I want to do is keep track of all the state machine instances that are running at a given time (puttting them in a linked list or something), 02:29PM pcarns slang: so that I can have a request that dumps the state of the server 02:29PM pcarns slang: what state machines are running, what state they are on, etc. 02:30PM pcarns slang: we have had some operations hang, and I can't track down how they derailed, largely because I can't grab a pointer to the s_op struct in gdb 02:30PM pcarns slang: but I can see the op in the request scheduler, and i can tell that there aren't any trove, bmi, flow jobs posted 02:31PM pcarns slang: thus my interest in figuring out what in the world some state machines are up to 02:38PM slang pcarns: that's cool 02:39PM slang pcarns: right now I just use the state name string to print out enter/exit debugging info for the state actions 02:41PM pcarns slang: that looks awesome 02:41PM pcarns do you happen to know, 02:41PM slang pcarns: what you want sounds like it might fit in with the per-request unique id stuff rob has suggesting 02:41PM pcarns if I grap a state machine structure (s_op) while it is in between states (waiting on a job to finish, for example), 02:42PM pcarns is the math still the same to get to the right name ((s_op->current_state - 3)->state_name)) 02:42PM pcarns 02:42PM pcarns slang: I assume it is, but I havn't looked at the code to confirm when that s_op->current_state pointer actually changes 02:42PM slang pcarns: after PINT_state_machine_next has been called? 02:43PM pcarns I guess state_machine_next() isn't called until the job completes eh? 02:43PM slang pcarns: I'm pretty sure it will always be 3 02:44PM pcarns slang: awesome 02:44PM pcarns slang: you are my hero 02:45PM slang pcarns: the _next and _locate functions should be the only 2 that increment the current_state 02:45PM pcarns slang: I think maybe we will at a new option to the setparam request, that will iterate through the request scheduler (printing all of the request queues) and iterate through all state machines telling where they are 02:45PM pcarns slang: so if something gets hung we can get a snapshot of what the server is up to 02:45PM slang pcarns: that's a cool idea 02:45PM pcarns slang: ok 02:46PM pcarns slang: in addition we should then also be able to gdb attach and actually find an s_op pointer in the server 02:46PM pcarns slang: nearly impossible at the moment 02:46PM 50* 53slang/#pvfs2 nods. 02:46PM pcarns slang: we don't keep references to the s_ops hanging around anywhere right now 02:47PM slang pcarns: right 02:47PM slang pcarns: you're thinking of having a static array of a few thousand that you can just push s_ops onto? 02:48PM pcarns pcarns: I haven't really thought about what data structure to use- probably just quicklist since things can be appended or removed in O(1) 02:48PM pcarns pcarns: and we won't be searching it for anything time sensitive 02:49PM pcarns just put hooks in the functions that allocate/complete state op structures to add/delete them from the quicklist 02:50PM pcarns *shrug* 02:51PM pcarns whoops, I addressed a couple of those to my own user id 02:51PM pcarns 02:52PM slang heh 02:52PM slang yeah makes sense 02:54PM pcarns slang: are you planning to remove all those little macros at the top of each state machine function in the server when this stuff is in the trunk? 02:54PM slang pcarns: yeah 02:54PM pcarns slang: double cool 02:54PM slang pcarns: most of them anyway 02:54PM slang pcarns: some of them print extra sm specific stuff 03:12PM pcarns slang: is there a diff of the state machine compiler to go with this? 03:12PM pcarns slang: I assume there needs to be something to put the string names in the state arrays? 03:22PM slang pcarns: its in there 03:22PM slang pcarns: codegen.c 03:24PM pcarns slang: oh, duh 03:25PM pcarns slang: I see now- I think my brain automatically filters out printf statements 03:25PM pcarns slang: which was exactly what I needed to look for in this case 03:25PM 50* 53slang/#pvfs2 grins 03:25PM pcarns slang: thanks 03:37PM slang printf(" 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3607:40pm BitchX : Press to see who left to change to [irc.freenode.net] 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56janx 36n=jan@d5152D086.access.telenet.be has joined #pvfs2 SignOff 57janx : #pvfs2 Client Quit NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3607:02pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl SignOff 57ronnocol : #pvfs2 "Changing server" 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-183.mia.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-61-120-183.mia.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:32pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3611:52pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56pcarns 36n=pcarns@adsl-211-217-243.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection 56slang_ 36n=slang@harley.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 104 (Connection reset by peer) 56laytonj_ 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 104 (Connection reset by peer) 53#pvfs2 57laytonj_ 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang_ 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57slang_ : #pvfs2 "leaving" 53#pvfs2 57laytonj_ 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj_ 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3605:31pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57laytonj_ : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3602:20am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" Topic 36#pvfs2 50): changed by 36slang happy thanksgiving! Netjoined: 57irc.freenode.net calvino.freenode.net 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Topic 36#pvfs2 50): happy thanksgiving! Topic 36#pvfs2 50): set by 36slang at 36Tue Nov 22 22:42:32 2005 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl phew... 1.3.1 *almost* out robl and it's off Topic 36#pvfs2 50): happy thanksgiving! Topic 36#pvfs2 50): set by 36slang at 36Tue Nov 22 22:42:32 2005 Topic 36#pvfs2 50): changed by 36robl Topic 36#pvfs2 50): changed by 36robl PVFS2-1.3.1 is out at last SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Remote closed the connection 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 104 (Connection reset by peer) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:04am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 11:17AM 53slang robl: we should get Murali in here robl slang: he's been on once or twice robl slang: ok, he's gonna sign on soon 11:33AM 53slang robl: woohoo! 56vilayann 36n=vilayann@csi0332384.mcs.anl.gov has joined #pvfs2 11:34AM vilayann hi guys! Topic 36#pvfs2 50): PVFS2-1.3.1 is out at last Topic 36#pvfs2 50): set by 36robl at 36Mon Nov 28 15:51:23 2005 11:35AM slang vilayann: hey man! 11:35AM vilayann finally, I have logged in! 11:37AM slang vil: now I can bug you without having to be at the lab ;-) 11:37AM vilayann cool! hey, it is usually me bugging you :) 11:47AM vilayann Off for lunch!! 11:47AM slang vil: are you still having failures when you try to do an out of tree build? 11:47AM slang vil: ok 11:47AM vilayann yup 11:47AM slang vil: see ya 11:47AM slang vil: hmm 11:47AM vilayann see ya in about half an hour 11:47AM slang vil; yep robl slang: how come you don't complete vilayann ? robl vl: slang has a busted irc client! 50* 57robl is stupid robl vilayann: that 11:49AM 53slang robl: or my 'ayn' keys are busted? 11:49AM slang something is busted somewhere.. 12:23PM vilayann hehe! back after a frosty lunch 12:24PM 50* 53slang/#pvfs2 waves 12:25PM 53slang robl: does myrinet on chiba have privileged vs. non-privileged ports? 12:25PM 53slang robl: 6 seems to be only accessible by root at least.. robl slang: wierd. i don't know of any such restriction 01:50PM 53slang robl: I was able to chmod 666 /dev/gm* to fix it but I don't know if that's the right thing 01:50PM 53slang robl: email systems i guess 01:51PM 53slang robl: don't mean you 01:51PM 50* 53slang/#pvfs2 will robl slang: that sounds like a familiar problem... 02:08PM vilayann how do you guys type stuff like "waves", "will"? I am IRC disadvantaged :( 02:08PM 50* 53slang/#pvfs2 uses /me 50* 57robl 02:11PM slang vl: I've got irssi running in screen too, so it looks like I'm always here ;-) 02:13PM 50* 53vilayann/#pvfs2 I see 02:14PM vilayann okay, got it! thanks 02:14PM vilayann help me 02:14PM 50* 53slang/#pvfs2 hehs 02:14PM vilayann this cross compilation stuff is broken on all my machines :( 02:15PM vilayann Have tons of pvfs2 trees floating around, and cant track which one has what! 02:15PM slang vl: cross compliation stuff? 02:15PM vilayann Oh sorry, out of tree builds... duh 02:16PM slang vl: what error do you get? 02:16PM vilayann linker error. 02:16PM vilayann some objects dont seem to get pulled in 02:17PM slang vl: for src or tests? 02:17PM vilayann src for sure. I havent tried tests in a while robl oh wow, i haven't trid building the tests in a long time either 02:18PM 53vilayann robl: looks like we wont need the disable-aio patch then? 02:18PM slang vl: so you do something like: cvs co pvfs2; mkdir pvfs2-build; cd pvfs2-build; ../pvfs2/configure ...? 02:19PM slang vl: and that gives linking errors? 02:19PM vilayann Oh does pvfs2-build have to be under pvfs2? I tried it outside of pvfs2 02:19PM vilayann and it gives linker errors 02:19PM slang vl: right 02:19PM slang vl: hmm 02:19PM 50* 53slang/#pvfs2 shrugs 02:19PM slang vl: not able to reproduce 02:20PM vilayann oh really.. have you tried this? have a src tree, create 2 dirs one for x86 and one for x86_64 02:20PM vilayann and then do a configure on an x86 and a x86_64 in each of these dirs.. 02:20PM slang vl: yeah I've started using the out-of-tree method of late 02:21PM slang vl: oh I haven't tried multiple out-of-tree from same source 02:21PM slang vl: lemme try that 02:21PM vilayann Oh sorry. I should have been clear about that.. 02:33PM slang vl: seems to work ok for multiple builds too.. 02:34PM slang vl: which linking errors do you get? libdb stuff? 03:08PM 53pcarns robl: are you about to do another quick release? 03:08PM 53pcarns robl: if so, hang tight for a pair of very small patches (one from me, one from David) 03:08PM 53pcarns robl: should be on list in next 24 hrs 03:09PM pcarns (just noticed cvs log on ChangeLog come across) robl pcarns: yup, too many "I CAN'T BUILD ON SLES 9" posts... robl pcarns: i can definitely wait 24 hrs 03:12PM pcarns thanks, composing email now 03:12PM pcarns David will send his by this evening SignOff 57vilayann : #pvfs2 "Leaving" 03:38PM 53pcarns robl: I will have some big patches next week, but those will clearly need some test time :) 03:38PM pcarns some perf counter magic, and a rewrite of some of the service functions in kernel module robl pcarns: cool. slang and vilayann have been looking long and hard at performance issues 03:42PM 53pcarns robl: real soon now (maybe tomorrow or monday) we are going to share some ideas for trove too 03:42PM 53pcarns robl: we have some good benchmark results to motivate 03:43PM pcarns should be a big deal for getattr performance on the server side robl pcarns: cool! 03:48PM pcarns we have a new guy (Derek) who has been focusing on berkeley db stuff lately 03:48PM pcarns anyway, we'll hopefully have our thoughts collected on that shortly, I think we have enough benchmark data to proceed with implementation NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3603:56pm BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57pcarns 36H n=pcarns adsl-218-108-248.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: hey, so w/ your patch, the pvfs2_client_sysint_getattr_sm 'dowork' state has two states with the same transistion? robl state dowork robl { robl jump pvfs2_client_getattr_sm; robl success => set_sys_response; robl default => set_sys_response; robl } robl 04:10PM 53pcarns robl: oh, yeah, 04:10PM 53pcarns robl: you could replace them with just a "default => set_sys_response;" transition 04:11PM 53pcarns robl: the success one is redundant 04:11PM 53pcarns robl: since both outcomes should go to the same state pcarns n=pcarns@adsl-218-108-248.asm.bellsouth.net has left #pvfs2 Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3608:11am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 50* 57robl hungry 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-218-108-248.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl HUNGRY FOR A NEW PVFS2 RELEASE 10:30AM 53slang robl: woah 10:30AM 53slang robl: plenty of chocolates robl slang: we're fresh out of pvfs2-1.3.2. i'll have to make some more 11:08AM pcarns hahaha 56rross 36n=rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 12:57PM 53rross robl: you around? SignOff 57rross : #pvfs2 Read error: 104 (Connection reset by peer) 56rross 36n=rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl rross: hi SignOff 57rross : #pvfs2 Read error: 104 (Connection reset by peer) pcarns n=pcarns@adsl-218-108-248.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3608:32pm BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-218-108-248.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 08:42AM pcarns hey guys, anyone able to connect to the pvfs2 cvs repository this morning? robl pcarns: looks unreachable to me, too robl well, down. i can traceroute to parlweb 08:44AM 53pcarns robl: ok, I'll email some folks 08:48AM 53pcarns robl: doh 08:48AM 53pcarns robl: that box also hosts mailing lists 08:49AM 53pcarns robl: perhaps I will try emailing again without using a list this time :) robl pcarns: huh. might have to call brad directly :> 08:57AM 53pcarns robl: I emailed Walt, Brad, and Will pcarns n=pcarns@adsl-218-108-248.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 robl pcarns: crap, cvs has been down all weekend SignOff 57laytonj : #pvfs2 "Leaving" pcarns n=pcarns@adsl-218-108-248.asm.bellsouth.net has left #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.1 is out at last Topic 36#pvfs2 50): set by 36robl at 36Mon Nov 28 15:51:23 2005 Topic 36#pvfs2 50): changed by 36robl PVFS2-1.3.2 is out SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 03:14PM slang what is that, irc spam? robl bad pcarns! 03:53PM slang SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 "leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3602:58am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-218-108-248.asm.bellsouth.net has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57pcarns 36H n=pcarns adsl-218-108-248.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 56ronnocol_ 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56laytonj_ 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Connection timed out SignOff 57ronnocol : #pvfs2 Read error: 110 (Connection timed out) SignOff 57pcarns : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3603:52pm BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57laytonj_ 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol_ 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57laytonj_ : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3608:47pm BitchX : Press to see who left to change to [irc.freenode.net] 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:17pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:18pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol_ 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:22pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56ronnocol_ 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3610:40pm BitchX : Press to see who left to change to [irc.freenode.net] 12:11AM ronnocol_ evening all 57ronnocol_ is now known as 36ronnocol 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 12:16AM ronnocol Evening slang_ SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56laytonj 36n=laytonj@24.196.226.167 has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-218-107-239.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-218-107-239.asm.bellsouth.net has left #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-218-107-239.asm.bellsouth.net has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-218-107-239.asm.bellsouth.net (gaim) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl ronnocol: hey (sorry, don't pay much attention here over the weekends) 11:56AM 53ronnocol robl: morning 11:56AM 53ronnocol robl: or afternoon... depending on where you are I suppose 11:58AM 53ronnocol robl: We have an application that does a lot of stat() calls (because it's written in Java, and there doesn't seem to be a way to do a single stat() it does lot's of stat()'s) 11:59AM 53ronnocol robl: is there a way to speed these types of file accesses up? 12:01PM 53ronnocol robl: According to time, it took 0m3.366s to deterimine if the file was a directory, it's size, and if it was readable on PVFS 12:01PM 53ronnocol robl: for comparison.. my C code took 0m1.976s, so obviously java just sucks :) 12:02PM 53ronnocol robl: I was reading in the FAQ about the AttrCache configs and optimizations that can be enabled (if the app can deal with out-of-sync caches) 12:03PM 53ronnocol robl: But it doesn't say how to enable those optimizations, and I was wondering if there was any info on what to set the AttrCache settings to as a SWAG setting 12:03PM ronnocol gotta run to a meeting... I'll check back in a bit later. robl ronnocol: yeah, not something i'm terribly familiar with. Might want to ask on -users. SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56Fobax 36i=Fobax@d198-166-49-97.abhsia.telus.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-218-107-239.asm.bellsouth.net has joined #pvfs2 01:57PM 53pcarns robl: you guys are about to get an avalanche of patches 01:57PM 53pcarns robl: we may need to talk about how to integrate some of them if you guys are interested robl pcarns: heh. nice! robl pcarns: what problems do you anticipate? 02:10PM 53pcarns robl: well, I have a couple of patch sets that are big changes, 02:11PM 53pcarns robl: one is the rewrite of the lowest level acache piece, 02:11PM 53pcarns robl: and another is a significant rewrite/update of the performance counters (motivated so that they can be used more easily on the client side) 02:13PM 53pcarns robl: I have a 3rd major change in our tree, which is an overhaul of the service_* macros in the kernel code, but that I am going to sit on until the others are sorted out one way or another 02:14PM 53pcarns robl: some of these might be hard to apply at this point, but if you guys decide you want them I can redo the patches so they are back in sync with the clemson tree, or help get them applied in a branch of the clemson tree or something 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SWAP: No such window: 4 SWAP: Window 3 is not hidden! 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 pcarns n=pcarns@adsl-218-107-239.asm.bellsouth.net has left #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3605:30pm BitchX : Press to see who left to change to [irc.freenode.net] 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-218-107-239.asm.bellsouth.net has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 pcarns n=pcarns@adsl-218-107-239.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56Elwell 36n=elwell@rhum.elwell.org.uk has joined #pvfs2 07:13AM Elwell Quickie Q - What version of linux requires least hacking to work as a PVFS2 server presently? robl Elwell: 2.4.19 or newer, 2.6. robl Elwell: we also work with just about any vendor kernel robl Elwell: the pvfs2 kernel module compiles out-of-tree, so there really isn't any patching or hacking to speak of Fobax i=Fobax@d198-166-49-97.abhsia.telus.net has left #pvfs2 56pcarns 36n=pcarns@adsl-211-251-106.asm.bellsouth.net has joined #pvfs2 01:40PM 53Elwell robl: cool. Am probably going to use debian for our servers with 2.6.`whatevers in sarge` robl Elwell: that'll work fine. it's one of our nightly test environments 01:49PM Elwell what I like to hear. almost as good as "there's a .deb on the FTP site" :-) 53#pvfs2 57pcarns 36H n=pcarns adsl-211-251-106.asm.bellsouth.net (gaim) 53#pvfs2 57Elwell 36H n=elwell rhum.elwell.org.uk (Andrew Elwell) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: so i'm finally taking a look at your acache patch robl pcarns: might take me a hile 02:48PM 53pcarns robl: ok, let me know if you need anything, I can clean up patches or whatever if needed SignOff 57pcarns : #pvfs2 Read error: 110 (Connection timed out) SignOff 57laytonj : #pvfs2 "Leaving" 05:50PM Elwell Hi folks - Trying to build 1.3.2 for the BGL js20 frontends (client only) 05:50PM Elwell ./configure --with-kernel=/usr/src/linux --disable-server 05:51PM Elwell uname -r is 2.6.5-7.201-pseries64 05:51PM Elwell I'm getting make kmod 05:51PM Elwell Building modules, stage 2. 05:51PM Elwell MODPOST 05:51PM Elwell *** Warning: ".mmgrab" [/home/z01/andrewe/compile/pvfs2-1.3.2/src/kernel/linux-2.6/pvfs2.ko] undefined! 05:58PM Elwell and when I try and insmod I get: 05:58PM Elwell insmod: error inserting './src/kernel/linux-2.6/pvfs2.ko': -1 Unknown symbol in module 06:51PM Elwell oh... and finally for the night... Should I be using 1.3.2 or 1.2.0 with the latest zeptoos client? robl Elwell: http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-December/001110.html and robl http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-December/001108.html 02:03AM Elwell meh - close but ./pvfs2-client -f -p ./pvfs-client-core is barfing on a /dev error looking at the log and keeps looping 02:16AM Elwell Dec 16 07:25:28 bglfen3 kernel: pvfs2: module not supported by Novell, setting U taint flag. 02:16AM Elwell Dec 16 07:25:28 bglfen3 kernel: pvfs2: module version 1.3.2 loaded 02:16AM Elwell Dec 16 07:28:55 bglfen3 kernel: ioctl32(pvfs2-client-co:7206): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req 02:16AM Elwell Dec 16 07:28:57 bglfen3 kernel: ioctl32(pvfs2-client-co:7207): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req 02:16AM Elwell Dec 16 07:28:58 bglfen3 kernel: ioctl32(pvfs2-client-co:7208): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req 02:16AM Elwell Dec 16 07:28:59 bglfen3 kernel: ioctl32(pvfs2-client-co:7209): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req 02:16AM Elwell Dec 16 07:29:00 bglfen3 kernel: ioctl32(pvfs2-client-co:7210): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req 02:16AM Elwell Dec 16 07:37:55 bglfen3 kernel: pvfs2: module version 1.3.2 unloaded 02:17AM Elwell crw------- 1 root root 254, 0 Dec 16 07:28 /dev/pvfs2-req robl Elwell: if you google for 'pvfs2 ppc64' you'll find this one: robl http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-April/000611.html 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We momentarily opened up irc.freenode.net, but as you may have noted, we're still seeing heavy spambot activity. We're reverting again. If you're running an infobot here, or are having trouble connecting, please take a look at http://freenode.net/news.shtml .... thank you for your patience, and thank you for using freenode! 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- You have already identified NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3607:08pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57laytonj : #pvfs2 "Leaving" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. In a few moments we're going to test a patch on one main rotation server which will hopefully result in our being able to reopen irc.freenode.net .... we'll have to reup the server...affected users about 2400. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] If all goes well, we may reup the rest of the servers at some point over the weekend, perhaps this morning. Thanks. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3604:26am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Our patch was not as successful as we might have hoped. We're going to be tweaking the config lines and trying again, but it doesn't look hopeful. Thanks for your patience. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Okay, it's time to reup that server once more. We're going to tweak the patch, but it looks like we're getting about 20% of the bots or less. IF this tweak doesn't work, we'll go back to chat.freenode.net . For more information on why irc.freenode.net isn't working, and how to connect to freenode (please spread the word), see http://freenode.net/news.shtml .... thank you. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3604:38am BitchX : Press to see who left to change to [irc.freenode.net] 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Okay, folks. We can use your help now. It *looks* as if we've solved our problem, at least until the bots change. But would you please message me if you get any spambots or spam that you are sure occurred *after* this global notice? Thank you! 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. It's looking as if we should now be recompiling the rest of the servers and reupping the main rotation servers one at a time. I've had no reports of problems since the upgrade. That's not to say that the bots won't mutate sometime soon, but for now we can run irc.freenode.net. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Okay, here goes. In just a few moments, a rather large main rotation server will be restarted. It will be followed by another, and another, and then by smaller servers. Please bear with us. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3605:26am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3605:30am BitchX : Press to see who left to change to [irc.freenode.net] 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 Elwell 54 ronnocol 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.864 secs!! #pvfs2 [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks! 56ChanServ 36ChanServ@services. has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56Elwell 36n=elwell@rhum.elwell.org.uk has joined #pvfs2 #pvfs2 [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks! 56Elwell 36n=elwell@rhum.elwell.org.uk has joined #pvfs2 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 06:24AM 32lilo:* kline adjustments; you may see a few bots 08:18AM 32lilo:* More kline adjustment; you may see the occasional spambot for a second. Thanks. 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-159.mia.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-159.mia.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57Elwell 36H n=elwell rhum.elwell.org.uk (Andrew Elwell) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-159.mia.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-61-120-159.mia.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57Elwell 36H n=elwell rhum.elwell.org.uk (Andrew Elwell) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: hey, i think this is your stuff: HAVE_PROC_HANDLER_SIX_ARG robl pcarns: but somewhere along the line we missed the configure test robl pcarns: can you resend robl pcarns: ? robl (well, just the configure test) 09:57AM 53pcarns robl: yeah, let me figure out what patch I've got it in, just a minute NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3610:45am BitchX : Press to see who left to change to [irc.freenode.net] 10:49AM 53pcarns robl: looks like we need an "extern int op_timeout_secs" in waitqueue.c as well pcarns n=pcarns@adsl-61-120-159.mia.bellsouth.net has left #pvfs2 04:38PM 32lilo:* Hi all. If you're seeing spambots that are not getting klined, please let us know. so far we've removed about 8500 IP's (maybe 24,000 bots) with the new patch, but if they're getting smarter we'll need to know about it.... thanks 04:39PM 32lilo:* please feel free to message at this nick .... thanks! SignOff 57laytonj : #pvfs2 "Leaving" Mode change 57-w for user 36robl 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3612:14pm BitchX : Press to see who left to change to [irc.freenode.net] 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54 Elwell 54 ronnocol 54ChanServ #pvfs2 [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks! Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.730 secs!! 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 04:20PM 32lilo:* restart, affected users 86 Mode change 57-w for user 36robl SignOff 57laytonj : #pvfs2 "Leaving" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Good morning, everyone. We'll be restarting a number of servers later this morning, and the restarts will affect most of our users. For more information, please see the news page: http://freenode.net/news.shtml . Thanks for your patience, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:06am BitchX : Press to see who left to change to [irc.freenode.net] 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Per the news item from earlier this morning ( http://freenode.net/news.shtml ), we're about to have a fairly large, though hopefully quick, break in service.... it should all hit in roughly five minutes. Thanks. NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:13am BitchX : Press to see who left to change to [irc.freenode.net] 56Elwell 36n=elwell@rhum.elwell.org.uk has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57zelazny.freenode.net 3612:14am BitchX : Press to see who left to change to [irc.freenode.net] 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 Elwell Netjoined: 57irc.freenode.net zelazny.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.546 secs!! 56ronnocol 36n=lance@216.58.72.60 has joined #pvfs2 SignOff 57ronnocol : #pvfs2 Killed by ballard.freenode.net (Nick collision) 56ronnocol 36n=lance@216.58.72.60 has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54 ronnocol 54ChanServ 54 Elwell Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.247 secs!! 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance 216.58.72.60 (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57Elwell 36H n=elwell rhum.elwell.org.uk (Andrew Elwell) You are not on a channel. Use /WHO ** to see everybody. 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54 ronnocol 54ChanServ 54 Elwell Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 1.134 secs!! SWAP: No such window: 4 SWAP: Window 3 is not hidden! You are not on a channel. Use /WHO ** to see everybody. 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+nt by 57irc.mzima.net 52Users 32#pvfs2 50)] 54robl Channel #pvfs2 was created at Thu Dec 22 15:43:05 2005 BitchX : Join to #pvfs2 was synched in 0.202 secs!! robl ~robl@ninjak.clustermonkey.org has left #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54 ronnocol 54ChanServ 54 Elwell Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 5.171 secs!! Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Thu Dec 22 15:45:22 2005 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 laytonj 54 ronnocol 54ChanServ 54 Elwell Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 0.998 secs!! SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3612:53am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. On behalf of the staff and volunteers of Peer-Directed Projects Center, I wanted to take this opportunity to wish you all, "Happy holidays!" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Our first level support ( http://freenode.net/faq.shtml#gettinghelp ) may be a bit light through the beginning of the year 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Have a great holiday season, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3601:06pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3606:32pm BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net calvino.freenode.net 56ronnocol 36n=lance@216.58.72.60 has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3606:36pm BitchX : Press to see who left to change to [irc.freenode.net] 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're experiencing server issues....there may be some server recycles needed. Please bear with us. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3606:52pm BitchX : Press to see who left to change to [irc.freenode.net] 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Our problems are a little less broad than we've thought.... affected users, about 7,000, and we should be stable. We're removing one server from the main rotation and we've shut it down. Apologies for any inconvenience. If there are no more high-impact problems, any further messages will be on wallops. NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3607:10am BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57Elwell : #pvfs2 Nick collision Netjoined: 57irc.freenode.net calvino.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56Elwell 36n=elwell@rhum.elwell.org.uk has joined #pvfs2 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 07:42AM 32lilo:* Added two new items to the freenode channel guidelines. See "Look for the best in people" and "Set a good example". Maybe intuitive stuff, but it never hurts to lay things out. http://freenode.net/channel_guidelines.shtml .... 56pcarns 36n=pcarns@adsl-145-179-39.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-145-179-39.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-145-179-39.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-145-179-39.asm.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57calvino.freenode.net 3602:45am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-145-179-39.asm.bellsouth.net has joined #pvfs2 08:14AM 53pcarns robl: are you able to get to parl cvs this morning? 08:16AM pcarns looks like the file server is down over there robl pcarns: heh. it's vacation dude, i haven't tried in days :> robl pcarns: but yeah, tinderbox is out 10:52AM 53pcarns robl: I should have asked santa for a more reliable parl network :) pcarns n=pcarns@adsl-145-179-39.asm.bellsouth.net has left #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 ronnocol 54 Elwell 54ChanServ #pvfs2 [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks! Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 16.694 secs!! 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 56pcarns 36n=pcarns@adsl-145-179-39.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-145-179-39.asm.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:55pm BitchX : Press to see who left to change to [irc.freenode.net] 11:20PM 32lilo:* annoyance attack in process, apologies for any inconvenience....please relay to new users when they're able to connect 56pcarns 36n=pcarns@adsl-145-179-39.asm.bellsouth.net has joined #pvfs2 robl pcarns: so you working this week? 08:53AM 53pcarns robl: yep 08:53AM 53pcarns robl: ANL still out for the week? robl pcarns: yeah. it's nice :> 08:57AM 53pcarns robl: I'm like the only one working at Acxiom this week, seems like :) pcarns n=pcarns@adsl-145-179-39.asm.bellsouth.net has left #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Good morning all....please take a look at the news page when you get a chance. Happy holidays. :) http://freenode.net/news.shtml 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. In about 45 minutes, it will be 2006 on Kiritimati (Christmas Island).... don't forget to go get your invitation to freenode's New Year's celebration.... http://freenode.net/news.shtml :) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Okay, folks, this is it. We are approaching New Year's on Kiritimati, which is pretty much the first moment it's 2006 on Planet Earth. Please come by #freenode-newyears and help us celebrate! :) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3602:22am BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57ronnocol : #pvfs2 Read error: 110 (Connection timed out) 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-34-58-210.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-34-58-210.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-34-58-210.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-34-58-210.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarn1 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 SignOff 57Elwell : #pvfs2 Remote closed the connection Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 pcarn1 n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 SignOff 57ronnocol : #pvfs2 Read error: 104 (Connection reset by peer) 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36G n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 robl pcarns: hey man 11:30AM 53pcarns robl: hey robl pcarns: in your acache tests, do you often run with mutiple metadata servers? 11:30AM pcarns I ran some this weekend, actually 11:30AM pcarns 15 servers, each doing meta and i/o 11:31AM pcarns I haven't looked at results yet (that was a 60 client run) but, 11:31AM pcarns I did look at some single client results 11:31AM pcarns got one oddball- removing files seemed to be _slower_ with cache enabled 11:31AM pcarns otherwise I haven't seen anything funny 11:32AM 53pcarns robl: what's up? 11:34AM 50* 53pcarns/#pvfs2 is heading to lunch robl pcarns: i'm trying to track down something where pvfs2-cp, reading from pvfs2, triggers an assertion robl pcarns: cool (re: lunch). i'm off to ultimate 12:17PM 53pcarns robl: hmm, I don't know 12:17PM pcarns I just started some LTP tests after merging from the clemson tree and I am seeing some problems too 12:17PM 53pcarns robl: with single server and single client 12:41PM 53pcarns robl: you hitting this assertion? sys-small-io.sm:183 12:41PM pcarns I am getting that from pvfs2-client-core while running the read01 test from LTP project 12:42PM pcarns ohhh 12:42PM 53pcarns robl: that was just fixed in clemson cvs, wasn't it... 12:43PM 53pcarns robl: yep, ok, let me try with that change 12:56PM 53pcarns robl: I took out that assertion (as in cvs) and it seems to just get stuck elsewhere 12:57PM 53pcarns robl: ah- its then on to server side: 12:57PM pcarns [E 19:56:37.776476] ../pvfs2_src/src/io/description/pint-request.c line 89: PINT_process_request: NULL segmax or bytemax! 12:58PM pcarns 12:58PM pcarns [E 19:56:37.776654] small_io: Failed to process file request 01:17PM pcarns hmm, one problem is that server state machine won't send negative acks, I think 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 robl 12:57PM robl: ah- its then on to server side: robl 12:57PM [E 19:56:37.776476] robl ../pvfs2_src/src/io/description/pint-request.c line 89: robl PINT_process_request: NULL segmax or bytemax! robl 12:58PM robl 12:58PM [E 19:56:37.776654] small_io: Failed to process file request robl 01:17PM hmm, one problem is that server state machine won't send robl negative acks, I think 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 03:05PM pcarns slang: you there? 03:06PM slang pcarns: yep 03:06PM pcarns slang: I see something weird in sys-small-io.sm, 03:07PM pcarns slang: in small_io_setup_msgpairs(), the regions variable is always zero unless it is a write operation 03:07PM pcarns slang: does there need to be an else block to go with the "io_type == PVFS_IO_WRITE" if block? 03:07PM pcarns to handle the read case? 03:08PM pcarns the regions variable being set to zero leads to the total_size being set to zero, which leads to bytemax being set to zero on the server side, and then the error I posted on pvfs2-developers, I think 03:09PM slang ah ok 03:09PM slang pcarns: it should be zero for reads 03:09PM slang pcarns: but bytemax shouldn't be 03:09PM slang pcarns: so the change is probably on the server 03:09PM slang pcarns: to set bytemax correctly 03:10PM pcarns slang: ok, I had a feeling I didn't really grasp what was supposed to happen there :) 03:10PM pcarns slang: yeah, bytemax on the server is set directly from the total_bytes field, which will be set to zero by the SMALL_IO_FILL macro if regions is zero 03:11PM slang right 03:11PM slang SET_FINAL also uses total_bytes 03:11PM slang (on the server) 03:12PM slang should probably be ds_attr.b_size for both 03:12PM slang (both SET_FINAL and bytemax in the case of a read) 03:15PM pcarns mmm, not sure 03:15PM slang pcarns: except that the filereq might be tiled 03:15PM pcarns what will tell server where the end of the read should be? (for example, if you ask to read 5 bytes from the beginning of a 500 byte file) 03:15PM pcarns yeah 03:16PM pcarns filereq is always tiled 03:16PM pcarns by default 03:16PM slang pcarns: not if its the same size as the memreq, but yeah 03:16PM pcarns right 03:16PM slang so I should probably set total_bytes to memreq.agg_size for a read 03:16PM pcarns memreq isn't tiled, so it will form the limit if the two don't match 03:17PM pcarns that would probably work 03:17PM pcarns I think the regular I/O function does something like that 03:18PM 50* 53pcarns/#pvfs2 is kind of winging it - I don't really remember all this stuff 100% 03:19PM pcarns PINT_REQUEST_TOTAL_BYTES(sm_p->u.io.mem_req) can tell you the total for a mem req 03:23PM 50* 53slang/#pvfs2 nods 03:55PM slang pcarns: well that fixes the PINT_request error 03:56PM slang pcarns: but now when I try to untar a big tarball I get an EOF error at some point 03:57PM pcarns hmm 03:57PM slang although that may be unrelated 03:57PM pcarns read01 passes with that fix 03:57PM slang I noticed writes were returning 0 sometimes with small io 03:57PM slang last friday 03:57PM slang I'll commit this fix and go investigate that 03:59PM pcarns 03:59PM pcarns if you commit what you have so far I'll sync up and keep looking at it too 04:01PM pcarns thanks pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 12:43AM 32lilo:* Looks as if we'll be restarting another main rotation server soon; this time about 1,300 users affected. If you're on the server in question, your status/notices window should have information on it. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:03am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:14am BitchX : Press to see who left to change to [irc.freenode.net] 01:17AM 32lilo:* in the middle of preparations, we had one of our hubbing problems in Australia.... affected users, about 320 01:18AM 32lilo:* those users are now back....meanwhile, the scheduled server restart has been performed, and we're about 500 users short....they're slowly trickling back 01:22AM 32lilo:* looks as if we're just about back up to speed.... thanks everyone 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Hi all. Please be aware that the server you're on, brown.freenode.net, is due for a scheduled restart as soon as we can get the user count down a bit. Please help us out by disconnecting and reconnecting to the main rotation, chat.freenode.net , as soon as you're able. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Have a great afternoon, and thank you for using freenode! 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 08:49AM pcarns slang: I merged again this morning but now I am getting server crashes 08:49AM pcarns slang: you guys seeing anything like that up there? SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 10:02AM 50* 53slang/#pvfs2 waves 10:02AM slang pcarns: you there? 10:02AM pcarns slang: yep 10:02AM slang pcarns: do you know where the server is crashing? 10:03AM slang pcarns: or what you're doing to make it happen? 10:03AM pcarns different places, seems to be a memory corruption 10:03AM slang pcarns: ah 10:03AM slang pcarns: how can I reproduce? 10:03AM pcarns slang: I'm running read01 from LTP test, but I don't know how easy that is to run for you 10:04AM pcarns you can skip running the whole test- just build LTP, go to testcases/bin dir, set TMPDIR env var to your pvfs2 mount point, and ./read01 robl slang: looks like pvfs2-cp is enough to trigger it 10:04AM 53slang robl: hmm...not for me.. 10:07AM pcarns I don't think there is anything special about read01, looks like it is just trying to read 512 bytes from beginning of a file when I run into trouble 10:08AM pcarns but I'm not entirely sure 10:09AM pcarns slang: I think I see the problem 10:09AM pcarns read_list is called with result.bytes as the amount to be read 10:10AM pcarns but the memalloc right before it is allocating s_op->req->u.small_io.total_bytes bytes 10:10AM pcarns the latter is 0, the former is 512 10:10AM pcarns in my case 10:10AM pcarns so not enough memory allocated to read data into 10:12AM pcarns slang: yep, I changed BMI_memalloc() to use result.bytes as size argument and it doesn't crash any more 10:12AM pcarns is that the correct fix, though? pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 10:28AM pcarns hello? 10:28AM pcarns I think my irc client broke :) 10:31AM slang pcarns: hi 10:31AM slang pcarns: sorry 10:31AM slang pcarns: bossman was inna office 10:32AM pcarns slang: np- my irc session did something weird, so I wasn't sure if it was working 10:33AM slang pcarns: hmm...on a read total bytes is zero..yeah I think you need result.bytes 10:38AM pcarns slang: I've got some other less critical failures now 10:38AM pcarns different tests 10:39AM pcarns slang: access02 test from LTP triggers this in pvfs2-client 10:39AM pcarns [E 01/10 17:33] ../pvfs2_src/src/io/description/pint-request.c line 89: PINT_process_request: NULL segmax or bytemax! 10:39AM pcarns not sure what its up to yet 10:39AM slang pcarns: again! 10:39AM pcarns different place, though :) 10:39AM pcarns last time was on server 10:40AM slang right 10:49AM pcarns slang: this one is happening from io_find_total_size; may not have anything to do with small-io 10:50AM slang pcarns: maybe not 10:51AM slang pcarns: the small-io sm returns from being jumped-to before that function is called though 10:51AM slang pcarns: does access02 create holes in the logical file? 10:52AM pcarns *shrug* 10:52AM pcarns the strace is confusing 10:52AM pcarns and I haven't stepped through it with gdb yet 10:54AM pcarns grr, something weird is going on, not seeing extra gossip statements I am adding... 10:55AM pcarns I'll tackle this again after lunch 10:55AM slang pcarns: heh..ok 10:55AM slang pcarns: I'll try to reproduce it in the meantime 10:56AM 50* 53slang/#pvfs2 always forgets if its PVFS2_DEBUGMASK or PVFS2DEBUG_MASK 10:56AM slang I usually end up setting both robl slang: testing 31msg 51slang 50)] SignOff 57slang : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 11:15AM 50* 53slang/#pvfs2 frrs 11:15AM slang pcarns: access02 doesn't cause any errors on the client when I run it 11:15AM slang pcarns: assuming I'm running it right 11:23AM slang pcarns: how many servers do you have running? 11:40AM pcarns slang: just one server 11:41AM pcarns slang: I'll pull the stock cvs tree and make sure its not just something in my tree 12:05PM pcarns slang: access2 breaks worse on the official tree for me 12:08PM pcarns slang: are you guys turning off acache or something? 12:09PM pcarns slang: official tree still needs fix from this email: 12:09PM pcarns http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-December/001737.html 12:10PM pcarns slang: if I turn off acache in official tree then I see access02 failure that I get on my tree 12:18PM slang pcarns: ah ok 12:19PM slang pcarns: somehow I missed that mail 12:19PM slang pcarns: I think I may have just deleted all emails received while on vacation ;-) 12:19PM pcarns 12:19PM slang pcarns: I'm not turning off acache specifically, no 12:20PM slang pcarns: but only the handles are cached by default right? 12:20PM pcarns I don't know what's different about our setup... 12:20PM slang pcarns: I thought -a had to be specified to pvfs2-client to make the cache timeout nonzero 12:20PM pcarns slang: how are you starting pvfs2-client? 12:20PM pcarns slang: if you run pvfs2-client -p ./pvfs2-client-core, for example, it tacks on a -a for your 12:21PM pcarns "your" -> "you" 12:21PM slang pcarns: ah 12:21PM pcarns defaults to 5 ms 12:21PM slang pcarns: I'm just running pvfs2-client-core directly :-) 12:22PM pcarns if you make the fix from that email, you might as well grab this one too while you are at it: 12:22PM pcarns http://www.beowulf-underground.org/pipermail/pvfs2-developers/2006-January/001741.html 12:22PM pcarns both emails are just to fix little things from the merge 12:22PM pcarns although the first one is pretty important (the cache miss one) 12:23PM slang pcarns: by official tree, you just mean pvfs2's cvs HEAD, right? 12:23PM pcarns yeah 12:23PM pcarns slang: I just say "official" to keep myself straight- I am usually running out of a modified tree we maintain at acxiom 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. For reference, MacWorld coverage: #apple-x in English, #macbidouille en Francais 12:27PM pcarns slang: ok, I see how to trigger it! 12:27PM pcarns cd /mnt/pvfs2 12:27PM pcarns touch foo 12:27PM pcarns chmod a+x foo 12:27PM pcarns ./foo 12:28PM pcarns or "cat foo" even works 12:28PM pcarns something to do with 0 byte file 12:28PM pcarns slang: access02 happened to be trying to exec the file, but I think just reading a zero byte file was the issue 12:29PM slang pcarns: ok that makes sense 12:29PM slang pcarns: I guess I need a check in find_total_size 12:39PM slang pcarns: that seems to fix it 12:40PM pcarns slang: fix for the "reading a zero byte file" issue? 12:40PM slang pcarns: yeah 12:40PM pcarns slang: awesome 12:42PM slang btw, what irc command do you use for slang: ? 12:42PM pcarns just typing it 12:42PM slang I've just been typing 'pcarns:' 12:42PM slang 12:42PM slang hmm 12:43PM pcarns does it show up right on your end? 12:43PM pcarns (beep or colorize or something) 12:43PM pcarns mine does, but I think it just beeps when my username shows up anywhere in a message 12:43PM slang pcarns: I'm using MacIrssi which has a growl plugin that gives me notifications on my desktop when you talk to me directly, but when robl tries it doesn't show up 12:45PM 50* 53slang/#pvfs2 shrugs robl slang: did you commit that result.bytes change you and pcarns were discussing earlier? 12:47PM 53slang robl: hey now it works! 12:47PM 53slang robl: yes committed 12:47PM pcarns slang: ok, assuming the fix works for me, I still have one last LTP failure (pwrite04) 50* 57robl sees it now robl pcarns: i bet i know what that's about 12:48PM 53pcarns robl: oh yeah? have you guys seen some problems with pwrite? robl pcarns: http://www.parl.clemson.edu/pipermail/pvfs2-users/2006-January/001163.html robl pcarns: but i committed murali's fix 12:50PM slang pcarns: pwrite04 works for me 12:50PM slang (with client-core -a) 12:50PM pcarns everything works for slang! 12:50PM 50* 53pcarns/#pvfs2 is all alone with his troubles... 12:51PM slang pcarns: heh - that either makes me the best beta tester or the worst.. 12:51PM slang pcarns: depending on which side of the code you are I suppose 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] At the same time Macworld Expo started, FSF announced the addition of Gnash, a flash player and firefox plugin ( http://tinyurl.com/a6mev ).... it's one of the FSF's priority projects ( http://www.fsf.org/campaigns/priority.html ) and a real FOSS milestone 12:52PM pcarns you sure the pwrite04 is hitting your pvfs2 mount point? 12:52PM pcarns slang: maybe strace to confirm? 12:52PM pcarns slang: I only suggest b/c I have had that happen before (set env var wrong or something and it just hit /tmp or something) 12:52PM 53pcarns robl: I think I have the fix in my tree 12:54PM slang open("pwrite04_file.31236", O_RDWR|O_CREAT, 0666) = 3 12:54PM slang pwrite(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024, 0) 12:54PM slang = 1024 12:54PM slang I'm sitting in the pvfs2 mountpoint 12:55PM slang its opening other files in /tmp, but I don't see any pwrites on those 12:56PM slang pcarns: oh 12:56PM slang pcarns: chdir 12:56PM slang pcarns: how do I specify a different dir? 12:56PM pcarns slang: set env variable TMPDIR to point to the directory you want it to work in 12:57PM slang $pwri/pwrite04 12:57PM slang pwrite04 1 FAIL : file size is 4096 != K4 12:57PM pcarns slang: yes! that's the failure I am getting 12:57PM 50* 53pcarns/#pvfs2 isn't crazy after all 12:58PM pcarns slang: that test did not always fail 12:58PM pcarns slang: msg that gets printed is actually a typo, but it should succeed 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] (sorry, I think we nailed that news site....here's the release on the Gnash flash player and firefox plugin: http://www.fsf.org/news/gnash.html ) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Thank you for using freenode, and have a great evening! 12:59PM pcarns slang: pwrite04.c:203 in my version of LTP (rather old) 01:02PM pcarns granted, the code doesn't make much sense to me 01:02PM pcarns (didn't realize pwrite() honored O_APPEND) 01:03PM slang pwrite(3, "\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1"..., 1024, 1024) = 1024 01:03PM slang close(3) = 0 01:03PM slang open("pwrite04_file.31275", O_RDWR|O_APPEND) = 3 01:03PM slang fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0 01:03PM slang lseek(3, 2048, SEEK_SET) = 2048 01:04PM slang pwrite(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024, 0) = 1024 01:04PM slang lseek(3, 0, SEEK_CUR) = 2048 01:04PM slang fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0 01:04PM slang fstat64(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 9), ...}) = 0 01:04PM slang mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7fe9000 01:04PM slang write(1, "pwrite04 1 FAIL : file siz"..., 48pwrite04 1 FAIL : file size is 4096 != K4 01:04PM slang ) = 48 01:04PM slang pcarns: so mmap2 is failing? 01:04PM slang pcarns: why is the fd -1? 01:04PM pcarns slang: its not the mmap failing 01:05PM pcarns slang: the test program is checking st_size from one of those fstat64 calls and finding a wrong size 01:05PM pcarns slang: this one: fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0 01:06PM pcarns slang: according to test proram, st_size should be 5 k rather than 4 k 01:07PM pcarns slang: it did a pwrite with an offset of zero, but says that since it was open with O_APPEND set that the data should have been appended to the end of the file 01:07PM pcarns slang: which is news to me, but apparently we passed this test before somehow 01:08PM slang pcarns: I think Murali made some changes re: O_APPEND a while back 01:14PM pcarns slang: any chance you can go ahead and commit the 0 byte file read fix? 01:14PM slang pcarns: i thought I did 01:14PM pcarns oh.. robl pcarns: Members: robl src/client/sysint/sys-getattr.sm:1.93->1.94 robl src/client/sysint/sys-io.sm:1.136->1.137 robl src/common/misc/pint-perf-counter.c:1.9->1.10 robl src/server/small-io.sm:1.10->1.11 01:15PM 53pcarns robl: doh! I was watching wrong mail folder 01:15PM pcarns slang: thanks! 01:18PM pcarns merging up here now (need to roll some rpms) 01:30PM slang pcarns: murali is now looking at pvfs2_file_write 01:31PM slang pcarns: it appears that generic_write_checks modifies the offset value 01:31PM slang pcarns: and the current code doesn't reset it correctly in the case of pwrite 01:31PM slang although 01:32PM slang when I try to do: *offset = original_offset; 01:32PM slang right after generic_write_checks 01:32PM slang pwrite04 still fails 01:40PM slang removing the generic_write_checks altogether also does not help 02:18PM pcarns slang: I think this is where we are getting snagged: 02:18PM pcarns /* for whatever reason, count is being set to inode->i_size in 02:18PM pcarns * generic_write_checks with O_APPEND opens. So if we want that to work, 02:18PM pcarns * we would have to do a getattr for the size which is ridiculous. 02:18PM pcarns * So we work that around here... 02:18PM pcarns */ 02:18PM pcarns if ((file->f_flags & O_APPEND) && (*offset != file->f_pos)) 02:18PM pcarns { 02:18PM pcarns *offset = file->f_pos; 02:18PM pcarns } 02:19PM pcarns the comment describes it, normally in O_APPEND mode we are supposed to set the *offset to the size of the file at the beginning of pvfs2_file_write() 02:22PM pcarns so I guess really this is an optimization- we don't really want to "fix" it :) 02:23PM pcarns is there a common app that writes in O_APPEND mode? (probably cp or something with our luck) 02:33PM slang pcarns: I tried removing that if block 02:34PM slang pcarns: didn't fix it 02:34PM slang pcarns: you're saying keep the if block? 02:34PM pcarns 02:34PM pcarns I don't know 02:35PM slang pcarns: the way murali described it, offset was being reset to file->f_pos because generic_write_checks was modifying it 02:35PM pcarns the fix would probably be to remove if block and also update i_size (by way of getattr) before calling write checks 02:35PM slang pcarns: ah right 02:36PM slang pcarns: I think murali was trying to aviod the getattr 02:36PM slang avoid 02:36PM pcarns slang: yeah 02:36PM pcarns slang: so I don't really know what the pros and cons are 02:36PM pcarns slang: if it is worth the getattr or not 02:39PM pcarns slang: although it seems like at least in the single client case we should be able to keep i_size more or less acurate on our own 02:39PM pcarns slang: not sure why it doesn't have the value we want if we remove the if block 02:40PM pcarns slang: maybe it should be updated on the way out of pvfs2_file_write()? 02:40PM slang pcarns: oh 02:40PM slang pcarns: well I was resetting offset 02:41PM pcarns slang: what do you mean? 02:41PM slang pcarns: I didn't just remove the if block 02:41PM slang pcarns: I replaced it with *offset = original_offset; 02:43PM pcarns slang: I'm going to try adding an if statement to set i_size() on the way out of file_write() and then remove the if block (without resetting offset) to see what that does 02:48PM pcarns that seemed to work for this test program, but I don't know what else it might have broken 02:48PM pcarns slang: do you remember why murali made this fix originally? is there a mailing list post? 02:52PM pcarns slang: ah, I found it, 11-18-2005 02:56PM pcarns slang: yeah, I think I have a solution that works for both LTP and the original problem 02:57PM pcarns slang: I added this to the end of pvfs2_file_write() (just before returning total_count): 02:57PM pcarns if(file->f_pos > inode->i_size) 02:57PM pcarns { 02:57PM pcarns inode->i_size = file->f_pos; 02:57PM pcarns } 02:58PM pcarns then I completely removed the "if ((file->f_flags & O_APPEND...." block 02:58PM pcarns slang: do you want to try it and see if it works on your end too? 02:59PM pcarns pvfs1 did something very similar 03:09PM slang pcarns: yeah lemme try it 03:11PM slang pcarns: yeah seems to work 03:12PM pcarns slang: I tried it against the original shell script append problem described by T M Tran and it seemed to work ok too 03:12PM pcarns http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-November/001654.html 03:13PM pcarns (towards the bottom of the email) 03:13PM slang pcarns: ok Ill commit 03:14PM pcarns slang: great, thanks! 03:14PM pcarns slang: these conversations on IRC this week have been about 40x faster than me having to go through patch process over here 03:14PM pcarns actually probably even more than that 03:15PM 50* 53slang/#pvfs2 cools. 03:35PM slang pcarns: murali pointed out that the update to i_size has to go at the beginning of pvfs2_file_write 03:35PM pcarns slang: why is that? 03:36PM slang pcarns: putting it at the end fixes the pwrite04 test, but Trach-Minh's date test breaks 03:37PM pcarns slang: the thing with the "w" script? 03:38PM slang pcarns: I think its because generic_write_checks modifies the f_pos value? 03:38PM slang pcarns: yes 03:38PM pcarns slang: the w script worked correctly for me with it at the end 03:39PM pcarns is there anything besides pvfs2_file_write() that can extend f_pos and i_size? 03:40PM slang 03:40PM slang dunno 03:40PM pcarns hmm 03:40PM pcarns my thinking was that i_size should just be updated continuously as needed, rather than trying to sort it out when the write happens 03:41PM pcarns maybe it needs to be updated in more places though? writev, aio, truncate? 03:45PM pcarns slang: the problem with putting it at the beginnnig is that anyone can change f_pos with an lseek, I think 03:46PM pcarns slang: we don't really want to update it when f_pos changes, just when someone writes beyond eof (f_pos just happens to be a handy way to get that info at the end of file_write() 03:46PM pcarns slang: in file_write() case we can determine if someone extended the file by checking if file position is beyond what we thought the size was when we started 03:47PM pcarns slang: what kind of system is the "w" test failing on? 03:47PM pcarns slang: I may be confused 03:47PM slang pcarns: errr...2.6 03:48PM slang pcarns: instead of: 03:48PM slang 1 Tue Jan 10 15:34:07 CST 2006 03:48PM slang 2 Tue Jan 10 15:34:09 CST 2006 03:48PM slang 3 Tue Jan 10 15:34:11 CST 2006 03:48PM slang 1 Tue Jan 10 15:34:16 CST 2006 03:48PM slang 2 Tue Jan 10 15:34:19 CST 2006 03:48PM slang 3 Tue Jan 10 15:34:21 CST 2006 03:48PM slang pcarns: which is the correct result, putting the update at the end of write gives: 03:49PM slang 1 Tue Jan 10 15:25:32 CST 2006 03:49PM slang 2 Tue Jan 10 15:25:34 CST 2006 03:49PM slang 3 Tue Jan 10 15:25:36 CST 2006 03:49PM slang 2 Tue Jan 10 15:26:06 CST 2006 03:49PM slang 3 Tue Jan 10 15:26:08 CST 2006 03:49PM pcarns slang: hunh, that didn't happen on my box (2.4) 03:49PM pcarns slang: sorry about that 03:49PM pcarns I got this: 03:49PM pcarns 1 Tue Jan 10 21:53:05 CET 2006 03:49PM pcarns 2 Tue Jan 10 21:53:07 CET 2006 03:49PM pcarns 3 Tue Jan 10 21:53:09 CET 2006 03:49PM pcarns 1 Tue Jan 10 21:53:35 CET 2006 03:49PM pcarns 2 Tue Jan 10 21:53:37 CET 2006 03:49PM pcarns 3 Tue Jan 10 21:53:39 CET 2006 03:50PM slang pcarns: its 10 p.m.! time to go home! 03:51PM pcarns heh robl nice. pcarns is working from europe 03:51PM 53pcarns robl: no, I have just come to grips with the fact that the clock on my computer can never be right 03:51PM 53pcarns robl: no matter what, clock goblins mess up my time zone and date 03:52PM slang pcarns: I think with 2.4, instead of generic_write_checks, pvfs2_precheck_file_write doesn't modify the f_pos value 03:52PM slang pcarns: which is why it worked for you? robl nice guys: nightly tests pass on gil for the first time in 3 weeks :> 03:54PM 53slang robl: they take so long on gil we should probably call them night-and-day tests robl goodl ol' crappy crappy gil robl valued at 3,000 US dollars robl that kills me 03:56PM 53pcarns robl: that box is still running? robl pcarns: yup. it's our FC4 test box 03:56PM 53pcarns robl: wow, swanky software and all 03:57PM pcarns slang: I'm so confused 03:57PM slang pcarns: me too! 03:57PM pcarns slang: if f_pos is wrong at the end of pvfs2_file_write() on 2.6 kernels, what in the world gets it set right? somehow it has to be correct before the user calls write again, no? 03:58PM slang I think I've filled up my bug-murali quota for the day..his door is locked! :-) 03:58PM pcarns slang: perhaps he has noticed something my stomach has been pointing out the last few minutes; it is almost beer 'o clock 03:58PM pcarns even here in europe 03:58PM slang pcarns: heh 03:59PM slang pcarns: I don't know anything about the kernel module code 03:59PM slang pcarns: esp. regarding what happens outside of pvfs2_file_write 04:00PM pcarns slang: I can fire up my centos vmware image in the morning and look at what's going on 04:01PM pcarns (that's my 2.6 test environment- I have to approximate rhel4 for our deployment but don't actually have a rhel4 license myself) 04:07PM pcarns have a good one guys, I'm out of here pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Hi all. Reminder: we're going to be restarting the server you're on, brown.freenode.net, as soon as we get the user count down more. Please help us speed up the process by disconnecting, and reconnecting to chat.freenode.net, first chance you get. Thanks, and thank you for using freenode! SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Client Quit SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Hi all. Just a reminder. The server you're on, brown.freenode.net, is scheduled for maintenance and will need to be re-upped. You can help by disconnecting and reconnecting to chat.freenode.net so that we can get the user count down. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Thanks in advance for your help, and thank you for using freenode! 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We've had another main rotation server scheduled for restart for a couple of days, and will be doing that in the next few minutes. Affected users, just under 2000, so you'll notice it. Apologies for the inconvenience, and thank you for using freenode! 03:00AM 32lilo:* about to do that restart 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Hi all. Here we go. We'll see you on the other side! Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] 52[freenode] *** Looking up your hostname... 52[freenode] *** Checking ident 52[freenode] *** No identd (auth) response 52[freenode] *** Found your hostname BitchX : For more information about BitchX type /about Welcome to the freenode IRC Network robl Your host is brown.freenode.net[brown.freenode.net/6667], running version hyperion-1.0.2 52[freenode] *** Your host is brown.freenode.net[brown.freenode.net/6667], running version hyperion-1.0.2 This server was created Sat Dec 17 11:03:59 UTC 2005 brown.freenode.net hyperion-1.0.2 aAbBcCdDeEfFGhHiIjkKlLmMnNopPQrRsStTuUvVwWxXyYzZ01234569*@ bcdefFhiIklmnoPqstv IRCD=dancer CAPAB CHANTYPES=# EXCEPTS INVEX CHANMODES=bdeIq,k,lfJD,cgijLmnPQrRstz CHANLIMIT=#:20 PREFIX=(ov)@+ MAXLIST=bdeI:50 MODES=4 STATUSMSG=@ KNOCK NICKLEN=16 :are supported by this server SAFELIST CASEMAPPING=ascii CHANNELLEN=30 TOPICLEN=450 KICKLEN=450 KEYLEN=23 USERLEN=10 HOSTLEN=63 SILENCE=50 are supported by this server local users on irc 50)] 100% global users on irc 50)] 94% invisible users on irc 50)] ircops on irc 50)] total users on irc 50)] unknown connections 50)] total servers on irc 50)] avg. 0 users per server total channels created 50)] avg. 33 users per channel Current local users: 33 Max: 33 Current global users: 33 Max: 33 Highest client connection count 50) 50)] 52[freenode] Server is currently split, channel modes are limited Unknown MODE flag Mode change 57+iw for user 36robl Due to a network split, you can not obtain channel operator status in a new channel at this time Due to a network split, you can not obtain channel operator status in a new channel at this time 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+ns by 57brown.freenode.net 52Users 32#pvfs2 50)] 54 robl 52[freenode] TS for #pvfs2 changed from 1136970103 to 1123487510 51ServerMode 36#pvfs2 57-s by 57irc.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Topic 36#pvfs2 50): changed by 36irc.freenode.net PVFS2-1.3.2 is out 52[freenode] TS for #mklinux changed from 1136970103 to 1059948526 55NickServ 35NickServ@services. 50)- This nickname is owned by someone else 55NickServ 35NickServ@services. 50)- If this is your nickname, type /msg NickServ IDENTIFY 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl #pvfs2 [freenode-info] if you need to send private messages, please register: http://freenode.net/faq.shtml#privmsg Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.498 secs!! 56ronnocol 36n=lance@i216-58-72-60.cybersurf.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 Closing Link: robl[~robl@ninjak.clustermonkey.org] irc.Prison.NET (Ping timeout: no data for 585 seconds) Connection closed from irc.efnet.us: Success Connecting to port 6667 of server irc.efnet.us [refnum 1] 52[Prison] *** Processing connection to irc.ptptech.com 52[Prison] *** Looking up your hostname... 52[Prison] *** Checking Ident 52[Prison] *** No Ident response 52[Prison] *** Found your hostname 52[Prison] You need to install identd to use this server Closing Link: 127.0.0.1 (Install identd) Connection closed from irc.efnet.us: Success Connecting to port 6667 of server irc.efnet.us [refnum 1] 52[Prison] *** Processing connection to irc.blessed.net 52[Prison] *** Looking up your hostname... 52[Prison] *** Checking Ident 52[Prison] *** No Ident response 52[Prison] *** Found your hostname BitchX : For more information about BitchX type /about Welcome to the EFNet Internet Relay Chat Network robl (from irc.blessed.net) Your host is irc.blessed.net[irc.blessed.net/6667], running version ircd-ratbox-2.1.7 (from irc.blessed.net) This server was created Wed Oct 26 2005 at 16:57:25 PDT (from irc.blessed.net) irc.blessed.net ircd-ratbox-2.1.7 oiwszcerkfydnxbauglZCD biklmnopstveI bkloveI CHANTYPES=&# EXCEPTS INVEX CHANMODES=eIb,k,l,imnpst CHANLIMIT=&#:40 PREFIX=(ov)@+ MAXLIST=beI:100 NETWORK=EFNet MODES=4 STATUSMSG=@+ KNOCK CALLERID=g :are supported by this server SAFELIST ELIST=U CASEMAPPING=rfc1459 CHARSET=ascii NICKLEN=9 CHANNELLEN=50 TOPICLEN=160 ETRACE CPRIVMSG CNOTICE DEAF=D MONITOR=60 are supported by this server TARGMAX=NAMES:1,LIST:1,KICK:1,WHOIS:1,PRIVMSG:4,NOTICE:4,ACCEPT:,MONITOR: :are supported by this server local users on irc 3469 50)] global users on irc 9470 50)] 11% invisible users on irc 74694 50)] 89% ircops on irc 50)] total users on irc 84164 50)] unknown connections 50)] total servers on irc 50)] avg. 1558 users per server total channels created 36944 50)] avg. 2 users per channel 3469 4567 Current local users 3469, max 4567 84164 92258 Current global users 84164, max 92258 Highest client connection count 4568 50) 4567 50)] 57> 52B-Drone 32bdrone@blessed.drone.mon 32 requested VERSION from robl Mode change 57+isw for user 36robl 56robl 36~robl@ninjak.clustermonkey.org has joined #c-60 Topic 36#c-60 50): ppl who watch tv should die Topic 36#c-60 50): set by 36dsp!~dsp@dorado.c-60.org at 36Sun Jan 8 21:50:33 2006 52Users 32#c-60 3213 50)] 54 robl 54bress 54ksb 54sdh 54sergent 54gah 54|az 54epg 54hideaway 54ajk 54notdsp 54mrbsk 54dsp Channel #c-60 was created at Tue Aug 30 22:07:37 2005 BitchX : Join to #c-60 was synched in 0.410 secs!! You are not on a channel. Use /WHO ** to see everybody. BitchX : You are now talking to channel #c-60 53#c-60 57robl 36H ~robl ninjak.clustermonkey.org (Rob Latham) 53#c-60 57bress 36H@ ~bress cpe-65-26-183-127.indy.res.rr.com (Josh Bressers) 53#c-60 57ksb 36H@ ~ksb rrcs-24-56-87-2.ma.biz.rr.com (K S Braunsdorf) 53#c-60 57sdh 36H@ csociety.ecn.purdue.edu (Seth Heckard) 53#c-60 57sergent 36H@ sergent csociety.ecn.purdue.edu (Jonathan Sergent) 53#c-60 57gah 36H@ ~held ns1.upin.com (Garrett Held) 53#c-60 57|az 36G@ ~laz ninjak.clustermonkey.org (Adam Lazur) 53#c-60 57epg 36H@ ~epg gould.diplodocus.org (*Unknown*) 53#c-60 57hideaway 36H*@ petef free.bsd (Come get some of this glowing) 53#c-60 57ajk 36H@ ~ajk rikers.itso.iu.edu (Ay Jay Kay) 53#c-60 57notdsp 36H@ ~dsp volans.c-60.org (dsp) 53#c-60 57mrbsk 36H@ ~mrb mixtec.wiredsoul.org (*Unknown*) 53#c-60 57dsp 36H@ ~dsp dorado.c-60.org (Doug Porter) WINDOW: Invalid option: [close] Window 3 Server: [1] Screen: 0x817dda4 Geometry Info: [0 42 0 41 41 41] CO, LI are [79 45] Current channel: #c-60 Query User: Prompt: Second status line is ON Split line is ON triple is ON Logging is ON Logfile is ~/.BitchX/irc-chat/#pvfs2.log Notification is OFF Hold mode is OFF Window level is NONE Lastlog level is ALL Notify level is ALL ADD BACK BALANCE BEEP_ALWAYS BIND CHANNEL CREATE DELETE DESCRIBE DISCON DOUBLE ECHO FIXED GOTO GROW HELP HIDE HIDE_OTHERS HOLD_MODE KILL KILL_OTHERS KILLSWAP LAST LASTLOG LASTLOG_LEVEL LEVEL LIST LOG LOGFILE MENU MOVE NAME NEW NEW_HIDE NEXT NOSERV NOTIFY NOTIFY_LEVEL NUMBER POP PREVIOUS PROMPT PUSH QUERY REFNUM REFRESH REMOVE SERVER SET SCRATCH SCROLL SCROLLBACK SHOW SHOW_ALL SHRINK SIZE SKIP SPLIT STACK STATUS_SPECIA SWAP TRIPLE UNBIND UPDATE Usage: /WINDOW help command to get help on specific commands Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Wed Jan 11 14:24:32 2006 robl ,who 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 03:19PM 32lilo:* Hi all. New channel: ##fastcgi , an unofficial support channel which will cover configuration and application development with fastcgi for your webserver and language of choice.... if you'd like to help out, please stop by! Mode change 57-w for user 36robl 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ronnocol 36H n=lance i216-58-72-60.cybersurf.com (Lance O'Connor) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SignOff 57ronnocol : #pvfs2 "leaving" 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:02pm BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 02:18PM 53pcarns robl: hey, do you happen to know approximately what the threshold is for small-io? robl pcarns: sam says it's 16k 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 02:21PM pcarns great, thanks robl pcarns: thanks for your help this week. nightly tests completed last night with 0 unexpected errors 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 02:22PM 53pcarns robl: no, thank you for helping to get that stuff fixed so quick 02:23PM 53pcarns robl: there is one more new bug fix on the list now 02:23PM pcarns everything is humming down here now, but we are still a few fixes ahead 02:24PM pcarns I am about to embark on some serious file system smack-down, we need some performance numbers here pronto 02:25PM pcarns need to start narrowing down some pvfs2 footprints, ext3 options, etc. robl pcarns: what's nate up to these days? robl haven't seen him around much on line 02:44PM 53pcarns robl: he's still doing the same stuff, actually in a seperate section from me now (reorg shortly after I was hired) 02:45PM 53pcarns robl: I guess he doesn't really have much time for pvfs2 tinkering 02:45PM pcarns *shrug* 02:45PM pcarns he is the jack of all trades node level O/S speciallist really here 02:46PM 53pcarns robl: I guess he is doing ok, I actually haven't talked to him in several months now myself robl pcarns: cool. glad he didn't get fired or anything like that :> 02:47PM 53pcarns robl: did you guys here that we are EMC minions in training now? 02:47PM 53pcarns robl: google for EMC acxiom partnership if not robl pcarns: does that mean you get good deals on vmware now? :> 02:58PM pcarns pcarns: every new hire gets 10 copies of vmware and a SAN box to take home 02:58PM pcarns j/k of course :) 02:58PM pcarns pcarns: EMC new hires now get a DVD full of incomprehensible grid software source code 02:59PM 53pcarns robl: nothing has really changed, though we are going to hire more folks and put more focus on making software sturdy enough to be deployed outside of our site robl pcarns: that's a pretty big change for acxiom 03:01PM 53pcarns robl: yeah 03:01PM 53pcarns robl: and something we couldn't do without a big name vendor that already sells software and support to people 03:02PM 53pcarns robl: acxiom got an indefinite license for whatever the end result is- I think eventually they would like to just hand off the whole thing to EMC in a couple of years 03:02PM 53pcarns robl: acxiom doesn't make any money off of creating grid software directly- it is just a big cost for them along the way to selling data products 03:03PM 53pcarns robl: that's my 2c 03:04PM 53pcarns robl: for the next 2 years we are all still acxiom employees, not clear after that robl oh! 03:05PM 53pcarns robl: yeah, that's the real serious part, which isn't really clear from press releases pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 robl parl is down again :< 09:42AM pcarns someone needs to go whip the mules to generate more electricity 09:42AM pcarns probably turned on the football stadium lights and overloaded the system 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl slang: hey 10:41AM 53slang robl: hi 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 53#pvfs2 57slang_ 36H n=slang 216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 02:06PM 53slang robl: is cvs.parl.clemson.edu down for you as well? SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 02:12PM 50* 53slang/#pvfs2 has identity issues today 02:23PM pcarns slang: cvs .parl is down for me at least 02:25PM slang pcarns: ok thanks robl pcarns: huh. it was up for about an hour there around noon :> 02:32PM 53pcarns robl: yeah, I saw you snuck a commit in there somehow robl pcarns: so the ANL->PARL link seems to be ok robl pcarns: maybe that's because we're on I2 ? 02:35PM 53pcarns robl: hunh, now everything is up for me 02:36PM pcarns Your I2 has nothing on me 02:36PM pcarns 50* 57robl just grasping for explanations robl heh. now lain can't get to parl robl that's probably related to some network mesups at argonne pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:35am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net brown.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:46am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net brown.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Server Notice] Hi all. The server you're on, brown.freenode.net, just experienced some major packet loss. We're investigating. You may want to disconnect and reconnect to chat.freenode.net .... thanks! 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We just experienced loss of bandwidth on a main rotation server. We've rearranged things accordingly. Apologies for the inconvenience, and thank you for using freenode. 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:31am BitchX : Press to see who left to change to [irc.freenode.net] 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3604:45am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3604:49am BitchX : Press to see who left to change to [irc.freenode.net] 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Remote closed the connection 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3606:05am BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. It's worth noting that the Free Software Foundation's GPLv3 draft is now available for reading and comment on http://gplv3.fsf.org/comments/ .... channel #gplv3 is available for discussion. Thanks! 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: any pvfs2 breakage over the weekend? 02:29PM 53pcarns robl: yeah, I got some patches I need to get out 02:30PM 53pcarns robl: should be ready today or tomorrow robl pcarns: parl fell off the net so the nightly tests didn't run (weren't able to pull from cvs and bailed) robl pcarns: i'm only up to dec 13 on your submitted patches :> 02:32PM 53pcarns robl: these things probably wouldn't break nightly robl pcarns: no, it would surprise me too 02:35PM 53pcarns robl: don't worry, you have all of hte big scary patches for a while at least 50* 57robl guesses it's release time soon SWAP: Window 3 is not hidden! pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl slang_: 100% faster! cool :> 10:06AM 53slang robl: oh that was supposed to be 10% 10:06AM slang woopsie 10:06AM slang 10:07AM 53slang robl: eh? robl slang_: oh, well look at that. 10% it is 10:18AM 53slang robl: if only all our 10s were 100s SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56samlang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 samlang_ 50] [ samlang 50] [ 50] [ robl samlang: you're having an identity crisis today? SignOff 57samlang : #pvfs2 Read error: 113 (No route to host) 03:07PM 53samlang_ robl: well, I thought I had figured out a way to get my irc client to always use 'slang' 03:08PM 53samlang_ robl: but I don't remember the IDENTIFY password anymore 03:08PM samlang_ rob: so I tried just starting over 03:08PM 53samlang_ robl: seems to not have worked 03:32PM samlang_ pcarns: what's the runtime error? robl tar: linux-2.4.31/CREDITS: Cannot change ownership to uid 573, gid 573: No robl such file or directory robl (sorry! overzealous trimming!) 03:34PM samlang_ its the very first file? robl ok, big paste 03:35PM samlang_ maybe something related to the suid bit changes robl bash-2.05b# tar -xvjf /usr/src/linux-2.4.31.tar.bz2 robl linux-2.4.31/ robl linux-2.4.31/Makefile robl linux-2.4.31/MAINTAINERS robl linux-2.4.31/CREDITS robl tar: linux-2.4.31/CREDITS: Cannot change ownership to uid 573, gid 573: No robl such file or directory robl linux-2.4.31/Rules.make robl tar: linux-2.4.31/Rules.make: Cannot change ownership to uid 573, gid 03:38PM 53samlang_ robl: works on 2.6 though eh? 03:43PM pcarns oh hey guys, sorry was away from irc 03:44PM pcarns that should be fixed with the "acache miss" patch 03:44PM pcarns I was seeing that exact same thing 03:44PM pcarns hmm, what was the name of that patch... 03:45PM pcarns I think you guys put it in already robl pcarns: yeah, i know you were seeing it. it's your bug report :> 03:46PM samlang_ pcarns: you're seeing it with cvs HEAD on 2.4? 03:46PM 50* 53samlang_/#pvfs2 confused 03:47PM pcarns I don't remember, I don't think it shows up in HEAD anymore but I haven't checked 03:51PM 53pcarns robl: oh wait, I am confused 03:51PM 53pcarns robl: so you didn't just see that just now yourself, you are just looking at my old email? 03:52PM 53pcarns robl: if so, then it is fixed now 03:52PM 53pcarns robl: you guys applied the changes I suggested to fix it, I believe robl pcarns: ok, cool 03:54PM 53pcarns robl: I don't have the email handy anymore, but it was the one that suggested adding js_p->error_code = GETATTR_ACACHE_MISS somewhere robl pcarns: yeah, i'm cleaning up outstanding issues in my mutt-as-bugzilla world 03:54PM 53pcarns robl: thanks for checking up on it though robl pcarns: no problem 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang_ : #pvfs2 Read error: 110 (Connection timed out) SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57laytonj : #pvfs2 "Leaving" 56samlang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang : #pvfs2 Read error: 113 (No route to host) 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang_ : #pvfs2 Read error: 113 (No route to host) 56samlang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang : #pvfs2 Read error: 113 (No route to host) 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang_ : #pvfs2 Read error: 110 (Connection timed out) 56samlang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang : #pvfs2 Read error: 113 (No route to host) 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang_ : #pvfs2 Read error: 113 (No route to host) 56samlang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@68-190-33-221.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 56samlang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57samlang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57samlang : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 08:35AM pcarns slang: I think you mis-spelled experiments :) 08:35AM slang heh woopsie 08:36AM slang pcarns: thanks 08:36AM slang pcarns: ments that expire? 08:37AM pcarns slang: heh SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 robl pcarns: wierd. is remount our only high-priority kernel operation? 11:35AM 53pcarns robl: yeah, I think so 11:35AM 53pcarns robl: the theory being that if you restart pvfs2-client, you have to do the remount before re-attempting any other operations robl pcarns: ok, makes sense 11:45AM 53pcarns robl: thanks for all of the patch wranglin' robl pcarns: no problem a'tall 11:45AM 53pcarns robl: still waiting on signoff on last couple of small bug fix patches here, hopefully won't be too long robl pcarns: asside from metheny's test patches, i think i've gotten everthing in that you've submitted robl pcarns: let me know if we missed anything 11:51AM 53pcarns robl: I think that is all the patches 11:52AM 53pcarns robl: I do have one more suggestion, though 11:52AM 53pcarns robl: not given as a patch, was buried in a long email: 11:52AM pcarns http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-July/001349.html 11:52AM 53pcarns robl: just the part regarding PVFS_NAME_MAX and PVFS_SEGMENT_MAX 11:53AM 53pcarns robl: we set SEGMENT_MAX to match NAME_MAX here so that we could support longer file names NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:44pm BitchX : Press to see who left to change to [irc.freenode.net] robl pcarns: i'll check it out just as soon as PARL comes back on the net SignOff 57laytonj : #pvfs2 "Leaving" 03:53PM 53slang robl: so much for the new parlweb server, eh? robl slang: yeah... this time it came back in less than a day though robl slang: oh! my mistake. i think the downtime was walt's switchover to the new server 04:09PM 53slang robl: ah robl (based on my new "HOLY CRAP! SOMETHING CHANGED" banner when i cvs diff :> 04:10PM 53slang robl: I thought that was yesterday 04:10PM 53slang robl: heh 04:11PM pcarns my cvs client says "OMFG itz the HAXORS" robl pcarns: ok, there we go. thanks for the heads up about name_max 04:44PM 53pcarns robl: thanks for putting that in 04:45PM pcarns I guess pvfs2-cvs list isn't up yet 04:45PM pcarns how am I supposed to eavesdrop on development now? :) pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) robl slang_: uh-oh! robl slang_: 404 for tinderbox 10:26AM 53slang_ robl: heh robl guess they didn't copy *everything* over 10:26AM 53slang_ robl: tinderbox didn't make the transition 10:27AM 53slang_ robl: the files are still there 10:28AM 53slang_ robl: probably just haven't configured apache as it was before 11:36AM 53slang_ robl: viewcvs is back 11:36AM 53slang_ robl: tinderbox seems to be having a little trouble still though.. 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 02:41PM pcarns slang_: there was a viewcvs and tinderbox at clemson??? 02:56PM slang_ pcarns: yeah robl pcarns: slang set it all up 02:58PM pcarns sweet! 02:58PM pcarns I'll need urls when it is up and running again :) 02:58PM slang_ pcarns: http://www.pvfs.org/cgi-bin/pvfs2/viewcvs/viewcvs.cgi/ 02:59PM slang_ pcarns: still something wrong with tinderbox 02:59PM pcarns slang_: that is the tenderbox you guys send nightlies to now? 02:59PM slang_ pcarns: was, hes 02:59PM slang_ pcarns: was, yes 03:00PM pcarns actually, if you have hte url I'll bookmark it for later 03:00PM slang_ pcarns: we still do I guess, but it doesn't appear to be working at present robl http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html 03:02PM slang_ oh maybe it is working 03:02PM 53slang_ robl: I think I had the wrong url 03:02PM slang_ woops 03:04PM 53slang_ robl: hmm...although some things definitely aren't working 03:04PM 53slang_ robl: the cgi scripts appear to be still having trouble being accessed from outside 03:08PM pcarns slang_: neat! so where would I click to see output from a build if it were working? 03:08PM pcarns slang_: the status lights are at least right for each host and you can click to see when build was 03:09PM slang_ pcarns: http://tinderbox.mozilla.org/showbuilds.cgi?tree=SeaMonkey 03:10PM slang_ pcarns: it kind of looks like that when its working 03:10PM slang_ pcarns: with build times and L/C links to click on to see the logs 03:10PM pcarns ahhh 03:10PM pcarns I seeeee 03:10PM slang_ pcarns: we don't show the developers guilty for breakage though 03:11PM slang_ :-) 03:11PM pcarns it only takes 3 or 4 guesses anyway :) 03:11PM slang_ because then it would just be: 03:12PM pcarns I'm lucky; rob commits my patches so it will always look like his fault when I break something 03:12PM 50* 53pcarns/#pvfs2 blames it all on robl robl pcarns: it's cool. something breaks and i get to publicly shame you on the lists :> 03:13PM pcarns oh the humanity 03:14PM 53slang_ robl: unless those are broken too 03:15PM 50* 53slang_/#pvfs2 discovers a convenient way to hide his mistakes..take down parl 03:15PM pcarns I keep all the subscribers memorized just in case 52[choopa] *** Looking up your hostname... 52[choopa] *** Checking Ident 52[choopa] *** No Ident response 52[choopa] *** Found your hostname robl Nickname is already in use.(from irc.he.net) 52[choopa] You need to install identd to use this server Closing Link: 127.0.0.1 (Install identd) Connection closed from irc.efnet.us: Success Connecting to port 6667 of server irc.efnet.us [refnum 1] You are not on a channel. Use /WHO ** to see everybody. ADD BACK BALANCE BEEP_ALWAYS BIND CHANNEL CREATE DELETE DESCRIBE DISCON DOUBLE ECHO FIXED GOTO GROW HELP HIDE HIDE_OTHERS HOLD_MODE KILL KILL_OTHERS KILLSWAP LAST LASTLOG LASTLOG_LEVEL LEVEL LIST LOG LOGFILE MENU MOVE NAME NEW NEW_HIDE NEXT NOSERV NOTIFY NOTIFY_LEVEL NUMBER POP PREVIOUS PROMPT PUSH QUERY REFNUM REFRESH REMOVE SERVER SET SCRATCH SCROLL SCROLLBACK SHOW SHOW_ALL SHRINK SIZE SKIP SPLIT STACK STATUS_SPECIA SWAP TRIPLE UNBIND UPDATE Usage: /WINDOW help command to get help on specific commands Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Thu Jan 19 15:41:11 2006 53#pvfs2 57slang_ 36H n=slang 216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 04:10PM 50* 53pcarns/#pvfs2 is getting dizzy 04:10PM pcarns seeing double... robl double? robl (dammit.. should have typed ddoouubbllee 04:24PM pcarns good test results today 04:24PM pcarns SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 04:24PM pcarns running a distributed small files test (60 clients create,read,write,mkdir,rmdir,list massive number of files and directories) 04:25PM pcarns got a 30% improvement overall by going from a 1 meta and 15 io setup, 04:25PM pcarns to a 15 server setup, where all do both meta and io robl wow, sweet! 04:26PM pcarns the only thing that was slower with the "all meta" setup was creating files 04:26PM pcarns I suspect lookup to be the culprit (having to bounce around servers to walk the path) but I don't know yet robl pcarns: that jives with our benchmarks 04:27PM pcarns recursive long listing time dropped by 66% 04:27PM 50* 53pcarns/#pvfs2 wants to give hte name cache some tcache lovin' 04:28PM pcarns for what its worth, we are now defaulting to an acache timeout of 200 ms 04:28PM pcarns found that beyond that we didn't get any more speedup 04:28PM pcarns but there was more to be had above the 5 ms that the stock pvfs2 defaults to 04:29PM pcarns I am trying to narrow down what our default deployment is going to look like here 04:30PM pcarns # of meta servers and acache settings are settled, still need to resolve ext3 options, sync options, DefaultNumDfiles option (for small files scenarios), maybe a few others 04:30PM pcarns maybe I can contribute some info to a tuning guide eventually pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Remote closed the connection 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 11:14AM pcarns man, the pvfs2 web site looks nekkid 11:14AM pcarns or naked, as folks in chicago might say 11:15AM slang pcarns: woah 11:16AM slang what happened? 11:16AM slang pcarns: www.pvfs.org is ok 11:16AM slang and pvfs1 seems ok 11:17AM pcarns the server side #include stuff isn't working 11:17AM pcarns you can check out pvfs2-web from cvs and see how it pulls in the "style" kind of stuff 11:18AM pcarns the sort of thing that whippersnappers do with css nowadays 11:18AM pcarns us old-uns did it with apache substitutions 11:18AM pcarns or whatever you call it 11:19AM pcarns pvfs1 style is accomplished by pasting the exact same big hunk of html into every page, so it is even older style technology :) 11:20AM slang pcarns: yeah 11:20AM slang pcarns: paste has been around for a looong time ;-) 11:21AM pcarns slang: and when the chips are down, lo and behold its hte one that works 11:21AM slang pcarns: heh 56laytonj 36n=laytonj@68-190-33-221.dhcp.gwnt.ga.charter.com has joined #pvfs2 robl also, anoncvs seems to be broken :> robl we need brad to hop on irc so we can harrass him in realtime robl guess it's email for now 11:42AM pcarns have you guys looked at that new bug report from Brian Smith? robl pcarns: he's a butthead so i'm stalling on it :> 11:42AM 53pcarns robl: heh, ok :) robl pcarns: at first pass, sounds like the stat stuff is fixed 11:44AM 53pcarns robl: yeah, I don't have any trouble cp'ing stuff on and off right now 11:44AM 53pcarns robl: but I am using 2.4 kernel 12:18PM pcarns slang: are you going to submit that patch to the ethereal folks? 01:58PM slang pcarns: I gave him an earlier one but it turned out to have mods right after I sent it 01:58PM slang pcarns: so I figured I would wait for a release pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-152-197-189.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-189.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 pcarns n=pcarns@adsl-152-197-189.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're experiencing problems with one of our main rotation servers. It's been removed from rotation and will be shut down in a couple of minutes. Affected users: about 3,700. Thanks. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3607:53pm BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.595 secs!! SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+nt by 57irc.easynews.com 52Users 32#pvfs2 50)] 54robl Channel #pvfs2 was created at Tue Jan 24 20:06:30 2006 BitchX : Join to #pvfs2 was synched in 3.752 secs!! 53#pvfs2 57robl 36H@ ~robl ninjak.clustermonkey.org (Rob Latham) 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 5.959 secs!! Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Tue Jan 24 20:59:33 2006 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 1.275 secs!! 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:40am BitchX : Press to see who left to change to [irc.freenode.net] 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 09:54AM 32lilo:* Hi all. Channel note about ##xen (our local channel for Xen, the operating system virtualizer application).... it's a small channel, but growing. If you know Xen and you'd like to help support it to random passers-by, please stop in. We can use your help. Thanks! Mode change 57-w for user 36robl pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Thu Jan 26 16:32:08 2006 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 4.097 secs!! SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 robl ,who 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) SWAP: Window 3 is not hidden! NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:14pm BitchX : Press to see who left to change to [irc.freenode.net] 03:38PM 32lilo:* Neoneurone has set up an unofficial sourceforge channel, for users to compare notes and assist each other....if you're interested in participating, please stop by ##sourceforge .... thanks SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:01am BitchX : Press to see who left to change to [irc.freenode.net] 01:03AM 32lilo:* two small EU regional servers dropped off, total users affected, about 400 SignOff 57ChanServ : #pvfs2 ACK! SIGSEGV! 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 robl slang: hey, how's it going? 02:30PM 53slang robl: hiya robl slang: one of these nights i'll get the nightly builds all passing 03:06PM 53slang robl: doesn't look like its anything major robl slang: nah, it's fixed now 03:07PM 53slang robl: maybe I should just change the test-failed color to green ;-) robl slang: no cheating! SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3611:50pm BitchX : Press to see who left to change to [irc.freenode.net] 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl slang: back from purdue already? 12:37AM 53slang robl: already? 12:38AM 53slang robl: its 1238 12:38AM 50* 53slang/#pvfs2 tired 12:39AM 53slang robl: I see Alito was voted in 12:39AM 53slang robl: did Bush say anything about increasing research funding? robl slang: didn't catch the whole sotu and haven't seen a transcript yet. tribune says he called for more funding for math and science teachers robl which would indicate some recognition of the importance of technology 12:48AM 53slang robl: looks like its on cspan now robl slang: no time for current events. gotta finish these cookies robl (making, not eating) 01:08AM 53slang robl: heh 01:09AM 50* 53slang/#pvfs2 waves 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Apologies for not getting back with you on that main rotation server split. We're looking at the problem. Meanwhile, US donor tax receipts for paypal donations have been sent to your paypal email address. If you need a receipt and haven't received one, please message me. Thanks! 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Those are the 2005 tax receipts. We're about to start our 2006-2007 fundraiser for PDPC, so if you would like to help get us going a bit early, please take a look at the freenode website ( http://freenode.net/pdpc_donations.shtml ). Thanks, and have a great morning! 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 07:36AM 32lilo:* Hi all. Need Turkish-English translation in #freenode. Thanks! 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57ChanServ : #pvfs2 ACK! SIGSEGV! 03:28PM slang oh dear 03:28PM slang irc is segfaulting 03:28PM slang that can't be good 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net robl ChanServ: what the hell man? 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36G n=pcarns adsl-152-212-72.asm.bellsouth.net (gaim) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 robl we need something exciting in #pvfs2 so pcarns sticks around after hours 05:46PM 53slang robl: ChanServ SIGSEGV isn't exciting enough I guess SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:22am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3608:42am BitchX : Press to see who left to change to [irc.freenode.net] 56slang_ 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57slang_ : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-212-72.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 50* 57robl is gonna try to knock out the sftp bug pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SignOff 57laytonj : #pvfs2 "Leaving" 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 11:44AM 32lilo:* Hi all. We seem to be having an influx of spambots. Most of you are SET UNFILTERED OFF with nickserv, so you won't be noticing the spam messages. If you are noticing the messages, though, please feel free to message a staffer, or first level support if available, to let us know about any spambots we've missed. Thanks! SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. If you have a moment, please stop by #freenode-survey and answer a few questions which may help us with feature design. Please check the topic or join notice for the questions and answer briefly on channel. Thanks. 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 03:01PM 32lilo:* If you're in Houston, Texas, USA and have an automobile and time to provide assistance to PDPC this afternoon, please message me. Thanks! pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 06:54AM 32lilo:* New channel set up for folks with group cloaks: #freenode-groups .... please stop by when you get a moment! Thanks, and have an excellent afternoon. 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 08:28AM 53pcarns robl: hey rob, you there? 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 robl pcarns: hey 09:42AM 53pcarns robl: is a concall this afternoon rather than 10am going to work? robl pcarns: works for us, yea 09:48AM 53pcarns robl: any particular time preference? 09:49AM 53pcarns robl: I don't think we care, but I can throw out 2pm central as a suggestion robl pcarns: 1pm perhaps? 09:50AM pcarns ok, that works 09:50AM pcarns I'll pass the word here 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-212-72.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 robl slang: 1pm concall robl that's all you missed 09:55AM 53slang robl: k 09:55AM pcarns are you guys in the same office? robl pcarns: well, yeah 10:43AM pcarns did you guys tell RobR in case he can make it? robl pcarns: now we did :> 10:46AM 53pcarns robl: thanks :) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 04:04PM 32lilo:* We've added a channel ( #freenode-groups ) for folks with group cloaks to compare notes.... if you fall in that category, please stop by when you get a chance.... thanks! pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3610:43am BitchX : Press to see who left to change to [irc.freenode.net] pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57laytonj : #pvfs2 "Leaving" 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@c-71-194-159-89.hsd1.il.comcast.net has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-152-212-72.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 11:28AM 32lilo:* Slight modification to the channel guidelines, http://freenode.net/channel_guidelines#sensitivematerial 11:30AM 32lilo:* The freenode channel guidelines are a list of do's and don'ts, based on the experience which went into the creation of freenode, and we urge you to adopt them for your channel. Thanks. 11:31AM 32lilo:* Whoops, that url should read: http://freenode.net/channel_guidelines.shtml#sensitivematerial 11:31AM 32lilo:* Thanks. 11:34AM 32lilo:* please read http://tinyurl.com/axxvl and let's talk before you're voiced again on ##linux 11:34AM 32lilo:* whoops, sorry, that one was intended as a private message :) 11:35AM 32lilo:* I must say, some days are a little more tiring than others. :) pcarns n=pcarns@adsl-152-212-72.asm.bellsouth.net has left #pvfs2 05:04PM 32lilo:* New channel notes.... the former #help has moved to ##anything, a channel stuffed with people who want to help you with any and all questions about, well, anything. 8) 05:06PM 32lilo:* Another interesting new channel is ##prepress, a resource for folks in the FOSS community who are preparing digital media for professional print publication. You should find some good experience to tap there if you have questions on the subject. SignOff 57laytonj : #pvfs2 "Leaving" 56slang 36n=slang@71.194.159.89 has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. If you're interested in tracking the near term winter storms and blizzard conditions in the northern US, you might try ##earth .... it's not that busy at the moment, but you can make it so. :) 56pcarns 36n=pcarns@adsl-218-106-103.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 08:21AM 32lilo:* Hi all. Reminder for folks with primary group cloaks....please do stop by #freenode-groups when you get a chance--it's a general social channel for project participants, and you can probably find a staffer or two. 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 robl slang: ugh. i'm finally back from nj 11:22AM 53slang robl: got back this morn? 11:23AM 53slang robl: if you leave now you can still make ultimate ;-) robl slang: yeah robl slang: thought about it robl but it's nice to be in one place for a bit 11:23AM 53slang robl: heh 11:24AM 53slang robl: I haven't seen dr. ross yet today either 11:26AM slang (6) Verifying that fsid 740873510 is acceptable to all servers... 11:26AM slang PVFS_mgmt_setparam_all: Detailed per-server errors are available 11:26AM slang Failure: not all servers accepted fsid 740873510 11:26AM slang Host: tcp://ccsto5:9991: Success 11:26AM 53slang robl: you remember what causes that? robl slang: stale storage spaces? 11:29AM 53slang robl: hmm...still get it when I reset them 11:29AM 53slang robl: oh well 11:29AM 53slang robl: ultimate time pcarns n=pcarns@adsl-218-106-103.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:01pm BitchX : Press to see who left to change to [irc.freenode.net] 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-218-106-103.asm.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang_ 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 09:38AM slang i don't know why MacIrssi has to log me in as two different nicks 09:39AM pcarns slang: are you trying to outnumber us? 09:40AM pcarns slang: one more and you will control majority 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57slang_ 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-218-106-103.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: don't forget ChanServ 09:44AM slang pcarns: all we need now is a voting system 09:45AM slang pcarns: so creates are slow because each one is syncing the entire db to disk, right? 09:45AM 53pcarns robl: ChanServ usually abstains from voting, he is no threat to slang's regime 09:45AM slang pcarns: at least the entire cached portions of the db 09:46AM pcarns slang: it seems like once most of it is synced, then then only thing hitting the disk subsequently would be the dirty pages, no? 09:47AM slang pcarns: I think that's true for the db portion of the sync 09:47AM pcarns slang: ahh, the cache itself may have more changes in it? 09:47AM slang pcarns: but db->sync also does an fsync to flush the in-core stuff to disk 09:47AM pcarns slang: ok, I see 09:48AM slang pcarns: I'm guessing that ext3 isn't smart enough to only sync the portions that changed? 09:48AM pcarns slang: it should be, I think 09:48AM slang 09:49AM pcarns slang: the one odd thing it does is sync in order, it can't sync any data block without syncing all previous data blocks 09:49AM pcarns slang: but i don't think it will "re-sync" any data blocks that are already consistent between disk and buffer cache 09:49AM slang pcarns: hmm ok 09:49AM slang pcarns: so much for my theory 09:50AM pcarns slang: the default journalling mode (data=ordered) is what causes the semantics of how writes end up getting flushed in order 09:50AM slang pcarns: seems strange that creates and getattrs would be inverses of each other though 09:50AM pcarns slang: we could always repeat the test without sync, or with transactions instead as an experiment 09:51AM pcarns slang: actually, turning off sync can be done via command line, I might as well kick it off and see what happens 09:51AM slang pcarns: cool 09:51AM pcarns slang: yeah, whatever the cause, it is definitely strange 09:51AM slang pcarns: nice graphs btw! 09:52AM pcarns heh, those are pretty quick and dirty 09:52AM pcarns but they do the job 09:58AM pcarns slang: running w/o sync is mad fast, actually shouldn't take very long to finish 09:58AM pcarns 2 seconds to create rather than 2000 seconds robl pcarns: any theory about why 270256 kb took 2999.501082 sec but 260256 took 2778.219992 ? robl pcarns: is that a hardware thing? 10:01AM 53pcarns robl: I have no idea 10:02AM 53pcarns robl: this is all run on a single scsi disk, for what its worth 10:02AM 53pcarns robl: I don't have any decent modern distros on machines with raid or san right now robl that inflection point is just shy of 256 MiBytes 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 10:04AM pcarns ok, sync is definitely the main factor in this inverted create result, I'll send an email w/ details robl the second inflection point is not so clear robl maybe somewhere just shy of 30 MB robl bleah, i have no idea what that means. maybe something to do with linux VM knobs? SignOff 57pcarns : #pvfs2 Read error: 113 (No route to host) robl slang_: you burried him in so much email it broke his irc connection? 02:45PM 53slang robl: perhaps I should have done some coalescing before sending them off robl slang_: i think 'coalescing' has been a part of every optimization we've ever done since i've worked here 02:46PM 53slang robl: time to switch to conglomerating? robl 121 Moby Thesaurus words for "coalesce": robl act in concert, act together, add, adhere, admix, affiliate, alloy, robl ally, amalgamate, assimilate, associate, band, band together, robl be in league, bemingle, blend, bracket, cleave, cling, robl ... Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 SignOff 57slang : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" SignOff 57slang_ : #pvfs2 "Get MacIrssi - http://www.g1m0.se/macirssi/" 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:05pm BitchX : Press to see who left to change to [irc.freenode.net] 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:52am BitchX : Press to see who left to change to [irc.freenode.net] 01:54AM 32lilo:* A small regional server has split and rejoined...we're waiting to see if there's significant packet loss. Affected users: about 310. Thanks. 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@crusoe-57.mcs.anl.gov has joined #pvfs2 01:52PM 32lilo:* Hi all....if you've seen spam recently from someone with the nick SolarMRqI, please paste it to me and let me know what channel it was on....thanks! Mode change 57-w for user 36robl 53#pvfs2 57slang 36H n=slang crusoe-57.mcs.anl.gov (Sam Lang) 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-215-223-2.aep.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56pw1v 36n=pw@d60-77-190.col.wideopenwest.com has joined #pvfs2 04:18PM 53pw1v robl change the topic 50* 57robl knew he forgot something Topic 36#pvfs2 50): PVFS2-1.3.2 is out Topic 36#pvfs2 50): set by 36robl at 36Tue Dec 6 11:23:40 2005 BitchX : Unknown command: TOPOC Topic 36#pvfs2 50): changed by 36robl PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html 04:20PM pw1v What's the deal with the release branch process? I saw you modified the changelog to look like we are starting on 1.4.1pre in that branch. Are you going to merge that release branch back to head soon? robl pw1v: that's the plan, yep 50* 57robl forgot to do that too 04:21PM pw1v Oh, twas genuine ignorance on my part. robl i should drop a note to pvfs2-internal about that. we've been releasing from a branch for the last few versions. seems to work pretty well pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 57pw1v is now known as 36pw SignOff 57pw : #pvfs2 "pw has no reason" SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang__ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang___ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 SignOff 57slang_ : #pvfs2 Read error: 110 (Connection timed out) SignOff 57slang : #pvfs2 Read error: 113 (No route to host) 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 10:57PM slang_ gotta be kidding me SignOff 57slang_ : #pvfs2 Client Quit SignOff 57slang : #pvfs2 Client Quit SignOff 57slang__ : #pvfs2 Read error: 113 (No route to host) SignOff 57slang___ : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 56slang 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 robl slang: gotta be kidding me about what? 10:20AM slang irc client went kinda haywire last night 10:20AM slang I was 'logged in' as slang, slang_, slang__, slang___, and slang____ 50* 57robl sees now robl slang: heh. so you figured out where that 120 queued ops came from? :> 10:23AM slang yeah 10:23AM slang wasn't subtracting for every add robl slang: i see why you wanted a moving average. that would help show just how common the 1 and 2 queed are 10:27AM 53slang robl: yep robl wonder why the bias towards early intervals? robl clients are more in sync early on? robl slang: you should point joshua mora towards the perfbase submission scripts you've written for pvfs2 10:37AM 53slang robl: I think all the clients submit right away so it ends up getting the server backed up 10:38AM 53slang robl: but then the queue kind of rate limits itself because a client can't submit another create until the previous one has completed 10:38AM 53slang robl: yeah I was going to clean them up a bit and send them off 10:39AM 53slang robl: they're not as nice as what joachim described, but its a start robl slang: so the worst possible case scenario is 1 server, 128 clients, all repeatedly creating a file and then calling MPI_Barrier. Not terribly likely :> 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 10:59AM slang_ here we go again SignOff 57slang_ : #pvfs2 Client Quit 56slang_ 36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com has joined #pvfs2 10:59AM slang_ pfft SignOff 57slang_ : #pvfs2 Client Quit 56slang_ 36n=slang@harley.mcs.anl.gov has joined #pvfs2 11:02AM 50* 53slang_/#pvfs2 goes back to using irssi robl slang_: i'm surprised ichat doesn't have irc support 11:05AM 53slang_ robl: that would be nice robl bwoop SignOff 57slang : #pvfs2 Read error: 110 (Connection timed out) 53#pvfs2 57slang_ 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36G n=pcarns adsl-215-223-2.aep.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57slang_ : #pvfs2 "leaving" 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 11:23AM slang 11:23AM slang I'll try to behave from now on 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57laytonj 36H n=laytonj 68-114-35-133.static.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-215-223-2.aep.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl i don't think any of us have the operator bit anyway 11:33AM 53slang robl: to give me the boot? 12:00PM 53slang robl: actually it looks more like the request scheduler is what's getting backed up 12:01PM slang not the actual trove metadata ops 12:01PM 50* 53slang/#pvfs2 is regenerating data/graphs 01:13PM pcarns slang: in your tests, are all the creates in the same directory, or different directories? 01:13PM pcarns slang: I imagine that the performance characteristics would be different because of contention on parent dir 01:16PM 50* 53pcarns/#pvfs2 sneaks in some irc during the world's longest meeting robl pcarns: dude, you're WFH. you could sneak in some gamecube if you wanted 03:55PM slang pcarns: all the same dir 03:56PM pcarns slang: how hard would it be to repeat one of the scenarios with different subdirs for each client? 03:57PM pcarns slang: just to see if it makes a difference, not for all scenarios 03:57PM slang pcarns: easy 03:57PM slang pcarns: I'm trying to regenerate the graphs with seperate data for keyval and dspace 03:58PM pcarns slang: cool 04:04PM slang pcarns: any thoughts on trove keys stuff 04:05PM pcarns slang: haven't quite gotten around to digesting that email yet :) 04:05PM slang pcarns: ok :-) 04:06PM pcarns slang: I'll get back to it in the morning pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com has joined #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Just a reminder: news article up at http://freenode.net/news.shtml .... group registrations, staff channels, 2006-2007 fundraising .... have a great evening, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:19am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 01:08PM pcarns slang: I have some tests running now with the struct/union based key format 01:09PM pcarns slang: I'll post later today or early tomorrow what the results are 01:15PM slang pcarns: cool pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3607:14pm BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-215-223-2.aep.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns: can you fix david's problem for us? robl pcarns: sam and i are out of ideas 03:23PM 53pcarns robl: yeah, we can dig into it some more robl pcarns: oh, hah, i was kinda joking 03:33PM pcarns hahaha 03:34PM pcarns we really kinda threw it out there on the list b/c its been hanging around and we haven't found time to work on it yet 03:34PM pcarns hoping someone might just spot what the problem is 03:35PM 53pcarns robl: by the way, I will hopefully have a bunch of xattr patches for you next week 03:35PM 53pcarns robl: wrapping up a bunch of bug fixing and tweaking robl pcarns: cool. thanks! 03:38PM 53pcarns robl: we are working on some new fsck tools now too, though that is going to take a while to pull together robl pcarns: cool. the existing fsck sure hasn't seen a lot of development (or probably even use) pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3606:10am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3610:55pm BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 08:08AM pcarns slang: how is the dbpf stuff coming along? 08:08AM pcarns slang: I see a lot of good stuff coming through cvs Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 pcarns n=pcarns@adsl-215-223-2.aep.bellsouth.net has left #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3604:42pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-215-223-2.aep.bellsouth.net has joined #pvfs2 SignOff 57pcarns : #pvfs2 Read error: 110 (Connection timed out) 56pcarn1 36n=pcarns@adsl-34-56-88.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarn1 36H n=pcarns adsl-34-56-88.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarn1: patch avalanche! robl pcarn1: we just a couple days ago ran up against the mpi objects issue SignOff 57pcarn1 : #pvfs2 Read error: 110 (Connection timed out) 56Mathman 36n=Mathman@certdhcp17.cert.ucr.edu has joined #pvfs2 03:43PM Mathman 03:44PM Mathman ping is telling me it can't retrieve info about my pvfs2tab entry. any know what that might mean? 03:45PM Mathman oops. anyone know I mean. robl Mathman: do you have an entry in /etc/fstab? robl Mathman: something along the lines of "tcp://some_server:3331/pvfs2-fs /mnt/pvfs2 pvfs2 defaults,noauto 0 0" ? 03:59PM Mathman no, pvfs2tab. it says it parses that just fine though robl Mathman: ok, what's your pvfs2tab look like? 04:00PM Mathman tcp://c2-9:3334/pvfs-fs /mnt/pvfs2 pvfs2 default,noauto 0 0 robl Mathman: and c2-9 is up and running? pvfs2-server is running happily on port 3334 ? 04:00PM Mathman yep 04:01PM Mathman hmm, should I change it to c2-9:3334/pvfs2-fs perhaps? robl Mathman: yeah, good eye 04:02PM Mathman that was it. 04:02PM Mathman thanks. =) robl Mathman: surprised we don't see more of that robl Mathman: pvfs2-ping isn't terribly helpful with that typo 04:04PM Mathman I blame that genconfig thing. it had some other stuff screwed up like that. 04:05PM Mathman shoot. mounting the stuff still times out though. 04:05PM Mathman mount: connection timed out 04:05PM Mathman that's from this command: mount -t pvfs2 tcp://c2-9:3334/pvfs2-fs /mnt/pvfs2 robl Mathman: you got pvfs2-client and pvfs2-client-core running? 04:06PM Mathman no... 04:07PM Mathman you know the install docs mentioned something or other about those. but I don't even have those in my install directory. 04:07PM Mathman I figured that was some older stuff or something that went away. robl Mathman: a 'make kmod install' will install pvfs2.ko, pvfs2-client-core and pvfs2-client robl those damn docs... i need to rewrite a lot of them robl (it's all accurate, just rather scattered) 04:14PM Mathman excellent. I'm up and running. 04:14PM Mathman really appreciate it. robl no problem. have fun 04:16PM Mathman well, one more question. what's the limit on the size of filesystem I can have with this stuff? 04:16PM Mathman I was hoping for around 4 terabytes or so. 04:17PM Mathman maybe more, maybe less. 04:17PM Mathman depends on how much all the spare partitions on my machines add up to. robl Mathman: yeah, each server will probably be able to contribute no more than 1, maybe 2 TB robl Mathman: but if you have enough servers.. well, i really don't know what the limit is. definitely above 4 tb 04:18PM Mathman ah. great. 04:18PM Mathman hehe, I'm gonna hold you to that now. robl well if you run into any problems there's the irc channel and also the pvfs2 mailing lists (where a lot more people pay attention) 04:20PM Mathman guess I oughta mention. I'm going for probably your more unconventinal uses. I just want to back stuff up to pvfs2. nightly snapshots or something. 04:20PM Mathman and I know it might be kinda unreliable as back up media goes. but with that in mind. you think I'm nuts here? 04:21PM Mathman maybe there's something else I oughta look into instead? 04:22PM Mathman basically I just want some way to utilize all the space that's going to waste in our rocks cluster. each machine has a 120 gig disk or so, so each one has 80 gigs or so completely free and ready to be put to use. robl well.. pvfs2 has no software redundancy (i can't think of any parallel file system that does) so a hardware failure on one node is bad news for your backup robl still, people do it all the time :> robl makes me a bit nervous myself but tb of data is just hard to manage 04:24PM Mathman yeah, I figured that. but all I need is for it to work most of the time so I can snapshot a few things. that way when people do stupid stuff like rm -rf /home/bob /file, I can help them out. 04:24PM Mathman if my pvfs2 stuff happens to be screwed at the same time, well, tough luck. it's still better than no backups at all like we're currently doing. robl Mathman: as long as you understand the tradeoffs, then great! 04:25PM Mathman the people I work for are nuts by the way. we have all this data and most all of it isn't backed up because they don't want to spend the money. 04:25PM Mathman well, long as you're not telling me I'm out of my mind, sounds like it's a go. robl writing backups will take a while unless you can increas the blocksize of whatever backup tool you're using 04:25PM Mathman thanks again. 04:26PM Mathman k, I'll keep that in mind. thanks. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3605:39pm BitchX : Press to see who left to change to [irc.freenode.net] SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-19-120-2.asm.bellsouth.net has joined #pvfs2 Mathman n=Mathman@certdhcp17.cert.ucr.edu has left #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-19-120-2.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) pcarns n=pcarns@adsl-19-120-2.asm.bellsouth.net has left #pvfs2 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 52Users 32#pvfs2 50)] 54 robl 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 16.702 secs!! #pvfs2 [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net Netjoined: 57irc.freenode.net herbert.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+nt by 57irc.colosolutions.net 52Users 32#pvfs2 50)] 54robl Channel #pvfs2 was created at Sat Mar 4 17:07:23 2006 BitchX : Join to #pvfs2 was synched in 3.804 secs!! 56robl 36~robl@ninjak.clustermonkey.org has joined #pvfs2 51ServerMode 36#pvfs2 57+nt by 57irc.mzima.net 52Users 32#pvfs2 50)] 54robl Channel #pvfs2 was created at Mon Mar 6 01:55:05 2006 BitchX : Join to #pvfs2 was synched in 3.054 secs!! Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log IRC log started Tue Mar 7 09:38:46 2006 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 52Users 32#pvfs2 50)] 54 robl 54 slang 54ChanServ Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 1.519 secs!! SWAP: No such window: 4 56rross 36n=rross@rrcs-67-52-72-134.west.biz.rr.com has joined #pvfs2 02:47PM rross anyone awake? rross n=rross@rrcs-67-52-72-134.west.biz.rr.com has left #pvfs2 02:55PM slang pfft 02:56PM slang on for 4 minutes?? robl sheesh robl we need a bot robl "hi %s!\n" robl "that question about %s is interesting. did you check the %s and %s?\n" robl rross would probably catch on pretty quick 04:31PM 53slang robl: hi robl! 04:32PM 53slang robl: that question about being awake is interesting! did you check the mailing list and faq? 04:32PM 53slang robl: yeah..dunno.. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3604:40am BitchX : Press to see who left to change to [irc.freenode.net] 57neillm No such nick/channel 12:51PM 32lilo:* "on recherche un monteur ou un PC/MAC puissant avec port FW pour derush et montage de video ce soir (4h de taf, le rea peut monter au cas ou) sur PARIS / site lestelechargements fr contre la loi DADVSI" 12:51PM 32lilo:* lilo merci 12:51PM 32lilo:* (whoops) 8) Mode change 57-w for user 36robl NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:13am BitchX : Press to see who left to change to [irc.freenode.net] 56ChanServ 36ChanServ@services. has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. One of our main rotation servers is misbehaving. It's back, but dropping users, and has been removed from rotation. We're looking at the issue. Any additional info will be on wallops ( /mode yournick +w )....thanks. SignOff 57slang : #pvfs2 Read error: 104 (Connection reset by peer) 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:53pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:06pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3602:49pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3602:52pm BitchX : Press to see who left to change to [irc.freenode.net] 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We just experienced a routing outage on a main rotation server. We're moving it out of main rotation and substituting other resources. You'll see people pinging out and coming back. Apologies for the inconvenience. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] We'll provide further information on wallops ( /mode yournick +w ) and if needed another global notice later. Thanks. 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pcarns your country needs you! SignOff 57slang : #pvfs2 Read error: 104 (Connection reset by peer) 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 robl 0,who 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. In a moment we're going to be performing some quick maintenance. About 4,000 users on a main rotation server will be detached from the network and reconnected. Please bear with us. NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:10pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3605:39am BitchX : Press to see who left to change to [irc.freenode.net] 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 55Md 35i=md@freenode/staff/md 50)- [GlobalNotice] Hi. we are missing a couple of servers because of a network outage, and services too. if your channel needs emergency mode changes (e.g. -R) please /msg me 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. Apologies for the inconvenience, but IRC services (nickserv and chanserv) are currently down; we're missing contact with some key servers. We're working to restore service and will keep you informed. Thanks. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Now would be a good time to mention that freenode could use more institutional server sponsors. Freenode is a service of Peer-Directed Projects Center, an IRS 501(c)(3) (not-for-profit) org in the US. If your organization would like to help, please message me. Thanks much. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi, folks. We are currently getting little tiny bits of bandwidth and high packet loss from our missing servers and, if you can believe it, that's actually good news. Stay with us and we'll keep you posted. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] For a bit more detailed information as available, please see wallops messages, which can be turned on via '/mode YOURNICK +w' on most clients 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. All service has been restored to the network and, so far, everything appears stable. A sponsor power outage caused most of our problems. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Again, I want to take the opportunity to note that freenode could use additional large institutional sponsors, to help us provide more redundant services---if your organization is interested, please email me (levin@pdpc.us) with your particulars and we'll talk. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] In the meantime, your client may not currently be identified to services; please identify or restart your client if that's more convenient. Thank you for your patience, and thank you for using freenode! NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:46am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:54am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3609:59am BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56pcarns 36n=pcarns@adsl-219-18-234.asm.bellsouth.net has joined #pvfs2 10:19AM pcarns hey, have you guys played with the io scheduler options on 2.6 kernels any? 10:20AM pcarns I fell into a rabbit hole last week (and so far this week) trying to track down big time stalls while doing read/write tests, 10:20AM pcarns wrote some benchmarks outside of PVFS2 stack and found that the stalls have nothing to do with pvfs2 code- its a system problem 10:21AM pcarns trying to find cause today, looks like changing io scheduler (and maybe settings with it) might help, but I need to do a lot more testing robl pcarns: haven't played with it much robl pcarns: the anticipitory scheduler as a gut feeling didn't sound right for pvfs2 robl pcarns: none of the standard schedulers did, actually 10:38AM 53pcarns robl: I have no clue 10:38AM 53pcarns robl: but so far it looks like anticipatory is actually doing the best 10:38AM pcarns trying noop next 10:40AM pcarns I'll post something on developers list if I find anything concrete robl pcarns: what does noop do? just run io requessts as soon as they show up? 10:41AM pcarns I guess so- it probably doesn't reorder disk queue any, or batch anything together 10:41AM pcarns there are 4 options in 2.6: cfq (default), as, deadline, and noop 10:41AM pcarns deadline didn't help my situation any 10:41AM pcarns noop running now 10:42AM pcarns basically my benchmark is trying to stream either 8G or 36G to disk in 256K chunks (like a flow would do) 10:42AM pcarns I have a version that uses aio, and version that uses pwrite 10:42AM pcarns aio version allows 16 concurrent ops (like flow does) 10:43AM pcarns I suspected aio as the problem at first, but it wasn't exactly robl pcarns: oh man, look slike there are infinity knobs yhou can turn for anticipatory, too 10:43AM pcarns anyway, depending on disk speed, ram, cpu speed, etc., I see some writes in the set stall for as long as 45 seconds 10:43AM pcarns which is longer than the flow timeout by default on server side (30 seconds) 10:43AM pcarns == boom 10:44AM pcarns the box I am testing on now sees stalls as long as 8 seconds with default scheduler, 10:44AM pcarns but it dropped to a max of 1.7 seconds when using as 10:44AM pcarns (but that's only a few test runs) 10:47AM pcarns hehe, noop wasn't very helpful 10:48AM pcarns I'm going to go back to as and try twiddling some more and confirming results NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3611:22am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3612:55pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:02pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:07pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:37pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:43pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3601:50pm BitchX : Press to see who left to change to [irc.freenode.net] 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-219-18-234.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 52.-------- 52-- 32-- 32--------- 32-- 50-- 50------------ -- - 52| 57laz n=laz@pdpc/supporter/active/laz 50) 57unknown 52: rcname : Adam Lazur 50| erver : irc.freenode.net (http://freenode.net/) laz is identified to services SignOff 57pcarns : #pvfs2 Remote closed the connection SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3603:59am BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57brown.freenode.net 3604:51am BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 SignOff 57laytonj : #pvfs2 Read error: 110 (Connection timed out) 56pcarns 36n=pcarns@adsl-61-120-100.mia.bellsouth.net has joined #pvfs2 09:28AM slang pcarns: I'll look into that tar problem 09:29AM slang pcarns: the stuff currently in that branch does a cursor get next for each of the entries in the directory up the position on *each* readdir 09:29AM slang pcarns: pretty expensive 09:30AM slang pcarns: I've written some code that fixes it (caches the pos->keyname pair), but it hasn't been committed yet 09:30AM pcarns slang: yeah, that seems like a reasonable first cut 09:30AM pcarns slang: oh, ok 09:32AM slang pcarns: anyway .. if the server restarts it has to fallback on the walking through approach, so that bug is still relevant 09:33AM pcarns slang: you think that bug has to do with the readdir? 09:34AM slang pcarns: dunno 09:34AM slang pcarns: just a first guess pcarns n=pcarns@adsl-61-120-100.mia.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-61-120-100.mia.bellsouth.net has joined #pvfs2 12:17PM slang pcarns: is it exactly 32 files into the tar file? 12:17PM slang pcarns: readdir does 32 entries at a time.. 12:22PM pcarns I think it is 32 files into it 12:22PM pcarns hmm 12:23PM pcarns maybe I can try to trigger by making a subdir, 12:23PM pcarns then creating 31,32,33 entries 12:23PM slang pcarns: well not readdir, but the kernel module has MAX_DIRENT_COUNT set to 0x20 12:23PM pcarns and listing at each point to see what happens 12:23PM slang pcarns: ok 12:24PM pcarns slang: I'll try that in a minute and let you know (rebuilding now with -g cflags) 12:24PM 50* 53slang/#pvfs2 grins robl it drives me crazy that -g isn't in our CFLAGS by default, though -O2 -g is pretty often not helpful 12:25PM 50* 53slang/#pvfs2 uses --enable-strict 12:25PM slang unless I'm doing perf tests 12:28PM 53pcarns robl: our build wrappers here automatically tack on -g, so I forget when I look at the clemson cvs tree 12:28PM pcarns slang: whoops 12:28PM pcarns slang: couple more warnings: 12:28PM pcarns ../pvfs2/src/io/trove/trove-dbpf/dbpf-open-cache.c:525: warning: long long unsigned int format, different type arg (arg 4) 12:29PM pcarns ../pvfs2/src/server/crdirent.sm:494: warning: passing arg 10 of `job_trove_keyval_write' from incompatible pointer type 12:29PM pcarns arg 10 - sweet! 12:29PM pcarns will have to use all fingers to count that one 12:33PM pcarns looks like it is using an int type for job id, rather than job_id_t 12:33PM pcarns 32 bit vs 64 bit 12:33PM slang pcarns: I can fix that 12:35PM pcarns slang: I fixed it in my tree temporarily to continue testing, 12:36PM pcarns slang: but I run into a problem before I get to try the 32 entry test: 12:36PM pcarns pcarns-vm pvfs2 # mkdir foo 12:36PM pcarns pcarns-vm pvfs2 # cd foo 12:36PM pcarns pcarns-vm foo # touch 1 2 3 12:36PM pcarns pcarns-vm foo # ls 12:36PM pcarns 2 3 12:36PM slang hrm 12:37PM pcarns pcarns-vm foo # cd ../ 12:37PM pcarns pcarns-vm pvfs2 # ls 12:37PM pcarns lost+found tmp 12:37PM slang pcarns: foo == tmp? 12:38PM pcarns no, doesn't look like it- it is a dir from something I did before what I pasted above 12:38PM pcarns has different stuff in it 12:39PM slang pcarns: oh 12:39PM pcarns in general, it looks like when I start creating things in a directory the first one is getting lost? 12:39PM slang pcarns: foo just isn't there 12:39PM slang pcarns: off-by-1 I guess 12:39PM slang pcarns: see if you can cd foo 12:39PM pcarns slang: ahh, it is just a problem in readdir- the objects are actually there 12:39PM pcarns pcarns-vm pvfs2 # ls 12:39PM pcarns blah blah2 lost+found tmp yeah 12:39PM pcarns pcarns-vm pvfs2 # ls foo 12:39PM pcarns 2 3 12:39PM pcarns pcarns-vm pvfs2 # cd foo 12:40PM pcarns pcarns-vm foo # ls 12:40PM pcarns 2 3 12:40PM pcarns pcarns-vm foo # ls -alh 1 12:40PM 50* 53slang/#pvfs2 nods 12:40PM pcarns -rw-r--r-- 1 root root 0 Mar 14 11:52 1 12:42PM pcarns slang: yep, and if I create too many entries in the dir, ls hangs 12:42PM pcarns slang: 30 works, 40 doesn't 12:42PM slang pcarns: too many == >32? 12:43PM slang pcarns: yeah I think that's related to the position stuff 12:43PM pcarns slang: whoops, wait 12:43PM pcarns slang: it eventually came back with 40 12:43PM pcarns slang: but says "no such file or directory" on one of the files 12:43PM slang slang: maybe 40 is just that much slower? 12:43PM slang 12:44PM slang now I've done something bad and I get SIGTRAP when I restart the server 12:45PM pcarns slang: I can believe it would be slower, but it can't take _that_ long to iterate through 32 entries, can it? 12:45PM slang pcarns: probably not no 12:48PM pcarns slang: I just timed an ls in that directory; took 24 seconds, but then didn't list anything 12:48PM slang pcarns: if it did a readdir after each new entry though.. 12:48PM slang pcarns: that would be 32*32 12:49PM pcarns slang: oh, does it restart if it sees that something changed? 12:49PM slang pcarns: I don't know when the readdirs happen 12:50PM pcarns slang: uh oh, my setup imploded after messing around with ls for a while: 12:51PM pcarns slang: got a msgpair failed out of pvfs2-ls, 12:51PM pcarns slang: then saw this in server logs: 12:51PM pcarns [E 12:06:25.852038] Error: accept: Too many open files 12:51PM pcarns [E 12:06:25.852096] ../pvfs2/src/io/bmi/bmi.c line 964: Error: critical BMI_testcontext failure. 12:51PM pcarns [E 12:06:25.852120] critical BMI failure. 12:51PM pcarns : Too many open files 12:51PM pcarns [E 12:06:25.852138] bmi_thread_function thread terminating 12:51PM pcarns slang: that wasn't very polite of bmi to react that way 01:03PM slang pcarns: no it wasnt 01:03PM slang pcarns: which errno is Too many open files? 01:05PM pcarns slang: ENFILE or EMFILE? 01:06PM pcarns slang: never actually heard of those, looking at accept man page 01:06PM pcarns slang: I think I see why it is running out of file descriptors though, 01:07PM pcarns slang; it looks like every trove operation is opening a new db reference 01:07PM slang pcarns: !! 01:07PM pcarns slang: I put a print in front of db_create() in the open cache code, and it gets triggered all the time 01:08PM pcarns slang: can we just toss the open cache now? 01:08PM pcarns slang: or well, maybe just not use it for db's any more? 01:09PM slang pcarns: yes 01:09PM pcarns slang: seems like we could open the db's at startup time and just hang onto them 01:09PM 50* 53slang/#pvfs2 nods 01:09PM pcarns slang: might be easier than fixing whatevers wrong with it 01:09PM slang pcarns: I was too lazy to change all the open cache stuff to just bstream handles 01:10PM pcarns slang: I've got a task on our todo list to test pvfs2 behavior when we run out of sockets, looks like I need to boost the priority on it a bit since it goes boom 01:11PM slang pcarns: I think I know what the off-by-1 ls error is 01:12PM slang pcarns: I'd like to make the fixes to the version I have that caches the position though 01:12PM slang pcarns: is that cool 01:12PM slang pcarns: ? 01:13PM pcarns slang: yep, sounds good to me 01:13PM slang pcarns: ok I'll commit that stuff to the onekeyval branch 01:13PM slang pcarns: the cache is based on the tcache 01:13PM slang pcarns: which I had to modify a bit to suit my needs 01:13PM pcarns slang: neat! robl valgrind --track-fds=yes ... oh, you guys figured it out already 01:22PM pcarns slang: anything I can do to help on the dbpf stuff for now, or just touch base again after commit? 01:24PM slang pcarns: yeah let me commit stuff first 01:24PM slang pcarns: shouldn't be more than an hour or so 01:24PM pcarns slang: no rush 02:55PM slang pcarns: well, the missing first entry is fixed 02:55PM slang pcarns: but now I'm getting multiple listings for the second to last entry 02:55PM slang :-) 03:08PM pcarns slang: I guess extra files are better than missing files :) 03:10PM pcarns slang: if it did it for all files you could just stop where you are at; we will tell people it is the new redundancy scheme 03:20PM 50* 53slang/#pvfs2 hehs 03:21PM slang pcarns: it seems to only happen via the vfs too 03:21PM slang pcarns: pvfs2-ls appears to behave 03:26PM slang good grief 03:27PM slang no wonder ls is so slow 03:27PM slang its calling readdir 3 times! 03:27PM slang even though all the entries were returned in the first call 03:31PM pcarns slang: yuck- is it not detecting when it has hit the end properly? 03:31PM 50* 53pcarns/#pvfs2 has never looked at the vfs readdir path... 03:44PM slang pcarns: vfs code never looks at the token for _END 03:48PM slang pcarns: murali showed me how to fix it 03:48PM slang maybe 03:53PM pcarns slang: would this have been causing extra readdirs all along? pcarns n=pcarns@adsl-61-120-100.mia.bellsouth.net has left #pvfs2 04:13PM slang pcarns: yes! 04:14PM slang pcarns: man if I can get this changed and do a DB_MULTIPLE_NEXT instead of DB_NEXT ls could get a lot faster 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-61-120-100.mia.bellsouth.net has joined #pvfs2 02:34PM slang theres some weirdness now with the ordering of the directory entry lost+found 02:34PM slang before it was always first 02:34PM slang now it appears in lexical order 02:37PM pcarns slang: does it matter? 02:37PM 50* 53slang/#pvfs2 shrug 02:37PM pcarns slang: what is lexical order? alphabetical? 02:37PM slang pcarns: right 02:37PM slang pcarns: it doesn't matter to me 02:40PM pcarns slang: looks like ext3 does that too 02:40PM slang pcarns: ok cool 02:44PM pcarns slang: did the new "end of dir" detection work ok for the vfs readdir? 02:44PM slang pcarns: yeah! 02:44PM slang pcarns: it works good 02:44PM slang pcarns: so that should save us an extra roundtrip 02:44PM slang pcarns: does save us 02:44PM slang pcarns: I tested it 02:44PM slang pcarns: I just committed a bunch of that stuff 02:44PM pcarns slang: awesome 02:45PM slang pcarns: I'll send an email to dev-int to keep people up-to-date on all that 02:45PM 50* 53slang/#pvfs2 should probably add some documentation in places too.. 02:52PM pcarns slang: looks like a nice big commit on the dbpf branch :) 02:53PM pcarns slang: I'll try to test it out some in a little bit robl slang: you ever gonna merge into the trunk? :> 03:03PM slang pcarns: heh 03:03PM slang pcarns: someday 03:03PM slang pcarns: I feel a little more confident about the stuff in my recent commit than previously 03:04PM slang pcarns: that other stuff was pretty buggy (as you discovered) 03:08PM slang pcarns: can you let me know if the tcache changes I made are cool? 03:08PM pcarns slang: will do 03:33PM pcarns slang: looks like I won't get to look at this stuff until tomorrow 03:33PM slang pcarns: that's fine 03:33PM slang pcarns: no rush pcarns n=pcarns@adsl-61-120-100.mia.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-145-176-27.asm.bellsouth.net has joined #pvfs2 09:33AM pcarns slang: did you forget to add dbpf-keyval-pcache.h to cvs? 09:34AM pcarns slang: actually, I guess the .c file too 09:40AM slang pcarns: oops 09:42AM slang pcarns: ok, added. sorry about that 09:42AM pcarns slang: no prob 09:43AM pcarns slang: thanks 10:04AM pcarns slang: I am still getting this warning: 10:04AM pcarns ../pvfs2/src/io/trove/trove-dbpf/dbpf-open-cache.c:525: warning: long long unsigned int format, different type arg (arg 4) 10:10AM pcarns slang: and now I get a different hang when trying tar -xvjf /usr/src/linux-2.6.15.4.tar.bz2 ... 10:11AM pcarns slang: this time it got 68 files/directories into the untar and is just stuck, no error messages yet 10:13AM pcarns slang: it eventually timed out: tar: linux-2.6.15.4/Documentation/aoe/mkshelf.sh: Cannot write: Connection timed out 10:16AM pcarns slang: I just sent an email with server log snippet (storage logging only) 10:18AM slang slang: ok I'll look at it, thanks 10:31AM pcarns slang: looks like maybe we are still hitting the open cache a good bit? 10:32AM pcarns slang: I got this after playing around some more: 10:32AM pcarns tar: linux-2.6.15.4/Documentation/SubmittingPatches: Cannot open: Too many open files 10:34AM pcarns slang: I added a msg before db_create again, then restarted everything and ran untar until it hung: 10:34AM pcarns pcarns-vm server # cat /tmp/pvfs2-server.log |grep "DB_CREATE CALLED" |wc 10:34AM pcarns 647 2588 24586 10:40AM pcarns slang: messing around a little bit more (creating new directories, cd'ing to them, listing contents) I get another hang with this message on the server: 10:40AM pcarns [E 09:53:00.400133] ../pvfs2/src/io/trove/trove-dbpf/dbpf-keyval.c line 747: dbpf_keyval_iterate_op_svc: DB_NOTFOUND: No matching key/data pair found 10:40AM slang pcarns: oh dear 10:41AM slang pcarns: dspace hits the open cache 10:41AM slang pcarns: I'm fairly sure keyval ops shouldn't 10:42AM pcarns slang: ah, some clarification on that last one: it looks like there is a bug in listing empty directories: 10:42AM pcarns # /mnt/pvfs2> mkdir foo1 10:42AM pcarns # /mnt/pvfs2> touch foo1/file1 10:42AM pcarns # /mnt/pvfs2> mkdir foo2 10:42AM pcarns # /mnt/pvfs2> ls foo1 10:42AM pcarns file1 10:42AM pcarns # /mnt/pvfs2> ls foo2 10:42AM pcarns 10:42AM slang pcarns: oh I think I know what the problem is there 10:43AM slang pcarns: I wasn't initializing the dirdata_size to zero 10:43AM pcarns slang: ah, ok 11:12AM slang hmm 11:13AM slang I want to be able to use MULTIPLE_NEXT when iterating through all the directory's entries 11:14AM slang but in order to that I have to specify (by mallocing the result data to the right size) the number of entries I want returned 11:15AM slang so I needed the number of the dir ents 11:15AM slang which I decided to store in the directory's keyval 11:15AM slang (as 'dirdata_size') 11:16AM slang and update it on crdirent and remove 11:16AM pcarns ah, but that's actually a different handle, though, right? 11:16AM pcarns from the one that has the entries stored in it 11:16AM slang pcarns: correct 11:17AM slang but I didn't feel like the dbpf keyval interface allowed me to pass the size into the iterate function 11:17AM pcarns what happens if you just ask for a fixed number with MULTIPLE_NEXT every time, but there aren't necessarily that many there? 11:17AM slang pcarns: it fills in the ones that are there and returns the size 11:18AM pcarns which iterate function are we talking about? 11:18AM slang pcarns: dbpf_keyval_iterate_op_svc 11:19AM slang pcarns: the get call doesn't know about different handles though 11:19AM slang pcarns: so with multiple directories a MULTIPLE_NEXT will most likely return the number I asked for 11:19AM slang pcarns: and then I would have to go and find only the ones that match the handle I want 11:20AM slang pcarns: I didn't want to have to do that 11:20AM slang pcarns: so I tried to set the dirent_count to be <= available entries 11:20AM slang pcarns: but then iterate never returns _ITERATE_END 11:21AM pcarns slang: I'm not sure I follow... 11:21AM pcarns slang: why would it give you more than the handle you ask for? 11:21AM pcarns slang: oh, I see 11:22AM slang pcarns: i.e. I'm decrementing s_op->req->u.readdir.dirent_count in readdir.sm if the dirdata_size and position show that there aren't enough entries available 11:22AM pcarns slang: the MULTIPLE_NEXT doesn't really have a stopping condition- it starts wherever the cursor is and keeps going? 11:22AM slang pcarns: right 11:22AM slang pcarns: as long as their are entries in the DB 11:24AM pcarns slang: what if you did something like this: 11:24AM pcarns slang: in the state machine, set the inout_count to dirent_count +1 11:25AM pcarns slang: in the iterate function, then just do multiple next ffor inout_count db entries, 11:25AM pcarns slang: and put in logic to eliminate the ones for the wrong handle, 11:25AM pcarns slang: but start from the rear of the list to get rid of those, 11:25AM pcarns slang: because of the count that the caller set, you should only have 1 at most to strip off 11:26AM slang pcarns: hmm 11:26AM pcarns slang: (although logic would need to accomodate that their could be more- it would just stop when it found a matching handle when iterating backwards through array) 11:26AM slang pcarns: that's a good idea 11:26AM slang pcarns: then _ITERATE_END would still get triggered 11:27AM pcarns slang: so basically you are doing what you didn't want to (having to find only the matching handles after the db calls), but the caller is setting it up the count such that it shouldn't be a big perf penalty 11:27AM slang pcarns: right 11:27AM pcarns slang: yeah, you could stick _ITERATE_END in there at the appropriate time 11:29AM pcarns pcarns: in the state machine (before calling iterate), do we already know the dirent_count? 11:29AM pcarns slang: or would there be an extra step to get it? 11:29AM slang pcarns: I get it from the parent keyval, yes 11:29AM slang pcarns: extra step 11:30AM slang pcarns: you think that's a big deal? 11:30AM pcarns slang: so there are possibly two (small?) penalties to setting things up like this then: having to retrieve the dirent_count, and possibly reading one extra entry 11:30AM pcarns slang: but the benefit is getting all the entries in one call rather than N 11:30AM slang pcarns: right 11:31AM pcarns slang: it is probably worth it 11:32AM slang pcarns: I might be able to only get the dirdata_size when the directory is big 11:32AM slang pcarns: where big means more than one readdir 11:32AM slang pcarns: by checking that pos != _ITERATE_START 11:33AM pcarns slang: then again, I guess we are assuming that MULTIPLE_NEXT is actually faster than just doing going through the cursor one at a time 11:33AM pcarns slang: I would assume that's true but db is kinda tricky like that sometimes :) 11:34AM slang pcarns: oh 11:34AM pcarns slang: *shrug* if it was me I would probably be inclined to do it the old fashioned way for now and come back later with the optimization 11:34AM slang pcarns: yeah I'm assuming that too 11:34AM slang pcarns: but I did want to run the tests to verify 11:35AM pcarns slang: oh ok, that's cool 11:36AM 50* 53pcarns/#pvfs2 is off to lunch 11:38AM 50* 53slang/#pvfs2 waves 12:35PM pcarns slang: oh I forgot, the tcache changes look fine 12:36PM pcarns slang: thanks for the updates 12:56PM slang slang: cool 12:57PM slang pff 12:57PM slang pcarns: cool 12:57PM slang pcarns: the hanging behavior is caused by the kernel module retrying readdir until 0 is returned 12:58PM slang pcarns: but in this case readdir is returning an error (<0) 12:58PM slang pcarns: seems like the kernel module should be smarter about checking for errors 01:06PM slang pcarns: might be able to get murali to fix it :-) 01:32PM pcarns slang: its worth a shot :) 03:20PM slang pcarns: committed some fixes 03:20PM slang pcarns: cp seems to be broken now 03:20PM slang pcarns: though 03:21PM slang pcarns: the server keeps getting SIGTRAP at any rate 03:51PM slang slang@lain:~/BUILD-pvfs2-ok$ ./src/apps/admin/pvfs2-ls 03:51PM slang 03:51PM slang lost+found 03:51PM slang eth2.tar.bz2 03:51PM slang pvfs2-ls now shows entries in reverse order.. robl slang: we can ship pvfs2-ls as a shell script that pipes 'real' pvfs2-ls to sort? 04:22PM 53slang robl: heh 04:30PM slang pcarns: tar gets pretty far for me now 04:30PM slang pcarns: still hangs at some point though 05:10PM pcarns slang: thanks for working on this stuff again; I'll check back in with you tomorrow... pcarns n=pcarns@adsl-145-176-27.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-145-176-27.asm.bellsouth.net has joined #pvfs2 56_Gandalf 36i=1000@ptr-68-179-18-98.ptr.terago.ca has joined #pvfs2 10:53AM _Gandalf hi all, hope your day is going well! 10:53AM slang _Gandalf: pretty well, how are you? 10:53AM _Gandalf anyone around that i could ask a pvfs2 related question? 10:53AM _Gandalf good thanks 10:54AM slang _Gandalf: what's up? 10:54AM _Gandalf well i'm getting seg faults with 1.4.0 on 2.6.15.6 10:55AM slang _Gandalf: oh dear 10:55AM _Gandalf hahaha 10:55AM slang _Gandalf: what's your usage scenario? 10:56AM _Gandalf i've seen it mentioned on the mailing list but nothing other than "go download the cvs" wich i've done and it still has the same issue... 10:56AM _Gandalf well testing right now 10:57AM _Gandalf but i would like to use it in a production environment eventually serving pdfs from a set of clustered document servers... 10:58AM _Gandalf theres never a situation where 2 people would be modifying the same doc so from what i've read pvfs2 would be almost a perfect fit 10:58AM _Gandalf and the docs are to numerouse for coda metadata goes thru the roof 10:58AM slang _Gandalf: ok 10:59AM slang _Gandalf: what are you doing to cause the segfault? 10:59AM _Gandalf trying to create the array 10:59AM _Gandalf pvfs2-server -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1 10:59AM _Gandalf then start and segfault 11:00AM _Gandalf nothing in dmesg or syslog or its log robl _Gandalf: what distribution? 11:00AM _Gandalf and when i strace it i can't see anything usful but i'm not a coder unfortunatly 11:00AM _Gandalf slackware 10.2 robl _Gandalf: this is a longshot, but try setting the LD_ASSUME_KERNEL environment variable to 2.4.1 and try again robl _Gandalf: also, what does 'ldd pvfs2-server' say? 11:04AM _Gandalf root@www1:~/pvfs2-1.4.0/src/server# ldd pvfs2-server 11:04AM _Gandalf linux-gate.so.1 => (0xffffe000) 11:04AM _Gandalf librt.so.1 => /lib/librt.so.1 (0xb7fa8000) 11:04AM _Gandalf libpthread.so.0 => /lib/libpthread.so.0 (0xb7f57000) 11:04AM _Gandalf libdb-4.3.so => /usr/lib/libdb-4.3.so (0xb7e73000) 11:04AM _Gandalf libc.so.6 => /lib/libc.so.6 (0xb7d5a000) 11:04AM _Gandalf /lib/ld-linux.so.2 (0xb7fd5000) 11:05AM _Gandalf root@www1:~/pvfs2-1.4.0# export LD_ASSUME_KERNEL=2.4.1 11:05AM _Gandalf root@www1:~/pvfs2-1.4.0# pvfs2-server -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1 11:05AM _Gandalf [D 11:43:56.506703] PVFS2 Server version 1.4.0 starting. 11:05AM _Gandalf Segmentation fault 11:09AM slang _Gandalf: can you run that in the debugger for us? 11:09AM slang _Gandalf: first: gdb pvfs2-server 11:09AM slang _Gandalf: then: run -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1 11:09AM slang _Gandalf: when it segfaults, do: bt 11:10AM _Gandalf #0 0xb7e29b3c in __dbenv_get_errpfx () from /usr/lib/libdb-4.3.so 11:10AM _Gandalf #1 0xb7e18c39 in __dbh_am_chk () from /usr/lib/libdb-4.3.so 11:10AM _Gandalf #2 0x0809980e in dbpf_db_open () 11:10AM _Gandalf #3 0x08099536 in dbpf_storage_lookup () 11:10AM _Gandalf #4 0x08097adf in dbpf_initialize () 11:10AM _Gandalf #5 0x08066b25 in trove_initialize () 11:10AM _Gandalf #6 0x08078f5b in pvfs2_mkspace () 11:10AM _Gandalf #7 0x080766a9 in PINT_config_pvfs2_mkspace () 11:10AM _Gandalf #8 0x08051f65 in main () 11:12AM slang _Gandalf: looks like a problem in berkeley db 11:12AM _Gandalf spiffy 11:13AM slang _Gandalf: what was your configure line for pvfs2? 11:13AM _Gandalf ./configure --with-kernel=/usr/src/linux robl _Gandalf: where'd you get db-4.3? slack 10.2 ships with 4.2.52, right? 11:18AM _Gandalf yeah i'm not sure this is a fresh install... i don't remember upgrading it... hmm... 11:19AM _Gandalf yeah i'm a retard i must have upgraded it. 11:19AM _Gandalf maybe when i did apache and php 11:20AM slang _Gandalf: can you do: locate db.h 11:22AM _Gandalf updating db just a sec 11:25AM _Gandalf ./usr/include/db4/db.h 11:26AM slang _Gandalf: can you try to do ./configure ... --with-db=/usr robl _Gandalf: please grep for 'DB_VERSION_STRING' in ./usr/include/db4/db.h ? 11:26AM slang _Gandalf: and recompile and try the pvfs2-server -f ... again? 11:27AM slang _Gandalf: do what robl says first :-) 11:32AM _Gandalf i missed this befor too /usr/include/db.h as well 11:33AM slang _Gandalf: I thought so ;-) 11:33AM _Gandalf Sleepycat Software: Berkeley DB 4.3.29: (September 6, 2005) 11:33AM _Gandalf that was for /usr/include/db4 11:33AM _Gandalf root@www1:~/pvfs2-1.4.0# cat /usr/include/db.h|grep DB_VERSION_STRING 11:33AM _Gandalf #define DB_VERSION_STRING "Sleepycat Software: Berkeley DB 3.3.11: (July 12, 2001)" 11:33AM _Gandalf root@www1:~/pvfs2-1.4.0# 11:34AM slang _Gandalf: heh 11:34AM slang _Gandalf: --with-db=/usr should work for you 11:34AM _Gandalf k gonna try now 11:35AM _Gandalf btw thanks for all your help guys i really appreciate it! 11:37AM _Gandalf nope same seg fault 11:38AM slang _Gandalf: grep CFLAGS Makefile 11:38AM _Gandalf #0 0x00000000 in ?? () 11:38AM _Gandalf #1 0x0809981c in dbpf_db_open () 11:38AM _Gandalf #2 0x08099536 in dbpf_storage_lookup () 11:38AM _Gandalf #3 0x08097adf in dbpf_initialize () 11:38AM _Gandalf #4 0x08066b25 in trove_initialize () 11:38AM _Gandalf #5 0x08078f5b in pvfs2_mkspace () 11:38AM slang _Gandalf: in the pvfs2 builddir 11:38AM _Gandalf #6 0x080766a9 in PINT_config_pvfs2_mkspace () 11:38AM _Gandalf #7 0x08051f65 in main () 11:40AM _Gandalf CFLAGS = -O2 -DGOSSIP_ENABLE_BACKTRACE 11:40AM _Gandalf PICFLAGS = -fPIC 11:40AM _Gandalf CFLAGS += -D__STATIC_METHOD_BMI_TCP__ 11:40AM _Gandalf #CFLAGS += -D__STATIC_FLOWPROTO_DUMP_OFFSETS__ 11:40AM _Gandalf CFLAGS += -D__STATIC_FLOWPROTO_MULTIQUEUE__ 11:40AM _Gandalf CFLAGS += -D_FILE_OFFSET_BITS=64 -D_LARGEFILE64_SOURCE 11:40AM _Gandalf CFLAGS += -I . 11:40AM _Gandalf CFLAGS += -I $(srcdir)/include -I include -I $(srcdir) 11:40AM _Gandalf CFLAGS += $(patsubst %,-I$(srcdir)/%,$(INCLUDES)) 11:40AM _Gandalf CFLAGS += -DPVFS2_VERSION="\"1.4.0\"" 11:40AM _Gandalf INTEL_CFLAGS := -Wall -wd279 11:40AM _Gandalf GCC_CFLAGS := -Wall -Wstrict-prototypes -pipe 11:41AM _Gandalf #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_JOB_THREADED__ \ 11:41AM _Gandalf #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_JOB_THREADED__ \ 11:41AM _Gandalf #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_TROVE_SUPPORT__ SignOff 57_Gandalf : #pvfs2 Excess Flood 56_Gandalf 36i=1000@ptr-68-179-18-98.ptr.terago.ca has joined #pvfs2 11:41AM _Gandalf that was super 11:44AM _Gandalf i could try installing the db4.4.16 package for db... robl _Gandalf: you've got db-3 and db-4 stuff in /usr/lib and /usr/include... try building a berkely db from source, but install into, say, /usr/local/db4 robl then you'll know for sure you aren't mixing headers and libraries robl (configure pvfs2 with the --with-db= option) robl we're off to lunch. let us know how it goes 11:47AM _Gandalf have a good lunch gents 11:47AM _Gandalf thanks again 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 12:18PM _Gandalf it worked! 12:18PM _Gandalf super thanks for all your help robl & slang 12:53PM slang _Gandalf: cool pcarns n=pcarns@adsl-145-176-27.asm.bellsouth.net has left #pvfs2 02:48PM _Gandalf should this be showing me the drives sizes added together robl roughly 03:04PM _Gandalf nice 03:05PM _Gandalf works well too robl _Gandalf: how big are your typical pdf files? 03:05PM _Gandalf is there any reason i wouldn't see the tcp connection in iptraf? 03:05PM _Gandalf around 10k each robl _Gandalf: about how many in a given directory? 03:08PM _Gandalf uhm 03:08PM _Gandalf just a sec 03:12PM _Gandalf anywhere from about 300 - 2000 03:12PM _Gandalf in total almost 800,000 pdfs robl _Gandalf: the total isn't too alrming, but 'ls' on that 2000 entry directory will take a few seconds (just wanted to warn you what to expect) 03:26PM _Gandalf there shouldn't ever be any ls'in just read and writes as agents move pdfs into customer account dirs and stuff like that... 03:26PM _Gandalf and the clients are local to the servers... 03:26PM _Gandalf this is basically so i can replicate my raid 5 in real time robl ok, cool SignOff 57laytonj : #pvfs2 "Leaving" Connection closed from irc.freenode.net: Success BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] Unable to connect to port 6667 of server irc.freenode.net: unknown host BitchX : Servers exhausted. Restarting. Connecting to port 6667 of server irc.freenode.net [refnum 0] 52[freenode] *** Looking up your hostname... 52[freenode] *** Checking ident 52[freenode] *** No identd (auth) response 52[freenode] *** Found your hostname BitchX : For more information about BitchX type /about Welcome to the freenode IRC Network robl (from kornbluth.freenode.net) Your host is kornbluth.freenode.net[freenode.freenode.net/6667], running version hyperion-1.0.2 (from kornbluth.freenode.net) 52[freenode] *** Your host is kornbluth.freenode.net[freenode.freenode.net/6667], running version hyperion-1.0.2 This server was created Sat Dec 17 11:04:34 UTC 2005 (from kornbluth.freenode.net) kornbluth.freenode.net hyperion-1.0.2 aAbBcCdDeEfFGhHiIjkKlLmMnNopPQrRsStTuUvVwWxXyYzZ01234569*@ bcdefFhiIklmnoPqstv IRCD=dancer CAPAB CHANTYPES=# EXCEPTS INVEX CHANMODES=bdeIq,k,lfJD,cgijLmnPQrRstz CHANLIMIT=#:20 PREFIX=(ov)@+ MAXLIST=bdeI:50 MODES=4 STATUSMSG=@ KNOCK NICKLEN=16 :are supported by this server SAFELIST CASEMAPPING=ascii CHANNELLEN=30 TOPICLEN=450 KICKLEN=450 KEYLEN=23 USERLEN=10 HOSTLEN=63 SILENCE=50 are supported by this server local users on irc 4334 50)] 16% global users on irc 13186 50)] 49% invisible users on irc 13556 50)] 51% ircops on irc 50)] total users on irc 26742 50)] unknown connections 50)] total servers on irc 50)] avg. 0 users per server total channels created 10804 50)] avg. 2 users per channel Current local users: 4334 Max: 6736 Current global users: 26742 Max: 30067 Highest client connection count 6737 50) 6736 50)] Unknown MODE flag Mode change 57+iw for user 36robl 56robl 36n=robl@ninjak.clustermonkey.org has joined #pvfs2 Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 52Users 32#pvfs2 50)] 54 robl 54 _Gandalf 54ChanServ 54 slang 55NickServ 35NickServ@services. 50)- This nickname is owned by someone else 55NickServ 35NickServ@services. 50)- If this is your nickname, type /msg NickServ IDENTIFY 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl #pvfs2 [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup Channel #pvfs2 was created at Mon Aug 8 02:51:50 2005 BitchX : Join to #pvfs2 was synched in 14.332 secs!! 08:13AM 32lilo:* Hi all. If you have any information on the current status of Larry, please message me. Thanks! 08:15AM 32lilo:* Hi all. If you're following Larry (a cat 4 storm heading for Australia's northeast coastline), please stop by ##earth .... thanks! 31msg 51nickserv 50)] identify password 55NickServ 35NickServ@services. 50)- Password accepted - you are now recognized mode 36robl 57+e by 57services. 55MemoServ 35MemoServ@services. 50)- You have no new memos NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3608:13pm BitchX : Press to see who left to change to [irc.freenode.net] NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3610:21pm BitchX : Press to see who left to change to [irc.freenode.net] 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57_Gandalf 36G i=1000 ptr-68-179-18-98.ptr.terago.ca (* I'm too lame to read BitchX.doc *) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3610:12am BitchX : Press to see who left to change to [irc.freenode.net] Netjoined: 57irc.freenode.net kornbluth.freenode.net 56ChanServ 36ChanServ@services. has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56_Gandalf 36i=1000@ptr-68-179-18-98.ptr.terago.ca has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net 57> 52freenode-connect 32freenode@freenode/bot/connect 32 requested VERSION from robl SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57_Gandalf : #pvfs2 "BitchX-1.1-final -- just do it." 56pcarns 36n=pcarns@adsl-34-59-188.asm.bellsouth.net has joined #pvfs2 03:34PM 32lilo:* congrats to BearPerson: it's his birthday, and he gets to be our newest staffer....now that he's Ancient :) 03:59PM 32lilo:* it's also a birthday for fedora's cds .... happy birthday, clair :) Mode change 57-w for user 36robl 53#pvfs2 57pcarns 36H n=pcarns adsl-34-59-188.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) SignOff 57pcarns : #pvfs2 Read error: 113 (No route to host) 56pcarns 36n=pcarns@adsl-215-227-62.aep.bellsouth.net has joined #pvfs2 09:32AM slang pcarns: ok so its a bstream problem now 09:33AM slang pcarns: I think part of my confusion with all this has been that I haven't made any changes to the open cache code itself 09:33AM slang pcarns: so it seems like it shouldn't suddenly go hog wild with open fds 09:40AM pcarns slang: now on dvd: "open caches gone wild" 09:40AM 50* 53slang/#pvfs2 laughs 09:41AM pcarns slang: I didn't actually check to make sure that's what's happening, just assuming that error code is genuine 09:41AM pcarns slang: might need to check lsof once it hits the hang 09:42AM pcarns slang: but I've been pulled off onto something else for a while this morning 09:42AM slang pcarns: yeah the log agrees with you 09:42AM slang pcarns: I added a debug statement in open_fd 09:45AM slang pcarns: I'll keep digging, thanks 09:49AM pcarns slang: cool, good luck 56pw 36n=pw@quasar.osc.edu has joined #pvfs2 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 01:15PM 50* 53hozer/#pvfs2 <- Troy Benjegerdes 01:18PM hozer how do you chsh on these machines? Complaint: "Cannot lock the password file; try again later. 01:18PM hozer heh 01:18PM hozer you ask your friendly admin ;) 01:18PM hozer what shell? 01:18PM hozer (we are using ldap for passwd lookups) 01:19PM chsh, asks for my password, asks for shell, then that complaint; all on opteron1 01:20PM hozer what shell do you want? 01:21PM hozer bash I assume? 01:21PM yeah, 01:22PM hozer changed SWAP: Window 3 is not hidden! 01:22PM kewl robl hey guys 01:23PM hozer I suppose the next question is what should we start benchmarking this with? 01:24PM hozer pw: all you really wanted was access to the repository, right? 01:24PM What've you got for openib-running NICs and storage? 01:24PM (Yeah, just the repo; but it seems to be in ~kschoche somewhere I can't read, I'm guessing.) 01:24PM hozer dual opteron with dual Areca controllers 01:25PM Enough server machines with interesting disk to get good numbers? 01:25PM hozer you should be able to read /afs/scl.ameslab.gov/project/infiniband/pvfs2/pvfs2-openib-dev 01:26PM Yeah, but it's old. No openib files around. I found processes running by kschoche on d5 that point into /afs/scl.ameslab.gov/user/kschoche, but acls won't let me see. 01:26PM hozer hrrm 01:26PM 53pw robl hiya. We're hijacking #pvfs2 for a while. :) 01:28PM hozer pw: I just updated the working copy 01:28PM hozer the stuff is in the repository, but the working copy hadn't been updated 01:30PM hozer pw: da5/da6 also have DDR infiniband cards 01:30PM hozer opteron1/2 have old PCI-X IB cards 01:32PM Hrm. I've got 40 dedicated SDR PCI-E, but those machines only have one SATA Drive each. I was hoping for both lots of IB nodes and reasonable storage. robl pw: excelent. pcarns n=pcarns@adsl-215-227-62.aep.bellsouth.net has left #pvfs2 01:34PM hozer we have around 12 of those storage servers, each with 16 sata drives 01:34PM hozer but some are not configured up yet. 01:35PM hozer and Brett is running production GAMESS jobs on pvfs2 over IPoIB on 3 of them as well 01:36PM hozer so ideally, we'll end up with 8-10 storage servers and 10 IBM 4cpu Power5's as clients 01:37PM hozer the IBM's have IBM's ehca driver.. and I need to update the kernel and openib info on those first 01:37PM Oh my, that sounds like some risk, but it should work. 01:38PM hozer yes 01:39PM hozer but we should be able to do a nice 4 client to 4 server test with the DDR opterons 01:40PM I guess so. At least you've got good disk, but I was hoping for some SUPERcomputing. 01:42PM hozer we'll be happy if the disk(s) can go fast enough to feed a 4 cpu IBM box running GAMESS in direct SCF mode 01:43PM hozer if I can max out the 12X infiniband links on one of the IBM nodes, I think we can find a GAMESS job that could be run on this system that we can't run anywhere else 01:45PM crazy, good app paper 01:47PM hozer the annoying thing is there's a 64 node IB cluster in the same building, but in the basement. (we are on the 4th floor) 01:48PM How much work would it be to drag everything down to the basement for the next month or so? Enough switch ports to hook it all up? 01:49PM hozer we could take 8-10 storage servers down to the basement 01:50PM hozer the 64 node cluster isn't technically ours though 01:50PM hozer I think if we find out sometime this week or early next that everything works, it might be worth tryingg 56pcarns 36n=pcarns@adsl-215-227-62.aep.bellsouth.net has joined #pvfs2 04:19PM 53pw robl I've never understood your ChangeLog format. New things go on top of old things in a particular release? Have you seen the GNU-standard ChangeLog format? 04:21PM hozer pw: do you know anything about Linux async I/O? 04:21PM hozer and/or libaio? 04:24PM Yeah, implemented by a separate thread in glibc, or via very recent unmerged kernel pathches 04:25PM hozer AIO has been in the kernel since at least 2.6.14 or so, I think robl pw: oh yeah, it's quite ad-hock robl hoc even 04:25PM hozer which is old by my standards at least ;) robl pw: i respect what the gnu changelog format does, but i find it too verbose robl pw: probably because i make heavy use of cvsps... w/o that i'd be all over the gnu format 04:26PM 53pw robl no big deal to me, just wondered if I was doing it wrong. robl pw: nope. as far as i can tell, you and i are the only ones who make changes to ChangeLog. Thanks for doing that, btw 04:28PM hozer you mean there should be a sys_aio_read etc that can be called directly from userspace? I've not seen that yet, but maybe I'm just missing it in the source. 04:28PM hozer pw: yeah.. what you want to be doing (especially on our 8-disk raidset machines) is open a file with O_DIRECT and use the aio_read functions 04:30PM hozer pw: look in /usr/src/aio on opteron1 04:30PM hozer the 'aiocp' program 04:31PM hozer we can get close to 400MB/sec with aiocp, but only 200-300 useing regular reads 04:32PM Oh, via io_submit etc rather than the posix aio_read calls, I see. This may require some porting work to get pvfs2 to talk it. 04:35PM hozer yep 04:35PM hozer if you do it right you avoid any memory copies 04:36PM hozer I believe you can use io_submit on TCP sockets as well and you might be able to get zero copy on regular TCP that way 04:36PM hozer at least on send 04:37PM hozer I had heard that someone had a posix aio_read implementation that used the linux io_submit underneath, but I've not been able to verify this yet 04:39PM That would be ideal. It is a hassle to shift stuff around as APIs change. SignOff 57pw : #pvfs2 "pw has no reason" 04:53PM pcarns hey guys, I am about to head out, but I just skimmed over end of conversation 04:53PM pcarns http://www.bullopensource.org/posix/ 04:53PM pcarns might be something to look at 04:54PM pcarns they have patches for kernel, and a posix compliant aio implementation to use the kernel aio stuff 04:54PM pcarns doesn't require O_DIRECT if patches are used pcarns n=pcarns@adsl-215-227-62.aep.bellsouth.net has left #pvfs2 SignOff 57hozer : #mklinux,#pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56pcarns 36n=pcarns@adsl-215-227-62.aep.bellsouth.net has joined #pvfs2 56pw 36n=pw@quasar.osc.edu has joined #pvfs2 SignOff 57pw : #pvfs2 "pw has no reason" 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 robl hozer: more infiniband work? 10:33AM hozer yeah 10:33AM hozer we're working on getting OpenIB working robl hozer: hey, can you send robl@mcs.anl.gov your async i/o benchmark? (if you don't mind) 11:46AM hozer http://developer.osdl.org/daniel/AIO/ SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 SWAP: Window 3 is not hidden! 56_Gandalf 36n=rtoomer@205-200-1-20.static.mts.net has joined #pvfs2 03:20PM _Gandalf hey guys hows your day? robl _Gandalf: hi. going ok. what's up? 03:29PM _Gandalf i have a question, i've got pvfs2 setup and working (again thanks to you and slang) but when 1 server goes down the other cannot write to the file system... is this me doing something wrong or is it that pvfs2 doesn't have any kind of allowance for disconnected opperation? robl _Gandalf: yeah, that's totally expected behavior 03:37PM slang _Gandalf: you mean you have 1 filesystem (call it A) with servers A1,A2,A3 and another (call it B) with servers (B1,B2,B3) and when A1 goes away you can't talk to fs B? robl _Gandalf: no software redundancy in pvfs2 (yet. maybe it'll be in place a year from now?) robl _Gandalf: pvfs2 is like raid 0 03:41PM _Gandalf ahhh k so is like drdb only you can mount both sides read write 03:41PM _Gandalf k cool 03:41PM hozer not really 03:42PM hozer my understanding is drdb is a *replicated* block device 03:42PM hozer there's no replication in pvfs2 03:42PM _Gandalf ahh cool interesting to know thanks for the info hozer pcarns n=pcarns@adsl-215-227-62.aep.bellsouth.net has left #pvfs2 05:42PM hozer hrrrm 05:42PM hozer local disk I/O of a 8GB file: 600MB/sec 05:44PM hozer pvfs2-cp of a 1.8GB file over IB: 100MB/sec 05:44PM hozer ... needs some tuning, I think ;) SignOff 57hozer : #mklinux,#pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56pcarns 36n=pcarns@adsl-215-227-62.aep.bellsouth.net has joined #pvfs2 08:01AM pcarns slang: thanks for getting those patches in 08:01AM pcarns slang: I'm going to beat on the dbpf branch with LTP some today 08:09AM pcarns slang: it looks like rename04 and rmdir02 tests from the latest LTP release are breaking now 08:11AM pcarns slang: ahh, must be something with dirent_count; I can trigger the first problem that rmdir02 finds manually: 08:11AM pcarns io/trove> mkdir dir1 08:11AM pcarns io/trove> touch dir1/foo 08:11AM pcarns io/trove> rmdir dir1 08:12AM pcarns we should get "directory not empty" 56pcarn1 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 08:50AM pcarn1 slang: I have a couple more updates (for dirent_count handling in server sm's) that I'll email along shortly 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 SignOff 57pcarns : #pvfs2 Read error: 110 (Connection timed out) 09:05AM slang pcarn1: ok 09:05AM slang pcarn1: thanks again for those patches 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 09:15AM pcarn1 slang: no problem- thank _you_ for doing all this dbpf work 09:15AM pcarn1 slang: its looking really good 09:45AM pcarn1 slang: heh, I suspect I should have added a state in crdirent.sm that sets the dirent_count to zero if a new dirdata object is created 09:57AM slang pcarn1: there's an init_dirdata_count in mkdir.sm 09:59AM slang pcarn1: I thought it would be better there 09:59AM pcarn1 ahh, ok 09:59AM slang pcarn1: I think the old code used to set the size to 0 if the the keyval db file wasn't there 09:59AM pcarn1 good deal 10:00AM pcarn1 slang: yeah, I don't know what went wrong in that patch I sent you, maybe you are better off ignoring it :) 10:00AM slang pcarn1: well I think you're right about where the dirent_count increment should go though 10:00AM pcarn1 slang: it fixed that one case (rmdir on empty/nonempty directories), but something else went haywire instead, not sure what yet 10:01AM pcarn1 slang: ohh, duh, I think my server is dying 10:01AM pcarn1 slang: must have goofed some memory in there somewhere 11:08AM slang pcarn1: yeah things seem ok to me with the patch 11:09AM slang pcarn1: maybe your storage locations were old? 11:09AM pcarn1 slang: there is no telling 11:09AM pcarn1 slang: I keep starting and stopping 3 different server builds 11:09AM pcarn1 slang: probably end user error :) 11:10AM pcarn1 slang: it was reassuring to see the server running well in valgrind 11:11AM pcarn1 slang: we get some false positives out of pwrite within berkeley db, but no true problems 11:11AM 50* 53slang/#pvfs2 nods SignOff 57_Gandalf : #pvfs2 "cheers gents thanks again for all your help" 12:37PM pcarn1 slang: oh, I jus t realized, 12:38PM pcarn1 slang: the migration util needs to write out those new keyvals for the dirent count 12:38PM pcarn1 slang: I'll look into that 12:43PM slang pcarn1: cool 12:47PM pcarn1 slang: hmm, there isn't any way for a given dirdata object, to find out what directory object goes with it, is there? 12:47PM slang pcarn1: no 12:47PM pcarn1 slang: ok 12:48PM slang pcarn1: we could store the handle as a common key for dirdata handle 12:48PM pcarn1 slang: nah, that's ok 12:49PM pcarn1 slang: it really isn't needed, it just would have made the migration a tad easier 12:49PM pcarn1 I can just keep seperate lists of the dirdata objects and the dir objects while iterating through the old collection, then combine them to figure out where to write what size 12:53PM pcarn1 slang: oh wait, no, its easier than that 12:53PM pcarn1 slang: heh, I'll figure something out :) 12:53PM 50* 53slang/#pvfs2 grins SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 03:32PM pcarn1 slang: have you committed those last patches yet? pcarn1 n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 robl topic Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 10:52PM 55bress 35n=bress@redhat/bress 50)] epg misses you in #c-60 SignOff 57slang : #pvfs2 Remote closed the connection 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 BitchX : Unknown command: MGS 31msg 51bress 50)] hah! tell him i'll be back soon 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-217.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 SWAP: No such window: 4 SWAP: Window 3 is not hidden! SWAP: Window 3 is not hidden! 56elventails 36i=elventai@elventails.COM has joined #pvfs2 02:32PM slang elventails: hello 02:32PM elventails slang: hi 02:35PM slang elventails: anything we can help out with regarding pvfs2? 02:35PM elventails slang: :) thx! I'll be with you in a bit - phone call.. 02:39PM slang elventails: take your time :-) 03:08PM elventails slang: hey :) sorry about that 03:08PM elventails slang: how are you? 03:09PM slang elventails: its cool. I'm doin good 03:09PM elventails so my name is Joy Khoriaty 03:09PM elventails I'm at MIT 03:09PM elventails and we've been looking at PVFS2 for some time now 03:10PM elventails ur whois shows that you're at anl, right? 03:10PM slang elventails: yes 03:10PM elventails I've been trying the 1.4 server with 1.3.x clients 03:10PM elventails and ran a few tests, bonnie++, mpi-io-test 03:11PM slang elventails: oh ok 03:11PM elventails and this morning, the client seemed pretty dumbstruck 03:11PM elventails specifically 03:11PM elventails [E 13:48:17.625291] Failed to umount via host tcp://192.168.2.14:3339 03:11PM elventails [E 13:49:22.575222] *** msgpairarray_completion_fn: msgpair failed, no retry: Connection refused 03:11PM elventails [E 13:49:22.575304] PINT_server_get_config failed: Connection refused 03:11PM elventails [E 13:49:22.575327] Failed to mount via host tcp://192.168.2.14:3339 03:11PM elventails [E 13:49:22.575348] Mount failed: Connection refused 03:11PM elventails [E 13:49:51.097907] *** msgpairarray_completion_fn: msgpair failed, no retry: Connection refused 03:11PM elventails [E 13:49:51.097970] PINT_server_get_config failed: Connection refused 03:11PM elventails [E 13:49:51.097992] Failed to mount via host tcp://192.168.2.14:3339 03:11PM elventails [E 13:49:51.098014] Mount failed: Connection refused 03:11PM elventails any clues? 03:12PM elventails it seems that the 1.4 server stopped serving.. 03:12PM slang elventails: are the servers still running? 03:12PM elventails with this log on the server 03:12PM elventails [E 15:48:11.673873] src/server/io.sm line 130: Server: IO SM: PINT_encode() failure. 03:12PM elventails [E 15:48:11.729635] [bt] /usr/local/sbin/pvfs2-server [0x433a3b] 03:12PM elventails [E 15:48:11.729684] [bt] /usr/local/sbin/pvfs2-server(main+0xf6b) [0x40e31b][E 15:48:11.729698] [bt] /lib64/tls/libc.so.6(__libc_start_main+0xda) [0x2aaaaafef5aa] 03:12PM elventails [E 15:48:11.729712] [bt] /usr/local/sbin/pvfs2-server [0x40befa] 03:12PM elventails [E 13:17:54.836076] src/proto/PINT-le-bytefield.c line 573: lebf_decode_req: improper input buffer size: 0x1f9dd48 != 0x1f9dd18 + 76 03:12PM elventails so the 1.4 server was stopped 03:12PM elventails I restarted it 03:13PM elventails and the client needed restarting too (otherwise it was giving a too many filesystems mounted or something like that) 03:13PM elventails so I was wondering how stable 1.4 is 03:13PM elventails and whether we should stick to 1.3.2 03:13PM slang elventails: 1.4 has been pretty stable 03:14PM slang elventails: we haven't gotten any serious bug reports since its been out 03:14PM elventails well - i think :q 03:14PM elventails that 03:15PM elventails i got something to report 03:15PM elventails cause the log says Mar 22 18:20:43 fs00 kernel: BUG! Please contact pvfs2-developers@beowulf-underground.org 03:15PM slang elventails: the over the wire protocol changed from 1.3.2 to 1.4 I believe 03:15PM elventails this is for another event that happened a few days back 03:16PM elventails what do you mean by that? 03:16PM elventails I had sent out a question asking about compatibility between the 1.3.x/1.4 client/servers but had received no replies.. 03:16PM elventails note: where the client/servers can be running on ppc/intel 03:16PM slang elventails: but I think 1.3.x clients should work with 1.4 servers.. 03:17PM elventails so are you running 1.4 on your bgl? 03:17PM elventails or both? 03:19PM slang elventails: hmm..rjl should know the answer to that robl elventails: still running 1.3.2 (client and servers) 03:20PM 53elventails robl: hi! robl elventails: hello 03:21PM 53elventails robl: i've been looking into 1.4 last week and so far it hasn't been that stable 03:22PM elventails i'll forward the logs I got to the mailing list 03:22PM elventails but I was wondering whether it was worth sticking with 1.4 for bgl - or putting 1.3.2 for this new partition - since it needs to start holding production runs soon 03:23PM elventails is there any serious benefit for using 1.4 now over 1.3.2? 03:23PM elventails e.g. in a bgl environment? robl elventails: the biggest improvement would be slang's small-io optimizations robl elventails: which might help a lot on bgl... i haven't benchmarked it though robl (because we haven't installed 1.4, and because i've been doing other stuff) 03:25PM elventails ok - thx - i guess we might fall back on 1.3.2 for now - will see 03:26PM elventails in both cases - i'll be benchmarking pvfs2 here - 03:26PM elventails so it will be nice to stay in touch and compare results robl elventails: are you running zeptoos? 03:26PM elventails I guess you posted the ones on the anl wiki? 03:26PM elventails yes robl elventails: or did you roll your own pvfs2 deployment? robl 03:26PM elventails through zepttos 03:27PM elventails what are the tyipcal arguments you use when running bonnie++? 03:27PM elventails it would be nice to have them posted on that benchmark page 03:27PM elventails so that I can easily compare robl elventails: hm. i don't know. I don't run bonnie++ on pvfs2 very much since it's not typical of scientific workloads. when i do, i just run it with the default parameters 03:35PM elventails cool - thx robl elventails: mpi-io-test (part of pvfs2) is a good way to get an upper-bound for performance, but there's no reason 1.4.0 should be much different from 1.3.2 for that workload robl elventails: sorry for not getting back to you about 1.3.2 vs 1.4.0. just dropped the ball there robl ah, those bonnie++ nubmers on http://www-unix.mcs.anl.gov/~robl/bgl/pvfs2.html are for the storage disks robl in theory you could take 'block sequential', multiply by the number of I/O servers, and that would be your upper bound for PVFS2 performance robl (but in practice we usually see only 50% of that) 03:42PM 53elventails robl: np for the compatibility thing 03:42PM 53elventails robl: so from what i understand the servers are backward compatible but not the clients? 03:43PM slang elventails: from 1.3.2 to 1.4 that's true 03:43PM slang elventails: other releases may be different 03:44PM elventails slang: thx 03:47PM elventails this is a log of a crash on the 1.4 server some time back - wasn't sure how useful this would be for you 03:47PM elventails http://elventails.com/joy-pvfs2-1.4-crash-log 03:48PM elventails this happened when the client "froze" (e.g wasn't responding to ls /data/P2) 03:48PM elventails umounting the fs would stall too 03:49PM elventails this was with the 1.4 client 03:49PM elventails i though i'd share it with you guys now just in case there's anything useful there 03:49PM elventails *thought robl elventails: this with SLES 9? 03:51PM elventails elventails: fs00:~ # cat /etc/issue 03:51PM elventails 03:51PM elventails Welcome to SUSE LINUX 10.0 (X86-64) - Kernel \r (\l). robl ok, cool. our BGL is suse 9 03:52PM elventails hehe robl elventails: this is on the login nodes? SWAP: No such window: 10 robl it might be related to kernel aio 04:04PM elventails this is on the fileservers robl elventails: what does uname -r report? 04:05PM elventails 2.6.13-15-smp pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 robl huh, yeah, i cry uncle. maybe the mailing list knows robl elventails: do you work with Andrew Pochinsky ? 04:16PM 53elventails robl: yes 04:16PM 53elventails robl: you guys know each other? robl elventails: i've met him once, but mostly I know him from the mailing list 04:18PM 53elventails robl: I joined almost 2 months back - I used to work in Edinburgh, EPCC robl elventails: big change 04:19PM elventails in what sense? :) robl elventails: well, country mostly 04:20PM elventails yeah - haven't been drinking much here lately 04:20PM elventails meeting at the pub was heavily part of the culture back there 04:21PM elventails u been to Edinburgh? robl elventails: nope, would like to though 04:31PM elventails lovely place 04:31PM elventails boston wasn't such a big difference really 04:32PM elventails i also knew it as a tourist - so the terrain wasn't that different 04:33PM elventails u guys in chicago right? robl right. live in chicago, work about 25 miles SW of the city 05:15PM elventails i rebuilt the pvfs2 servers (with 1.3.2) 05:15PM elventails mounted them on bgl and ran an mpi-io-test 05:15PM elventails all fine - 05:15PM elventails except for one client 05:15PM elventails where /etc/init.d/pvfs2-client start 05:15PM elventails fails with [E 18:01:10.612077] Failed to mount via host fs04.bgl:3340 05:15PM elventails [E 18:01:10.612112] Mount failed: Protocol not available 05:15PM elventails although mounting from the command line works - i.e mount -t pvfs2 tcp://...etc.. 05:16PM elventails "protocol not available".. is it not seeing the "tcp" in some config file? 05:17PM slang elventails: did you do pvfs2-client start with the right privs? 05:17PM elventails /etc/sysconfig/pvfs2/clients/fs-P2.conf 05:17PM elventails has PROTOCOL=tcp 05:17PM elventails slang: root robl elventails: the mount syntax is really really picky robl elventails: is there a port number in /etc/init.d/pvfs2-client ? 05:19PM elventails the script doesn't have a port number it seems 05:19PM elventails but I'm using port number 3340 05:20PM elventails i.e. a different one that's specified in the etc files 05:20PM 50* 53elventails/#pvfs2 is debugging the script to check that its getting the right args robl mount -t pvfs2 tcp://testhost:3334/pvfs2-fs /mnt/pvfs2 robl unfortunately, all fields have to be present. there's no way for mount to guess the right values 05:21PM elventails yeah - clearly the script isn't getting the port # 05:22PM elventails cause the command line (like the one u just wrote works fine) 05:27PM elventails hmm - is the /etc/init.d/pvfs2-client script supplied by you guys? 05:27PM elventails how does the client know which port to access? 05:33PM elventails actually i'm wrong about the script not knowing the port number..since the logs say 05:33PM elventails [E 18:01:10.611992] PVFS_sys_fs_add: Failed to initialize any appropriate BMI methods. 05:33PM elventails [E 18:01:10.612077] Failed to mount via host fs04.bgl:3340 05:33PM elventails [E 18:01:10.612112] Mount failed: Protocol not available 05:42PM elventails okie - figured it out - my bad SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3601:59am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 robl hozer: hey. back for more IB hacking? 10:27AM hozer yep 10:27AM hozer well, I was going to see if pw was around robl hozer: he's only on IRC if you drag him onto it 10:33AM hozer I'm noticeing that 10:33AM hozer what sort of systems do people tend to run pvfs servers on 10:35AM hozer I am wondering what the peak bandwith out of a single server 10:35AM hozer that people have been seeing robl well, when the disks are the crappy hard drives in the jazz compute node, we get 50% of peak (as measured by bonnie++ block sequential throughput) robl i'm afraid that's all the quantitative data i've got offhand 10:40AM hozer okay 10:40AM hozer we have servers that are getting close to 600mb/sec with DD robl wow, that's awesome robl we have servers that get close to 20 MB/sec :> 10:48AM hozer yeah 10:48AM hozer except I'm afraid I'm going to be limited by overhead in kernel->userspace copies to pvfs-server SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 12:27PM elventails hi - running the suite of mpi-io-test and the results don't look too good 12:27PM elventails still - the system/filesystem hasn't been tweaked at all yet 12:28PM elventails do you know what CIOD_RDWR_BUFFER_SIZE your using on BGL? robl elventails: how many compute nodes to io nodes? 12:28PM elventails 128 robl elventails: we use 4 MB 12:28PM 53elventails robl: ok - we're still on the default 87600 bytes I think - I'll start by changing that - it should give a decent improvement right? robl elventails: seems to work ok for 32 compute nodes per io node. we can go as high as 8 before the io node chokes robl elventails: oh man, the default 87k is definitely gonna kill performance 12:29PM elventails cool - did you try 256k, 512k, etc.. 12:30PM elventails any figures out there/papers/presentation showing the results of varying the buf size? 12:35PM elventails actually - another question - are you running LVM across your fileservers? 12:36PM elventails specifically, did you play around with the volume's groups PE size? robl elventails: i didn't play around too much with CIOD_RW_BUFFER_SIZE, only to see that making it bigger helped large i/o robl elventails: and i was lazy and did not graph the data robl elventails: we are not running LVM. hardware raid 12:42PM elventails thanks robl elventails: i'm absolutely sure you could tweak LVM settings and have a great impact on pvfs2 performance 12:42PM elventails yeah - another layer of things to play around with - a great birthday cake :) 12:43PM elventails i'll post some results as soon they're out robl elventails: that would be great robl pcarns: did you ever get Differential profiles with opreport working 01:49PM 53pcarns robl: not sure what a differential profile is (which probably answers your question) :) robl pcarns: ok, the oprofile docs make it sound really cool but i can't reproduce it .. http://oprofile.sourceforge.net/doc/opreport.html#opreport-diff robl stupid oprifile... you always tempt me into thinking i'll get useful information out of you! 01:54PM pcarns oh, no we didn't try that, 01:54PM pcarns we just did a opcontrol --reset between every run, 01:54PM pcarns and just compared snapshots manually 01:55PM pcarns we used the --seperate-kernel to be able to show library and kernel accesses attributed to particular processes rather than as one big lump, that is probably the only interesting feature we really played with 01:55PM 53pcarns robl: I have kind of a strange question 01:56PM 53pcarns robl: do you guys have any small changes or anything laying around that need to go into trunk (not counting any patches from us)? I need a change in the tree from you guys to test out some new merge processes down here :) 01:57PM 53pcarns robl: we just switched to subversion and I did one vendor merge last night, but need to do another one to try some stuff out 01:58PM 53pcarns robl: doesn't matter what it is (could be one line change) robl pcarns: nothing's pending, but i'll make some changes for you to play with 02:04PM 53pcarns robl: many thanks! robl pcarns: that change enough for you or do you need something more? 02:28PM 53pcarns robl: thats perfect- thanks! 03:11PM 53elventails robl: where do you actually set CIOD_RDRW_BUFFER_SIZE from? the S50ciod file? 03:12PM elventails I took a peek at /etc/sysconfig/ciod that's on the IO nodes through allocating a block and redirectiing IO with the MMCS console - and it seems to be already set to 4MB - but I can't find from where.. 03:23PM elventails I see - we have 8 Gb links from the fileservers to the switch 03:24PM elventails so we already have an upper bound of 1GB i guess.. 03:25PM elventails what's the interconnect bandwidth on your side? robl elventails: ZeptoOS sets CIOD_RW_BUFFER_SIZE somewhere in its init scripts (it's been a while so i forget where exactly) robl we have gige links, too. not sure what the bisection bandwidth is pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 SignOff 57ChanServ : #pvfs2 Shutting Down 56ChanServ 36ChanServ@services. has joined #pvfs2 51ServerMode 36#pvfs2 57+o ChanServ by 57irc.freenode.net NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3605:18am BitchX : Press to see who left to change to [irc.freenode.net] 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 11:24AM slang pcarns: fyi, I'm still trying to fix the problem where keyval entries weren't getting deleted properly 11:24AM slang pcarns: my solution is to do iterate over all the keyvals for a handle (in remove.sm) and then delete them one at a time 11:25AM slang pcarns: that way we get rid of xattr keyvals as well 11:25AM slang pcarns: at the state machine doesn't seem to want to do recursive states.. 11:27AM slang pcarns: that should be 'at the moment the state machine...' 01:02PM pcarns slang: so you are doing the deletes at the state machine level rather than inside of trove? 01:02PM pcarns slang: (sorry, was out to lunch for a while) 01:08PM slang pcarns: no worries 01:14PM pcarns slang: would it be possible to just delete the keys from within trove? 01:15PM slang pcarns: you mean break the trove abstraction bits 01:15PM slang pcarns: ? 01:16PM 50* 53slang/#pvfs2 managed to generate an error code he hasn't seen before: 01:16PM 50* 53slang/#pvfs2 | rm: cannot remove `t1': Machine is not on the network 01:19PM pcarns slang: haha- you didn't know your db keys were being copied over the network? :) 01:19PM pcarns slang: I was just thinking of keeping the old trove semantics, where if you destroy a dspace it takes all of the keys with it implicitly rather than having to manually delete them 01:19PM slang pcarns: who knows what's happening underneath my gets and puts 01:20PM slang pcarns: ah 01:20PM slang pcarns: so add keyval code to the dspace code? 01:21PM slang pcarns: my impression of the way the interfaces were designed is that was a no-no 01:22PM pcarns slang: oh, I don't know- I never really thought of the different pieces below the trove api as being abstracted from each other... 01:22PM pcarns slang: but I'm not sure 01:23PM pcarns slang: oh, you mean calling the API from underneath the api? 01:23PM pcarns slang: yeah, I wouldn't do that, I was thinking make berkeley db calls from within the dspace code to clean up 01:24PM slang slang: right 01:24PM slang slang: I guess I always looked at the dspace and keyval pieces as completely separate 01:24PM slang pff 01:25PM slang pcarns: I had meant to talk to you not myself 01:25PM pcarns slang: hehe 01:26PM pcarns slang: yeah, I don't know about the seperation, might be a question for robr- I think all of that stuff is still more or less in the layout he came up with 02:27PM slang pcarns: is it not possible to set non-zero error-codes and return 0 from a state? 02:27PM slang pcarns: i.e. js_p->error_code = STATE_TYPE_DATAFILE; return 0; 02:28PM slang pcarns: the state machine code seems to ignore my error_code value 02:29PM slang it looks like the job_status for that operation gets reset in the job_test code 02:29PM slang which makes sense I guess 02:29PM slang but kind of limiting.. 02:39PM pcarns slang: yeah, you can either get the status by setting it manually and returning 1 in your sm function, _or_ you can post a job and have it fill in the status when it finishes; not both 02:39PM slang pcarns: right 02:39PM pcarns if you need to carry some information across sm functions but also want to get the job status, then you need to add a flag to the s_op structure and stick it there 02:39PM slang pcarns: so I need a separate state just to go to where I can set the error_code back to zero and return 02:40PM pcarns slang: depends on what you are doing, but that may be the case 02:41PM pcarns slang: keep in mind that the status value is what determines what transition you take too, so you can't really overload it much 02:41PM slang pcarns: in this case I'm trying to use it to take a different transition 02:42PM pcarns slang: sounds like you would want to set your status value and return 1, then have the next state be the one that posts the job 02:43PM pcarns slang: but I would probably need to see sm to understand better 02:43PM slang pcarns: its in the remove code...right now I jump to get_keyvals from remove_dspace after it completes 02:43PM slang pcarns: but if the handle is a datafile, there are no keyvals to remove 02:44PM slang pcarns: so I'm just going to set error_code and return at the beginning of get_keyvals 02:44PM slang pcarns: and then have a separate cleanup state to jump to that sets the error_code back to zero before returning 02:44PM slang pcarns: unless you have a better way to do that of course ;-) 02:45PM pcarns slang: ah ok, I see 02:46PM pcarns slang: sounds like that would work 02:46PM pcarns slang: the only other option would be to have a state that checks the type before the remove, and triggers different transition there (set error code and return 1), 02:46PM pcarns slang: so that you remove keyvals before removing dspace, and kind of avoid the funky transition 02:47PM slang slang: hmm yeah that makes sense 02:47PM pcarns if the type were datafile it would jump straight to remove dspace 02:48PM pcarns the state function that posts the remove wouldn't care what hte error_code coming in is, so no cleanup step needed 02:49PM pcarns slang: I guess there will be a sync after each keyval remove, since they look independent from trove's point of view? 02:50PM pcarns slang: or is there a trove function to remove multiple keys at one time? 02:50PM slang pcarns: there's not, not 02:51PM slang pcarns: there's not, no 02:52PM slang pcarns: I was thinking about adding a new trove_keyval interface that would either allow removing a set of entries 02:53PM slang pcarns: or alternatively all the entries for the given handle 02:55PM pcarns slang: all of the entries for a given handle would be nice for this case :) 02:55PM slang pcarns: yep pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 robl wierd, oprofile says -dbpf-onekeyval spends a ton more time in the kernel robl (ton more time than -HEAD) robl i wonder if i'm archiving results the wrong way or doing something else 11:55AM 53slang robl: yeah that seems strange 11:56AM 53slang robl: I think I have alignment problems 01:42PM elventails hi - here are some of the first numbers i'm getting 01:42PM elventails http://elventails.com/BGL/pvfs2/ 01:43PM elventails going to do another set of runs to verify them 01:43PM elventails but i think they should give a first impression of the current system status pvfs-wise 01:44PM elventails it seem to do well for small block sizes.. robl elventails: cool 01:44PM elventails any feedback appreciated 01:44PM elventails sill want to play around with so many different variables..including checking the switch 01:44PM elventails and LVM robl the dropoff for large block sizes seems unusually bad, but I haven't run mpi-io-test on our BGL for a year now 01:47PM elventails i agree - i'm going to do another set of runs just to double check 01:47PM elventails i had started with your best case of 32mb on 1024.. 01:47PM elventails and that didn't look good :) 01:48PM elventails which gives a lot of room for improvement hopefully :) 01:49PM elventails any other test runs you find useful? these are good to help me figure the different tuning parameters across BGl robl elventails: mpi-io-test is a good starting point. should give an upper-bound for performance robl after that, perofrmance is so application-driven that it's hard to suggest good benchmarks 02:13PM elventails yes - i agree - luckily enough our users run mainly Scidac QCD codes - so one of the next steps is looking there robl elventails: quantum chromodynamcis? (i'm just googling here) 02:16PM 53elventails robl: yep :) 02:17PM 53elventails robl: http://www.linuxworld.com/story/48131.htm?DE=1 50* 57robl 's head explodes contemplating the color of anti-red 02:27PM elventails ?anti-red? robl maybe this guy is misleading me robl http://webphysics.davidson.edu/mjb/qcd.html 02:29PM elventails hehe 02:29PM elventails the particle adventure is fun actually 02:30PM elventails http://particleadventure.org/particleadventure/ 02:30PM elventails ..a classic :P pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3612:34am BitchX : Press to see who left to change to [irc.freenode.net] 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hmmm. You know, I could do an April Fool's Day joke, but maybe instead we should make this a group effort. Let's all just go to irc.oftc.net channel #oftc, and tell them that freenode has shut down and has repointed its servers to OFTC, and ask if they're going to be adding more facilities to handle the load. 8) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Okay guys, thanks for the fun, let's let those poor guys on OFTC off the hook. :) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Okay guys, give the folks on OFTC a rest, it was a good joke, time to go home. :) 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. On behalf of my self and all 200 or so people who participated in that April Fool's prank on OFTC, please accept our apology. I know that when you're the person pranked, it doesn't seem all that funny. So, apologies and bygones! 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Erm, assuming anyone from OFTC is still here. 8) SignOff 57hozer : #mklinux,#pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-217.asm.bellsouth.net (gaim) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl no pvfs2 april fools this year robl too bad 12:39PM 53elventails robl: :) robl http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-April/001160.html 12:50PM elventails lol 01:11PM slang pcarns: hey phil are you around? 01:15PM pcarns slang: hey, I'm here 01:16PM slang pcarns: hi 01:16PM slang pcarns: just wondering how the dspace db gets synced when meta sync is off 01:16PM pcarns slang: what's up? 01:16PM pcarns slang: I don't think it ever does :) 01:17PM slang pcarns: ah 01:17PM slang pcarns: ok 01:17PM slang pcarns: it didn't look like it 01:17PM slang pcarns: there's no dspace_flush 01:17PM pcarns slang: yeah, turns out it is pretty dangerous 01:17PM slang pcarns: so even the flush operation doesn't do it 01:18PM pcarns slang: oh, ok 01:18PM slang pcarns: I was thinking of adding a dspace_flush 01:18PM pcarns slang: never thought about that- that would make sense to have a flush operation 01:18PM slang pcarns: and then do dspace_flush from flush.sm 01:18PM pcarns slang: seems reasonable, 01:19PM slang pcarns: also I'm adding a meta-sync timer that will flush periodically (keyval and now dspace) if the meta-sync option is off 01:19PM pcarns slang: but you would probably also want to add the check at creation time to make sure that old .bstream files aren't laying around 01:19PM pcarns slang: bogus bstream files are the biggest danger we ran into when testing with meta sync disabled 01:20PM pcarns slang: the timer would be cool, particularly if the time interval is configurable from conf file 01:20PM slang pcarns: right 01:21PM slang pcarns: I guess the open cache did something similar in the past 01:21PM pcarns slang: similar to what? 01:21PM slang pcarns: when open fds and bds got pushed out of the cache they were flushed at that point 01:21PM pcarns slang: ohh, not sure 01:21PM pcarns slang: I don't think they were actually, but they may have been 01:22PM slang pcarns: isn't that why old bstream files remain after removes? 01:22PM pcarns slang: no, it just seems like creating new files on ext3 seems to not need a flush to stick around after a crash- but changes to an existing db file do 01:23PM slang pcarns: oh I see 01:23PM pcarns slang: ie, you are more likely to lose changes to particular blocks than lose an entire file 01:23PM pcarns slang: I guess something in the kernel or somewhere tends to flush things that modify the name space more so than data buffers 01:24PM slang pcarns: so what should create do if it finds old bstreams that it doesn't know about? just delete them? 01:24PM pcarns yes 01:24PM pcarns slang: in my opinion 01:25PM pcarns slang: we don't have enough information to rescue them in any useful way, I don't think 01:25PM slang pcarns: could try to recover with default attributes I guess 01:25PM pcarns slang: pvfs1 used .saveme files, but everyone always just deleted them anyway 01:25PM pcarns *shrug* 01:26PM slang pcarns: ok I'll delete them for now, maybe send an email about it later :-) 01:26PM pcarns slang: once you hit the point where you discover an existing .bstream file that collides with something you want to create, you have the additional problem of needing to back up a little and pick a new handle 01:26PM pcarns slang: if you try to save the old bstream, that is 01:27PM slang pcarns: ah right 01:27PM pcarns slang: we could have a conf file option to enable "saveme" mode :) 01:28PM pcarns slang: at acxiom they actually had to write scripts to delete the old .saveme files on pvfs2 because some of them would be huge if a server crashed while you were trying to delete a multi-terabyte file 01:28PM pcarns slang: err, pvfs1, not pvfs2 01:29PM slang pcarns: heh 01:30PM slang pcarns: rewrite open to return an fd to /dev/null if fname==*.saveme? 01:30PM pcarns 01:58PM slang pcarns: I don't know that I can check if the bstream files are there 02:01PM pcarns slang: no? 02:01PM slang pcarns: maybe I can 02:01PM slang pcarns: jumped the gun on that one 02:01PM pcarns slang: maybe an access() check within dspace create fn? 02:01PM pcarns slang: ok 02:02PM slang pcarns: kind of breaks the open cache stuff though 02:05PM pcarns slang: it does? 02:05PM slang pcarns: since whether the file exists or not is hidden in open_fd.. 02:06PM pcarns slang: oh, ok- would it need like a truncate flag or something passed to it at create time so it knows that the file shouldn't exist (or should at least be empty) at that point? 02:07PM pcarns slang: actually, that may be slightly better anyway rather than having an extra system call to check existance 02:07PM slang pcarns: yeah I guess that would work 02:07PM pcarns slang: I don't know, just throwing ideas out there 02:07PM slang pcarns: except will that cause touch to behave badly? 02:08PM pcarns slang: how so? 02:08PM slang pcarns: touch is supposed to just update timestamps, not truncate the file to zero right? 02:09PM slang pcarns: I guess it depends on how we implement it 02:09PM pcarns slang: yeah, but I don't think trove would tell the open cache to use truncate mode in that case 02:10PM slang pcarns: ok 02:10PM pcarns slang: the dspace db entry gets created before the bstream file anyway, right? so you should be able to tell if the bstream file is supposed to exist 02:11PM pcarns we really just need to catch the particular case where the db entry does not exist but the bstream file does 02:11PM slang pcarns: err...from the client? 02:11PM pcarns slang: no, I don't think the client knows about any of that 02:11PM slang pcarns: what about all the servers that are just data servers? 02:11PM pcarns slang: it just asks the server to create a datafile 02:11PM pcarns slang: even the data servers have to have something in the db to say that the file exists, in addition to jsut having the bstream file ther 02:12PM pcarns slang: that's why we have the opportunity for skewed state: a data server who's db entries don't match what bstream files are there 02:12PM pcarns its ok to have a db entry but no bstream file but not the other way around 02:12PM slang pcarns: ok 02:13PM slang pcarns: I didn't realize that data servers wrote dspace attrs as well 02:13PM pcarns slang: the client, or the server for that matter, don't really realize the seperation between the db and the flat file 02:13PM pcarns slang: yeah, they do- no attributes are set except for the "type" field though 02:14PM pcarns slang: it doesn't fill in the uid, gid, or any of that stuff 02:14PM slang pcarns: why is necessary to store the type? 02:14PM slang pcarns: doesn't that get passed along in the requests? 02:15PM pcarns slang: I guess it isn't technically 02:15PM pcarns slang: but the trove design assumes that every object is going to have an attr structure 02:15PM pcarns slang: the iterate_handles functions for example use that as an indication of what files exist (by iterating through the dspace db) 02:16PM slang pcarns: wouldn't creates be a lot faster if we didn't have to do that? 02:17PM pcarns slang: I guess so, now that we know how expensive the db syncs are relative to everything else 02:26PM pcarns slang: might be worth considering if we don't really need the type field 02:26PM pcarns slang: I guess we could even make it implicit- if you ask for attribs on an object, and it finds that the bstream file is there but the dspace attr isn't, then it "makes up" an attr structure with the type set to dfile 02:27PM pcarns slang: would look the same from the trove user point of view but wouldn't need a sync on create 02:29PM slang pcarns: why is the dspace attr needed for the datafile at all? 02:29PM slang pcarns: is it just a 'for future use' kind of thing? 02:30PM pcarns slang: I don't think any technical reason, but some stuff depends on it now, for example 02:30PM pcarns slang: you have to do a getattr on a datafile object to find out its size (its a dynamic field that gets filled into the attr structure as if it came off of disk that way) 02:30PM slang pcarns: ah right 02:31PM pcarns slang: but yeah, I don't think there is any practical technical use for having true attributes on a datafile 02:31PM slang pcarns: and I guess dspace_create is the only way to get a handle for it 02:31PM pcarns slang: from the api point of view yes, I think you would still want to do a dspace_create to create it, regardless of what's happening with db or file under the covers 02:32PM slang pcarns: right 02:32PM pcarns slang: and you would need to make sure that the iterate_handles functions still showed the datafile as a full fledged object (right now it depends on the dspace db entry) 02:32PM pcarns slang: would need to readdir in bstreams directories to find them instead of iterating through db SWAP: Window 3 is not hidden! 02:35PM slang pcarns: oh I see 02:35PM slang pcarns: that's maybe not so nice 02:35PM slang pcarns: maybe the coalescing syncs solution is a better answer 02:39PM pcarns *shrug* I don't know 02:40PM pcarns slang: how is the time frame looking on the dbpf merge to trunk, by the way? Still a good ways off? 02:41PM slang pcarns: I could do it now probably.. 02:41PM slang pcarns: I was going to add the sync timer stuff first but I can merge if it makes life easier for you guys 02:45PM pcarns slang: would the sync timer stuff change on disk compatibility any? 02:45PM pcarns slang: and did you guys get some perf results to be comfortable w/ the merge? 02:47PM slang pcarns: I've gotten some preliminary results that are encouraging 02:47PM pcarns slang: we are interested b/c we are supposed to go code complete on our supported version of pvfs2 here around the end of this week, 02:47PM slang pcarns: got them about 10 mins ago :-) 02:47PM pcarns slang: if the trunk merge happens before then, then we will take those changes and include them in our testing that follows, otherwise we will have to wait before we can do anything with it for stability reasons 02:48PM pcarns slang: cool about the perf results 02:48PM slang pcarns: let me send an email and see if there are any objections about merging now 02:48PM pcarns slang: ok, I don't want you to feel like I am rushing you guys, 02:48PM pcarns slang: but I just figured it wouldn't hurt to ask robl the only oddity is that the onekeyval nightly tests on gil (yeah a real workhorse, that one) take 60% longer than HEAD robl but since nightly tests are for correctnes and not perf, i'm not saying it's a real issue. just a curiosity 02:52PM 50* 53slang/#pvfs2 shrugs 02:52PM 53slang robl: more code to build? ;-) 02:52PM 53pcarns robl: are you guys running on any other boxes? robl pcarns: now that they all pass on gil i'll try jazz again SWAP: Window 3 is not hidden! 02:57PM 53pcarns robl: cool 03:21PM 53pcarns robl: thanks again for sticking some commits in last week to help us test some stuff, 03:21PM 53pcarns robl: fwiw, we are really pleased with subversion so far robl pcarns: we'll convert to svn the day rross retires probably 03:22PM 53pcarns robl: makes it easier for us to manage vendor merges, and so far is better at generating patches too robl pcarns: cool! those are svn advantages i had not heard before 03:23PM 53pcarns robl: heh, we didn't run into significant enough reasons to bother taking the time to switch until pretty recently 03:25PM 53pcarns robl: the biggest vendor merge difference is that svn is nice enough to let you drop the new merged code into one big tree and look at it (resolving conflicts etc.) before you have to commit anything at all 03:26PM 53pcarns robl: with cvs we had a period of madness during vendor merge, because it would put some stuff in the tree in one commit, then you have to fix conflicts in another commit, etc. 03:26PM 53pcarns robl: now its atomic, and a good bit safer 03:26PM 53pcarns robl: on generating patches, its just good because we don't have to use cvsps anymore 03:27PM 53pcarns robl: cvsps can get terribly confused when you have enough branches running around, particularly vendor branches 03:27PM 53pcarns robl: cvsps can't always tell where change sets come from- the authors just didn't think about all of those cases, I believe robl pcarns: good to know! i always assumed that cvsps was "close enough" to svn changesets SWAP: Window 3 is not hidden! 03:54PM 53pcarns robl: yeah, svn will pretty much do what cvsps does with a little bit of wrapper script, but does a better job 03:55PM 53pcarns robl: you have to use a wrapper script because the normal svn diff commands won't let you just cherry pick an arbitrary set of disjoint commits- you have to glue that together yourself by doing a diff for each commit and combining them into the same patch 03:56PM 53pcarns robl: nothing 10 lines of perl won't fix pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Hi all. We're working on the problems with Tor abuse. We ask that you only ban "*@tor/session/*", rather than adding a global ban on "*@tor/*" . Freenode continues to support the Electronic Frontier Foundation's Tor project and will work on ways to filter out the abuse without causing problems for legitimate users. 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Our policy on Tor is here: http://freenode.net/policy.shtml#tor .... thanks! 55lilo 35i=levin@freenode/staff/pdpc.levin 50)- [Global Notice] Clarification: we definitely don't recommend you ban tor nodes if you can avoid doing so; if you do need to, we recommend you quiet them (+q instead of +b). And we recommend you make those quiets temporary. Please be aware: there are a number of legitimate Tor users on the network. Thanks! 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 56pw_ 36n=pw@quasar.osc.edu has joined #pvfs2 53#pvfs2 57pw_ 36H n=pw quasar.osc.edu (pw) 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-217.asm.bellsouth.net (gaim) 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) robl pw_: hey. hozer keeps looking for you :> 01:26PM I can't seem to manage to pay much attention to this irc thing, even when I do remember to start it up. 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 02:38PM heya hozer. I was doing the kerberos thing fine, just wanted you to shut up the legalese on every login. No hope on that, I figure. 02:51PM hozer ssh -q 02:51PM hozer did you get an email from me today? 02:51PM hozer I found a way to shut it up from .ssh/config 02:51PM hozer did you get logged into p5l1 ? 02:52PM hozer I was going to try to look at that endian thing sometime, but I have about 3 other things I need to do first 02:52PM msg nickserv identify pw 02:52PM hozer .. and I'm going to a (late) lunch 02:52PM 50* 53hozer/#pvfs2 hands pw a / 02:53PM hozer bbl.. 02:53PM hozer did not find that your changes to .ssh/config shut it up, hence my confusion. I will also go try p5l1 now. (Thanks for the /, this irc stuff is too tough.) 02:53PM hozer hrrm.. does 'ssh -q' shut it up? 02:54PM I'll be damned, it does. Except for these two lines it is very nice now: 02:54PM id: cannot find name for group ID 34205 02:54PM id: cannot find name for group ID 43847 02:55PM hozer that looks like AFS pag ID's.. 02:55PM hozer I don't seem to get that, and I'm not sure why 02:55PM hozer I am using this ssh version: 02:55PM hozer troy@talia:~$ ssh -v 02:55PM hozer OpenSSH_4.2p1 Debian-5, OpenSSL 0.9.8a 11 Oct 2005 02:55PM hozer ... bbl 02:55PM here: OpenSSH_4.3p2, OpenSSL 0.9.8a 11 Oct 2005 02:56PM LogLevel QUIET makes me mostly happy, thanks. SignOff 57pcarns : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57pw_ : #pvfs2 "pw_ has no reason" SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 10:02AM pcarns slang: do you happen to know where the INTPTR_MIN definition is coming from in your 2.6 kernel version? 10:02AM pcarns slang: just wondering if there is something that replaced it that we could grab, 10:02AM pcarns slang: otherwise I'll look at doing something like Nathan suggested robl pcarns: what's check_common_0_0_1 supposed to do? and if it's not being used, is it ok to remove? 10:13AM 53pcarns robl: hmm, it used to be used... 10:14AM 53pcarns robl: ohh, I think Sam made some changes where it isn't necessary any more 10:14AM 53pcarns robl: it was being used to figure out what "type" flag to stick on trove key/val pairs in new dbpf code 10:14AM 53pcarns robl: so yeah, it can be removed robl pcarns: ok, thanks 10:23AM 53pcarns robl: that "common_key_names" array can be removed too robl one more for you guys robl aiocb_print 10:29AM 53pcarns robl: heh, looks like a cleaner version of something I submitted in a patch, just isn't plugged into anything 10:30AM 53pcarns robl: I would like it if something like that hung around (without build warning of course) robl pcarns: ok, when either slang or i merge that patch, we'll use aiocb_print instead 10:40AM 53pcarns robl: sounds good 10:40AM 53pcarns robl: you might be able to make that function an inline or something if those strings are moved to global vars, so people don't complain about overhead (I didn't do that in my patch either though) robl pcarns: hah. our overheads are in disk-head activity, not a couple extra symbols in the library :> 10:42AM 53pcarns robl: hehe, I agree 10:56AM pcarns hmm, looks like we picked up a bunch of misc. warnings on x86_64 with the dbpf merge 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 01:39PM slang pcarns: oh yeah lots of warnings 01:39PM slang pcarns: those can't be good 01:52PM pcarns slang: luckily most are easy to fix, just missing llu(...)'s and such 01:54PM 50* 53slang/#pvfs2 nods NetSplit: 57irc.freenode.net split from 57kornbluth.freenode.net 3603:12pm BitchX : Press to see who left to change to [irc.freenode.net] 56pw_ 36n=pw@quasar.osc.edu has joined #pvfs2 03:28PM hozer pw: how's 4 gigabits sound? 56KyleSchochenmaie 36n=kschoche@ohm.scl.ameslab.gov has joined #pvfs2 03:44PM hozer there we go 03:46PM KyleSchochenmaie alright :-) pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 04:17PM 4 Gb/s is a big number. 04:18PM p5l1 does not like me much 04:18PM pw@p5l1:/$ cd ~pw 04:18PM -bash: cd: /afs/scl/user/GUEST/pw: Permission denied 04:18PM pw@p5l1:/$ ls -lad ~pw 04:18PM drwxrwxr-x 7 mukul admin 2048 Apr 5 16:12 /afs/scl/user/GUEST/pw 04:19PM hozer run 'aklog' 04:19PM hozer hrrrm 04:20PM hozer someone messed up your userid KyleSchochenmaie n=kschoche@ohm.scl.ameslab.gov has left #pvfs2 56KyleSchochenmaie 36n=kschoche@ohm.scl.ameslab.gov has joined #pvfs2 04:25PM pw@p5l1:/$ aklog -d 04:25PM Authenticating to cell scl.ameslab.gov (server hal.scl.ameslab.gov). 04:25PM We've deduced that we need to authenticate to realm SCL.AMESLAB.GOV. 04:25PM Getting tickets: afs/scl.ameslab.gov@SCL.AMESLAB.GOV 04:25PM Using Kerberos V5 ticket natively 04:25PM Identical tokens already exist; skipping. 04:25PM pw@p5l1:/$ getent passwd pw 04:25PM pw_ *:3129:4001:Pete Wyckoff:/afs/scl/user/GUEST/pw:/bin/bash 04:25PM pw@p5l1:/$ getent passwd mukul 04:25PM mukul:*:3126:4001:Mukul Sabharwal:/afs/scl/user/mukul:/bin/tcsh 04:25PM pw@p5l1:/$ id 04:25PM uid=3129(pw) gid=4001(scl) groups=4001(scl) 04:26PM hozer type 'tokens' 04:26PM I would just set happy ACLs on ~pw if I could figure out how to do that... 04:26PM hozer fs sa 04:26PM pw@p5l1:/$ tokens 04:26PM Tokens held by the Cache Manager: 04:26PM User's (AFS ID 3129) tokens for afs@scl.ameslab.gov [Expires Apr 9 08:47] 04:26PM --End of list-- 04:26PM hozer okay, you have the right afs id but wrong unix id 04:26PM Oh, helpful. 04:26PM fs la ~pw says I have everything. 04:27PM hozer you should be able to 'cd ~pw' now 04:27PM Yay, works and logged in and everything. Still ~pw owned by mukul, but he's probably a friendly sort. 04:27PM hozer ... I'm going in to talk to kyle .. bbl.. 04:31PM hozer now, if you can figure out the endian stuff, we can start testing on the IBM nodes ;) 04:34PM KyleSchochenmaie I got my netpipe module running over pvfs O:-) 04:34PM KyleSchochenmaie 145: 134217725 bytes 45 times --> 5231.57 Mbps in 195734.58 usec 04:34PM Yeah, I'm trying to find the openib build now so I can try compyling. 04:35PM Latest hg changeset is 13, 30 mar, right? 04:38PM KyleSchochenmaie lemme check 04:39PM KyleSchochenmaie i had the permissions stuff fixed for your dir, it should work now 04:41PM KyleSchochenmaie yes 04:41PM KyleSchochenmaie kschoche@ohm:~/pvfs2/pvfs2-cvs-openib$ hg history | head 04:41PM KyleSchochenmaie changeset: 13:4def4a9c1d64 04:41PM KyleSchochenmaie tag: tip 04:41PM KyleSchochenmaie user: kschoche@ohm.scl.ameslab.gov 04:41PM KyleSchochenmaie date: Thu Mar 30 11:17:21 2006 -0600 04:41PM KyleSchochenmaie summary: made a few more changes, now have everything synced up w/ Pete's Code. 04:43PM Great; got that. What do you use for ./configure --with-openib=... ? 04:43PM On p5l1, that is. 04:44PM KyleSchochenmaie ./configure --with-kernel=/usr/src/linux-2.6.16 --with-openib=/usr 04:44PM KyleSchochenmaie kschoche@ohm:/afs/scl.ameslab.gov/project/nodeimg/ppc64/usr/src/pvfs2-cvs-openib$ head config.log 04:44PM duh, didn't think of /usr. :) 04:56PM Does p5l1 have an openib nic? 04:56PM [E 16:52:07.451959] Error: BMI_ib_initialize: ibv_open_device error number: 0 04:58PM KyleSchochenmaie good question, lemme ask Troy real quick 05:12PM KyleSchochenmaie yes it has a mellanox card, but it's acking weird 05:13PM KyleSchochenmaie hey pete... p5l0 is 'working', try that instead of p5l1 05:13PM KyleSchochenmaie ..for now at least 05:14PM That's got the uid issues, can you fix me there too? 05:14PM opteron1$ ssh p5l0 05:14PM Could not chdir to home directory /afs/scl/user/GUEST/pw: Permission denied 05:14PM -bash: /afs/scl/user/GUEST/pw/.bash_profile: Permission denied 05:15PM KyleSchochenmaie you have to aklog manually for now 05:15PM KyleSchochenmaie :'( 05:19PM Oh, I see what that is now, got it. 05:22PM KyleSchochenmaie you keeeled it! 05:22PM KyleSchochenmaie da10:/tmp# tail pvfs2-server.log 05:22PM KyleSchochenmaie [E 17:19:54.917894] Error: encourage_recv_incoming: unknown message header type 33554432 my bufnum 0 len 40. 05:22PM KyleSchochenmaie [E 17:19:54.919138] [bt] sbin/pvfs2-server(error+0xca) [0x44132a] 05:22PM KyleSchochenmaie [E 17:19:54.919155] [bt] sbin/pvfs2-server [0x43e787] 05:22PM KyleSchochenmaie [E 17:19:54.919167] [bt] sbin/pvfs2-server [0x43e9cf] 05:22PM KyleSchochenmaie [E 17:19:54.919178] [bt] sbin/pvfs2-server(BMI_testunexpected+0x117) [0x41a347] 05:22PM KyleSchochenmaie [E 17:19:54.919189] [bt] sbin/pvfs2-server [0x42301c] 05:22PM KyleSchochenmaie [E 17:19:54.919200] [bt] /lib/libpthread.so.0 [0x2aaaaacd2b1c] 05:22PM KyleSchochenmaie [E 17:19:54.919211] [bt] /lib/libc.so.6(__clone+0x73) [0x2aaaab19f273] 05:31PM oops, just did pvfs2-ls one time. I'll kill my own stuff then send you a patch. Sholud have expected that. SignOff 57pw_ : #pvfs2 "pw_ has no reason" KyleSchochenmaie n=kschoche@ohm.scl.ameslab.gov has left #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" Netjoined: 57irc.freenode.net kornbluth.freenode.net 56elventails 36i=elventai@elventails.COM has joined #pvfs2 56slang 36n=slang@harley.mcs.anl.gov has joined #pvfs2 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 56pw_ 36n=pw@quasar.osc.edu has joined #pvfs2 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 56pcarns 36n=pcarns@adsl-152-197-217.asm.bellsouth.net has joined #pvfs2 53#pvfs2 57pcarns 36H n=pcarns adsl-152-197-217.asm.bellsouth.net (gaim) 53#pvfs2 57hozer 36G n=troy narn.hozed.org (gaim) 53#pvfs2 57pw_ 36H n=pw quasar.osc.edu (pw) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) 01:08PM Did anybody look at that set of patches from batayl@gmail? The genconfig changes might be worth it, but not the rest. I just feel bad about leaving him hanging, since he's trying to help. robl pw_: and further, slang already did the same with his --ioports and --metaports patches robl s/patches/changes/ robl pw_: i'll respond. thanks for reminding me 01:14PM Oh, okay, thanks. 01:14PM His rhel casts are completely wrong, but he could add llu() here and there if that's needed. 01:14PM The whitespace changes we could all do without, although cleanup is always nice, this is just below the margin of interesting. robl pw_: what about the "continue if pvfs2-ping finds a bad server" part? 01:18PM I totally missed it buried in the whitespace changes. Does it make sense to you? robl pw_: heh. i almost missed it too. takiing a closer look at it now 01:19PM Looks reasonable, just have to do it by hand since the patch is so hairy. robl right. well, i'll try to let the guy down nicely :> 01:32PM pcarns hey guys 01:33PM pcarns fyi, batayl is one of us 01:33PM pcarns we can get the patched cleaned up based on some feedback, though 01:34PM pcarns we meant to have the whitespace seperate from the other changes, but I goofed something 01:34PM pcarns when donig some cvs->svn conversion, and it got combined 01:34PM pcarns I think I can seperate it though robl pcarns: you guys and your lack of acxiom email addresses! :> 01:36PM 53pcarns robl: yeah, its sneaky 01:36PM 53pcarns robl: sorry if I didn't introduce him yet, can't remember who you guys have met 01:37PM 53pcarns robl: but definitely just give some feedback on the patches, and I'll see if I can help get them cleaned up for another go at it robl pcarns: done! 01:39PM 53pcarns robl: are you interested in a seperated version of that one patch, or you just going to manually do the changes? 01:39PM pcarns on pvfs2-ping, that is robl pcarns: i'll manually do it, that's cool 01:42PM 53pcarns robl: awesome, thanks 01:43PM The gmail thing is unnerving. Not just batayl, but in general. I tend to give those users lower credence due to their unwillingness to divulge their affiliation. Maybe it's just curmudgenosity on my part though. robl pw_: it's years and years of associating hotmail and aol and others with a low quality individual on the other end. 21st century prejudice i guess 01:53PM 53pcarns robl: hehehe 01:53PM 53pcarns robl: um, I guess another heads up- trohed is an acxiomer too 01:53PM 53pcarns robl: he didn't even put his name in the email, I see 01:54PM 53pcarns robl: probably the only patch you will ever see from him, we only manage to steal his time from another project long enough to get that one thing (state dumper) going 01:55PM 53pcarns robl: batayl will be working with pvfs2 stuff more in the future robl pcarns: cool. slang liked the state dumper i recal robl pcarns: it's cool to have more acxiomers but i was kinda thinking pvfs2 had hit /. or something to get all these new patches all of a sudden :> 01:57PM 53pcarns robl: it could use more improvements (ie, dumping stuff from more subsystems, and maybe a little more sophisticated output), but its pretty helpful in its current form SWAP: Window 3 is not hidden! robl pcarns: is trohed's patch format indicative of typical svn patches? robl pcarns: instead of a diff relative to HEAD, includes every incremental revision between point A and HEAD? 03:40PM pcarns its the same (I think?) as what we would have had to do with cvsps 03:40PM 53pcarns robl: the problem is that those changes were scattered over a long time, 03:40PM 53pcarns robl: so it wasn't just diff from A to B, because that would have caught a pile of other unrelated stuff 03:41PM 53pcarns robl: we had to cherry pick revisions 03:41PM 53pcarns robl: in retrospect that should have been done in a branch to isolate, but we didn't realize it was going to be in progress that long robl pcarns: gotcha robl pcarns: ok, cool. that makes sense robl pcarns: tell trohed i'm really not as mean as the email i'm about to send makes me sound :> 03:56PM 53pcarns robl: heh, ok pcarns n=pcarns@adsl-152-197-217.asm.bellsouth.net has left #pvfs2 SignOff 57hozer : #pvfs2 "Download Gaim: http://gaim.sourceforge.net/" SignOff 57pw_ : #pvfs2 "pw_ has no reason" 56laytonj 36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com has joined #pvfs2 56KyleSchochenmaie 36n=kschoche@ohm.scl.ameslab.gov has joined #pvfs2 KyleSchochenmaie n=kschoche@ohm.scl.ameslab.gov has left #pvfs2 53#pvfs2 57laytonj 36H n=laytonj 68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj) 53#pvfs2 57slang 36H n=slang harley.mcs.anl.gov (Samuel Lang) 53#pvfs2 57elventails 36H i=elventai elventails.COM (elven) 53#pvfs2 57ChanServ 36H@ ChanServ services. (Channel Services) 53#pvfs2 57robl 36H n=robl ninjak.clustermonkey.org (Rob Latham) Topic 36#pvfs2 50): PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html Topic 36#pvfs2 50): set by 36robl at 36Wed Feb 15 16:18:48 2006 56hozer 36n=troy@narn.hozed.org has joined #pvfs2 SignOff 57laytonj : #pvfs2 "Leaving" 56KyleSchochenmaie 36n=kschoche@ohm.scl.ameslab.gov has joined #pvfs2 SignOff 57hozer : #pvfs2 Remote closed the connection KyleSchochenmaie n=kschoche@ohm.scl.ameslab.gov has left #pvfs2