Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Sat Apr  2 11:13:46 2005
56robl 
36~robl@63.170.133.110
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 Try the mailing lists if we're not around! http://www.pvfs.org/pvfs2/lists.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Mon Jan 17 16:55:20 2005
52Users
32#pvfs2
50)]
54 robl      
54ChanServ  
 Channel #pvfs2 was created at Mon Mar  1 12:46:26 2004
BitchX
: Join to #pvfs2 was synched in 0.248 secs!!
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56rross 
36~rross@visitor120147.mcs.anl-external.org
 has joined #pvfs2
 pcarns 
~pcarns@adsl-218-105-167.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57rross
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
 Ignoring QUITS from parts!*@*
BitchX
: You must specify one of the following:
 	ALL MSGS PUBLIC WALLS WALLOPS INVITES NOTICES NOTES CTCPS CDCC KICKS MODES SMODES JOINS TOPICS QUITS PARTS NICKS PONGS SQUITS CRAP NONE
 Ignoring PARTS from #pvfs2
 Ignoring QUITS from #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56kraken 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
10:56PM 
53kraken
 robl: have you guys had any exposure to ibrix?
robl
 kraken: hey, nope
robl
 kraken: i think neillm heard one of their sales pitches at sc03
11:05PM 
kraken
 hrm.  I've been down for the last few days talking to the dell hpcc folks
11:05PM 
kraken
 and I heard an ibrix pitch from their cto
11:06PM 
kraken
 it got pretty technical since we were asking hard questions, and at one point he said that pvfs was stuck with a single metadata server
11:07PM 
kraken
 so of course I said, "well, not in pvfs2 - in pvfs2 you can have multiple metadata servers, and it just divides up the inode space and assigns a range to each server
11:07PM 
kraken
 and he said, "oh, that's interesting... that's how we do it, and we have a patent on that"
11:10PM 
kraken
 I actually marked 3 times in his talk where he discussed something that he said was patented and I thought, "pvfs2 basically does that"
robl
 oh man. patents suck
11:11PM 
kraken
 there was the splitting of inode space, one on "the amount of metadata exchanged between servers is of fixed size"
11:12PM 
kraken
 and one that was on "allocation policies for writes" which boiled down to the same thing as writing your own distribution (start on a random node, round-robin the start node, put the file on one node, across all, in some other pattern, etc)
11:13PM 
kraken
 it seems that they've focused on the small random I/O, because their "WHOA" graphs that they show are bonnie++ of PVFS vs. IBRIX
robl
 well, that's a fair thing to hit pvfs/pvfs2 on
robl
 i'll have to see if i can find neillm's notes or pick his brain for what he learned
robl
 but that was so long ago that i bet ibrix is a lot differnt not
robl
 now
11:23PM 
kraken
 they talked about one of their customers going from pvfs to ibrix and dropping their processing time for a certain kind of seismic processing from 3 days to 3 hours
11:24PM 
kraken
 I _highly_ suspect that the app was a pretty poor match to pvfs in the first place
11:25PM 
kraken
 the patent in question I think is http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F6023706
robl
 ah, network attached storage in that patent
11:30PM 
kraken
 it's got a lot of generic stuff
11:30PM 
kraken
 stupid patents
11:36PM 
kraken
 anyway, thought it was 'interesting'.  sleep time now :)
robl
 yeah, walk the dog time and then sleep
robl
 thanks for the url
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:58am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56kraken 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56rross 
36~rross@adsl-67-121-7-14.dsl.mtry01.pacbell.net
 has joined #pvfs2
robl
 hey
53#pvfs2     
57rross     
36H   
~rross
adsl-67-121-7-14.dsl.mtry01.pacbell.net (gaim)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-218-105-167.asm.bellsouth.net (gaim)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 rross: you missed kraken on sunday talking about ibrix and their patents 
robl
 patent # 6,023,706 " Parallel file system and method for multiple node file access"
robl
 and that was the last conversation in this channel
03:40PM 
rross
 yeah, i've heard that they have patented something or another.  they had better hope that it is something we didn't implement 10 years ago.
03:40PM 
rross
 some times it's good to work for the man.
robl
 make good use of your new friends in Argonne Legal, huh?
03:48PM 
pcarns
 btw, the copyright thing is slowly getting resolved here- should be able to submit patches again once I get back from vacation later this month
03:48PM 
pcarns
 I wrote up a little document outlining what our procedure will be, legal guys want to make some minor changes though
03:55PM 
rross
 ok.  let me know if there is anything that i can do.
03:55PM 
kraken
 silly legal guys
03:55PM 
rross
 pcarns: is the reception going to be a late-night thing btw?
03:56PM 
pcarns
 it is nominally scheduled for 4pm-8pm
03:58PM 
rross
 ok.  i guess us alcoholics will have to retire to some other venue.
03:59PM 
pcarns
robl
 rross: hip flask?
04:06PM 
rross
 we'll figure something out i'm sure.
04:10PM 
kraken
 hip flasks are dangerous.  one greedy bum and it's all gone
04:11PM 
rross
 sip sip give!
robl
 ok, a camel pack
robl
 3 liters should be more than enough for anyone
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 kraken: http://www.googlism.com/index.htm?ism=lustre&type=1
robl
 kraken: compare with http://www.googlism.com/index.htm?ism=pvfs&type=1
07:00PM 
kraken
 wow, that's pretty darn accurate for pvfs
07:01PM 
kraken
 I like how the 3rd lustre one is "lustre is not stable" :)
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56rross 
36~rross@207-177-224-62.dsl.redshift.com
 has joined #pvfs2
53#pvfs2     
57rross     
36H   
~rross
207-177-224-62.dsl.redshift.com (gaim)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 rross: howdy
01:01PM 
rross
 hey.  dean is about to give his pnfs talk.
01:22PM 
rross
 pretty good talk all around.
53#pvfs2     
57kraken    
36G   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 yay! it's our favorite install-pvfs2-on-ancient-machines user
09:45AM 
kraken
 wow
09:45AM 
kraken
 now with bonus engrish!
56yftty 
36~chatzilla@61.49.188.119
 has joined #pvfs2
robl
 yftty: hi
53#pvfs2     
57yftty     
36H   
~chatzilla
61.49.188.119 (New Now Know How)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
10:19AM 
yftty
10:19AM 
53yftty
 robl: how do you do
robl
 yftty: fine over here
10:20AM 
53yftty
 robl: hehe
robl
 yftty: been using pvfs2 much or just curious?
10:21AM 
53yftty
 robl: I'm also a fs developer
10:21AM 
yftty
 join this to see if get some ideas
10:21AM 
yftty
 now I'm working on design a new distributed fs for my company
robl
 yftty: cool.  truth be told, not a lot of development happens over irc.  the mailing lists are were most of the action happens
10:21AM 
yftty
 and you ?
robl
 i'm one of the argonne PVFS2 developers
robl
 kraken is one of our earliest users and bug finder/fixer
10:22AM 
yftty
 oh, great
10:22AM 
yftty
 all cool guys
10:23AM 
yftty
 before I'm a developer of www.lustre.org
10:23AM 
yftty
 and now lead a team to develop a fs as Google.com's googlefs
10:23AM 
yftty
 and it'll has the same features as Mogilefs
robl
 ooh, a lustre developer.  we don't get to hear much from those guys
53#pvfs2     
57yftty     
36H   
~chatzilla
61.49.188.119 (New Now Know How)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
10:24AM 
yftty
 oh, I've heard the Lustre is somewhat famous in the cluster world
tglx1_gone     
50] [
tgall_foo      
50] [
tlbmiss        
50] [
tnt__          
10:24AM 
yftty
 or maybe I'm too close to it ;)
robl
 yftty: yes, plenty famous...but since they are kind of our competition, we don't work too closely with them :>
10:25AM 
55kraken
35~kraken@takealook.conwaycorp.net
50)]
 haha, is that typical lustre arrogance? :)
robl
 yftty: hey, thanks for the pointer to mogilefs.  first i've heard of it
10:25AM 
yftty
 hehe, yes
10:26AM 
yftty
 have you find its link, or I'll post here
robl
 http://www.danga.com/mogilefs/
10:26AM 
yftty
 yes, that's it
10:26AM 
yftty
 you really know how to punch the net ;)
robl
 so one could imagine PVFS2 having a mogilefs back end, givning us replication w/o much development effort
robl
 but since the files are suposes to be write-once, we'd need some caching 
10:28AM 
yftty
 sorry, I need a little to know what's PVFS2's mechnism
robl
 oh, yeah, got ahead of myself there
10:28AM 
yftty
 is PVFS2 also a assymetric arch ?
10:29AM 
yftty
 or it is the same arch as Redhat's GFS ?
robl
 yftty: no, assymetric. userspace servers which write to files and databases on a filesystem (in some ways, similar ot mogilefs)
10:30AM 
kraken
 You should probably read http://www.pvfs.org/pvfs2/pvfs2-guide.html
10:30AM 
kraken
 it explains a lot about the architecture
robl
 yftty: and there's a paper in the works as well (shooting for cluster 2005 )
10:30AM 
yftty
 ok, I'll read it
10:31AM 
yftty
 the fs design work makes me always headache
10:31AM 
yftty
 maybe the pvfs2 can meet our requirements
10:32AM 
yftty
 then I need not to do it from scracth ;)
10:32AM 
yftty
 the work is for a website company
robl
 yftty: yeah, check out the web page documents and ask some questions on pvfs2-devel
10:33AM 
yftty
 and the files I/O is featured as very very large small file read/write
robl
 usually website compaines have workloads that don't match well for pvfs2, in all honesty, but maybe with some work
robl
 yftty: what work did you do for lustre?
10:34AM 
yftty
 and my fs should give much efforts on low latency than high bandwidth
10:34AM 
yftty
 and seems there are no at-hand fs fight with it. so google.com develop it themself
10:35AM 
yftty
 they need to splitting the big files to pieces, but we need to splicing many small files together
robl
 yftty: true.. every file system worries more about bandwith than latency
robl
 well it's possible that pvfs2 might help.  i'd be interested in hearing how that goes, and we can help out as time permits
10:35AM 
yftty
 but how should we do a fs with GB connection but the files are typical 100 KBs
10:36AM 
yftty
 and the product will save our company for about 10 billion per year, hehe
10:37AM 
yftty
 the file writing seems can packed as logfs writing, but I don't know how to do the file reading ?
robl
 yeah, 100 KB files are not our strong suit
10:38AM 
yftty
 yes, seems no fs give efforts on it
10:39AM 
yftty
 now I need figure out a good mechnism to suit the very little file I/O mode
10:41AM 
yftty
 and I have read almost all design papers about (d)fs, but seems few to no fighting on that mode
robl
 i suppose if you had one server per file, and tried to distribute files as evenly as possible, that's how you'd get PVFS2 to meet that need
robl
 but that hasn't been a primary concern for us, so it's not likely to be super-fast
10:46AM 
yftty
 hehe, the bad condition is that we are in china, and can't lay pcs there as we want
10:46AM 
yftty
 the space is very limited
10:47AM 
yftty
 oh, does PVFS2 has a mechenims to sync the files among the servers if I put one server per file ?
10:48AM 
yftty
 that seems too expensive for us
10:48AM 
yftty
 we have about 7 billions users, and every users has a one GB diskspace, plus one server per file
10:48AM 
yftty
 which would be a disaster for the company ;)
56rross 
36~rross@p221.n-sfpop07.stsn.com
 has joined #pvfs2
53#pvfs2     
57rross     
36H   
~rross
p221.n-sfpop07.stsn.com (gaim)
53#pvfs2     
57yftty     
36H   
~chatzilla
61.49.188.119 (New Now Know How)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 rross: hey.  i put in the mpi-like pseudocode, but i don't know enough latex magic to make it fit in 1/2 a page *and* look good, so maybe we can work on that before submitting?
56rros1 
36~rross@p221.n-sfpop07.stsn.com
 has joined #pvfs2
56rros1 
36~rross@p221.n-sfpop07.stsn.com
 has joined #pvfs2
01:44PM 
53rros1
 robl: re: shared fp paper right?
01:44PM 
rros1
 (dropped for some reason)
robl
 rross: sharedfp, right
robl
 kraken: woo!
robl
 kraken: read david's email.  that's great on both counts!
03:14PM 
kraken
 what email?
robl
 kraken: oh, the "we're going to use pvfs2, and now you don't need to be shy about telling people acxiom uses it"
03:24PM 
kraken
 ooh, neat
03:24PM 
kraken
 I didn't get copied on that unfortunately
53#pvfs2     
57yftty     
36H   
~chatzilla
61.49.188.119 (New Now Know How)
53#pvfs2     
57kraken    
36H   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56yftty 
36~chatzilla@61.49.188.119
 has joined #pvfs2
56yftt1 
36~yf@61.49.188.119
 has joined #pvfs2
56yftty 
36~yf@61.49.188.119
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftt1 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.189.162
 has joined #pvfs2
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56yftt1 
36~yf@61.49.133.115
 has joined #pvfs2
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36~yf@61.49.133.115
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftt1 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56alban_ 
36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr
 has joined #pvfs2
11:37AM 
alban_
 Does PVFS2 support open(2) with O_DIRECT ?
robl
 alban_: hm. good question... i don't know off the top of my head
53#pvfs2     
57alban_    
36H   
~acrequy
AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy)
53#pvfs2     
57yftty     
36G   
61.49.103.240 (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 alban_: you should email the pvfs2-users list, where i'm sure someone more knowledgable about the kernel interface than i will answer
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftt1 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
03:11AM 
53alban_
 robl: thanks... I've just emailed the list
56alban_ 
36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr
 has joined #pvfs2
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56kraken 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
56yftty 
36~yf@61.49.103.240
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56snitm 
36~snitm@msnitzer.dsl.xmission.com
 has joined #pvfs2
04:37PM 
53snitm
 robl, you around?
robl
 snitm: hey!
04:54PM 
snitm
 hola
04:54PM 
snitm
 how've you been?>
robl
 been alright. doing the househunting thing lately
robl
 man, what a process
04:55PM 
snitm
 yeah, no fun
04:56PM 
snitm
 so you going to make it to laz's wedding?
04:57PM 
snitm
 well actually finding the house for you is fun; its the tedious process leading up to that diamond in the rough
robl
 snitm: heh. we're definitly seeing a lot of "rough" so far
robl
 snitm: yeah, kaitlyn and I are going to be there, but just for the weekend, not the whole week
04:58PM 
kraken
 I thought I was done with all the paperwork of homeownership after closing
04:58PM 
kraken
 but in the last few days I've added about another inch to my stack!
robl
 kraken: crap!
04:59PM 
snitm
 kraken, did you actually read it all?  I just signed where they told me.. I may not even _really_ own my house for all I know
04:59PM 
kraken
 snitm: I tried, I really tried.
05:00PM 
kraken
 but mostly I just listened to what they said it was and scanned to make sure it looked similar
05:01PM 
snitm
 yeah, same here...  so in that you guys are at ANL; have you heard anything about talks between Peter Braam and Pete Beckman?
05:01PM 
snitm
 I just got a mail through the new lustre user's group ML (lugheads) from a guy at LLNL
05:02PM 
snitm
 On Thu, Apr 21 2005 at 14:40,
05:02PM 
snitm
 Bill Boas <boas1@llnl.gov> wrote:
05:02PM 
snitm
05:02PM 
snitm
 > Have you seen the latest exchange between PeterBs (Beckman and Braam) -
05:02PM 
snitm
 > causing  some soul searching at the Tri-labs about the long term viability
05:02PM 
snitm
 > of CFS...... when can we talk?
robl
 snitm: heh, yeah.  it's been entertaining
robl
 http://www.clusterfs.com/lustre_is_oss.html
05:06PM 
snitm
 yeah, I saw that; it got sent out to lustre-discuss
robl
 oh, right.  
05:07PM 
snitm
 that seems passive agressive; Bill Boas seemed to indicate actual open discussions
robl
 sure are
robl
 braam maintains lustre is open source and that's good enough
robl
 the tri labs and argonne maintain that open source is the letter of what they asked for, but not the spirit
05:08PM 
snitm
 yes, and that is when CFS starts talking about CFS needing to eat too, correct?
robl
 the tri-labs wanted an open development model where they can pay CFS to take care of lustre, but if IBM, apple, or university researchser want to contribute something, they'll be welomed
robl
 i think the tri-labs don't really care if CFS has a shitty business model :>
05:09PM 
snitm
 yeah, thats not going to happen; I attended the Lustre user's group at Snowbird, Utah.. this very topic came up and got fairly heated
robl
 no doubt
robl
 what the tri-labs want is for colaborators to be able to make improvmensts an not have to transfer copyright to CFS
05:10PM 
snitm
 their business model isn't all that shitty; but it falls on its face when others, like the tri-labs, had different expectations
robl
 i'm biased but PVFS2 has the develoment model the tri-labs wanted
05:11PM 
snitm
 yes, but I can see CFS's point too; did the tri-labs want CFS to be a flash in the pan or be able to be around for a while?
robl
 absollutely.  so take a look at panasas
robl
 tons of money from DoE (probably their only customer for a while)
robl
 commercial product.  no one has any problem with them
05:12PM 
snitm
 sure, but its all closed
05:12PM 
snitm
 can't get their FS without their hardware
robl
 right. close source soutions aren't a problem if that's clear from the beginning
05:13PM 
snitm
 ok, so it all comes down to management of expectations
robl
 taking several millions of gov't dollars and hoarding the resulting softare when the deal was that in exchange for those several million dollars you share the software.... yeah, you got it
robl
 the anl guys think this is going to in the end not result in a whole lot of actual change
53#pvfs2     
57snitm     
36H   
~snitm
msnitzer.dsl.xmission.com (Mike Snitzer)
53#pvfs2     
57kraken    
36G   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57alban_    
36H   
~acrequy
AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
05:14PM 
snitm
 yes, it won't
05:15PM 
snitm
 hearing peter first hand it is clear they have no intention of changing their model
05:17PM 
snitm
 so just so I'm clear; is beckman trying to push for PVFS to be what the tri-labs use?  doesn't seem to mesh well with what they intend to do.. campus-wide filesystems et al
robl
 yeah that would suck for us!
05:17PM 
snitm
 or is beckman just saying it shouldn't be Lustre, but not offering an alternative?
robl
 well beckman was one of the people who wrote the lustre contract
robl
 he's dissapointed with himself for not specifying both open source and open development
robl
 the tri-labs are dissapointed that they can't fund university research to improve lustre
05:19PM 
snitm
 ok, yeah that does suck; its not fun to beat yourself up about it.. so its best to call CFS out ;)
robl
 so after a couple years everyone is kinda salty and now they vent
05:19PM 
snitm
 well they could subvert lustre
05:19PM 
snitm
 it is open source; they'd just have to fork it
robl
 there's been talk of it. i guess you could say it's the nuclear option
05:20PM 
snitm
 braam and CFS are just looking out for #1
robl
 because CFS realy does provide a valuable service to the tri-labs
robl
 file systems are bitch-hard to get right
robl
 we hand-wave a lot in pvfs2 land
05:20PM 
snitm
 definitely.
05:20PM 
snitm
 bah, I doubt that
05:21PM 
snitm
 how is pvfs2 going?
robl
 oh, it's going great for target applications
robl
 but if you wanted to, say, use shared writeable mmap to a file, that's not gonna fly :>
robl
 and if you want to compile the linux kernel on it, be preparied to wait 4 days for vmlinux to show up
robl
 (i exaggerate)
05:23PM 
snitm
 so what is the reason for the lengthy kernel compile?
05:23PM 
snitm
 naive question but I don't have my pvfs hat on; lost that when I left plogic ;)
05:24PM 
snitm
 shared writeable mmap is just cause there aren't any locks right?
robl
 to answer both questions:  no locking, so simutaenous writes to the same region of a file is undefined.  also there is no client side cache, so writes to pvfs go straight to the server
robl
 in the future we will evaluate how you can cache, but not screw over scientific applications (like NFS does)
robl
 (NFS screws scientific apps, i mean)
robl
 i think gcc mmaps files.  read-only mmap does work on pvfs2, but we don't do readahead (neillm couldn't find and fix the bug before taking off)
robl
 so it's slow but functional
05:28PM 
snitm
 gotcha, brb.. someone is at the door
05:29PM 
snitm
 didn't need a "free" deep cleaning of one room
05:30PM 
snitm
 neillm left pvfs for good?
robl
 he works at anl still, but on a different project.  got a little burned out i think
05:35PM 
snitm
 gotcha
05:35PM 
55snitm
35~snitm@msnitzer.dsl.xmission.com
50)]
 so my Xilo project is on "hold"
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
53#pvfs2     
57kraken    
36G   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57alban_    
36H   
~acrequy
AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3611:17am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.49.188.97
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-218-105-167.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
takealook.conwaycorp.net (I am Jack's $IRCNAME)
53#pvfs2     
57alban_    
36H   
~acrequy
AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: woah, back from the honeymoon already?
10:36AM 
53pcarns
 robl: yeah, back to the grind :)
10:36AM 
53pcarns
 robl: the temptation to stay and work from maui was pretty high
robl
 pcarns: see if you can get a job with maui supercomputing center
robl
 i bet those guys pay crap and still have no problem hiring eople
robl
 people even
10:37AM 
53pcarns
 robl: I saw where it was on a map, but somehow taking a tour there didn't make it onto our agenda
robl
 good for you!
01:40PM 
kraken
 welcome back pcarns 
01:40PM 
pcarns
 kraken: thanks!
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56yftty 
36~yf@221.216.130.95
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
Netjoined: 
57irc.freenode.net zelazny.freenode.net
56kraken 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
56kraken 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
56kraken_ 
36~kraken@takealook.conwaycorp.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-218-105-167.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57alban_    
36H   
~acrequy
AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr (Alban Crequy)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56yftty 
36~yf@61.135.152.194
 has joined #pvfs2
56alban_ 
36~acrequy@AToulouse-105-2-2-69.w217-128.abo.wanadoo.fr
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-167.asm.bellsouth.net
 has joined #pvfs2
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
03:25PM 
elliot
 so i don't guess anyone uses the irc channel
robl
 hi elliot
robl
 i'm always here (often idle)
robl
 but yes, as for real communication, it's mostly drive-bys lately
03:41PM 
elliot
 I was wondering if its possible to mount tcp://testhost:3334/pvfs2-fs/users/$USERNAME like with nfs
 SWAP: Window 3 is not hidden!
03:44PM 
elliot
 if users and $USERNAME were directories in the file system
robl
robl
 well, let me check
robl
 wait, i don't have to check
robl
 sorry, a bit out of it
robl
 the part after the port number is the pvfs2 "file system id"
robl
 it *looks* like a directory on the remote server, but it's not. it's just an identifier (one server could have multiple pvfs2 file systems, but that's rare)
04:18PM 
elliot
 right
04:19PM 
elliot
 it would be handy to be able to automount things directly like that rather than having a mount on the box for the pvfs2 files system and the automounting out of that
04:27PM 
elliot
 also I was wondering how about to make mutli homing work since it just mentions that it should work in the docs
robl
 elliot: i'll add it to the list of "things users like" but I don't know when we'll be able to implement it
04:31PM 
elliot
 not really a big thing, it would just be nice
robl
 elliot: as for the multihome, definitely drop an email to pvfs2-users and the guy who did the multi-home stuff will answer any questions you've got
robl
 (and then i'll add it to the faq)
04:32PM 
elliot
 ok..thanks
Netjoined: 
57irc.freenode.net zelazny.freenode.net
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
56yftty 
36~yf@61.49.189.133
 has joined #pvfs2
56yftty 
36~yf@61.48.130.23
 has joined #pvfs2
56yftty 
36~yf@61.48.130.23
 has joined #pvfs2
56yftty 
36~yf@61.48.130.23
 has joined #pvfs2
56yftty 
36~yf@61.48.130.23
 has joined #pvfs2
56snitm_ 
36~snitm@208.177.141.226.ptr.us.xo.net
 has joined #pvfs2
03:13PM 
53snitm_
 robl: hey rob, quick question... so what's mpich2's license?  it says to me that you are free to do anything (closed or open); am I mistaken?
03:14PM 
53snitm_
 robl: "Permission is hereby granted to use, reproduce, prepare derivative works, and to redistribute to others."
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56rross 
36~rross@host217-37-28-180.in-addr.btopenworld.com
 has joined #pvfs2
07:53AM 
53rross
 robl: you on here?
07:54AM 
rross
 elliot: hey -- we're in cardiff this week; weird time schedule.
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
07:56AM 
rross
 pcarns: hey!  how was the honeymoon?
07:59AM 
pcarns
 rross: absolutely fantastic
07:59AM 
pcarns
 rross: we have approximately 5 billion photos to put online when I have time
08:00AM 
rross
 heh, nice!  thx for the comments on the paper too; i've got to knock all that out this week i guess.
08:00AM 
pcarns
 yeah, that deadline is coming in a hurry
08:00AM 
rross
 i'm really glad that i was able to come and participate in the festivities btw.  i still owe you guys a gift...
08:01AM 
pcarns
 eh- don't sweat the gift- we were really happy to have you there and to get to hang out
08:01AM 
rross
 ah, the deadline has moved to 5/21!
08:02AM 
pcarns
 oh, excellent
08:02AM 
rross
 we really have to get this stupid noncontig thing worked out :(.
08:03AM 
pcarns
 where is the src for that version of noncontig you guys are running?
08:04AM 
pcarns
 this is something from joachim or someone?
08:04AM 
rross
 good question.  i think that robl has a tar file he can send you.  yes, it's from joachim.
08:05AM 
rross
 i think that if we get the piobench consortium pages up and running that NEC will be comfortable having the code available on that site.
08:06AM 
rross
 it sounds like someone is driving a r/c car around in the adjacent room.
08:07AM 
pcarns
 what's the relationship between nec and joachim's code? is his sort of a clone or is it something different entirely?
08:08AM 
rross
 joachim works for nec.  the code is a modified version of rajeev's original noncontig test in the romio test suite.
08:08AM 
pcarns
 ohohoh
08:08AM 
pcarns
08:08AM 
rross
08:09AM 
pcarns
 I live under a rock
08:09AM 
rross
 he has a copy of btio in C also, which would be very nice to be able to distribute.  well, you knew it was from joachim, so it must not be a very big rock.
08:10AM 
pcarns
 it is a semi-opaque rock
08:10AM 
pcarns
 btio in c would be nice
08:10AM 
pcarns
 seems like every 2 years or so we have to dig out notes on how to compile the fortran one
08:11AM 
rross
 i see :).  yes (btio)!  this measly 6-hour time change has kinda screwed me up; i am weak!
08:11AM 
pcarns
 oh yeah- other good news!
08:11AM 
pcarns
 I am all clear on the patch front now
08:11AM 
rross
 that's great to hear.
08:12AM 
pcarns
 will probably be no sooner than late this week before I start feeding stuff back, but I have a easy approval path and a green light to give patches now
08:12AM 
rross
 excellent.
08:12AM 
pcarns
 I'll try to pick out the most important ones first, we have a few interesting things to contribute
08:12AM 
pcarns
 nothing related to noncontig problems though
08:13AM 
rross
 heh.  that's too bad :).
08:14AM 
rross
 sam is getting up to speed this week hopefully -- sucks that robl and i had to be out of town his second week on the job.
08:14AM 
pcarns
 oh, you guys have a new hire?
08:14AM 
rross
 yes; acquired from the dsl.  i think he's quite good.
08:15AM 
pcarns
 excellent!
08:15AM 
rross
 and murali starts with us mid-june also.
08:15AM 
rross
 since we couldn't get you :).
08:16AM 
pcarns
 heh- glad murali is aboard too
08:16AM 
pcarns
 Sam Lang?
08:16AM 
rross
 yes.
08:16AM 
rross
 i think maybe you met him.
08:16AM 
rross
 and i'm sure you saw him join the lists or something.
08:17AM 
pcarns
 nah, I handed off lists to Brad
08:17AM 
pcarns
 I don't think I met him- just found name on mcs page
08:19AM 
rross
 ok.  anyway, that's him.
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
08:44AM 
rross
 kraken: werd.
08:47AM 
kraken
 howdy
08:48AM 
rross
 thx again for all your pvfs2-users responses.  that guy jason kills me.
09:00AM 
kraken
 if I were him I would have started including some you know, debug information, by now
09:03AM 
rross
 he's special.
09:04AM 
rross
 we've gotten emails from him off and on for the last couple of years i think.
09:09AM 
kraken
 lucky you!
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
09:14AM 
rross
 hey jeff
09:16AM 
laytonj
 rross: Hey back at you.
09:16AM 
laytonj
 rross: Who is usually on IRC?
09:17AM 
rross
 i'm usually not.
09:17AM 
53rross
 robl often is.
09:17AM 
rross
 this is probably the biggest crowd in a while, but i wouldn't know for sure.
09:18AM 
laytonj
 Well I wanted to mention a couple of things I learned from ORNL this past week.
09:21AM 
elliot
 rross: its the most people i've ever seen
09:22AM 
rross
 laytonj: what's up?
09:24AM 
rross
 elliot: so did we finally get pnetcdf working for you guys on the cray?
09:25AM 
laytonj
 rross: Well I went to a Lustre "workshop" sponsored by Scott Studham at ORNL. While we were there, there was some mention of a similiar PVFS2 workshop.
09:25AM 
laytonj
 The goal of the workshop is to produce a "dummies" handbook.
09:25AM 
laytonj
 I'm guessing, but it sounded like there was some interest in PVFS2 at ORNL.
09:26AM 
rross
 that's funny.  studham must have mentioned that?  he likes workshops.
09:26AM 
laytonj
 Just thought I would mention that. I don't know the politics in DOE at all, but just thought I would pass it along.
09:26AM 
rross
 thanks.  what was the lustre workshop about?  installation and admin?
09:27AM 
laytonj
 rross: The goal of the workshop was to produce a "dummies" handbook because the documentation from CFS stinks and is wrong in many places.
09:27AM 
rross
 weird.  ok.  so were there a lot of lustre experts there?  are you a lustre expert?  didn't know that.
09:28AM 
laytonj
 rross: NO :) The group were decent Linux admins, but didn't know Lustre at all.
09:28AM 
laytonj
 They wanted a totally novice group to write some docs on how to get Lustre installed and working.
09:28AM 
rross
 that seems like a poor choice of people to get together to write a handbook on how to use lustre.
09:29AM 
rross
 i hope he doesn't do the same thing for pvfs2.
09:30AM 
laytonj
 Well that's what he was talking about. I mentioned that PVFS2 was pretty easy to install - infinitely easier than Lustre - so a workshop might not be too useful.
09:30AM 
rross
 our quickstart could definitely use more work, and having some novice people walk through it would be helpful, but you should have people that know what they're doing write things like that.
09:31AM 
rross
 was the workshop a success?  was such a handbook written?
09:31AM 
laytonj
 rross: Well, it's good to get the perspective of a novice. Everyone in the workshop were pretty good Linux admins in general.
09:32AM 
laytonj
 Yep. A handbook was written (51 pages in 5 days). I thought it was a pretty good effort especially because CFS doesn't tell you everything.
09:32AM 
laytonj
 We're still trying to figure out how to distribute the handbook.
09:38AM 
rross
 ok.  what resources were used for testing installation etc?
09:40AM 
laytonj
 That is the main reason I went :) It was one of our clusters with 16 nodes and FastE. We knew there would be performance limits. We just wanted to get it installed and running.
09:40AM 
laytonj
 The cluster had 16 ndoes of single Xeon with 512 MB and FastE.
09:41AM 
rross
 who are you working for now?
09:42AM 
laytonj
 Didn't you know? I work for Linux Networx as a Field Sale Engineer.
09:42AM 
laytonj
 (I can hear the laughter in Chicago from here)
09:42AM 
rross
 didn't know that.  how long have you been doing that?
09:43AM 
rross
 i'm in cardiff btw.
09:43AM 
laytonj
 rross: Full-time?
09:43AM 
rross
 nah, just this week.
09:44AM 
rross
 yeah, how long have you been doing that full time.
09:44AM 
rross
 (one of those two was the answer you were looking for...)
09:45AM 
laytonj
 I started on Dec. 1. I finally got burned out at Lockheed. I was there almost 7 years and that was about 6.5 years too long.
09:49AM 
rross
 ok, so it's not like you've been working there 5 years w/out me knowing it or anything :).
09:52AM 
laytonj
 rross: Naahh. So what's going on in Cardiff?
09:55AM 
rross
 CCGrid.  RobL and I are giving a tutorial, I'm giving a talk, RobL is chairing a session.  But that's all tomorrow and the next day.  Today I'm hanging out and reviewing tutorial material.
09:55AM 
laytonj
 I lived in England when I was 15 and I remember traveling to Cardiff. This was a long time ago, but it was really nice. I think Alan Cox lives around there somewhere.
09:56AM 
rross
 the weather is a little cool, but otherwise it's quite nice.
09:59AM 
laytonj
 Enjoy!
10:00AM 
rross
 thx
robl
 aw man i missed the party
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 laytonj: hey, congrats on leaving lm!  and no laughing about field engineers. it seems like something you'd be good at with your background of both technical and teaching
03:42PM 
53laytonj
 robl: It's fun, but very, very, stressful. :) How do you like Cardiff?
robl
 laytonj: small.  nice place to visit, but a week here might be a few days too long
robl
 laytonj: not sure how much fun the ol' fiance is having while i'm off conferencing, but she's a trooper
03:44PM 
53laytonj
 robl: Always an issue with travel. I travel about 50% of the time and it really wears on the family.
robl
 laytonj: oh, she's here in town i mean
03:47PM 
53laytonj
 robl: Gotcha. Lucky girl. I love Cardiff although it's been a few years (like 28).
10:37PM 
kraken
 how does he recompile his VB to use in PVFS?
robl
 poor guy
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
01:39PM 
kraken
 I was a faq-linking machine this morning.  where 'machine' is 'two emails'
01:45PM 
laytonj
 kraken: I saw that. Good responses to the emails :)
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: hey, did my way-too-fast email make any sense?
08:43AM 
53pcarns
 robl: about the noncontig test? yeah, I think it made perfect sense actually
08:44AM 
53pcarns
 robl: I still haven't tried on a different box yet, but your test cases and the patch that walt sent me monday seemed to get along fine on my laptop
robl
 pcarns: ok, i'm going to very carefully re-apply walt's patch and make 100% sure i didn't rush things
robl
 i don't know if maybe it's an aio-callback difference?
robl
 on leela, we should be exercising the aio-callback path
robl
 not sure if that's the case on rhel
08:56AM 
pcarns
 my laptop (gentoo) is using aio callbacks, I just don't have nptl
08:56AM 
pcarns
 maybe tonight or tomorrow I can run it on a gentoo or rhel3 with nptl
08:56AM 
pcarns
 leela still crashing with Walt's patch from monday?
robl
 yeah, but like i said, i might have been in a rush
09:01AM 
pcarns
 oh sorry, didn't see that line in my irc for some reason
09:03AM 
pcarns
 sorry I can't help right this second- got another pain in the &*^% pvfs1-related problem I have to work on today
robl
 hey, no worry. i'm in @#$ cardiff and getting an interrupt every few minutes :>
robl
 ok, it definitley doesn't work for me.  i'll have to re-read walt's and neill's exchange when i have time to see if all code paths are being checked
09:12AM 
kraken
 is that the reason you guys are bouncing devpvfs so often?
robl
 yeah, trying to get a noncontiguous io benchmark working so we can collect data so we can talk about it in a paper due in 10 days :>
robl
 ok, back to the conference
09:13AM 
55dsp
35~dsp@volans.c-60.org
50)]
 are you going to laz's bachelor party thing?
09:16AM 
pcarns
 kraken: have a production problem showing on pvfs1, having a heck of a time replicating
09:19AM 
kraken
 bummer
01:55PM 
elliot
 anyone around?
02:00PM 
pcarns
 hi elliot
02:01PM 
elliot
 at the root of my pvfs2 tree I have a directory called users
02:01PM 
elliot
 in that directory I have a directory for each of my users
02:02PM 
elliot
 running ls in the "/users" directory as root works fine
02:02PM 
elliot
 but as a normal user ls takes a long time
02:02PM 
elliot
 as in a few minutes to get a directory listing of 25 or so directories
02:03PM 
elliot
 is this normal behavior
02:05PM 
pcarns
 no, I don't think so
02:05PM 
pcarns
 each of the 25 directories has a different user?
02:06PM 
elliot
 yes
02:06PM 
elliot
 all have 0755 permissions and a different user and group
02:07PM 
pcarns
 on the server side, it probably short circuits most permission checking for root users
02:07PM 
pcarns
 is it possible that your server is being slow to retrieve user/group information from nis or ldap?
02:08PM 
elliot
 the server is the nis master
02:12PM 
pcarns
 I would maybe try setting the EventLogging on the server to include "server" and watch the logs while you do one of those listings
02:12PM 
pcarns
 if you could see a consistent place where it stalled we might be able to tell what's going on
02:58PM 
kraken
 pcarns: you guys just installed a new rpm, right?
03:05PM 
pcarns
 kraken: I dropped a new pvfs-lib rpm earlier today
03:05PM 
pcarns
 on 12
03:06PM 
kraken
 hrm, my iods died about 15 minutes ago, must have just gotten around to croaking.
03:07PM 
pcarns
 must be yesterday's change- I'm not sure what exactly about putting a new rpm makes them die so I don't know how long it takes
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3603:43pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
11:21AM 
kraken
 pcarns: congrats :)
11:21AM 
pcarns
 kraken: thanks!
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Global Notice] Hi all. We're experiencing the user summer spammer infestation. If you get klined by mistake, please email staff at freenode dot net. Apologies in advance for any problems, and thank you for using freenode!
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56yftty 
36~yf@61.51.110.81
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56Paganist_ 
36~pierre@h-66-167-173-104.cmbrmaor.dynamic.covad.net
 has joined #pvfs2
53#pvfs2     
57Paganist_ 
36H   
~pierre
h-66-167-173-104.cmbrmaor.dynamic.covad.net (pierre)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
10:46AM 
Paganist_
 Hi ! I'm reading the faq and am wondering if pvfs2 does a real mirroring of every file on every node.... Other question is when i shutdown a node and put it up like an hour later, will it automaticaly get the modifications and apply them to the files it has localy ?
robl
 Paganist_: hey.  pvfs2 does no mirroring
robl
 lots of people ask for it.  ther are some people working on it, but they are in early stages
robl
 in the default configuration, when you shut down a node, the whole pvfs2 volume is taken out of service, so there's not really any concept of integrating modifications
10:57AM 
Paganist_
10:57AM 
Paganist_
 thank you
10:59AM 
kraken
 well, that was easy enough, eh?
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
11:04AM 
pcarns
 didn't even make it to the kraken faq machine this time
56yftty 
36~yf@61.49.189.147
 has joined #pvfs2
11:10AM 
kraken
 that's ok, I just linked someone on the mailing list instead
robl
 kraken: i've got this one
11:21AM 
kraken
 good :)
12:06PM 
yftty
robl
 kraken: you need to make the mountpoint?
robl
 kraken: news to me
robl
 kraken: it's just a key into a database
robl
 kraken: where the 'database' is the flatfile $PVFS2TAB_FILE
01:37PM 
kraken
 oh ho, I thought it needed to be there
01:37PM 
kraken
 but if he'd read the "notes on running without root access" and done what it said, he should have been able to make it work :)
01:37PM 
kraken
 he still seems to think that he can access the data files by just looking under the storage space
53#pvfs2     
57yftty     
36G   
61.49.189.147 (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56slang 
36~slang@visitor120164.mcs.anl-external.org
 has joined #PVFS2
robl
 yay
53#pvfs2     
57slang     
36H   
~slang
visitor120164.mcs.anl-external.org (slang)
53#pvfs2     
57yftty     
36G   
61.49.189.147 (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
05:01PM 
slang
 hey
05:01PM 
slang
 cool
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
robl
 kraken: harsh dude! he did ask -users :>
robl
 oh! pvfs *1*  hah
08:49AM 
kraken
 he's asked a couple of questiones recently that mentioned "pvfs" and not "pvfs2", so I suspected quietly that he was actually needing pvfs1 help
08:49AM 
kraken
 but asking about pvfs-test is a dead giveaway
robl
 missed that. must be too early for me
56slang 
36~slang@visitor120164.mcs.anl-external.org
 has joined #PVFS2
56slang 
36~slang@visitor120164.mcs.anl-external.org
 has joined #PVFS2
53#pvfs2     
57slang     
36H   
~slang
visitor120164.mcs.anl-external.org (slang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
10:05AM 
kraken
 I don't want to reply to that last email, because it honestly doesn't sound like he needs PVFS2 for what he wants to do
10:06AM 
kraken
 I shudder to think of the poor performance that running a berkeley db (for subversion) on top of pvfs2 could lead to
10:15AM 
pcarns
 that first goal is kind of vague too (aside from the hardware description)
10:30AM 
kraken
 yeah, and I think his goal of a highly available distributed filesystem is a bit misplaced, if he only wants to use 5 machines
56slang_ 
36~slang@harley.mcs.anl.gov
 has joined #PVFS2
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: hey. just in time.  remember anything about trove? 
robl
 pcarns: just kidding. i'm not seriously asking about trove... yet
02:53PM 
53pcarns
 robl: depends: if it is broken, I don't know nuthin
robl
 aw yeah
02:54PM 
53pcarns
 robl: what you working on?
02:55PM 
53pcarns
 robl: bet its more fun that what I'm doing - staring at sys_rename() trying to make it less dangerous :)
robl
 pcarns: noncontig is still broken with 2 or more servers
02:55PM 
pcarns
 doh
robl
 only need one client to trigger, but i never like debugging if it takes two servers to show the bug
02:56PM 
pcarns
 send me the command line when you get a chance
robl
 pcarns: i think i already did
02:57PM 
pcarns
 not that I don't certify the flow code to be 100% bug free already
robl
 yup. sent it to wastedcycles
robl
 sent it to the whole gang, in fact
02:59PM 
pcarns
 oh ok, got it
02:59PM 
pcarns
 what is testcase.c
02:59PM 
pcarns
robl
 pcarns: it's noncontig, but only with noncontig_mem_noncongig_file
robl
 and a lot of command line processing hard-coded in
03:01PM 
pcarns
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: hm. it might be that this access pattern is just *really* bad for pvfs2
04:17PM 
pcarns
 does it eventually finish?
04:17PM 
pcarns
 I haven't run it yet
robl
 pcarns: i've given it several minutes
robl
 pcarns: it doesn't *appear* to finish, but when i look at the logs i see lines like this
robl
 [16:12:10.737001] ATTRIB: retrieved attributes from DISK for key 2863311532
robl
         uid = 0, mode = 0, type = 2, dfile_count = 0, dist_size = 0
robl
         b_size = 2556, k_size = 0
robl
 and b_size increases
robl
 (slowly)
robl
 ok, never mind
robl
 it does fail. takes about 5 minutes
04:22PM 
pcarns
 I wonder how many trove operations are being posted
04:23PM 
pcarns
 is each trove operation taking a long time, or are there just a ton of little ones
04:23PM 
pcarns
 might be hard to tell from the logs, though
robl
 when i fire it up in gdb i can see that there are lots of short lived threads
robl
 but not sure what those threads come from
04:24PM 
pcarns
 probably aio
04:25PM 
pcarns
 but one trove job could potentially make several threads, depends on what its asked to do I think
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
05:14PM 
53pcarns
 robl: you still there?
robl
 pc: hey!
robl
 guess phill left
BitchX
: Unknown command: WOH
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@68.211.217.174
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
68.211.217.174 (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: your email rocked
09:01AM 
53pcarns
 robl: thanks!
09:02AM 
pcarns
 now I just have to figure out what in the world Avery's code is triggering :)
robl
 pcarns: the good news is valgrind reports several errors
robl
 pcarns: the bad news is i don't understand the code at all in those parts :>  (but i will)
robl
  ERROR SUMMARY: 30000 errors from 11 contexts
robl
 yeah, that's not a good sign :>
09:36AM 
pcarns
 eek
50* 
57robl 
gets to work
robl
 heh. here's a new one:
robl
 Syscall param writev(vector[...]) points to unaddressable byte(s)
robl
 not "1 byte after a block.." but flat out unaddressable :>
robl
 pcarns: if you run with -veclen 64 -elmtcount 64, it's much faster and still fails
10:43AM 
53pcarns
 robl: that's good that you found a smaller test case
10:44AM 
53pcarns
 robl: isn't there some mpi datatype call you can make to get the upper and lower bound on a datatype?
10:44AM 
53pcarns
 robl: maybe do that before each mpi-io call and see if any of the bounds go beyond the buffer?
robl
 pcarns: well, it's just one mpi-io call
10:49AM 
pcarns
 all the better
robl
 man, if there's one part of mpi i'm weak on, it's datatypes
10:57AM 
pcarns
 doh! same here
10:57AM 
50* 
53pcarns/#pvfs2 
eyes the irc room attendees hoping for a datatype expert
robl
 it's cool. i'll go bug robr if i get stuck
11:02AM 
pcarns
 maybe MPI_Type_ub() and MPI_Type_lb()?
robl
 that should be pretty close. will give values in terms of relative offsets
11:08AM 
pcarns
 ah, ok
11:08AM 
pcarns
 might be enough- if ub is greater than size of buffer
11:08AM 
pcarns
 would indicate if bug was in the datatype constructed in the application or not
robl
 rob has a good helper routine
robl
 MPIU_Datatype_debug
robl
  MPIDU_Datatype_debug(MPI_Datatype type, int array_ct)
robl
 if you call that and also set MPICH_DBG_OUTPUT, you get a dump of the datatype to stdiout (or a file, i presume)
11:10AM 
pcarns
 oooo- that's good to know about
11:11AM 
pcarns
 I think I'll put that in my notes...
robl
 pcarns: i'm quite proude of my entry for that one:
robl
 . MPIDU_Datatype_debug(MPI_Datatype type, int array_ct)
robl
         array_ct has to be "big enough" for the data type.  32 is a good number
robl
         for simple datatypes.  no harm in making it bigger, though
robl
 . the environment variable MPICH_DBG_OUTPUT must be set to something (usu.
robl
   stdout) or you won't see anything and you'll go insane wondering why 
robl
 (because i really did waste half a day wondering why i wasn't getting output)
11:12AM 
53pcarns
 robl: nice- thanks for the tip
robl
 so that call says we have
robl
  Size = 16384, Extent = 16384, LB = 0(sticky), UB = 16384(sticky), Extent = 16384
11:13AM 
53pcarns
 robl: that doesn't seem right
robl
 yeah, i know... i'm totally puzzled
11:14AM 
53pcarns
 robl: looks like the description of a single contiguous region
11:15AM 
53pcarns
 robl: since the size, extent, and ub all match
robl
 it's a (and i don't get it...) "contig of vectors of contig"
robl
 wierd!
robl
 MPI_Type_get_extent says the extent is 0 and the lb is 16384
robl
 i have no idea what that means
11:26AM 
pcarns
 I got nuthin'
01:21PM 
kraken
 on a side note, naming cats is not easy
01:39PM 
pcarns
 naming cats?
01:47PM 
kraken
 I got a pair of kittens, and for now they're "littler one" and "bigger one"
robl
 friend of mine named his 'five'
robl
 "here's my cat five"
01:49PM 
kraken
 haha
01:49PM 
kraken
 someone suggested I name them 5 and 5e
robl
 it doesn't really matter what you call them because it's not like they'll respond to any name you give them
01:50PM 
kraken
 that is true
01:54PM 
pcarns
 I always thought it would be fun to name something (pets, children, whatever) after HP Lovecraft creatures
01:54PM 
pcarns
 Cthulhu, Yog-Sothoth, etc.
01:56PM 
kraken
 ooh
01:56PM 
kraken
 one of my friends names his cats after dictators.  he has a benito and a joseph (mussolini and stalin, respectively)
01:56PM 
pcarns
 not that I have a clue how to pronounce...
robl
 "what's your cat's name?" "to pronounce it correctly i would have to rip out your tounge"
01:57PM 
pcarns
 "he who is not to be named"
01:57PM 
kraken
 look out for Phil's first child, Cthulhu Carns
01:58PM 
kraken
 it's alliterative even
01:59PM 
pcarns
 ha!
02:00PM 
pcarns
 you see some fun things searching on google for how to spell that sort of thing
02:01PM 
pcarns
 http://catalog.chaosium.com/images/CHA0087.gif
robl
 aw, damn "who will be eaten first" got taken down
robl
 ah, sweet sweet internet
robl
 http://www.geocities.com/tribhis/cthulhutract.html
02:12PM 
kraken
 the cthulhu for president stuff was great... "why settle for the lesser evil?"
robl
 pcarns: oh, hey! valgrinid reports memory overruns in ADIOI_GEN_WriteStrided as well!
robl
 pvfs2 is off the hoook.... for now
robl
 pcarns: oh balls and a half
robl
 pcarns: the datatype constructed is bunk for 1 proc but is a-ok for 2 procs or more
02:27PM 
pcarns
 noncontig.c doing something wrong in the 1 proc case?
robl
 pcarns: yeah, but that's all i know
robl
 pcarns: ==27492== ERROR SUMMARY: 67 errors from 12 contexts (suppressed: 23 from 1)
robl
 pcarns: and thoese 12 contexts are all "uninitialzed memory regions"
robl
 pcarns: will respond to the ml
robl
 er, your last email
robl
 that might only be true with 64/64
 SWAP: Window 3 is not hidden!
robl
 pcarns: sucks about patch beaurocracy
robl
 pcarns: oh, hey, have you met slang?
53#pvfs2     
57pcarns    
36H   
~pcarns
68.211.217.174 (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
03:03PM 
53pcarns
 robl: no, I haven't
03:05PM 
pcarns
 Sam is it?
robl
 pcarns: yeah, Sam Lang.  He's currently looking at ways to profile what the pvfs2-server is doing when all these requests come in from clients
robl
 slang_: phil and neill wrote most of pvfs2
03:07PM 
pcarns
 very cool about the profiling
03:08PM 
pcarns
 that patch was good, with the state machine names
03:08PM 
pcarns
 could be used to eliminate those debug messages at the beginning of each state machine function
03:22PM 
slang_
 pcarns: yeah
03:22PM 
slang_
 pcarns: didn't know if it made sense to replace those or just leave them
03:23PM 
pcarns
 IMHO it would be neat to remove all those PINT_STATE_DEBUG() lines in the .sm files altogether, and instead print the exact same information from one centralized location in the state machine infrastructure code
03:24PM 
pcarns
 if the state machine unions have the string name, then it seems like it wouldn't be too hard, and it would remove a lot of clutter (and a few incorrect gossip messages) from the .sm files
03:24PM 
slang_
 pcarns: so do PINT_STATE_DEBUG_START/STOP w/ the start/stop event calls?
03:24PM 
pcarns
 ditto for both the client and server
03:25PM 
slang_
 pcarns: I can go ahead and do that
03:26PM 
pcarns
 well... there are events, then there are log messages- both are probably needed
03:26PM 
slang_
 yes
03:27PM 
slang_
 macros would end up being called in the same place
03:27PM 
pcarns
 yep, you're right
03:28PM 
slang_
 there's a couple state_action calls in pvfs2-server.c instead of state-machine-fns.h ... i'd almost like to make a PINT_state_machine_invoke_state call in state-machine-fns.h for consistency..
03:29PM 
pcarns
 slang: you just blew past the amount of state machine architecture that is present in my short term memory :)
03:29PM 
pcarns
 slang: but anything to make hte code organization nicer is always good :)
03:29PM 
slang_
 :-)
03:30PM 
pcarns
 by the way- if you are playing with (or will be in the future) the event logging stuff,
03:30PM 
pcarns
 I suspect there might be a bug in there but I never got around to trying it out for sure,
03:30PM 
pcarns
 I don't think the event logs are rotating right- supposed to be a ring buffer
03:31PM 
pcarns
 but it seems like I did some runs late last year that just filled up and stopped
03:31PM 
slang_
 hmm ok
03:31PM 
pcarns
 at the time I couldn't really stop to look at it, was more worried about what I was measuring
03:31PM 
pcarns
 but just a heads up
03:32PM 
slang_
 cool thanks
03:32PM 
pcarns
robl
 pcarns: 1 server, 2 clients, no problems.  2 servers, 2 clients, read back bad data.  progress of a sorts, i suppose
robl
 pcarns: ok, i haven't fixed anything on my end
robl
 pcarns: but your suggetion to sync up the dbpf and flow offset lenghts seems to help a lot
robl
 pcarns: now if you have 2 servers, 2 cliens, and use a minimum element count of 2, things work
robl
 that should be enough to start getting some benchmark data, then next week when walt's in town look more closely at the failure cases
04:11PM 
53pcarns
 robl: ok, let me know if anything comes up that i can help with
robl
 pcarns: sure thing.  on my end i need to figure out what's wrong with the single-processor version of the data type, then see if i can learn what's up with the "2 servers and a 1024x1 vector" case
robl
 pcarns: after i have a better idea what's broken, maybe you can help me fix it if it's tricky.  but don't worry, i'm good about pretending you still live at clemson :>
04:16PM 
pcarns
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
01:41PM 
elliot
 anyone around?
robl
 elliot: hi. what's u?
robl
01:54PM 
elliot
 somehow one of my users managed to create a file on my pvfs2 filesystem that neither he nor root can get to
01:55PM 
elliot
 if I try to get any of the files attributes as root it just gives me permission denied errors
02:01PM 
elliot
 also I have noticed that my pvfs2 server daemons are getting a lot of connection timeout errors
robl
 hm. ok, do the pvfs2-* tools grok the file? 
02:20PM 
elliot
 yep
02:21PM 
kraken
 have you tried unmounting, killing the pvfs2-client, rmmod'ing the pvfs2 kernel module
02:21PM 
kraken
 then redoing the modprobe, starting the client, and mounting
02:22PM 
elliot
02:22PM 
kraken
 it'd be nice to know if it was a state issue on the client or something that persists (i.e. something on the server side that the kernel module isn't expecting)
02:22PM 
elliot
 well it is affecting all of my clients
02:23PM 
kraken
 ahh
02:23PM 
kraken
 hrm
02:23PM 
kraken
 still might be worth a shot to cycle the stuff on one
02:25PM 
elliot
 so pvfs2-ls will list the file, but pvfs2-ls -al hangs when trying to get the attributes for the file
02:27PM 
elliot
 kraken: and I still get permission denied as root even after cycling through everything
02:29PM 
kraken
 interesting
02:41PM 
elliot
 so anyone have any ideas as to what is going on? I have people that would like to be able to use this data.
02:44PM 
kraken
 I'm light on ideas about what's going on, but have you tried setting the perms manually with pvfs2-chmod/chown to see if that 'fixes' it or if they hang as well?
robl
 elliot: nothing comes to mind immediately. nobody's reported anything like that for months and months now.  
robl
 might be interesting to bounce the pvfs2 servers
robl
 would tell us if it's a problem with state or with the file system itself
02:45PM 
kraken
 and if it persists after that, maybe pvfs2-fs-dump could help
02:45PM 
kraken
 can you do a pvfs2-ls -i on that file?
02:47PM 
elliot
 kraken: pvfs2-chmod/chown doesn't seem to help
02:48PM 
elliot
 neet...pvfs2-ls segfaults now that I chmod/chown the file 
02:48PM 
kraken
 ooh
02:48PM 
elliot
 -rw-r--r--    1 blondin  blondin    256005068 2005-04-17 19:24 SasnzD1010.nc
02:48PM 
elliot
 free(): invalid pointer 0x80c22cc!
02:48PM 
elliot
 Segmentation fault
02:48PM 
elliot
 the next file in the list is the one with problems
02:51PM 
50* 
53elliot/#pvfs2 
starts taking down the fs
02:59PM 
elliot
 got everything back up and still have the same problem
02:59PM 
kraken
 does pvfs2-ls still segfault?
03:00PM 
elliot
 yes
03:02PM 
kraken
 can you ulimit -c unlimited and get a core dump?  that might be useful
03:02PM 
kraken
 having a pvfs2-ls with debugging symbols and running it from within gdb would be even better
03:03PM 
elliot
 getattr_object_getattr_failure : Input/output error
03:03PM 
elliot
 Failed to get attributes on handle 1073741766,1322993734
03:03PM 
elliot
 Getattr failure: Input/output error
03:04PM 
kraken
 hrm, and nothing in the logs on any of the servers?
03:04PM 
elliot
 i changed the ulimit and got an error rather than a segfault
03:04PM 
elliot
 and now it segfaults again
03:06PM 
elliot
 yea...this seems to be the only error that i can see in the metadata server log:
03:06PM 
elliot
 The requested dfile count of 0 is invalid; aborting operation.
03:06PM 
elliot
 + attrs read from dspace: (owner = 7268, group = 7268, perms = 644, type = 1
03:06PM 
elliot
    atime = 1116372293, mtime = 1116372293, ctime = 1116372293 |
03:06PM 
elliot
    dfile_count = 0 | dist_size = 0)
03:06PM 
elliot
 but there is a lot more output 
robl
 sounds like pvfs2-fsck might be needed... but i can't gaurantee it's bug-free
03:08PM 
elliot
 http://rudi.ncren.net/~elliot/pvfs2log.txt
robl
 (we've tested what we can, but it hasn't see a lot of in-the-wild situations)
03:10PM 
kraken
 ooh, robl do you remember the evil evil dfile count problems I hit long long ago?
03:10PM 
elliot
 and if you want to core from pvfs2-ls http://rudi.ncren.net/~elliot/core.13110
robl
 kraken: yeah, i do
03:16PM 
53elliot
 robl: pvfs2-fsck segfaults
robl
 dangit
 SWAP: Window 3 is not hidden!
robl
 elliot: i can't work on this too much today... or tomorrow... but maybe monday?
robl
 i could maybe log in and see how things look
03:21PM 
elliot
 i think what happend was the use canceled there job, causing the process to get killed, and not properly closing the file maybe
03:22PM 
53elliot
 robl: sure
03:22PM 
elliot
 any help would be appriciated
robl
 elliot: in the meantime, take it up on the mailing list to see if anybody else has any idea
 Topic 
36#pvfs2
50):
 Try the mailing lists if we're not around! http://www.pvfs.org/pvfs2/lists.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Mon Jan 17 16:55:20 2005
03:30PM 
elliot
03:30PM 
elliot
 let me know when you are available on monday
56rross 
36~rross@216-80-31-74.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
04:42PM 
53rross
 robl: you 'round?
robl
 rross: hey
04:46PM 
53rross
 robl: two questions.  (1) how many files total is the osc metadata test working with, and (2) what size does it resize the files to?
04:47PM 
rross
 i'm not going to make dinner btw; just a little too much to get done between paper completion and prepping for weekend.  would like to though :(.
robl
 (1): 2560 files total across all processors.  each process operates on 2560/nprocs files
robl
 (2) 2^20 (2<<20)
04:52PM 
rross
 1MB.
04:52PM 
rross
 ok.  thanks!
robl
 er, 2^21 (missed a bit)
04:53PM 
rross
 i skipped the noncontig section for the moment.  i'll knock it out after you've had a chance to finish up the data.  pretty close i think.  the paper isn't a glowing endorsement of pvfs2, but i think that's a strong point actually.
04:54PM 
rross
 you sure?  wanna run it real quick like and look at the file size :)?
robl
 (gdb) p maxsize
robl
 $1 = 2097152
04:56PM 
rross
 right now.  thanks.
04:56PM 
rross
 i dunno what i'm typing.
robl
 i had to double-check in gdb m'self
04:56PM 
rross
 weather outside sucks.
robl
 here too
05:30PM 
rross
 crap, back up to 27 pages.
05:30PM 
rross
 can't wait for the extended director's cut.
robl
 http://www-unix.mcs.anl.gov/~robl/pvfs2/noncontig/
robl
 couldn't come up with a better way to present the data
05:42PM 
rross
 the top lines are short because the file gets too big?  just haven't run the points yet?
robl
 rross: top lines are short because ... wait, now i forget
robl
 ah, noncontig wants the vector blocklen to be a multiple of nprocs
05:44PM 
rross
 i think that a better way to show it might be in terms of a fixed file size, with # of pieces/process as the different lines (1 being a contiguous block).  we don't have to show the really terrible cases here; they will be much better with the datatype code, so 1, 4, 8, 16, 32, 64 pieces would be great points i think.  sorry i didn't think about this more sooner.
robl
 and in these runs, as vector blocken decreases, element count increases
05:44PM 
rross
 needed to see the graphs to think about what would be best, as usual.  sucks that it took so long to get the bugs out.
05:45PM 
rross
 just do the contig mem/noncontig file if you can select just that.
robl
 sure can
robl
 need to think a second for how to get noncontig to do that
05:49PM 
rross
 ok.  start with a 128MB/process total size, and work back from there.  then the top line in the graph should basically be the same as the one in the contig tests.
05:50PM 
rross
 we can get troy to run the same tests on the OSC cluster later on, before the final paper version.
robl
 er, wait, 128mb/process means variable file size?
05:56PM 
rross
 right.  sorry.  fixed amount of data per process, as in the contig tests.  just varying # of regions.  that make sense?
robl
 yeah, i think so. just trying to convert it into terms of veclen and elmtcount
05:57PM 
rross
 what's the difference between veclen and elmtcount?
05:58PM 
rross
 veclen is the # of regions, elmtcount is the size of the region?
robl
 veclen: blocksize of vector  elmtcount: number of <type> in each block
robl
 right
05:58PM 
rross
 aren't papers fun :)?
05:58PM 
rross
 veclen is not the # of regions then.  what is the # of regions?
05:59PM 
rross
 is there a count?
robl
 ah, i see. 'veccount' 
robl
 either you give it a file size or a vec count
robl
 and one is derrived from the other (depending on which you passed to noncontig)
robl
 great
06:02PM 
rross
 file size = vec count * veclen * elmtcount, i'd guess.
06:02PM 
rross
06:02PM 
rross
 file size = vec count * veclen * elmtcount * nprocs
06:03PM 
rross
 we want vec count * vec len * elmtcount = 128MB, and to vary vec count from 1 to 64.
06:03PM 
rross
 i think.
06:03PM 
rross
robl
 yay datatypes
06:03PM 
rross
 sure!
06:04PM 
rross
 just fix veclen at 1, so vec count * elmtcount = 128MB
06:04PM 
rross
 that'll get you an elmtcount from 128MB to 2MB.
06:07PM 
rross
 cool?
robl
 think so
robl
 submit a bunch of jobs with a variable number of processors
robl
 each job runs noncontig, varying the veccount (and reducing the elmtcount appropriately)
robl
 take the output, plot it up
robl
 ok, in the queue
robl
 will let you know what' sup after dinner
06:12PM 
rross
 thanks much.  i should have everything else knocked out tonight.  i can finish this up tomorrow if necessary.  only thing that sucks is that i may not get much done on the romio front prior to bill's tagging on monday :(.
06:32PM 
rross
 ha, we have until may 28th now :).
06:32PM 
50* 
53rross/#pvfs2 
tries to wrap up for now, switch to romio, do the rest of this next week.
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3607:04pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3607:37pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
robl
 rross: extention!
robl
 rross: ok
09:21PM 
rross
 yeah, that makes it easier.
robl
robl
 (dur)
robl
 esp. because jazz is packed tonight
robl
 get of my cluster, you ..... scientists!
robl
 off
BitchX
: No Banned Words on list
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3601:09am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Global Notice] Good evening, all. News up on the freenode website: (1) Major downtime on Sunday. (2) Status of fundraiser.  Please take a look at http://freenode.net/news.shtml ! Thank you for your support for freenode, and have a great evening!
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
56pcarns 
36~pcarns@adsl-211-217-174.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-211-217-174.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 hi phil
03:11PM 
pcarns
 howdy
55deedra
35dmwaters@dmwaters-osuosl.staff.freenode
50)-
 {global notice} Hi all! In a little more then 12 hours, I will begin major maintenence  on the network. For more information, please see 'http://www.freenode.net/news.shtml' Thank you for your patience, and thank you for using freenode!
56elliot_ 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
 Signon time  :    Sat Apr  2 11:10:48 2005
 Signoff time :    Sun May 22 10:20:36 2005
 Total uptime :   49d 22h  9m 48s
SignOff: 
57robl 
 Mike Tyson says BitchX BITES! Do you HEAR what I'm saying?!
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Sun May 22 10:21:33 2005
56robl 
36~robl@63.170.133.110
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 slang_    
54ChanServ  
54 elliot    
 Channel #pvfs2 was created at Sun May 22 02:20:25 2005
BitchX
: Join to #pvfs2 was synched in 5.918 secs!!
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-209-12-241.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-209-12-241.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36~pcarns@adsl-209-12-241.asm.bellsouth.net
 has joined #pvfs2
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-209-12-241.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57pcarns    
36G   
~pcarns
adsl-209-12-241.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
SignOff 
57kraken
: #pvfs2 
"leaving"
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-209-12-241.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57slang_    
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
 pcarns 
~pcarns@adsl-209-12-241.asm.bellsouth.net
 has left #pvfs2 
05:55PM 
slang_
05:55PM 
slang_
 quit
SignOff 
57slang_
: #pvfs2 
"leaving"
50* 
57robl 
has days like that
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3607:12pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-209-12-241.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-209-12-241.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
robl
 hello #pvfs2
robl
 elliot: haven't forgotten about you. just didn't have time yesterday
11:53AM 
53elliot
 robl: today maybe?
SignOff 
57slang
: #pvfs2 
Remote closed the connection
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
03:03PM 
53elliot
 robl: poke poke
robl
 elliot: today is not looking so good either.
03:06PM 
elliot
 i can reinitialize the filesystem to fix it, but I would like to figure out whats going on in case it happens again
robl
 elliot: stil trying to finish a few rounds of tests for a paper due imminently
03:07PM 
elliot
robl
 elliot: and i would love to get my hands on a file system that causes pvfs2-fsck to segfault
03:07PM 
elliot
 tomorrow maybe?
robl
 yeah, tomorrow looks good
03:08PM 
elliot
 ok, ping me whenever you have time tomorrow
robl
 you got it
03:40PM 
pcarns
  elliot: I think I know what the story is on your problem, or at least what got it to that state
03:41PM 
pcarns
 I'll respond to your mailing list posting in a minute
03:59PM 
53pcarns
 robl: my email shows how to trigger this bug so you can reproduce a scenario that makes pvfs2-fsck segfault, if you guys want to work on that aspect of the problem
robl
 pcarns: ok, good
robl
 pcarns: the bad news is that the only reason elliot ran pvfs2-chmod was because we (kraken and i) told him to :>
04:11PM 
pcarns
 it wasn't necessarily the pvfs2-chmod command itself that broke it the first time though
04:12PM 
pcarns
 the error was server side- any setattr could have done it
robl
 pcarns: and  pvfs2-ls -al would certainly hang if dfile and distro are zeroed out
 SWAP: Window 3 is not hidden!
 pcarns 
~pcarns@adsl-209-12-241.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
Netjoined: 
57irc.freenode.net brown.freenode.net
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-224-172.aep.bellsouth.net
 has joined #pvfs2
10:10AM 
slang
 pcarns: hi
10:10AM 
pcarns
10:11AM 
slang
 pcarns: wanted to ask you a quick question, what are the setparam requests that happen every second?
10:11AM 
pcarns
 every second?
10:11AM 
slang
 yeah
10:11AM 
pcarns
 when the server is idle?
10:11AM 
slang
 appears to be on a second interval
10:11AM 
slang
 yes
10:12AM 
pcarns
 there is a state machine running (gets started in servers main()) that rotates performance counters and stuff like that, I don't think it should show up as a setparam, though
10:12AM 
slang
 hmm
10:13AM 
slang
 its getting logged as mgmt_setparam:do_work
10:13AM 
slang
 I think the do_work is from another state though
10:13AM 
slang
 err... state machine
10:13AM 
slang
 a nested machine possibly
10:14AM 
pcarns
 ah, there are actually two constantly running sm's
10:14AM 
pcarns
 neither should have that name though, IIRC
10:14AM 
pcarns
 look for hte  server_state_machine_start_noreq() calls in pvfs2-server.c
10:14AM 
slang
10:14AM 
pcarns
 those are kicking off those state machines, one for perf updates, and one for job timers
10:14AM 
slang
 maybe my operation index->name mapping is off
10:17AM 
slang
 so all the requests from clients are handled in main with the server_state_machine_start
10:17AM 
slang
 call
10:17AM 
slang
10:18AM 
pcarns
 yeah
10:18AM 
pcarns
 when it gets unexpected bmi requests
10:18AM 
pcarns
 the _noreq flavor of that function is to kick off state machines that didn't originate from a bmi request
10:20AM 
slang
 is it used for anything else besides perf updates and job timers at present?
10:21AM 
pcarns
 not that I know of, but you might want to grep around to make sure
10:21AM 
slang
10:21AM 
slang
 pcarns: cool thanks
10:21AM 
pcarns
 those state machines don't have the usual server state log macros in them, because it makes the output too noisy
10:21AM 
slang
 right
10:22AM 
pcarns
 you maybe could set a flag or something during the _noreq call that turns them off it becomes automatic
10:22AM 
slang
 well - with the log macros happening outside..right
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-224-172.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
01:31PM 
elliot
 "Moderate alcohol consumption, described by Dr. Longwell as "enough booze to get her to say yes," does not inhibit rabbitrol's performance"
01:31PM 
elliot
 grr...wrong window
robl
 elliot: heh. happens to all of us
01:34PM 
53elliot
 robl: so want to take at my pvfs2 problems?
robl
 elliot: hey, it sounds like phil found the problem for your file system, right? at this point (since the dfile_count and dist_size are zero) you'll have to rebuild pvfs2
01:34PM 
elliot
 he said thats fixed in cvs right?
01:35PM 
pcarns
 maybe you could use that pvfs2-remove-object to snipe out the busted meta file without rebuilding?
01:35PM 
pcarns
 I don't think its in cvs
robl
 it is now
robl
 (like just 30 seconds ago now)
01:36PM 
pcarns
 ah ;)
01:38PM 
53pcarns
 robl: don't forget the flowproto bytemax fix if you happen to get into a cvs fixin' mood
01:38PM 
53pcarns
 robl: that particular one I don't have checked into any of my stuff either, so its not really recorded except for in that email
robl
 pcarns: huh. i think i did that already
robl
 nope, guess not
robl
 wierd
01:45PM 
pcarns
 mm, yeah, I don't think its in there
01:45PM 
pcarns
 the change to make MAX_REGIONS match romio is in there, though
robl
 pcarns: i don't understand it well enough to make a menaningful changelog
robl
 "reflect work we've already done on a request" ?
50* 
57robl 
goes with that
robl
 pcarns: just have two insure patches you sent back in feburary that i need to understand before committing.
01:48PM 
pcarns
 yeah, pretty much
01:49PM 
53pcarns
 robl: those still aren't very high priority, IIRC, since they weren't really the result of observed bugs
01:49PM 
53pcarns
 robl, or maybe the one dealing with locking might be interesting
robl
 pcarns: yeah, i committed all the boring ones already
01:50PM 
53pcarns
 robl: if it helps any, we have been running with those patches in place since then without any obvious side effects
01:50PM 
53pcarns
 robl: but just in testing and such, not much production beat-down
01:51PM 
53pcarns
 robl: I never did come back and finish "insuring" the code, too many more obvious tasks to worry about
01:52PM 
53pcarns
 robl: but one day I shall return
robl
 pcarns: that's cool. it's definitely more important to get the acxiom code contribution policy squared away
01:56PM 
53pcarns
 robl: my boss is trying hard to get it squared away, we talked about it the other day and he is putting priority on it as best he can
01:57PM 
pcarns
 you guys will get a patch avalanche sooner or later, we've been doing some fairly substantial correctness testing and production polish
robl
 pcarns: heh. can't handle an avalanche just yet. getting there
01:58PM 
53pcarns
 robl: thanks for dropping those in the tree!
02:00PM 
pcarns
 hopefully the approval process will be pretty lightweight here in the end, or else we won't be able to output in an avalanche anyway
 pcarns 
~pcarns@adsl-215-224-172.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
Netjoined: 
57irc.freenode.net brown.freenode.net
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
02:51PM 
elliot
 anyone around?
robl
 elliot: hi
02:55PM 
elliot
 when trying to build from cvs it isn't building pvfs2-client and pvfs2-client-core
02:55PM 
elliot
 everything else seems to be there
robl
 elliot: we had to make a small change to help out the cross-compile situations
robl
 elliot: pvfs2-client and pvfs2-client-core are part of 'make kmod' and 'make kmod24'
04:30PM 
53elliot
 robl: make doesn't respect a DESTDIR variable for kmod_install
robl
 yeah... just prefix for pvfs2-client-core and pvfs2-client.  hm
robl
 elliot: looking for a way to install the kernel module somewhere else?
04:33PM 
elliot
 no, just packaging things, which requires installing things into a destdir
robl
 elliot: looks like in that case  you could set the KMOD_DIR to something
robl
 elliot: ok, yeah.. we probably need to do a bit of work to be packager friendly
04:34PM 
elliot
 everything else seems to work except for that and there are a couple of files that end up with the wrong paths in them
robl
 which files?
04:50PM 
elliot
 pvfs2-server.rc
04:52PM 
elliot
 thats really the only one that i have found
06:20PM 
elliot
 anyone around?
06:20PM 
elliot
 [root@compute-0-0 root]# mount -t pvfs2 tcp://controller-0:3334/data /mnt/pvfs2/mount: Protocol not supported
06:25PM 
elliot
 nevermind...needed to restart the servers
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
56kraken_ 
36~kraken@24.144.40.22
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-228-78.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 kraken_ 
~kraken@24.144.40.22
 has left #pvfs2 
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.cpe.ga.charter.com
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
 pcarns 
~pcarns@adsl-215-228-78.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
56Jeff_Layton 
36~chatzilla@66.239.25.73.ptr.us.xo.net
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3602:19pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net brown.freenode.net
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-228-78.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57Jeff_Layton
: #pvfs2 
"no reason"
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-228-78.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36~pcarns@adsl-215-228-78.aep.bellsouth.net
 has joined #pvfs2
56Jeff_Layton 
36~chatzilla@63.80.253.131
 has joined #pvfs2
SignOff 
57Jeff_Layton
: #pvfs2 
"no reason"
56Jeff_Layton 
36~chatzilla@66.239.25.72.ptr.us.xo.net
 has joined #pvfs2
56yftty 
36~yf@221.216.130.169
 has joined #pvfs2
SignOff 
57Jeff_Layton
: #pvfs2 
Read error: 110 (Connection timed out)
56Jeff_Layton 
36~chatzilla@66.239.25.72.ptr.us.xo.net
 has joined #pvfs2
SignOff 
57Jeff_Layton
: #pvfs2 
Read error: 145 (Connection timed out)
56Jeff_Layton 
36~chatzilla@66.239.25.72.ptr.us.xo.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-228-78.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57Jeff_Layton
: #pvfs2 
"no reason"
56Jeff_Layton 
36~chatzilla@63.80.253.131
 has joined #pvfs2
 yftty 
~yf@221.216.130.169
 has left #pvfs2 
 Ignoring QUITS from parts!*@*
BitchX
: You must specify one of the following:
 	ALL MSGS PUBLIC WALLS WALLOPS INVITES NOTICES NOTES CTCPS CDCC KICKS MODES SMODES JOINS TOPICS QUITS PARTS NICKS PONGS SQUITS CRAP NONE
 Ignoring JOINS from #pvfs2
 Ignoring PARTS from #pvfs2
 Ignoring QUITS from #pvfs2
 SWAP: Window 3 is not hidden!
53#pvfs2     
57pcarns    
36G   
~pcarns
adsl-215-228-78.aep.bellsouth.net (gaim)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
 SWAP: Window 3 is not hidden!
Netjoined: 
57irc.freenode.net brown.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
03:23PM 
53kraken
 robl: so the note on pvfs-users is one of our users who is a huge pain in the butt
robl
 kraken: horray for end-uers!
robl
 kraken: it sounds like he's been back and fort with you a few times 
03:25PM 
kraken
 yeah
03:25PM 
kraken
 someone was asking about a faster way to copy files than cp, and I mentioned using dd with a large blocksize
03:26PM 
kraken
 and he posted this big long missive about how he "doesn't trust that Linux dd"
03:26PM 
kraken
 he had some crazy-ass piping an awk script to dd example where the output wasn't the  same every time, and claimed that he'd gotten a patch to fix it on Tru64
03:27PM 
kraken
 my thought was, "if it'd shut you up, I'd fake a patch too"
03:27PM 
kraken
03:31PM 
kraken
 I thnk I'm going to reply and mention that the 4 seconds from local disk isn't realistic since he'd just copied it to local disk and it was in cache
robl
 how big is this file?
03:32PM 
kraken
 he's never said
03:33PM 
kraken
 I maintain that any file that's so big you can't just copy it locally, you shouldn't be running diff on anyway
03:34PM 
kraken
 I like how he says he "has" to use a Linux system.  he's such a tru64 bigot :)
robl
 gotta hold onto those 64 bit big endian systems while they still run
robl
 wait, alpha is LE
robl
 ok, nevermind
robl
 kraken: thanks for fielding that one
04:28PM 
kraken
robl
 hm. did anybody ever respond to that guy who was running pvfs2 on a raw device?
robl
 how did that ever work?
04:38PM 
kraken
 sounded kinda crazy to me
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 drat. where'd phil go?
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-69.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 kraken: i've got this one
robl
 kraken: apps guys are kinda funny when they talk with systems software folks.  the two worlds see things just differently enough to be humorous
09:05AM 
kraken
 heh
09:06AM 
kraken
 so I saw that LANL is going to be part privately-run now
09:14AM 
pcarns
 whoa- I just looked on news.google for information on that (LANL), looks like things are getting rough and tumble out there:
09:14AM 
pcarns
 http://www.kobtv.com/index.cfm?viewer=storyviewer&id=19678
09:15AM 
kraken
 I heard a story on NPR a few days ago
09:16AM 
kraken
 wow, that story is scary
robl
 wow
BitchX
: Unknown command: WOH
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-69.aep.bellsouth.net (gaim)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 elliot: hey, i've got a way to make 'make kmod_install' packager-friendly
robl
 elliot: you ok with something like "make kmod_path=/blah/blah/blah" kmod_install ?
robl
 elliot: even though lars already responded there's still time to put your 2 cents in if you've got comments
04:12PM 
53elliot
 robl: how about make DESTDIR=/blah/blah/blah kmod_install
04:15PM 
elliot
 ooo....lightning
robl
 i guess that's a bit more standard
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
robl
 elliot: hey, i can't convinc myself that DESTDIR is any better than kmod_dir if nothing else honors DESTDIR
07:35PM 
53elliot
 robl: you could fix that everywhere else as well :)
10:16AM 
kraken
 pcarns: you and david are patching fools these days :)
robl
 yeah, i just might make pcarns take back his cvs commit privs :>
robl
 i wonder if we'll ever do another pvfs1 release
10:35AM 
pcarns
 phhh
10:35AM 
pcarns
 you ain't seen nothing yet
10:37AM 
53pcarns
 robl: at least the pvfs1 patches will be archived on the list in case any other lost souls are dragging it along in production
robl
 pcarns: what does [associate:artf11671] mean in your changesets?
10:51AM 
pcarns
 oh, that's a special tag we use to automagically associate commit sets our tasks lists here
10:51AM 
pcarns
 we use sourceforge enterprise- has bug trackers and task lists built in
10:51AM 
pcarns
 and integrates with cvs 
10:52AM 
pcarns
 so for anyone besides us it is pretty much garbage :)
11:02AM 
kraken
 I'm just amazed that we've already broken 10k artifacts :)
11:03AM 
pcarns
 kraken: I hope VA used big integers for those things :)
robl
 32 bits is enoguh for anyone!
robl
 pcarns: hey, can you tell me more about the setattr patch (kernel side)
robl
 pcarns: i don't see how convert_attribute_mode_to_pvfs_sys_attr modifies anyting
robl
 pcarns: to my eye it looks like it's read-only
robl
 (probably lunchtime)
11:13AM 
pcarns
 ok, I think the code path goes something like this:
11:14AM 
pcarns
 pvfs2_inode_setattr() is called, and it has an inode filled in with whatever attributes it thinks should be pushed to disk
11:14AM 
pcarns
 it calls copy_attributes_from_inode() to copy those attributes into a PVFS2 specific upcall
11:14AM 
pcarns
 copy_attribute_from_inode() calls convert_attribute_mode_to_pvfs_sys_attr()
11:15AM 
pcarns
 the latter is in turn responsible for setting the attribute mask in the setattr upcall that gets shipped off to pvfs2 by the client daemon
robl
 so you end up with an attr->objtype that might not be correct?
11:17AM 
pcarns
 I think the patch effects what it puts in the objtype field and what it puts in the attr mask,
11:17AM 
pcarns
 the objtype shouldn't be set ever really,
robl
11:18AM 
pcarns
 oh yeah, sorry, I got ahead of myself, I guess that's all the function did is set the obj type and the mask to go along with it
11:18AM 
pcarns
 but the point is still the same; it can't really be allowed to change that on setattr
robl
 ok, i think i get it
11:19AM 
pcarns
 these things have been happening (thus far) to always overwrite with the same value (so no blood no foul) but it gives me the jeebies
11:19AM 
pcarns
 if a client's inode cache gets out of whack with that's actually on the server (due to a race with another client) you could have big trouble
robl
 makes sense
robl
 pcarns: also, i don't like leaving commented-out code around, so i'm just leaving explanatory comments
11:27AM 
53pcarns
 robl: that's cool- I'm confident in ditching the old code now, just wasn't able to put together a new patch
robl
 excellent
11:31AM 
53pcarns
 robl: I'm about to grab some lunch, but I'll be back shortly
robl
 ultimate soon for us, so that'll work out a-ok
01:20PM 
slang
 valgrind is still showing some memleaks
01:21PM 
slang
 looks like the biggest one is allocation of the server ops for the 50 unexpected requests
01:22PM 
slang
 leaks about 50K
01:22PM 
slang
 is it worth keeping track of the s_op pointers for server shutdown?
01:28PM 
pcarns
 may be a little tricky
01:28PM 
pcarns
 I suspect that if the s_op's actually get used, then they are free'd when the state machine completes
01:29PM 
pcarns
 in state_machine_complete()
01:32PM 
pcarns
 maybe state_machine_complete() and server_post_unexpected_recv() could work together and maintain a linked list or something, so at the end you have a list of the ones that were associated with an unexp recv that never came through
01:33PM 
pcarns
 hopefully its bounded, though (the number of s_ops that could be leaked at the end)
01:39PM 
kraken
 is there a max number of outstanding unexp recvs that can be pending at one time?
01:42PM 
pcarns
 I think the "UnexpectedRequests" field in the config sets the max
01:43PM 
pcarns
 its 50 by default
robl
 kraken: yeah, what phil said
01:43PM 
pcarns
 but I haven't looked at the logic in a long time to confirm
robl
 pcarns: looks like it still holds
robl
 pvfs2-genconfig creates a config file with 50 unexpected requests
02:01PM 
slang
 pcarns: its not a huge deal since the leak is constant over the lifetime of the server process
robl
 i'd put it low on the list but it'd be nice to have valgrind run w/o any errors
02:02PM 
slang
 true
02:04PM 
slang
 ==9894== 20 bytes in 1 blocks are definitely lost in loss record 7 of 25
02:04PM 
slang
 ==9894==    at 0x1B90459D: malloc (vg_replace_malloc.c:130)
02:04PM 
slang
 ==9894==    by 0x806753E: __job_time_mgr_add (job-time-mgr.c:126)
02:04PM 
slang
 ==9894==    by 0x8067676: job_time_mgr_add (job-time-mgr.c:171)
02:04PM 
slang
 ==9894==    by 0x8075FFA: io_start_flow (io.sm:241)
02:04PM 
slang
 ==9894==    by 0x8054388: PINT_state_machine_next (state-machine-fns.h:140)
02:04PM 
slang
 ==9894==    by 0x8051DE2: main (pvfs2-server.c:360)
02:04PM 
slang
 ==9894==
02:04PM 
slang
 ==9894==
02:04PM 
slang
 ==9894== 54 bytes in 1 blocks are definitely lost in loss record 13 of 25
02:04PM 
slang
 ==9894==    at 0x1B90459D: malloc (vg_replace_malloc.c:130)
02:04PM 
slang
 ==9894==    by 0x1BA8E08F: strdup (in /lib/tls/libc-2.3.2.so)
02:04PM 
slang
 ==9894==    by 0x808DB59: dbpf_attr_cache_do_initialize (dbpf-attr-cache.c:86)
02:05PM 
slang
 ==9894==    by 0x80923A2: dbpf_collection_setinfo (dbpf-mgmt.c:154)
02:05PM 
slang
 ==9894==    by 0x8068BEE: trove_collection_setinfo (trove.c:885)
02:05PM 
slang
 ==9894==    by 0x8052A97: server_initialize_subsystems (pvfs2-server.c:759)
02:05PM 
slang
 ==9894==    by 0x805212C: server_initialize (pvfs2-server.c:449)
02:05PM 
slang
 ==9894==    by 0x8051C4E: main (pvfs2-server.c:251)
02:05PM 
slang
 ==9894==
02:05PM 
slang
 ==9894==
02:05PM 
slang
 ==9894== 64 bytes in 3 blocks are definitely lost in loss record 14 of 25
02:05PM 
slang
 ==9894==    at 0x1B90459D: malloc (vg_replace_malloc.c:130)
02:05PM 
slang
 ==9894==    by 0x808E6BB: dbpf_attr_cache_elem_set_data_based_on_key (dbpf-attr-ca
02:05PM 
slang
 che.c:448)
02:05PM 
slang
 ==9894==    by 0x808C9B2: dbpf_keyval_read_op_svc (dbpf-keyval.c:139)
02:05PM 
slang
 ==9894==    by 0x8091F28: dbpf_do_one_work_cycle (dbpf-thread.c:172)
02:05PM 
slang
 ==9894==    by 0x8091DB4: dbpf_thread_function (dbpf-thread.c:91)
02:05PM 
slang
 ==9894==    by 0x1B925B62: start_thread (in /lib/tls/libpthread-0.60.so)
02:05PM 
slang
 ==9894==    by 0x1BAEE189: clone (in /lib/tls/libc-2.3.2.so)
02:05PM 
slang
 ==9894==
02:05PM 
slang
 ==9894==
02:05PM 
slang
 ==9894== 340 bytes in 5 blocks are possibly lost in loss record 18 of 25
02:05PM 
slang
 ==9894==    at 0x1B904F75: calloc (vg_replace_malloc.c:175)
02:05PM 
slang
 ==9894==    by 0x1B8F2588: (within /lib/ld-2.3.2.so)
02:05PM 
slang
 ==9894==    by 0x1B8F285B: _dl_allocate_tls (in /lib/ld-2.3.2.so)
02:05PM 
slang
 ==9894==    by 0x1B92624A: allocate_stack (in /lib/tls/libpthread-0.60.so)
02:05PM 
slang
 ==9894==    by 0x1B925C54: pthread_create@@GLIBC_2.1 (in /lib/tls/libpthread-0.60.so)
02:06PM 
slang
 ==9894==    by 0x8091BC8: dbpf_thread_initialize (dbpf-thread.c:43)
02:06PM 
slang
 ==9894==    by 0x8092641: dbpf_initialize (dbpf-mgmt.c:295)
02:06PM 
slang
 ==9894==    by 0x8067AF2: trove_initialize (trove-mgmt.c:77)
02:06PM 
slang
 ==9894==    by 0x805250E: server_initialize_subsystems (pvfs2-server.c:617)
02:06PM 
slang
 ==9894==    by 0x805212C: server_initialize (pvfs2-server.c:449)
02:06PM 
slang
 ==9894==    by 0x8051C4E: main (pvfs2-server.c:251)
02:06PM 
slang
 ==9894==
02:06PM 
slang
 ==9894==
02:06PM 
slang
 ==9894== 47600 bytes in 50 blocks are definitely lost in loss record 25 of 25
02:06PM 
slang
 ==9894==    at 0x1B90459D: malloc (vg_replace_malloc.c:130)
02:06PM 
slang
 ==9894==    by 0x80538F6: server_post_unexpected_recv (pvfs2-server.c:1247)
02:06PM 
slang
 ==9894==    by 0x8051D69: main (pvfs2-server.c:376)
02:06PM 
slang
 ==9894==
02:06PM 
slang
 that's the complete list
02:07PM 
slang
 sounds like irc rate-limits my inputs so that paste was really painful for everyone
02:07PM 
slang
 sorry about that
02:08PM 
pcarns
 slang: no problem- more dramatic/suspenseful that way ;-)
02:09PM 
slang
 pcarns: heh
02:13PM 
kraken
 pcarns: it should be fixed now
robl
 it's nice to see some traffic in #pvfs2 at least
02:14PM 
pcarns
 kraken: thanks!
robl
 pcarns: heh, i just noticed you stuffed a real copyright symbol in the file
robl
 pcarns: how'd you do that?
50* 
57robl 
doesn't know how to do anything more complicated than (C)
02:17PM 
pcarns
 I have no idea- just cut 'n paste
02:17PM 
pcarns
 some guy figured it out in the 60s and everyone has cut and pasted since
robl
 yeah, probably :>
02:25PM 
slang
 programmers cared about copyrights in the 60s? ;-)
robl
 pcarns: ok, there you go.  a one-day turnaround instead of 4 months like last time :>
robl
 pcarns: we've definitely had at least one user ask about how we handle secondary groups, so thanks for kicking that out!
02:33PM 
53pcarns
 robl: woohoo! thanks for merging those in
robl
 slang: http://www-unix.mcs.anl.gov/~robl/pvfs2/benchmarking/mpi-io-test.txt
robl
 slang: on jazz: ~robl/bin/my_emerge is my "update pvfs2 and mpich2, build the whole mess, and install it"
robl
 slang: color cvs is in ~robl/bin, on any system i've got an acct
03:10PM 
53slang
 robl: cool thanks
03:12PM 
slang
 all the test programs get installed in <prefix>/bin
03:12PM 
slang
 would it make sense to put them in <prefix>/test?
robl
 i'd go along with that, sure
robl
 pcarns: hey, do you have an answer for http://www.parl.clemson.edu/pipermail/pvfs2-developers/2005-March/001106.html ?
03:20PM 
53pcarns
 robl: eek- march 10- think he still needs an answer?
03:22PM 
53pcarns
 robl: not sure what he means by contents, bmi header? request protocol?  encoder stuff?
robl
 pcarns: yeah, i was ondering if he wanted tcpdump output or something like that?
03:24PM 
53pcarns
 robl: I have no idea, maybe get him to be more specific what the problem is?
03:24PM 
pcarns
 he's writing his own bmi module- he shouldn't really care what the payload is as long as his module works...
robl
 ==14734== LEAK SUMMARY:
robl
 ==14734==    definitely lost: 0 bytes in 0 blocks.
robl
 ==14734==      possibly lost: 0 bytes in 0 blocks.
robl
 that's nice to see
04:44PM 
53slang
 robl: woo!
robl
 (that's client side, btw)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3606:52pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
09:19AM 
55pcarns
35~pcarns@adsl-218-106-58.asm.bellsouth.net
50)]
 hey rob, you in yet this morning?
09:20AM 
55pcarns
35~pcarns@adsl-218-106-58.asm.bellsouth.net
50)]
 ping me when you get a chance- I need to get a feel for when you guys want to cut a final release
09:20AM 
55pcarns
35~pcarns@adsl-218-106-58.asm.bellsouth.net
50)]
 we may be able to get a couple more patches out, depending
10:02AM 
53pcarns
 robl: so I think there is actually still a permission bug in the current cvs snapshot
10:02AM 
53pcarns
 robl: I don't _think_ I introduced it, maybe just didn't notice it was there before
10:02AM 
pcarns
 to recreate:
10:02AM 
pcarns
 (through vfs)
10:03AM 
pcarns
 1) create a file as one user
10:03AM 
pcarns
 2) change the group to a non-primary group
10:03AM 
pcarns
 3) set permissions to turn off read for user and group, but turn on read for other
10:04AM 
pcarns
 4) try to access the file as another user who also doesn't have that primary group
10:04AM 
pcarns
 you get permission denied, despite the o+r
10:05AM 
pcarns
 but from what I can tell, seems to be something wrong on client side; server never denies permission
robl
 pcarns: we've always had issues with secondary groups
robl
 pcarns: your patches improve the situation, but it sounds like there's a little more tweaking we need to do
10:06AM 
53pcarns
 robl: could be
10:07AM 
53pcarns
 robl: something may have been coded on the client to balk at non-primary groups and I just missed it before
10:08AM 
53pcarns
 robl: ahh, more clues- this bug isn't present when using admin utilities
10:08AM 
53pcarns
 robl: must be something in the kernel module
10:08AM 
pcarns
 or pvfs2-client
10:09AM 
53pcarns
 robl: I'm going to double check and make sure this happens the same way in our tree
robl
 pcarns: huh. WORKSFORME
robl
 [joetest2@gil foodir]$ id
robl
 uid=503(joetest2) gid=503(joetest2) groups=503(joetest2) context=user_u:system_r:unconfined_t
robl
 [joetest2@gil foodir]$ ls -l testfile
robl
 --w----r--  1 robl users 23 Jun  9 10:13 testfile
robl
 [joetest2@gil foodir]$ cat testfile
robl
 here is some test data
10:20AM 
pcarns
 whoa, weird
10:21AM 
50* 
53pcarns/#pvfs2 
thinks his laptop needs more coffee
10:22AM 
pcarns
 I assume that you can also cat it as robl, right?
robl
 pcarns: i cannot
robl
 pcarns: because it's o-r
robl
 pcarns: that's true for both pvfs2 and ext3
robl
 "er, user -r
robl
 let me try that again
10:26AM 
pcarns
 maybe I just confused myself on permission semantics this morning...
robl
 becasuse it's u-r, i cannot cat the file as robl on either pvfs2 or ext3
robl
 i know it's soemthing we (pvfs2) need to take a very close look at
robl
 this is on a fedora 3 machine
robl
 hardly a trustworthy source for a reference implementation
10:28AM 
pcarns
 crud- the case I outlined originally does the same thing on ext3
10:28AM 
pcarns
 I'm a dingbat
10:29AM 
pcarns
 I guess false alarm on the permission bug (not that there probably aren't others), I just got confused
robl
 that's cool and totally understandable
robl
 we've been saying forever that we need to sit down with whatever "permissions semantics" documents we can find and make sure we follow all the rules.. but of course it's a low-priority issue
10:33AM 
pcarns
 so probably the biggest problem at this point is that the client library (and thus admin utilities and mpi-io) probably aren't strict enough
10:34AM 
pcarns
 it looks like the combination of the kernel's permission checking plus the servers's makes things ok through the vfs
robl
 i tend to think that's good enough for now
11:16AM 
pcarns
 I think I'm going to send an email to the list about that permissions issue, I see roughly where its going amiss
11:16AM 
pcarns
 maybe someone will look at it
11:17AM 
pcarns
 the same basic flaw was in old code and I continued it in my patch
11:17AM 
rross
 pcarns: can you recap for us late-comers?
11:18AM 
pcarns
 rross: realized something is still up with permissions this morning (after getting myself and anyone listening to me confused for a bit),
11:19AM 
pcarns
 rross: the new permissions stuff is still not restrictive enough,
11:19AM 
pcarns
 rross: but you can't tell through vfs, because it adds its own permission checking and gets it right,
11:19AM 
rross
 ah.  what specifically isn't being enforced?
11:20AM 
pcarns
 rross: problem is that both the old code and the new code keeps dropping through each level of permission bits (user, group, other) trying to find one that allows the access you want,
11:20AM 
pcarns
 when really, for example, if the uid matches, but the group read bit is not set, then read access should be denied- no matter what the other bits are
11:20AM 
pcarns
 this page explains in simple terms:
11:20AM 
rross
 gotcha
11:20AM 
pcarns
 http://www.ientry.com/oracle_ad.html
11:21AM 
pcarns
 whoops I said wrong: "group read bit" -> "user read bit"
11:21AM 
rross
 ok.  i don't think that this should be something that we worry about fixing for this release.
11:22AM 
pcarns
 I think robl was of the same opinion
11:22AM 
pcarns
 good news is that I don't know of anything off when you go through the kernel
11:22AM 
pcarns
 its just that in some odd cases the admin utilities or library will let you bypass when it shouldn't
robl
 well it's bug 68 now
11:25AM 
rross
 cool.
11:25AM 
pcarns
 I'll record it here too, but we likewise probably have more pressing priorities
11:26AM 
rross
 is there anything left that is a real show-stopper?
robl
 haven't found anything today yet
11:27AM 
pcarns
 my testing looks ok
11:28AM 
pcarns
 rross: I was telling robl that's all the patches coming from us for this release
11:28AM 
rross
robl
 rross: and also told phil that we're going to try for monthly releases
11:29AM 
pcarns
 thats good news for us
11:29AM 
pcarns
 we'll have some more contributions for the next release, and they won't be so last minute next time :)
robl
 rross: we pass pvfs2-shelltest on gil, for what that's worth
robl
 lunch train. choo choo
11:36AM 
rross
 pcarns: sounds good :)
11:37AM 
rross
 lunch it is.
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:33pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3610:43pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
 #pvfs2  There isn't a topic.
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 huh. where'd our topic go?
 Topic 
36#pvfs2
50):
 changed by 
36robl
 pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html
05:46PM 
elliot_
 anyone around that could help with building mpich2
robl
 elliot: perhaps i can. what's up?
10:47PM 
53elliot
 robl: i keep getting errors like this one when trying to build without enabling any of the extra features
10:47PM 
elliot
 icc -DHAVE_CONFIG_H -I. -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll -I../../../../include -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/include -O2 -march=i686 -g -I/home/elliot/conary/build/mpich2/mpich2-1.0.2src/mpid/common/sock/poll   -c sock.c
10:47PM 
elliot
 sock.c(8): catastrophic error: could not open source file "mpidu_sock.h"
10:47PM 
elliot
   #include "mpidu_sock.h"
10:47PM 
elliot
 this include file is part of mpich2 so the make file should be taking care of seting the correct include paths
10:48PM 
elliot
 s/include file/header file/
robl
 hm.  looks like it should be including /home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/, and not /home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll
robl
 drop a mail to mpich2-maint@mcs.anl.gov and one of the mpich2 guys will be able to help out, i'm sure.  me, i've never seen that kind of error before, but i don't use icc ever
12:13AM 
53elliot
 robl: I get the same error using gcc
12:13AM 
elliot
 gcc -DHAVE_CONFIG_H -I. -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/mpid/common/sock/poll -I../../../../include -I/home/elliot/conary/build/mpich2/mpich2-1.0.2/src/include -O2 -march=i686 -g -I/home/elliot/conary/build/mpich2/mpich2-1.0.2src/mpid/common/sock/poll   -c sock.c
12:13AM 
elliot
 sock.c:8:24: mpidu_sock.h: No such file or directory
12:14AM 
elliot
 i'm guessing that someone actualy built this on some platform before releasing it
08:30AM 
53pcarns
 robl: thanks for getting the new release out the door last week!
robl
 elliot: yeah, that doesn't exactly inspire confidence, but i did build (CVS) a day before the release
robl
 pcarns: no problem.  you and the davids did all the work. i was just a patch monkey last week :>
robl
 elliot: wierd man
robl
 elliot: wget, tar, configure, make, and it seems to work for me
robl
 elliot: and my compile line is a jillion time longer than your
robl
  gcc -DHAVE_CONFIG_H -I. -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpi
robl
 d/common/sock/poll -I../../../../include -I/sandbox/robl/build/foodir/mpich2-1.0
robl
 .2/src/include  -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/binding/f77 -I/san
robl
 dbox/robl/build/foodir/mpich2-1.0.2/src/binding/f77 -I/sandbox/robl/build/foodir
robl
 /mpich2-1.0.2/src/mpid/ch3/include -I/sandbox/robl/build/foodir/mpich2-1.0.2/src
robl
 /mpid/ch3/include -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/data
robl
 type -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/datatype -I/sandb
robl
 ox/robl/build/foodir/mpich2-1.0.2/src/mpid/ch3/channels/sock/include -I/sandbox/
robl
 robl/build/foodir/mpich2-1.0.2/src/mpid/ch3/channels/sock/include -I/sandbox/rob
robl
 l/build/foodir/mpich2-1.0.2/src/mpid/common/sock -I/sandbox/robl/build/foodir/mp
robl
 ich2-1.0.2/src/mpid/common/sock -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mp
robl
 id/common/sock/poll -I/sandbox/robl/build/foodir/mpich2-1.0.2/src/mpid/common/so
robl
 ck/poll -c sock.c
robl
 (sorry about that)
09:05AM 
53elliot
 robl: what flags are you passing configure/
09:05AM 
elliot
 s/\//?/
robl
 elliot: nothing
robl
 cflags, ldflags, libs all empty env vars
robl
 (cppflags too)
robl
 i have no idea why you are missing all the ch3, datatype, and channel includes
robl
 i can understand missing the fortran includes if you don't have one installed
robl
 (one == one fortran compiler)
09:09AM 
50* 
53elliot/#pvfs2 
wonders if the configure.in might be broken
09:14AM 
elliot
 i'm running configure with these options and it breaks
09:14AM 
elliot
 ./configure --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/usr/com --mandir=/usr/share/man --infodir=/usr/share/info
09:14AM 
elliot
 CFLAGS="-O2 -march=i686 -g" CXXFLAGS="-O2 -march=i686 -g " CPPFLAGS="" LDFLAGS="-g" CC=gcc CXX=g++ FC=ifort
09:16AM 
53elliot
 robl: if you don't mind could you try to build using those vars and configure options and see if it breaks for you
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:37am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
robl
 elliot: sure will
robl
 elliot: are you building out-of-tree or in-tree
10:07AM 
53elliot
 robl: out of tree
robl
 elliot: ok, cool, i get an error now
robl
 i'm suspecting it's the null CPPFLAGS
robl
 yeah
robl
 that's stupid of us
robl
 when i "unset CPPFLAGS" then i can configure and build
 SWAP: Window 3 is not hidden!
11:43AM 
elliot
 *sigh*
11:59AM 
53elliot
 robl: where in the makefiles/configure is causing the problem?
robl
 elliot: not sure yet
robl
 top-level configure.in always appends to CPPFLAGS
robl
 src/mpid/common/sock does too
03:43PM 
robl_gaim
 (the gaim irc interface is .... bizzare)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-19-120-225.asm.bellsouth.net (gaim)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 huh. i sent a message to pvfs2-devel 4 hours ago and it hasn't shown up yet
02:23PM 
53pcarns
 robl: might have to do with firewall changes down there today
robl
 ah, sure. ok
02:33PM 
pcarns
 I have no idea how that's going
02:33PM 
pcarns
 Walt may need to know about mailing list problem if it doesn't work out shortly
robl
 there it goes
robl
 yay
robl
 hm. 6pm in ATL
robl
 bet phil's asleep 
robl
 pc: nitpick on post-error.patch
robl
 pc: i'm going to go with "posted_op" instead of 'post_only', since it makes the logic after the switch make more sense to me
robl
 ( if posted_op == 1 && ret < 0 ) ---> we posted the opertaion but it failed immediately
10:20PM 
53elliot
 robl: trying to build mpich2 with romio with pvfs2 support get the following errors/warnings
10:20PM 
elliot
 ad_pvfs_open.c: In function `ADIOI_PVFS_Open':
10:20PM 
elliot
 ad_pvfs_open.c:16: error: variable `pstat' has initializer but incomplete type
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: excess elements in struct initializer
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: (near initialization for `pstat')
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: excess elements in struct initializer
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: (near initialization for `pstat')
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: excess elements in struct initializer
10:20PM 
elliot
 ad_pvfs_open.c:16: warning: (near initialization for `pstat')
10:20PM 
elliot
 ad_pvfs_open.c:16: error: storage size of `pstat' isn't known
10:20PM 
elliot
 ad_pvfs_open.c:26: error: `O_META' undeclared (first use in this function)
10:20PM 
elliot
 ad_pvfs_open.c:26: error: (Each undeclared identifier is reported only once
10:20PM 
elliot
 ad_pvfs_open.c:26: error: for each function it appears in.)
10:25PM 
53elliot
 robl: nevermind....typo in the configure....was trying to build with support for pvfs not pvfs2
robl
 elliot: gar! we should fix that
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3610:39pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net brown.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@connect.utility.freenode
32 requested VERSION  from robl
53#pvfs2     
57pcarns    
36G   
~pcarns
adsl-19-120-225.asm.bellsouth.net (gaim)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
robl
 pcarns: in kernel-revalidation.patch, why do you PVFS2_LOOKUP_LINK_NO_FOLLOW?
robl
 pcarns: i know you're checking out the parent
robl
 i would have thought that if the parrent directory is a symlink you'd want to follow it to the destination?
12:04PM 
53pcarns
 robl: you are doing a lookup from the parent to the child, not the other way around,
12:04PM 
53pcarns
 robl: so the NO_FOLLOW option affects what it does when it hits the child
12:05PM 
53pcarns
 robl: I think it is ok if the child is a symlink, doesn't really matter as long as its there
robl
 pcarns: ah! that makes sense. thanks
12:13PM 
53pcarns
 robl: np
02:39PM 
bradles
 phil
02:39PM 
pcarns
 hey
02:39PM 
pcarns
 bradles: so I am kind of torn about how those client params should work
02:40PM 
bradles
 well I don't even see how they would affect the clients
02:40PM 
pcarns
02:40PM 
bradles
 I mean, clearly you could add proto for them
02:40PM 
pcarns
 the clients pull the config files in their entirety from servers and parse them
02:40PM 
bradles
 but, yuck
02:40PM 
bradles
 how bout that
02:40PM 
pcarns
 the getconfig request already grabs the whole shebang
02:40PM 
bradles
 live and learn
02:41PM 
bradles
 so yea, stick em in there then
02:41PM 
pcarns
 if you really want to be afraid, look at how clients write those config files out in /tmp then parse them in and delete them :)
02:41PM 
bradles
 oh yeah -- that does suck
02:42PM 
bradles
 oh well
02:42PM 
pcarns
 the dotconf parser doesn't have hooks to operate on mem buf instead of fd, should probably fix one day
02:42PM 
bradles
 heh, I had assumed it was xml until yesterday
02:42PM 
pcarns
 doesn't seem like it would be that hard, but then again, hasn't really seemed to be a problem for anyone
02:43PM 
bradles
 yea, diskless clients suck :)
02:43PM 
bradles
 we're still playing the game over who reigns supreme on options tho
02:43PM 
bradles
 right now, romio is getting the last word on dfile entries
02:44PM 
bradles
 maybe hints continue to reign supreme
02:44PM 
pcarns
 hehehe - add a new "TrumpCard" option to config file
02:44PM 
bradles
 followed by config files
02:44PM 
bradles
 yeah
02:44PM 
bradles
 followed by code
02:44PM 
pcarns
 yeah, I generally tend to lean towards runtime options always winning over config files
02:45PM 
bradles
 sure
02:45PM 
bradles
 (tho there may be fairshare issues to consider on some options)
02:45PM 
bradles
 client retry limit pops to mind
02:46PM 
bradles
 and should default to 1
02:46PM 
bradles
 but I digress
02:46PM 
bradles
 actually should default 0
02:46PM 
pcarns
 for retries?
02:46PM 
bradles
 in my opinion
02:46PM 
bradles
 but no biggie -- they are off in my tree
02:47PM 
pcarns
 not all of us have redundancy in our tree- we like to retry :)
02:47PM 
bradles
 perhaps
02:47PM 
pcarns
 its actually handy to be able to get through server restarts, failovers, switch reboots, ...
02:48PM 
bradles
 well that is how I think of that mechanism
02:48PM 
pcarns
 but at least when its a config option everyone will get to have their way
02:48PM 
bradles
 once failover is there
02:48PM 
bradles
 then retries get cool
02:48PM 
bradles
 but I suppose ofr other transient errors they are ok
02:48PM 
bradles
02:48PM 
bradles
 I'm cool with doing the dist stuff
02:48PM 
bradles
 it will be like this I think:
02:50PM 
bradles
 <dist>
02:50PM 
bradles
   <simple_stripe>
02:50PM 
bradles
      param stuff
02:50PM 
bradles
   <simple_whatever>
02:50PM 
bradles
     param stuff
02:50PM 
bradles
 </dist>
02:50PM 
bradles
 <default_dist>
02:50PM 
bradles
   simple_Stripe
02:50PM 
bradles
 </default_dist>
02:50PM 
bradles
 <filesystem>
02:50PM 
bradles
   default_num_dfiles x
02:50PM 
bradles
 </filesystem>
02:50PM 
bradles
 obviously changed to however we spell stuff (humpltyback, etc)
02:51PM 
bradles
 cool?
02:53PM 
pcarns
 are you comfortable with the parser (server-config.c) needing to know names of supported dists?
02:53PM 
pcarns
 I guess really there aren't ever going to be all that many
02:53PM 
bradles
 oh, the parser would have to know the names in that case?
02:53PM 
bradles
 screw that
02:54PM 
pcarns
 beyond that looks good, though you will probably need to end sections for dists, (ala </simple_stripe>
02:54PM 
bradles
 I'll figure out a way of avoinding that
02:54PM 
bradles
 I've got all the names in strings
02:54PM 
bradles
 I assumed I could hunt them down
02:54PM 
pcarns
 you could just give those sections a generic name, then have a param that says name
02:54PM 
pcarns
 like the FileSystem block
02:54PM 
bradles
 yeah, that will probably do
02:54PM 
bradles
 no way am I putting names in the parser
02:55PM 
bradles
 I may actually want to use this someday :)
02:55PM 
pcarns
 it just has a <FileSystem> followed by "Name foo"
02:55PM 
pcarns
 heh, ok
02:55PM 
pcarns
 yeah, the keyword (first word on line) has to be known by parser so it knows what to do when it encounters it
02:55PM 
bradles
 yeah, maybe multiple dist sections?
02:55PM 
pcarns
 beyond that it is free reign- you can pull value in as string and just chunk it somewhere
02:55PM 
bradles
 is that kosher
02:55PM 
pcarns
 yeah
02:56PM 
bradles
 yep, then that will be fine
02:56PM 
bradles
 <dist>
02:56PM 
bradles
   name simple_stripe
02:56PM 
bradles
   ...
02:56PM 
bradles
 good, now no one touches my dist code
02:56PM 
pcarns
02:56PM 
bradles
 my precious
02:57PM 
bradles
 (and I can make sure it really works )
02:57PM 
bradles
 alright
02:57PM 
bradles
 later
02:57PM 
pcarns
 sweet
02:58PM 
pcarns
 I'll wait a few days for everyone's 2c, then start on the other config options if no objections
02:59PM 
53pcarns
 robl: we have rest of our patches (lower priority ones) generated now, I suspect we can unload them maybe in a week or so
03:00PM 
bradles
 oh wait
03:00PM 
bradles
 there is an annoying catch
03:00PM 
bradles
 types
03:00PM 
bradles
 uggh
03:00PM 
pcarns
 you mean types on the way into dist interface?
03:00PM 
bradles
 maybe I should stick type information in the distribution, and then cast with a macro
03:00PM 
bradles
 uggh
03:00PM 
bradles
 yeah
03:01PM 
pcarns
 maybe let them ride as strings into dist functions?
03:01PM 
pcarns
 and do appropriate sscanf in each dist?
03:01PM 
bradles
 oh yeah, thats not bad
03:01PM 
pcarns
 instead of working type out outside?
03:01PM 
bradles
 I have the info (for encoding) anyway
03:02PM 
pcarns
 that actually hit me the other day after robr asked something on the list about the strip_size type problem
03:02PM 
bradles
 can sscanf core dump?
03:02PM 
pcarns
 but I forgot to email again
03:02PM 
bradles
 that would be my only serious concern
03:02PM 
pcarns
 core dump?
03:02PM 
pcarns
 I guess if it gets a string pointing at a not-happy memory location
03:03PM 
bradles
 yeah, if I read "xhgrft" into an unsigned int
03:03PM 
pcarns
 oh, no that won't core dump
03:03PM 
bradles
 then this will be safe
03:03PM 
pcarns
 you just need to check return code of sscanf to see how many items matched
03:03PM 
bradles
 yeah, thats no prob
03:03PM 
bradles
 tho now I have to write more dist code (uggh, and a macro at that)
03:03PM 
bradles
 no biggie
03:03PM 
pcarns
 just steer clear of the temptations of atoi and friends ;-)
03:03PM 
bradles
 I'll do it sometime next week
03:04PM 
bradles
 stoll
03:04PM 
bradles
 strtoll
03:04PM 
bradles
 I mean
03:04PM 
pcarns
 hehehe
03:04PM 
pcarns
 those are fun for the whole family
03:04PM 
bradles
 yeah, that sucker is no fun
03:04PM 
pcarns
 like a box of chocolates- never know what you end up with in your memory
03:04PM 
bradles
 I have to write test program every frickin time
03:04PM 
bradles
 the doc for that func is atrocious
03:05PM 
pcarns
 pete added a macro to help with scanf'ing 64 bit integers too
03:05PM 
bradles
 oh, is that hard?
03:05PM 
bradles
 no long long support?
03:05PM 
bradles
 %lld
03:05PM 
bradles
 %llu
03:06PM 
pcarns
 no, its just that scanf doesn't have a native type qualifier for 64 bit int- you just have to know to choose either long or long long depending on whether you have big words or small words on your architecture
03:06PM 
bradles
03:06PM 
pcarns
 so one arch or the other will warn, unless you have a macro that switches the qualifier
03:06PM 
bradles
 all are types are typedef'd from specific lengths I thought int32_t uint64_t
03:06PM 
bradles
 oh yeah
03:06PM 
bradles
 I see the prob
03:06PM 
bradles
 fucking word sizes
03:07PM 
bradles
 excuse my french
03:07PM 
bradles
 (since you left my vocab has taken a distinct downturn)
03:07PM 
pcarns
 hmm, where is that macro, I know I saw it on cvs log...
03:08PM 
pcarns
 that's what happens when clemson fellas go to the big city
03:08PM 
bradles
 Pint_util.h  (please let it be pint-util and not pvfs2-req-proto)
03:08PM 
pcarns
 ah, SCANF_Ld, example is in pvfs2-cp.c now
03:09PM 
bradles
 cool
03:09PM 
pcarns
 its in pvfs2-types.h, the definition
03:09PM 
bradles
 ah, sweet
03:10PM 
bradles
 just the %Ld thing
03:10PM 
bradles
03:11PM 
pcarns
 basically just use SCANF_Ld if you want to read a signed 64 bit int
03:12PM 
pcarns
 need to make a SCANF_Lu if occasion arises to want to scan an unsigned one
03:12PM 
pcarns
 kind of like those Ld(...) and Lu(...) macros in reverse
03:12PM 
bradles
 so now hang on, are you sure that;s portable
03:13PM 
bradles
 what size is a long long on a 64 bit platform
03:13PM 
bradles
 I really have no idea
03:13PM 
pcarns
 i think the choice of types is portable,
03:13PM 
pcarns
 but not so sure that scanf/printf qualifiers are- I don't know if everyone outside of linux handles L or not
03:13PM 
bradles
 but we never use long longs
03:14PM 
bradles
 we use int64_t
03:14PM 
bradles
 scanf uses long longsx
03:14PM 
bradles
 whatever, if it breaks, it will break the same in cp and pete will fix it
03:14PM 
bradles
 or tell me how to fix it
03:15PM 
pcarns
 I think it will be ok
03:15PM 
bradles
 me to
03:15PM 
bradles
 cool
03:15PM 
pcarns
 at any rate, blame it on pw if not ;)
03:16PM 
pcarns
 I don't even have a 64 bit login anywhere that I know of, so I don't see what the hubbub is :)
03:16PM 
pcarns
 always works when I compile...
03:17PM 
bradles
 exactly
03:17PM 
bradles
 32bits should be good enough for anyone
03:17PM 
bradles
 elitist jerks
robl
 holly conversation!
robl
 pcarns: that's cool about the patches. 
03:27PM 
pcarns
 actually, just realized we probably need to get a patch in before any further fiddling with config file options
03:28PM 
pcarns
 cleans up parser, makes it stop on errors, show line numbers, check types....
03:28PM 
pcarns
 I'll get on that
robl
 pcarns: thanks for fielding jonh paris's question
robl
 pcarns: i was still trying to figure out where dfile_count was being set in the kerenel interface :>
09:41AM 
pcarns
 heh- I'll probably get something useful out of it
09:42AM 
pcarns
 I need to figure out how to make small files work better too, so if he does a little testing it will be worth it :)
robl
 pcarns: cool
11:07AM 
53slang
 robl: /var/www/cgi-bin/tinderbox2/processmail_builds
11:07AM 
53slang
 robl: /usr/local/tinderbox2/local_conf/BuildStatus.pm
11:09AM 
53slang
 robl: lain:80/tinderbox2/
02:42PM 
rross
 yeah fake tinderbox!
robl
 rross: hey stranger
02:51PM 
rross
 i'll probably be on here more in the next couple of weeks.
53#pvfs2     
57freat     
36H   
~freat
h-69-3-229-184.chcgilgm.covad.net (ron s)
53#pvfs2     
57bradles   
36G   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57rross     
36H   
~rross
hermit-10.mcs.anl.gov (gaim)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-19-120-225.asm.bellsouth.net (gaim)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
53#pvfs2     
57freat     
36H   
~freat
h-69-3-229-184.chcgilgm.covad.net (ron s)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-19-120-225.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.cpe.ga.charter.com (laytonj)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
11:31AM 
53slang
 robl: www-data:/var/www/cgi-bin/tinderbox2/tinder.cgi
11:59AM 
freat
 hello
11:59AM 
freat
 besides the obviously googlable resources... can anyone point me to some other web resources on getting up to speed on PVFS2?
12:00PM 
freat
 got some university research lining up to implement pvfs2 on a linux cluster...
12:01PM 
freat
 also, I'm in Chicago... any of the Argonne people involved with the project here in Chicago? sure would be cool to get a discussion going as Loyola already has some relationship with Argonne... :)
12:35PM 
slang
 freat: hi - the www.pvfs.org/pvfs2 site is the main area for doc
12:35PM 
slang
 freat: the user and dev mailing lists might have some info for particular questions you have as well
12:39PM 
freat
 slang: thanks
12:39PM 
slang
 freat: I'm not aware of any other web resources .. sorry
12:42PM 
slang
 freat: the main contact at argonne for pvfs2 is rob ross (rross@mcs.anl.gov) -- best to email him with collaboration ideas
02:17PM 
slang
  Failure: lookup returned 376 when it should've returned 376.
02:17PM 
slang
 "that's a funny failure
robl
 slang: someitmes i'll get "0 when should've retured 0", but I don't know how to reprocuce that
53#pvfs2     
57freat     
36H   
~freat
h-69-3-229-184.chcgilgm.covad.net (ron s)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
63.170.133.110 (Rob Latham)
01:47PM 
bradles
 Here is a question for anyone:  why by default do we build with -O2 ?
robl
 bradles: not sure. i don't think anyone has quantitavitvely (too many ts and vs there) studied the effects of various CFLAGS
01:51PM 
bradles
 I believe I recall a day when it was not set, but I cannot be certain
02:11PM 
slang_
 bradles: AC_PROG_CC adds -O2 by default if the compiler is gcc
02:11PM 
slang_
 bradles: adds it to CFLAGS
02:12PM 
slang_
 I'd be game for turning that off actually
02:13PM 
slang_
 bradles: you can get around it by setting CFLAGS=-g before configure
02:15PM 
bradles
 hmm, I may try setting it in my environ then
02:17PM 
slang_
 it makes sense that people will just do ./configure;make;make install so its good to have -O2 for performance, but removing -O2 from CFLAGS is harder than adding it in for the default case
02:18PM 
slang_
 also, --enable-strict seems to be doing strange things (like adding -O2 to CFLAGS so that its there twice)
02:19PM 
slang_
 is that carryover from mpich land?
02:22PM 
slang_
 in any case I don't see how strict debugging should include compiler optimizations
50* 
57robl 
didn't even know pvfs2 /had/ --enable-strict
robl
 heh. the comment says "strict debugging" but we don't pass -g
02:23PM 
53slang_
 robl: right, but its already in CFLAGS anyway
02:24PM 
53slang_
 robl: AC_PROG_CC adds -g to CFLAGS if the compiler supports it
02:24PM 
53slang_
 robl: and then adds -O2 if its gcc..
02:30PM 
bradles
 see, now here is my guess -- you can call me crazy -- the way the mechanism was chosen is someone worked on it, until it compiled.  And then they quit.
02:30PM 
bradles
 no one at any point actually chose the flags that made sense
02:31PM 
bradles
 now I reserve the right to be totally wrong on that
02:39PM 
slang_
 bradles: you're crazy!
02:39PM 
slang_
 bradles: jk ;-)
02:39PM 
slang_
 bradles: I hope that's not how it happened
02:41PM 
slang_
 I can fire off an email to the developer's list with some suggested changes
02:41PM 
slang_
 give everyone something to iterate on
02:42PM 
bradles
 it seems to me you know alot about this stuff, so I defer to your judgement
02:43PM 
bradles
 as long as you don't start moving up the -On ladder
02:43PM 
bradles
 at which point I will curse you
02:43PM 
slang_
 bradles: ah, but you haven't tried -O12 yet have you..
02:43PM 
slang_
 bradles: you don't know what you're missing ;-)
02:43PM 
bradles
 I have not, its true
02:44PM 
bradles
 I would suspect that specifying things like march would give alot more mileage than O2
02:44PM 
freat
 uhhh... I used -03 on my gentoo install and thought that was pushing it
02:45PM 
bradles
 I would rather we explicitly turn inlining on, and O2 off
02:45PM 
bradles
 as I don't think O2 is doing me any favors the rest of the time
robl
 give us another couple weeks and we can get a performance profile of optimized and un-optimized builds
02:46PM 
bradles
 (I know it does, I just don't think modest loop unrolling and reordering is going to gain us that much)
robl
 considering we're usually disk bound, i think we could compile in the stupidest way possible and still be ok
02:47PM 
freat
 yeah but then my cluster of pentium pros would become the bottleneck (jk)
02:47PM 
bradles
 and that we are system call machines
04:06PM 
bradles
 slang_: +1 on your email
09:37AM 
slang_
Netjoined: 
57irc.freenode.net brown.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
03:22PM 
elliot
 anyone around? robl?
robl
 always
robl
 elliot: what's up?
03:27PM 
elliot
 trying to build mpich2 with smpd and for some reason i'm missing smpd_version.h
03:28PM 
elliot
 it doesn't look like it gets generated by anything, at least not in the smpd directory
03:29PM 
elliot
 it is referenced by smpd.h
robl
 that's a bug in the release.  see http://www.mcs.anl.gov/web-mail-archive/lists/mpich-discuss/2005/06/msg00050.html and follow-up messages
04:16PM 
53elliot
 robl: thanks...seems to be working now
robl
 cool. no idea when a new release will come out, so you'll have to remember to make that patch yourself
 Connection closed from solar.clustermonkey.org: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 20000 of server solar.clustermonkey.org [refnum 0]
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Tue Jun 28 10:06:18 2005
56localhost 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Fri Jun 10 10:01:39 2005
52Users
32#pvfs2
50)]
54 localhost 
54 robl_gaim 
54 freat     
54 pcarns    
54ChanServ  
54 slang_    
54 bougyman  
54 elliot    
 Channel #pvfs2 was created at Sun May 22 02:20:25 2005
BitchX
: Join to #pvfs2 was synched in 0.176 secs!!
 robl_gaim 
~robl@crushinator-57.mcs.anl.gov
 has left #pvfs2 
 SWAP: No such window: 4
 SWAP: Window 3 is not hidden!
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
02:21PM 
bradles
 pcarns: is default num dfiles a StorageHint in the config
02:21PM 
bradles
 pcarns: or is it just under filesystem
 SWAP: Window 3 is not hidden!
02:30PM 
pcarns
 bradles: I think under filesystem
02:41PM 
bradles
 cool
02:51PM 
bradles
 pcarns:  If I lookup a fs_config thru the hash in pint_cached_config, should I get the fully loaded config (it doesn't have my new default_num_dfiles struct member :( )
02:52PM 
bradles
 but it does have trove_sync_meta!?
02:55PM 
pcarns
 bradles: I guess so- is the member missing altogether, or it just doesn't have the value in it?
02:56PM 
bradles
 it just doesn't ahve the value
02:56PM 
bradles
 tho it is set
02:57PM 
bradles
 or at least it is set during dotconf parsing I should say
02:58PM 
bradles
 where does the client parse the darn config -- at least then I can follow to the config being cached
03:00PM 
pcarns
 I really don't understand the flow of that code so well to be honest with you- I just gdb break on stuff to follow it
03:00PM 
bradles
 no prob
03:01PM 
bradles
 will do
03:01PM 
pcarns
 you setting a default value somewhere, in case the option isn't specified in the config file?
03:02PM 
pcarns
 I think that part happens in DOTCONF_CB(enter_filesystem_context)
04:07PM 
bradles
 pcarns: the config that the client receives and parses from the server is diffierent than the one stored in pint_cached_config calls
04:07PM 
bradles
 pcarns: now I know
04:07PM 
bradles
 mind you, I haven't figured out what config is in there yet, but it has a different address than the one parsed
04:08PM 
bradles
 (rebuilding without -O2 to find it now)
04:08PM 
bradles
 damn -O2
04:23PM 
pcarns
 ohhh, yeah
04:23PM 
pcarns
 the cached config thing is what keeps up with the handle mappings and such
04:23PM 
pcarns
 I think it has a "load" function of some sort that pulls the information it wants from the server config file
04:24PM 
bradles
 yeah, I'm on the trail
04:25PM 
bradles
 there is some weird stuff in the guts of the dot conf -- you know
04:25PM 
bradles
 not the parser, I mean the stuff we've added
04:25PM 
bradles
 but such is life
04:26PM 
bradles
 it seems like every time I make a 2 second change, it always takes me 2 hours to learn that soemthing isn't what I expected
04:26PM 
bradles
 its alot to memorize
04:27PM 
pcarns
 yeah, I know what you mean
04:27PM 
pcarns
 the config parsing stuff layered on top of dotconf usually throws me for a loop too
04:29PM 
bradles
 okay, found it
04:30PM 
bradles
 so what is the policy on the cached config
04:30PM 
bradles
 what should be in it?
04:30PM 
bradles
 if I make sure my config info is in there, is it safe?
04:30PM 
pcarns
 policy?  whahahahahahaaa
04:31PM 
pcarns
 nah, seriously, I think thats a fine place to put it
04:31PM 
bradles
 well trove_sync_meta is set correctly in there, so I'm gonna do the same for mine then too
04:31PM 
pcarns
 there are already functions in that api like get_num_dfiles that are vaguely related
04:32PM 
bradles
 that is the function I'm chanign
04:32PM 
bradles
 it will check to see if the server overrides before letting dists have a shot at overriding
04:32PM 
pcarns
 ahhh, ok
04:32PM 
pcarns
 good
04:32PM 
bradles
 (this will make having as an fstab option easy I think too)
04:32PM 
bradles
 cool, its late in EDT
04:33PM 
bradles
 have a beer
04:33PM 
bradles
 heck, its late in CDT, I may have a beer
04:33PM 
bradles
04:34PM 
pcarns
 not a bad idea
04:34PM 
pcarns
 heh- look for the PINT_bucker_get_num_dfiles comment
04:34PM 
bradles
 its fixed
04:34PM 
bradles
04:34PM 
bradles
 don't worry
04:34PM 
bradles
 but yeah, pathetic typo from long ago
04:34PM 
bradles
 there's a hole in the bucket
04:36PM 
bradles
 so there is a new eclipse, can I finally get rid of emacs and use an IDE
04:36PM 
bradles
 anybody tried it, do I need a Cray to run it on still?
04:37PM 
pcarns
 Nathan actually works on it
04:37PM 
pcarns
 debardeleben, that is
04:38PM 
bradles
 yeah, he's apparently building plugins
04:38PM 
bradles
 rt?
04:38PM 
pcarns
 I've never tried it
04:38PM 
bradles
 I wonder if they have plugins named like nuclear_warhead or soemthing
04:38PM 
bradles
 all top secret and what not
04:39PM 
pcarns
 so far in this decade I have switched to a gui email reader- that's enough change for now
04:39PM 
bradles
 yes, and I remember the cursing
04:39PM 
bradles
 but your still using IMAP, so I'm not sure it counts
04:40PM 
bradles
 you should tell Nate to build  a FrESH plugin for eclipse
04:40PM 
bradles
 or the EmulaSHun plugin perhaps
04:40PM 
pcarns
 hahaha- he probably would
robl
 pcarns: wow, no more pine?
04:42PM 
pcarns
 robl: nope, I'm pimpin the thunderbird now
robl
 cool. dunno what it'll take to get me off of mutt but the graphical mail readers are a lot better than netscape 4 (last one i used)
04:47PM 
pcarns
 it took having webmail access to get me off- that way I have a fallback from other computers
04:47PM 
pcarns
 well, imap and web mail
04:49PM 
bradles
 you guys need to recognize that red hat and gnu have decided that you should use gnome and read mail with evolution
04:50PM 
bradles
 if you keep trying to run other apps they're gonna make you take 1000 line config files with you everywhere you go
04:50PM 
pcarns
 red hat?  those guys aren't out of business yet? :)
robl
 i only use evolution because its calendar can sync with my phone
robl
 and i don't care about 1000 line config files if i can access my cvs dotfile repository
04:50PM 
bradles
 oh dear god
04:50PM 
pcarns
 I only use thunderbird because it looks vaguely like firefox
50* 
57robl 
loves his cross-platform, cross-host  .zsh directory
04:51PM 
bradles
 no, I've almost retired my .Xdefaults, and I like it that way
04:51PM 
bradles
 it used to be enormous, now I'm not even sure my xterm setting even work anymore
04:51PM 
pcarns
 robl: man, not a bad idea- having to copy my .vimrc and .cshrc is almost enough to make me want to never switch jobs again
04:51PM 
bradles
 I just press buttons like a monkey to get things to work
04:52PM 
pcarns
 I still bugger up indentation sometimes because of some nether-computer that didn't get my vimrc
robl
 pcarns: it's the only way to fly
04:53PM 
bradles
 see if I switch from emacs to eclipse, that's a whole lisp dialect I no longer have to remember
04:53PM 
bradles
 and 1 less config file
04:53PM 
bradles
 you guys are figting a losing battle
04:53PM 
bradles
 red hat will crush you both
04:54PM 
pcarns
 bradles: just because your config files aren't in text format doesn't mean they aren't there :)
04:54PM 
bradles
 all hail binary packages and configurations
04:54PM 
bradles
 really, I'm just a few wasted afternoons from just giving in and using windows
 pcarns 
~pcarns@adsl-19-120-225.asm.bellsouth.net
 has left #pvfs2 
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Fri Jun 10 10:01:39 2005
52Users
32#pvfs2
50)]
54 robl      
54 bougyman  
54 elliot    
54 slang_    
54 freat     
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 Channel #pvfs2 was created at Sun May 22 02:20:25 2005
BitchX
: Join to #pvfs2 was synched in 20.873 secs!!
Netjoined: 
57irc.freenode.net brown.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang_ 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
56bougyman 
36bougyman@bougyman.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36~pcarns@adsl-19-120-225.asm.bellsouth.net
 has joined #pvfs2
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
10:24AM 
bradles
 I guess I'm going to add a field to PVFS_sys_mntent for the default_num_dfiles
10:25AM 
bradles
 any objections -- it is a system interface change technically
10:25AM 
bradles
10:27AM 
pcarns
 fine w/ me- I guess it will be an option in tab file?
10:28AM 
bradles
 yeah, robr wants it as both types of option
10:28AM 
pcarns
 sweet
10:28AM 
bradles
 num_dfiles=x in the tabfile will override the server setting
10:28AM 
bradles
 it "speeds" up metadata
10:28AM 
bradles
 which is the point I suppose
10:28AM 
pcarns
 sounds good to me- would be very useful to us too
10:29AM 
bradles
 setting distribution params is gonna be tricky, let me tell you
10:29AM 
bradles
 you set them in the server, but the changes have to be made on the client
10:29AM 
bradles
 uggh
10:29AM 
bradles
 ok, well phil's vote is enough for me, I'm changing sysint
12:47PM 
bradles
 all: is adding PVFS_util_get_mntent(fsid) to pvfs2-util.h (a global header) okay, or is there already a way to retrieve mntents?
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
 pcarns 
~pcarns@adsl-19-120-225.asm.bellsouth.net
 has left #pvfs2 
09:38AM 
elliot
 anyone around?
robl
 hey
09:48AM 
elliot
 trying to get mpich2 working with smpd
09:48AM 
elliot
 I get: unable to connect mpiexec tree, socket connection failed, error stack:
09:48AM 
elliot
 MPIDU_Socki_handle_connect(815): connection failure (set=1,sock=16777216,errno=111:Connection refused).
09:48AM 
elliot
 unable to post a write for the next command,
09:48AM 
elliot
 sock error: socket operation in progress, error stack:
09:48AM 
elliot
 MPIDU_Sock_post_writev(657): sock is in the process of being closed locally (set=1,sock=16777216)
09:49AM 
elliot
 unable to post a write of the close command to tear down the job tree as part of the abort process.
09:49AM 
elliot
 which I'm guessing that its trying to use the wrong rsh
robl
 elliot: there's been a lot of discussion about smpd on mpich-discuss, but i've got no experience with it myself. i use mpd (even if it does introduce a python dependency)
09:51AM 
elliot
 i'm using smpd so that I can use mpich2 with sge
robl
 elliot: you might be able to find something useful at http://www-unix.mcs.anl.gov/web-mail-archive/lists/mpich-discuss/threads.html , or failing that, dropping a line to mpich2-maint@mcs.anl.gov
robl
 oh, i'm sure smpd is a good process manager for lots of situations. just saying i haven't played with it much
09:53AM 
elliot
56pcarns 
36~pcarns@adsl-19-120-225.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: thanks for the patches
12:05PM 
pcarns
 robl: you're welcome- I've got several more ready to send, but I'll probably group into a few emails
55christel
35christel@christel.staff.freenode
50)-
 [Global Notice] Hi again, Thanks for using freenode! As you are all aware today is the last day of the fiscal year, and also of the PDPC fundraiser. We are so close to hitting target. You can help us get there! Dig deep and help us raise the last $1200. If this is your first time making a donation, please read http://freenode.net/fundraiser.shtml . Thanks for the support and have a great day!
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Server Notice] Hi all.... please bear with us, christel's message will be repeating, to your server only
55christel
35christel@christel.staff.freenode
50)-
 [Global Notice] Hi again, Thanks for using freenode! As you are all aware today is the last day of the fiscal year, and also of the PDPC fundraiser. We are so close to hitting target. You can help us get there! Dig deep and help us raise the last $1200. If this is your first time making a donation, please read http://freenode.net/fundraiser.shtml . Thanks for the support and have a great day!
robl
 pcarns: oooh, mounted-fs-detection.patch sounds very nice
01:19PM 
pcarns
 robl: I really like it :) not sure if you guys would or not
robl
 i'm going to mull it over a bit but it seems like at the very least it'd be good to have as an undocumented feature'
01:21PM 
pcarns
 robl: make sure to catch the changes to quickstart if you want it to remain undocumented ;)
robl
 holy crap! a documentation update patch too!
01:22PM 
pcarns
 I must have been bored that day, what can I say
01:26PM 
pcarns
 did someone trip over the power cord to BGL at Argonne?
01:26PM 
pcarns
robl
 pcarns: big fat power outage last night
robl
 pcarns: we get to find out this morning a: which machines are not on a UPS and b: which machines had hard drives on the verge of death (hint: they're now dead)
01:30PM 
pcarns
 ah, I remember b: being an issue up there in previous outages
01:30PM 
pcarns
 robl: you guys need little mini-ups's just for the hard drive motors
robl
 i always forget about "unscheduled outages" when debating the merrits of solid state disks
01:34PM 
slang_
02:06PM 
pcarns
 whew, that's all my patches
02:06PM 
pcarns
 David may have a couple more today or monday
02:07PM 
pcarns
 robl: that was a backlog of a few months, now I should be caught up and can turn the fire hose off
02:08PM 
pcarns
 well, actually there are a few more in the pipe for those config options we talked about on list, but it will be a bit before those come out
robl
 ok, cool.  if i'm going to meet the goal of pvfs2 releases every month, we'll probably roll all these in for a release july 10th and do a 1.1.1
robl
 or a 1.2.0.  version numbers seem like such a silly thing to worry about
 pcarns 
~pcarns@adsl-19-120-225.asm.bellsouth.net
 has left #pvfs2 
56rross 
36~rross@m010f36d0.tmodns.net
 has joined #pvfs2
robl
 rross: hey
05:17PM 
rross
 robl: hey.
05:17PM 
rross
 stuck in SFO airport for a few more hours.
05:18PM 
rross
 maybe i've got the bird flu; that would be notable.
robl
 rross: yeah, that bird flu is all over germany...
05:19PM 
rross
 heh.  you never know with these international conferences :).
05:19PM 
rross
 elliot: john's talk was really good.
05:23PM 
rross
 robl: someone's going to have to tell me how to read this tinderbox stuff when i get back..
05:23PM 
rross
 slang_: you around?
05:23PM 
slang_
 rross: yep
05:23PM 
rross
 whatcha been up to?
05:23PM 
slang_
 rross: sittin in the kiddie pool right now..
05:23PM 
slang_
 rross: :-)
robl
 rross: i'm trying to maek it more readable
robl
 it's better now
05:23PM 
rross
 nice one!  i'm sitting in the airport.  not the same.
05:24PM 
slang_
 rross: looking at attribute cache stuff
05:24PM 
rross
 robl: cool.  seems like things are moving along.  i've got some comments from users (on PVFS2 in general) all stored up for when i get back.
05:24PM 
slang_
 rross: I think io is caching correctly now
05:25PM 
slang_
 rross: the change I made is kind of..small
05:25PM 
rross
 slang_: was that "it"?  Or are you talking about the readahead cache?  Or am I missing something?
05:26PM 
slang_
 rross: err..
05:26PM 
slang_
 rross: was that all I've been working on?
05:26PM 
slang_
 rross: more or less yeah
05:27PM 
rross
 no, you said "I think io is caching ...", and I was making sure that was a typo, that's all.
05:27PM 
rross
 not trying to belittle your fine work :).
05:27PM 
slang_
 pff
05:27PM 
rross
 dunno that acronym.
05:28PM 
slang_
 pff?
05:28PM 
rross
 heh
robl
 it means IT'S GO TIME!
05:28PM 
rross
 this is an unusually awkward conversation :).  is neill here?
05:28PM 
slang_
 that's just the sound my mouth wanted to make when I read that
05:29PM 
slang_
 my understanding was that the io operation wasn't using the attribute cache correctly
05:29PM 
slang_
 so that each io op had to do a getattr first
05:29PM 
slang_
 and we wanted to fix that if possible
05:30PM 
slang_
 so its true that it wasn't caching correctly
05:30PM 
rross
 ok, so you knocked that out then?
05:31PM 
slang_
 I think so
05:31PM 
slang_
 writing a test now that verifies
05:31PM 
rross
 excellent.  there's a clear separation now between the distro stuff that doesn't need to be constantly updated and the other things that do?
05:31PM 
slang_
 uh..
05:32PM 
rross
05:33PM 
slang_
 rross: no but I can look into doing that
robl
 slang_: he does that all the time
05:33PM 
rross
 ok, how do we avoid the getattr?
robl
 "hey, i did something cool!" "did you do ____ " "oh.... yeah, i'll fix that" :>
05:35PM 
slang_
 rross: let me say what I understand to be happening and then you can clarify
05:35PM 
rross
 perhaps i do not show my appreciation as well as i should :)...
robl
 hah! nah, it's all good
05:37PM 
rross
 slang_: ok...
05:37PM 
slang_
 rross: flush,io,readdir and truncate all do a getattr-acache first and if there's a hit, that attr is used, if there's a miss, the getattr op happens
05:38PM 
slang_
 a 'hit' right now is determined by the requested attr masks set and the cached attr masks set (if the attr exists in the cache at all)
05:39PM 
slang_
 so as long as requested == cached for the masks, the cached attr is used
05:39PM 
slang_
 I basically changed it to requested <= cached
05:39PM 
rross
 ok.  that sounds like a good idea.
05:40PM 
rross
 (of course, we're not even turning it on by default right now, but we'll address that once we have our tests in place)
05:41PM 
slang_
 how do you mean turning it on?
05:41PM 
slang_
 decent timeouts?
05:42PM 
rross
 the acache is disabled at the moment, as i understand it.  hold off on that for a second.  the thing that i was referring to in the comment after the "excellent." was this: there is a timeout associated with the entry.  that timeout only needs to apply to attributes that can change.  ones that cannot, like the distro info, should not need to be re-read due to the attr cache timeout, but only often enough to ensure that the handle is still a valid one.
05:43PM 
slang_
 hmmm...right
05:44PM 
rross
 that make sense?
05:44PM 
slang_
 so you really want per-group timeouts
05:45PM 
slang_
 groups being common, meta, data, sys
05:46PM 
rross
 hmm.  well, there are two timeouts: the timeout that the user/admin requested (how long we're willing to let the mutable data go before updating), and a timeout related to the handle reuse timeout that ensures that we're not referring to a totally different object.  everything that is mutable falls under the first timeout, the rest fall under the second timeout.  the first timeout value can never be bigger than the second timeout value.
05:47PM 
rross
 i'm happy for you to implement it however you think is best :).
05:48PM 
rross
 hey we got the r&d100 for mpich2 btw.
05:48PM 
slang_
 yeah ok
robl
 rross: oh wow, that's pretty cool
05:49PM 
slang_
 nice
05:49PM 
rross
 it seems reasonable to do per-group timeouts, yes.  but i haven't really looked at it enough to make a good assessment of that.
05:50PM 
slang_
 well I think you're right
05:51PM 
rross
 anyway, what you've done so far is a great first step, because it gets the io path in line with the rest and will reduce the number of getattrs.  this stuff will just further reduce them.
05:51PM 
slang_
 it seems like the requested mask is really only ever set to two values: COMMON_ALL|META_ALL and SYS_ALL
05:51PM 
slang_
 the first being set by all the 'other' ops (io,truncate,readdir,etc.)
05:51PM 
slang_
 the second being set by user calls to PVFS_sys_getattr
05:52PM 
rross
 what gets the distro information?
05:52PM 
slang_
 META_ALL
05:52PM 
slang_
 #define PVFS_ATTR_META_DIST    (1 << 10)
05:52PM 
slang_
 #define PVFS_ATTR_META_DFILES  (1 << 11)
05:52PM 
slang_
 #define PVFS_ATTR_META_ALL \
05:53PM 
slang_
 I guess the timestamps in COMMON are mutable
05:53PM 
slang_
 and the perms
05:54PM 
slang_
 hmm
05:54PM 
slang_
 maybe just a different timout for META
05:54PM 
50* 
53rross/#pvfs2 
resizes his window to see all slang's stuff
05:54PM 
rross
 yeah, i think you're right.
05:55PM 
slang_
 the problem is that META is never requested by itself
05:55PM 
slang_
 so we'll have to change that for that cases where only the distro info is needed
05:55PM 
slang_
 for the cases
05:56PM 
rross
 right.  i don't think that we really need anything else for the IO cases...that was the idea anyway.
05:57PM 
slang_
 really?  don't they need the COMMON stuff? ownership and perms and what not?
05:58PM 
slang_
 dump access rights in the name of speed?
05:58PM 
rross
 hmm.  well, that depends on how you look at it.  the server is going to check permissions anyway.  do we check permissions at io operations on the client too?
06:00PM 
slang_
 dunno if the code checks client side at present
06:01PM 
rross
 yeah, i'm tempted to eschew (i like that word) getattrs at io time to boost performance.  if we don't we are going to be checking permissions all the damn time.
06:01PM 
slang_
 fine with me
06:02PM 
rross
 is there any reason why we shouldn't do that?  actually it isn't the case that the server is going to check -- it cannot check permissions on datafiles.
06:02PM 
rross
 (there are no permissions stored for datafiles)
06:03PM 
rross
 so we would be implementing a policy where it is possible for a user to grab the datafile handles with a getattr and then do IO even if the permissions are changed.  that's ok.
06:04PM 
rross
 we would want to check permissions at least once in there though!
06:05PM 
slang_
 how tested is this stuff in multiuser environments?
06:06PM 
rross
 some.  phil and them test it pretty thoroughly i think, particularly permission issues.  it might be worth bringing this up on developers and see if they have any input on this?
06:07PM 
slang_
 rross: ok
06:08PM 
rross
 i asked him today what tests they're using; i think maybe some of the linux fs tests.  hopefully he'll point us to something.
06:09PM 
rross
 ok, i'm gonna go find some water and take some medicine.  being sick in airports (and planes for that matter) sucks.
robl
 drop some tests in test/automated/vfs-tests.d
robl
 that'll be a good meta test... can we take phil's tests and w/o much work drop them into this testing infrastructure
06:10PM 
rross
 hope we can!  see ya all either on sunday or on tuesday.  later.
 rross 
~rross@m010f36d0.tmodns.net
 has left #pvfs2 
06:10PM 
slang_
 ciao
56bougyman_ 
36bougyman@bougyman.com
 has joined #pvfs2
SignOff 
57bougyman
: #pvfs2 
Read error: 131 (Connection reset by peer)
SignOff 
57freat
: #pvfs2 
Read error: 110 (Connection timed out)
57slang_ 
is now known as 
36slang
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
10:25AM 
bradles
 robl:
10:25AM 
bradles
 slang:
10:26AM 
bradles
 It looks like the remove mntent is only used when unmounting a filesystem
10:26AM 
bradles
 which is good, as you unmount it and then try to create a file on it, well screw you
10:28AM 
bradles
 I am still going to have to mutex util_get_mntent (the add function effectively does a realloc), but I don't guess that's a major deal
10:29AM 
bradles
 (and during initialization if there was an error during init)
10:44AM 
bradles
 Nope, even as written, its unsafe -- darnit
02:27PM 
elliot
 when running nc_test from pNetCDF should I have to pass it any arguments?
robl
 first you run nc_test -c to create 'test.nc'
robl
 then you can run nc_test (yep, with no args)
robl
 you have to run it with only one processor. we did port it from serial netcdf but didn't add any parallelism to it
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
57bougyman_ 
is now known as 
36bougyman
56pcarns 
36~pcarns@adsl-34-59-151.asm.bellsouth.net
 has joined #pvfs2
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-34-59-151.asm.bellsouth.net (gaim)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
~pcarns@adsl-34-59-151.asm.bellsouth.net
 has left #pvfs2 
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Tue Jul  5 22:54:27 2005
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 pvfs2-1.1.0 is out! http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Fri Jun 10 10:01:39 2005
52Users
32#pvfs2
50)]
54 robl      
54 bougyman  
54ChanServ  
54 elliot    
54 slang     
 Channel #pvfs2 was created at Sun May 22 02:20:25 2005
BitchX
: Join to #pvfs2 was synched in 0.286 secs!!
 #pvfs2  [freenode-info] why register and identify?  your IRC nick is how people know you.  http://freenode.net/faq.shtml#nicksetup
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-34-59-151.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: got any more patches in the pipeline?
robl
 pcarns: i realized last night that if i want to keep my "montly releases" plan, we'll have to make a release monday
09:29AM 
53pcarns
 robl: we have some more, but we won't get them to you in time
robl
 (i think that's gonna slip at this point)
robl
 cool
09:29AM 
53pcarns
 robl: you've got the biggest chunk already
robl
 excellent. man, it's great to have you guys contributing
09:30AM 
pcarns
 thanks
SignOff 
57bougyman
: #pvfs2 
Read error: 131 (Connection reset by peer)
56bougyman 
36bougyman@bougyman.com
 has joined #pvfs2
09:33AM 
slang
 pcarns: hey
09:33AM 
slang
 pcarns: how goes?
09:35AM 
50* 
53slang/#pvfs2 
| That way the compiler lets you know if you forget to fill in a parameter
09:35AM 
slang
 pcarns: how do the PINT_SERVREQ_*_FILL macros do that?
09:39AM 
pcarns
 slang: hey
09:39AM 
pcarns
 slang: can we talk about the state organization real quick first?
09:39AM 
pcarns
 slang: I think we are thinking the same thing but maybe I am saying it wrong :)
09:40AM 
slang
 pcarns: sure
09:40AM 
pcarns
 slang: so suppose I am in a state machine (say sys_truncate)
09:40AM 
pcarns
 slang: what would that state machine do to retrieve the attributes for the object it wants to operate on?
09:40AM 
pcarns
 slang: what does it call/jump to/whatever?
09:41AM 
slang
 it would first jump to the getattr nested sm
09:42AM 
pcarns
 slang: does it have to do anything after that, or is that it?
09:42AM 
slang
 if that fails, it would go to truncate_cleanup
09:42AM 
pcarns
 ok, cool
09:42AM 
pcarns
 sounds good, sorry about confusion on last email
09:43AM 
slang
 but I was going to remove the acache set valid stuff from truncate_cleanup
09:43AM 
pcarns
 I wasn't sure what the diagrams were of- nested machine or sys_getattr, or what
09:43AM 
pcarns
 awesome
09:43AM 
slang
 as that would happen in..
09:43AM 
slang
 yeah - I guess I didn't make that clear..sorry
09:43AM 
pcarns
 no prob
09:43AM 
slang
 its a nested state machine .. call it getattr-dowork
09:43AM 
pcarns
 ok, back to macro thing?
09:44AM 
slang
 and the getattr sm would just jump to the getattr-dowork
09:44AM 
pcarns
 cool
09:45AM 
slang
 right - so the *_FILL macros push variable init checking to compile time somehow?
09:46AM 
pcarns
 I'm making that issue more complicated than it should be :) ,
09:46AM 
pcarns
 so I was originally thinking, that probably you have some fields you need to set in sm structure before jumping to nested machine
09:46AM 
slang
 yes
09:46AM 
pcarns
 I dunno, like s_op->getattr_handle, or s_op->getattr-dowork.handle, etc.
09:47AM 
pcarns
 and maybe if there are a couple of things, then someone using it just needs to remmember to fill in the various fields
09:47AM 
slang
 ok..
09:47AM 
pcarns
 the alternative is to have a macro, like FILL_GETATTR_DOWORK_FIELDS(handle, fsid, mask ...)
09:48AM 
pcarns
 that way, if you decide later that you need another parameter, then macro must change
09:48AM 
pcarns
 and all instances calling macro will break at compile time because lacking argument
09:48AM 
slang
 ah ok
09:48AM 
pcarns
 wheras if setting fields directly, it will be less obvious where instances need to change, some places just will have an uninitialized fields
09:48AM 
slang
 right
09:49AM 
pcarns
 I dunno if that's really a good idea or not, the reason its on my mind
09:49AM 
pcarns
 is in a pvfs2 tree I hacked on for my dissertation I had a ton of nested machines
09:49AM 
pcarns
 and it was confusing to remember what needed to be set on the way in, and what could be read on the way out
09:50AM 
pcarns
 your case isn't as big a deal since we are just talking about a fairly consistently used sm when you are done,
09:50AM 
pcarns
 but it might set a precedent for future nested machines to follow :)
09:50AM 
slang
 the client_sm struct has the union of different operation handles, but that doesn't seem to take care of nested machines well
09:51AM 
slang
 or 'nested operations' I guess is what I mean
09:51AM 
pcarns
 yeah, nested sm's like msgpair have gotten around that so far by sticking things outside of the union
09:51AM 
slang
 as in the getattr case
09:52AM 
pcarns
 just putting a little struct in the s_op structure but outside of the union is about the only short term way to do it
09:52AM 
slang
 yeah
09:53AM 
slang
 seems like it clutters it up
09:53AM 
pcarns
 yeah, pretty much
09:53AM 
slang
 heh
09:53AM 
pcarns
 one possible solution, but would take a lot of work
09:53AM 
pcarns
 I had an issue where I had server state machines that needed to call nested machines from other operations
09:54AM 
pcarns
 where those nested machines were accessing things in the union already, and I didn't really want to change
09:54AM 
pcarns
 what you end up wanting to do is make a copy of the whole sm structure and put it in a stack
09:54AM 
pcarns
 then modify what you want, run nested sm, grab outputs, and switch back to old sm structure
09:55AM 
pcarns
 sort of like a function call in a programming language or something
09:55AM 
slang
 hmm
09:55AM 
slang
 I guess that would get expensive?
09:56AM 
pcarns
 IMHO I don't think so
09:56AM 
pcarns
 the sm struct is big, but not ridiculous, especially if more things coudl be put in union after the change
09:57AM 
slang
 what about just copying the union and putting that on the stack?
09:57AM 
pcarns
 that would work
09:57AM 
pcarns
 probably- most likely any change like this will break some state machine or another, but fixable
09:58AM 
slang
 I like the idea
09:58AM 
pcarns
 IMHO its ok to just go with seperate struct for now and then come back later and tackle this general purpose stack of unions issue
09:59AM 
slang
 that sounds like a good plan
09:59AM 
pcarns
 something like this is one of the pieces that would help towards being able to merge in some of my dissertation stuff (server to server communicating operations)
10:00AM 
pcarns
 the other piece would be having parallel steps/transitions in a state machine, but that's another whole tangent :)
10:01AM 
pcarns
 both of those things I did in my hacked tree, but in a very non-elegant way to get by- I think it could be done cleanly with some changes to the state machine infrastructure
10:01AM 
slang
10:02AM 
slang
 pcarns: is that a branch of the main pvfs2 repos or your own archive?
10:03AM 
pcarns
 seperate archive
10:04AM 
pcarns
 pretty far out of date now
10:04AM 
pcarns
 I was just mirroring the tree and doing occasional vendor merges at the time
10:04AM 
slang
 ok cool
10:05AM 
slang
 I'll add those things to a todo list we have going
10:05AM 
pcarns
 I think the project is called pvfs2-pcarns, in parl repository
10:05AM 
pcarns
 great!
10:06AM 
slang
 pcarns: thanks for your help!
10:06AM 
pcarns
 slang: no, thank you!
 SWAP: No such window: 4
 SWAP: Window 3 is not hidden!
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-34-59-151.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24.196.226.167 (laytonj)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-34-59-151.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24.196.226.167 (laytonj)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
03:50PM 
slang
                 if (trimmed_mask & PVFS_ATTR_DATA_SIZE)
03:50PM 
slang
                 {   
03:50PM 
slang
                     trimmed_mask &= (PVFS_ATTR_META_ALL |
03:50PM 
slang
                                      PVFS_ATTR_DATA_SIZE |
03:50PM 
slang
                                      PVFS_ATTR_COMMON_ALL);
03:50PM 
slang
                 }
03:50PM 
slang
                 else
03:50PM 
slang
                 {
03:50PM 
slang
                     trimmed_mask &= (PVFS_ATTR_META_ALL |
03:50PM 
slang
                                      PVFS_ATTR_COMMON_ALL);
03:50PM 
slang
                 }
 pcarns 
~pcarns@adsl-34-59-151.asm.bellsouth.net
 has left #pvfs2 
05:23PM 
slang
 am I missing something or is that equiv to:
05:23PM 
slang
 trimmed_mask &= (PVFS_ATTR_META_ALL | PVFS_ATTR_COMMON_ALL);
05:27PM 
slang
                 /*
05:27PM 
slang
                   if a size was requested, we also need to match
05:27PM 
slang
                   the data size related bits when checking attrs;
05:27PM 
slang
                   PVFS_ATTR_DATA_SIZE was specially added by
05:27PM 
slang
                   sys-getattr.sm setup msgpair if size is requested.
05:27PM 
slang
                 */
05:27PM 
slang
 that's the comment above the if/else
05:31PM 
slang
            # version control systems
05:31PM 
slang
 #          'TinderDB::VC_CVS',
05:31PM 
slang
 #          'TinderDB::VC_Bonsai',
05:31PM 
slang
 #          'TinderDB::VC_PVCSDimensions',
05:31PM 
slang
 #         'TinderDB::VC_Perforce',
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57laytonj   
36H   
~laytonj
24.196.226.167 (laytonj)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
08:21PM 
32christel:*
  Hi everyone, I just wanted to share with everyone that I am currently the luckiest woman alive, and on November 5th I will become Mrs. McBratney
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-34-59-151.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-34-59-151.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36~pcarns@adsl-34-59-151.asm.bellsouth.net
 has joined #pvfs2
11:38AM 
slang
                 /*
11:38AM 
slang
                   if a size was requested, we also need to match
11:38AM 
slang
                   the data size related bits when checking attrs;
11:38AM 
slang
                   PVFS_ATTR_DATA_SIZE was specially added by
11:38AM 
slang
                   sys-getattr.sm setup msgpair if size is requested.
11:38AM 
slang
                 */
11:38AM 
slang
                 if (trimmed_mask & PVFS_ATTR_DATA_SIZE)
11:38AM 
slang
                 {   
11:38AM 
slang
                     trimmed_mask &= (PVFS_ATTR_META_ALL |
11:38AM 
slang
                                      PVFS_ATTR_DATA_SIZE |
11:38AM 
slang
                                      PVFS_ATTR_COMMON_ALL);
11:38AM 
slang
                 }
11:38AM 
slang
                 else
11:38AM 
slang
                 {
11:38AM 
slang
                     trimmed_mask &= (PVFS_ATTR_META_ALL |
11:38AM 
slang
                                      PVFS_ATTR_COMMON_ALL);
11:38AM 
slang
                 }
11:39AM 
slang
 pcarns: thats from getattr-acache.sm
11:39AM 
slang
 pcarns: it seems like that if/else block is equivalent to:
11:39AM 
slang
 trimmed_mask &= (PVFS_ATTR_META_ALL | PVFS_ATTR_COMMON_ALL);
11:39AM 
slang
 pcarns: but the comment suggests otherwise..
11:40AM 
slang
 pcarns: I guess i'm confused what the desired goal is
11:40AM 
slang
 pcarns: any idea?
SignOff 
57pcarns
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
31ctcp
51me
50)] 
PING
57me
 No such nick/channel
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-80.asm.bellsouth.net
 has joined #pvfs2
03:22PM 
pcarns
 slang: you there?
03:22PM 
pcarns
 slang: just looked at that "trimmed_mask" stuff from yesterday
03:22PM 
pcarns
 slang: I have no idea what its trying to accomplish
03:23PM 
pcarns
 slang: DATA_SIZE mask doesn't go together with META masks
03:23PM 
pcarns
 those are masks for two different types of objects
robl
 pcarns: i think it's going to take me a week or so to get the release out
robl
 i'd like to get all acxiom patches in
04:01PM 
pcarns
 okdoke
04:02PM 
pcarns
 we've posted all we will have until at least late next week
04:04PM 
slang
 pcarns: replied via email
04:05PM 
pcarns
 slang: yep, gotcha
04:05PM 
pcarns
 I don't think I have any extra insight on the intention, really
04:05PM 
pcarns
 but I'll be happy to help test when you have something that should mostly replicate the right behavior
04:06PM 
slang
 :-)
04:06PM 
slang
 pcarns: cool, thanks
 pcarns 
~pcarns@adsl-218-105-80.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3608:16pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3608:20pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3608:24pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57elliot
: #pvfs2 
Remote closed the connection
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
Netjoined: 
57irc.freenode.net tolkien.freenode.net
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
Netjoined: 
57irc.freenode.net tolkien.freenode.net
56bougyman 
36bougyman@bougyman.com
 has joined #pvfs2
56elliot 
36~elliot@babylon.physics.ncsu.edu
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-80.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57pcarns    
36G   
~pcarns
adsl-218-105-80.asm.bellsouth.net (gaim)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
~pcarns@adsl-218-105-80.asm.bellsouth.net
 has left #pvfs2 
robl
 dang
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57bougyman  
36H   
bougyman
bougyman.com (IT Specialist)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
 bougyman 
bougyman@bougyman.com
 has left #pvfs2 
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36~pcarns@adsl-218-105-80.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey, got any ideas about find(1) and st_nlink?
09:48AM 
pcarns
 hmm
09:48AM 
pcarns
 I don't know, actually
09:48AM 
pcarns
 I guess we need to try it and see
09:49AM 
pcarns
 I can test that out tonight or tomorrow
robl
 pcarns: ok, cool. didn't know if you had something set up already
09:52AM 
53pcarns
 robl: nah, I didn't think to look at that
robl
 pcarns: ok, cool. i'll test it here
09:52AM 
pcarns
 I wonder what happens on pvfs1 since it keeps the link count at 1
09:53AM 
pcarns
 it might actually be better, maybe find ignores st_nlink if it doesn't make sense :)
robl
 we'll find out soon enough. gonna run through metheney's mkdir patch and then i'll test on our beater boxes
10:11AM 
53pcarns
 robl: thanks for working on all these patches!
robl
 well it's not like robr's gonna do it. he's too busy chillin' with the president :>
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3610:26am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
10:31AM 
pcarns
 chillin' with the president?
robl
 http://www.prnewswire.com/cgi-bin/stories.pl?ACCT=104&STORY=/www/story/06-14-2005/0003870975&EDATE=
robl
 so he got to meet george bush for a little bit
10:38AM 
pcarns
 ahh, neat- I had heard about award but didn't no he got to meet bush
robl
 pcarns: any damage from the edge-of-dennis rains?
10:53AM 
53pcarns
 robl: not much where I live, except my tomato plant is a little crooked :)
10:54AM 
53pcarns
 robl: the one before dennis hit a few things though, atlanta motor speedway actually had a tornado or something tear it up
10:55AM 
pcarns
 I guess that was "Cindy"
robl
 tomato plant? dang man, you got all domestic-like real fast
robl
 (but hey, fresh tomatos!)
10:58AM 
pcarns
robl
 pcarns: ok, so with st_nlink at 2, find won't work as expected w/o -noleaf
robl
 trying now w/ st_nlink held at 1
robl
 yeah, that seems to work better
12:35PM 
53pcarns
 robl: hunh, that's interesting
robl
 indeed!
SignOff 
57ChanServ
: #pvfs2 
ACK! SIGSEGV!
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
robl
 pcarns: hey, so rob was ok w/ your safe rename patch, even though it added a couple extra operations in the worst case, right?
01:16PM 
pcarns
 I think so
01:16PM 
pcarns
 I think its worth it to make that operation less scary
01:17PM 
pcarns
 we'll get spanked when somone publishes the pvfs2 vs. lustre rename paper
01:17PM 
pcarns
robl
 hm. we don't have any rename tests really
robl
 pcarns: heh, with your safer-rename patch, the dot representation of sys-rename.sm is pretty crazy
01:36PM 
pcarns
 muahahahha
robl
 pcarns: hey, do you remember if viewcvs was ever running on parl?
01:49PM 
pcarns
 I don't think so
01:49PM 
pcarns
 it might have been once as a trial run or something, but we never had anything like that up permanently
robl
 pcarns: totally unrelated, i'm really digging paper mario on the gamecube
02:12PM 
53pcarns
 robl: cool!
02:12PM 
53pcarns
 robl: I started playing res. evil 4 the other day
02:13PM 
53pcarns
 robl: its really fun too, but completely different kind of fun of course :)
robl
 pcarns: i'm waiting for it to hit players choice pricing, but it's defintiely on my list
 pcarns 
~pcarns@adsl-218-105-80.asm.bellsouth.net
 has left #pvfs2 
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
07:31AM 
nextgens
 hi :)
robl
 hello
08:48AM 
50* 
53nextgens/#pvfs2 
is fighting against the bmi_ib module
08:48AM 
nextgens
 I can t get it compiling with Topspin s includes :/
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
robl
 nextgens: hey, you should mail pvfs2-users@beowulf-underground.org w/ the errors you're seeing
robl
 slang: http://www.sueandpaul.com/gmapPedometer/
11:35AM 
53slang
 robl: that's really cool
50* 
57robl 
is a big ol' mapping nerd
 nextgens 
~nextgens@jabber.hst.ru
 has left #pvfs2 
 SWAP: Window 3 is not hidden!
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elliot    
36H   
~elliot
babylon.physics.ncsu.edu (Elliot Peele)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 slang: you're missing out, man... anthony and thomas are chillin' out in d-247
04:56PM 
53slang
 robl: is that our office numba?
04:56PM 
50* 
53slang/#pvfs2 
can never remember
robl
 slang: yeah, our office
04:58PM 
53slang
 robl: dont let them eat all the candy!
robl
 slang: they only got away with a little
robl
 but next time i'll be ready!
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
04:07AM 
nextgens
05:46AM 
nextgens
 [11:45:23.733565] Error: bad magic in BMI TCP message.
05:46AM 
nextgens
 do you know what does it mean?
56pcarns 
36~pcarns@adsl-218-105-80.asm.bellsouth.net
 has joined #pvfs2
09:00AM 
53pcarns
 robl: hey, sorry about that patch
09:00AM 
53pcarns
 robl: I'm about to start looking at it here
09:53AM 
53pcarns
 robl: I see the problem, I'll post a fix on the list in a few minutes
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
 nextgens 
~nextgens@jabber.hst.ru
 has left #pvfs2 
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
SignOff 
57nextgens
: #pvfs2 
Remote closed the connection
 pcarns 
~pcarns@adsl-218-105-80.asm.bellsouth.net
 has left #pvfs2 
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36~laytonj@24.196.226.167
 has joined #pvfs2
robl
 pc: wow, that was fast
robl
 pc: been away today. closed on a house
robl
 of course phil's not online
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
56synchro 
36~defseg@athe730i-4291.otenet.gr
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56synchro_ 
36~defseg@athe730i-4291.otenet.gr
 has joined #pvfs2
 nextgens 
~nextgens@jabber.hst.ru
 has left #pvfs2 
SignOff 
57synchro
: #pvfs2 
Nick collision from services.
57synchro_ 
is now known as 
36synchro
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
SignOff 
57nextgens
: #pvfs2 
Remote closed the connection
SignOff 
57slang
: #pvfs2 
Remote closed the connection
56nextgens 
36~nextgens@jabber.hst.ru
 has joined #pvfs2
09:11AM 
nextgens
 nextgens 
~nextgens@jabber.hst.ru
 has left #pvfs2 
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-218-105-80.asm.bellsouth.net
 has joined #pvfs2
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
 pcarns 
~pcarns@adsl-218-105-80.asm.bellsouth.net
 has left #pvfs2 
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3611:50am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57elliot
: #pvfs2 
"reboot"
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 60 (Operation timed out)
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
57synchro_ 
is now known as 
36synchro
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 110 (Connection timed out)
56sadleder 
36~sadleder@p54A230D8.dip0.t-ipconnect.de
 has joined #pvfs2
56K1 
36~K1@D857a.d.pppool.de
 has joined #pvfs2
06:32AM 
sadleder
 Hi guys
SignOff 
57K1
: #pvfs2 
"You will soon forget this."
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
56synchro 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
SignOff 
57synchro_
: #pvfs2 
Read error: 110 (Connection timed out)
53#pvfs2     
57synchro   
36H   
~synchro
athe730i-4303.otenet.gr (obscure spectre)
53#pvfs2     
57sadleder  
36H   
~sadleder
p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 sadleder: hi
09:59AM 
53sadleder
 robl: hi, i think i was writing while you were still asleep ;-)
10:01AM 
53sadleder
 robl: what about exposing distribution information and parameters through vfs extended attributes? this would the possibily to set such params even while posix file access
10:14AM 
sadleder
 do you think this is a reasonable feature request?
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
robl
 sadleder: it's a good idea, and now that walt comitted his extended attribute stuff the first part is in place
robl
 sadleder: but i don't think we have the manpower for that just now.  once we get mpi-io stuff in place and exercised, then we can focus on vfs
robl
 sadleder: but you should bring it up on the mailing lists and see if it gets someone fired up
10:33AM 
53sadleder
 robl: ok. now as you mention vfs: maybe it would be way easier to use fuse for the vfs layer
robl
 sadleder: we've thought about it
robl
 sadleder: our kernelspace-userspace bridge is tailored for pvfs2, so doesn't have some of the overhead of the more general purpose fuse.
robl
 sadleder: however, fuse has see a *lot* of developent over the last year, so it might be worth comparing
robl
 sadleder: like everything else, it's manpower... if someone wants to write a fuse plugin for pvfs2 and benchmark fuse against our pvfs2-client stuff, that would be very interesting to see
10:35AM 
53bradles
 robl: how does seteattr relate to distribution info?
10:35AM 
53sadleder
 robl: i think it could be easier to use for userspace installations of pvfs2
robl
 bradles: sadleder suggested eattrs might be a way to get/set distribution information
robl
 bradles: but since i know not much about etiehr eattrs or distribution stuff, i can't evaluate if that's practial
10:37AM 
bradles
 personally, I can't see how they are related, but that might just be my own limitation :)
10:39AM 
sadleder
 bradles: i thougth you could expose distribution information as xattrs. there is now relation, but i suggested to build one up ;-)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57synchro   
36H   
~synchro
athe730i-4303.otenet.gr (obscure spectre)
53#pvfs2     
57sadleder  
36H   
~sadleder
p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
10:40AM 
bradles
 sadleder: I'm weaker on the real fs stuff than the distribution stuff, but file attributes can be modified at any time, correct?
10:43AM 
bradles
 sadleder: well at any rate, modifying the distribution after the file is created is a tricky business.  Walt and I have discussed that as a research topic before.
10:43AM 
bradles
 but I defer to other's more informed judgements
10:44AM 
bradles
10:44AM 
sadleder
 bradles: yes, sure.
10:45AM 
sadleder
 bradles: what das walt's eattr stuff do atm?
10:46AM 
bradles
 sadleder: allows you to set extended attributes and delete them for a file
10:46AM 
bradles
 sadleder:  just name value pairs, no relevance to how the file behaves
10:47AM 
sadleder
 bradles: ah, and where do you store such information?
10:47AM 
bradles
 sadleder:  In my replication code I use the eattrs to maintain consistency info -- but that code isn't in the main tree.  TMK that is the only example thus far of eattrs changing system behavior
10:49AM 
bradles
 sadleder: in the berkeley db for each object
10:49AM 
bradles
 sadleder: hmm, I have no idea how they get looked up
10:49AM 
bradles
 I'll have to ask walt this afternoon
10:51AM 
sadleder
 bradles: ok, maybe it could be of use to be able to set dist settings through the VFS, at least it would be nice
10:51AM 
bradles
 sadleder: no doubt about that
10:52AM 
bradles
 sadleder: just not sure if eattrs are exactly what you want since distribution is set at file creation time
10:55AM 
sadleder
 bradles: ok, i see.
10:59AM 
sadleder
 bradles: will eattrs get exposed through the kernel module?
10:59AM 
bradles
 sadleder: I'm not so much involved on the VFS stuff, so I don't know
11:00AM 
bradles
 sadleder:  a quick perusal of the code seems to indicate that file wide eattrs are set on the metaserver -- which makes sense I think, will get a confirm later
11:00AM 
sadleder
 bradles: ok, cu.
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57synchro   
36H   
~synchro
athe730i-4303.otenet.gr (obscure spectre)
53#pvfs2     
57sadleder  
36H   
~sadleder
p54A230D8.dip0.t-ipconnect.de (Philipp Sadleder)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
11:01AM 
bradles
 sadleder: you can set the default distribution and params in the server config file now (in CVS)
11:03AM 
sadleder
 bradles: this is a major step forward.
11:08AM 
bradles
 sadleder:  well i hope it helps some people -- you can also set the default number of objects created per file
11:09AM 
bradles
 I've not seen any careful studies of how these options affect performance, but hopefully they help someone
robl
 bradles: hey, is everything ok at clemson?
robl
 cvs [checkout aborted]: connect to cvs.parl.clemson.edu(130.127.210.68):2401 failed: Connection timed out
11:10AM 
53sadleder
 robl: Same at my site
11:11AM 
bradles
 No, clemson is down
11:11AM 
bradles
11:11AM 
bradles
 I'll tell walt
56synchro_ 
36~synchro@athe730i-4303.otenet.gr
 has joined #pvfs2
11:13AM 
bradles
 so, all the outlets in the lab are currently putting out 55 volts
11:13AM 
bradles
 thus all the machines are not really working
robl
 oh man that can't be good
11:14AM 
bradles
 Will is currently moving a machine to see if our new router is currently able to handle machine reloc
11:14AM 
bradles
 if so, we may have cvs by end of today
11:15AM 
bradles
 yeah, somehow I don't think our cluster is running so well withonly 55 volts
11:16AM 
bradles
 but hopefully just moving the fileservers is no big deal
11:16AM 
bradles
 so probably no mailing lists or CVS until this afternoon
SignOff 
57synchro
: #pvfs2 
Read error: 110 (Connection timed out)
11:16AM 
bradles
 sorry!
SignOff 
57sadleder
: #pvfs2 
"Verlassend"
SignOff 
57synchro_
: #pvfs2 
"traveling without moving"
03:09PM 
bradles
 cvs is available again
03:09PM 
bradles
 no mailing lists yet
03:10PM 
bradles
 if cvs breaks again, let me know and I'll try to find out why
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 bradles: cool, thanks for the update
03:27PM 
slang
 bradles: thanks
03:46PM 
bradles
 the mailing lists should be available as well
03:48PM 
bradles
 well, maybe I better not get ahead of myself just yet
03:49PM 
bradles
 Okay yes, the mailing lists are back
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
56freat 
36~freat@h-69-3-229-184.chcgilgm.covad.net
 has joined #pvfs2
SignOff 
57freat
: #pvfs2 
Remote closed the connection
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36~yf@61.149.48.36
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56sadleder 
36~sadleder@p54A22958.dip0.t-ipconnect.de
 has joined #pvfs2
SignOff 
57sadleder
: #pvfs2 
Client Quit
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 kraken: you've got a lot of patience with that dude
robl
 http://catandgirl.com/view.php?loc=270
01:24PM 
kraken
 it's sad to explain fread over and over again
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56sadleder 
36~sadleder@p54A23AAD.dip0.t-ipconnect.de
 has joined #pvfs2
SignOff 
57sadleder
: #pvfs2 
Client Quit
56sadleder 
36~sadleder@p54A23AAD.dip0.t-ipconnect.de
 has joined #pvfs2
 sadleder 
~sadleder@p54A23AAD.dip0.t-ipconnect.de
 has left #pvfs2 
57"Verlassend"
robl
 1,who
robl
 dur
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
01:13PM 
53laytonj
 robl: Are you around?
robl
 laytonj: hey
01:41PM 
53laytonj
 robl: Got a couple of questions for an article.
01:41PM 
laytonj
 If I run PVFS over GigE on a single node to 8 clients, will I see better throughput than using NFS?
01:42PM 
kraken
 I can answer that
01:42PM 
kraken
 Nope!
01:43PM 
bradles
 What if the clients were doing really large reads and writes?
01:44PM 
laytonj
 How many data servers would I need so that PVFS was faster than NFS?
01:44PM 
kraken
 in my experience, it depends more on the number of clients you're hitting it with
01:44PM 
kraken
 but you can't really consider PVFS a PVFS without multiple servers
01:44PM 
kraken
 since the P is missing in that case
01:45PM 
kraken
 I had some graphs at one point of PVFS vs. NFS performance, and once you passed 10 clients (100mbit, servers on gige) PVFS started blowing away NFS
01:46PM 
laytonj
 how many servers?
01:46PM 
kraken
 I'd think that even if you only had 2 PVFS servers, once the bandwidth of clients exceed the bandwidth of your server(s) you get wins with PVFS
01:46PM 
kraken
 16 I think
01:47PM 
kraken
 but as I said, it really depends more on how much your clients can pull
01:47PM 
kraken
 if everything is gigE, 1 NFS server and 10 clients, your aggregate bandwidth can't exceed 1gbit
01:48PM 
laytonj
 I've got to run. Can you send an email to me with these numbers? laytonjb@charter.net
01:48PM 
laytonj
 Thanks!
01:48PM 
kraken
 if you put pVFS even on 2 servers, you just doubled that aggregate bandwidth
robl
 uh.. yeah, what kraken said :>
02:05PM 
bradles
 shouldn't pvfs have less overhead than nfs on large reads and writes?  (I guess you could crank rsize and wsize thru the roof -- but no one does)
02:08PM 
kraken
 most likely... the highest you can go with r/wsize on Linux is 32kb, I think
02:09PM 
kraken
 (and only on NFS over TCP, iirc)
02:10PM 
kraken
 buuuut
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
02:10PM 
kraken
 since NFS is going to act the same way as PVFS in the generic case (VFS caching on the server-side)
02:11PM 
kraken
 you probably won't notice that much of a difference
02:12PM 
bradles
 do you guys use mpi-io to access pvfs (or is that need to know type stuff)?
02:13PM 
bradles
 I would guess without mpi-io, the number of clients and servers needed to see improvement with PVFS is much greater
02:13PM 
bradles
 but with mpi-io, probably not so much
02:14PM 
bradles
 (I recognize that laytonj was probably not talking about parallel access)
02:14PM 
kraken
 no mpi here
robl
 bradles: in the single server case we can pretty easily saturate the network link (i think)
robl
 so you need multi servers and then you're limited by bisection bandwidth of the switch
02:15PM 
kraken
 that's what I've seen - with a single server you pretty much max it out just as much as NFS does
robl
 there was that one dude who was doing 10 gig e to the switch and gig e to the clients.  *that's* an interesting situation
02:15PM 
bradles
 I haven't tried GigE, so I can't comment emphatically, but I think it depends on the interconnect
02:16PM 
kraken
 I'd start to wonder about disk speeds at that point :)
02:16PM 
bradles
 PCI bus
02:16PM 
kraken
 the interconnect makes a big difference in the sense of "how many clients does it take to saturate the combined server bandwidth"
02:17PM 
kraken
 if clients are 100mbit, it takes a lot more of them to saturate gigE connected servers
02:17PM 
kraken
 but if everything's gigE, you max out the servers a lot sooner
02:17PM 
bradles
 I can say from my own testing, that at 100mbit, yes, the link is toast
02:18PM 
kraken
 and I can speak for gigE :)
02:18PM 
bradles
 at Myrinet (which is a different can of worms I know), the link is not the problem if you sync the filesystem after reads and writes
02:19PM 
bradles
 (and actually for the way we do writes -- in myrinet the link still isn't the bottleneck on writes, even if you don't sync)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
02:20PM 
bradles
 (in other words we could go even faster without syncing if we so chose)
robl
 bradles: myrinet is great. clos routing means everyone's got a nice fat connection to everyone else
02:21PM 
bradles
 well its academic anyway, Nathan has used GigE, I have not
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56vilayann 
36~vilayann@barbados.cse.psu.edu
 has joined #pvfs2
SignOff 
57vilayann
: #pvfs2 
"Leaving"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56kraken_ 
36~kraken@24.144.40.22
 has joined #pvfs2
SignOff 
57kraken
: #pvfs2 
Read error: 110 (Connection timed out)
56K1 
36~silvestre@D9a7e.d.pppool.de
 has joined #pvfs2
56sadleder 
36~sadleder@p54A204E6.dip0.t-ipconnect.de
 has joined #pvfs2
 sadleder 
~sadleder@p54A204E6.dip0.t-ipconnect.de
 has left #pvfs2 
 K1 
~silvestre@D9a7e.d.pppool.de
 has left #pvfs2 
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
"leaving"
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
 #             4OP           :             ABORT         ABOUT        
 ADDFORWARD    ADDIDLE       ADDLAMENICK   ADDNOFLOOD    ADDSHIT      
 ADDUSER       ADDWORD       ADMIN         AJOIN         AJOINLIST    
 ALIAS         ASSIGN        AWAY          AWAYLOG       AWAYMSG      
 B             BACK          BAN           BANSTAT       BANTYPE      
 BANWORDS      BEEP          BHELP         BIND          BK           
 BKI           BLESS         BREAK         BYE           C            
 CALL          CBOOT         CD            CDCC          CHANNEL      
 CHANST        CHAT          CHATOPS       CHGAOP        CHGCHAN      
 CHGLEVEL      CHGPASS       CHGPROT       CHGUH         CHOPS        
 CLEAR         CLEARAUTO     CLEARLOCK     CLEARTAB      CLINK        
 CLONES        CMSG          CONNECT       CONTINUE      CSAY         
 CSET          CTCP          CTOGGLE       CWHO          CWHOM        
 CYCLE         D             DATE          DBAN          DC           
 DCA           DCC           DCG           DCS           DCX          
 DEBUG         DEBUGFUNC     DEBUGHASH     DEBUGMSG      DEBUGUSER    
 DEOP          DEOPER        DESCRIBE      DETACH        DEVOICE      
 DF            DIE           DIGRAPH       DISCONNECT    DLINE        
 DME           DNS           DO            DOP           DS           
 DUMP          ECHO          EHELP         ENCRYPT       EVAL         
 EVALSERVER    EXEC          EXIT          FE            FEC          
 FINGER        FK            FLUSH         FOR           FOREACH      
 FORWARD       FPORTS        FPROT         FSET          FTP          
 FUCK          FUCKEM        GONE          HASH          HELP         
 HISTORY       HOOK          HOST          HOSTNAME      I            
 IF            IG            IGH           IGHT          IGNORE       
 IGT           INFO          INPUT         INPUT_CHAR    INVITE       
 IRCHOST       IRCNAME       IRCUSER       ISON          J            
 JNW           JOIN          K             KB            KBI          
 KICK          KICKIDLE      KILL          KLINE         KNOCK        
 L             LAMENICKLIST  LASTLOG       LEAVE         LINKS        
 LIST          LISTDLL       LK            LKW           LLOOK        
 LOAD          LOADDLL       LOCAL         LOCOPS        LS           
 LUSERS        M             MAP           MB            MD           
 MDOP          MDVOICE       ME            MESG          MK           
 MKB           MKNU          MODE          MODELOCK      MOP          
 MORE          MOTD          MSAY          MSG           MTOPIC       
 MUB           MULT          MVOICE        N             NAMES        
 NEWNICK       NEWUSER       NICK          NOCHAT        NOPS         
 NOTE          NOTICE        NOTIFY        NSLOOKUP      NWHOIS       
 NWHOWAS       OFFERS        ON            OOPS          OP           
 OPER          OPERWALL      ORIGNICK      OSTAT         OV           
 P             PARSEKEY      PART          PARTALL       PASTE        
 PAUSE         PING          POP           PRETEND       PS           
 PURGE         PUSH          Q             QME           QUERY        
 QUEUE         QUIT          QUOTE         RANDOMNICK    RBIND        
 READLOG       RECONNECT     REDIRECT      REHASH        REINIT       
 REINITSTAT    REL           RELC          RELCR         RELCRT       
 RELCT         RELD          RELDT         RELI          RELIT        
 RELM          RELMT         RELN          RELNT         RELOAD       
 RELS          RELSD         RELSDT        RELSM         RELSMT       
 RELSN         RELSNT        RELST         RELSTT        RELSW        
 RELSWT        RELT          RELTT         RELW          RELWT        
 REMLOG        REPEAT        REQUEST       RESET         RESTART      
 RETURN        REVISIONS     RMAP          RPING         SAVE         
 SAVEIRC       SAVELIST      SAY           SC            SCAN         
 SCANF         SCANI         SCANN         SCANO         SCANS        
 SCANV         SEND          SENDLINE      SERVER        SERVLIST     
 SET           SETAR         SETENV        SHIFT         SHITLIST     
 SHOOK         SHOWIDLE      SHOWLOCK      SHOWSPLIT     SHOWWORDKICK 
 SLEEP         SPAM          SPING         SQUERY        SQUIT        
 STACK         STATS         STUB          SUMMON        SV           
 SWALLOP       SWATCH        SWITCH        T             TBAN         
 TBK           TCL           TIGNORE       TIME          TIMER        
 TKB           TKLINE        TLOCK         TOGGLE        TOPIC        
 TRACE         TRACEKILL     TRACESERV     TYPE          U            
 UB            UMODE         UNAJOIN       UNBAN         UNBANWORD    
 UNFORWARD     UNIDLE        UNIG          UNIGH         UNKEY        
 UNKLINE       UNLAMENICK    UNLESS        UNLOAD        UNLOADDLL    
 UNSCREW       UNSHIFT       UNSHIT        UNTIL         UNTOPIC      
 UNUSER        UNVOICE       UNWORDKICK    UPING         UPTIME       
 URL           USER          USERHOST      USERINFO      USERIP       
 USERLIST      USERS         USERSHOW      USLEEP        USRIP        
 VER           VERSION       VOICE         W             WAIT         
 WALL          WALLCHOPS     WALLMSG       WALLOPS       WATCH        
 WHICH         WHILE         WHO           WHOIS         WHOKILL      
 WHOLEFT       WHOWAS        WI            WII           WILC         
 WILCR         WILM          WILN          WINDOW        WORDLIST     
 WSET          WW            XDEBUG        XECHO         XEVAL        
 XQUOTE        XTRA          XTYPE                                    
 Usage: /help  
command
 or /command -help 
 to get help on specific commands
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57kraken_   
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57kraken_   
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
02:51PM 
slang
 weirdness
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
04:40PM 
bradles
 lots netsplits on freenode lately
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
57kraken_ 
is now known as 
36kraken
01:24PM 
53kraken
 robl: psst
01:25PM 
kraken
 I think line 376 of src/io/description/dist-varstrip.c should be changed from
01:25PM 
kraken
                 PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH)
01:25PM 
kraken
01:26PM 
kraken
                PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH - 1)
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3601:27pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
robl
 kraken: oh?  i didn't write that code.  why - 1?
01:28PM 
kraken
 because it's checking to see if the sprintf following it will fit in the static buffer
01:28PM 
kraken
 and strlen doesn't count the needed null
01:29PM 
kraken
 dist-varstrip-parser.c has a similar check, and it uses -1
01:29PM 
kraken
 er, not a sprintf, strcpy
01:30PM 
kraken
 if you give it a string exactly PVFS_DIST_VARSTRIP_MAX_STRIPS_STRING_LENGTH it'll lead to segfaults later when it uses an unterminated string :)
56rross 
36~rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 rross: hey
02:42PM 
53rross
 robl: hey!
02:45PM 
rross
 still working on these talks.  was sort of hoping that phil would be around to chat with about the acxiom one.  ah well.
02:52PM 
kraken
 want me to poke him with email? :)
SignOff 
57rross
: #pvfs2 
Read error: 104 (Connection reset by peer)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 kraken: so... you got some sort of lint tool running over pvfs2?  you were pretty fast with that varstrip thing?
03:34PM 
kraken
 nah, I caught it when doing the strcpy/sprintf pass last week
robl
03:35PM 
kraken
 the good thing is that nearly all the uses of sprintf/strcpy are safe in that they're either copying in static/const information or doing their bounds checking elsewhere
03:36PM 
kraken
 src/io/bmi/bmi_ib/util.c has several vsprintf's that should probably be changed to vsnprintf for safety
03:36PM 
kraken
 -    vsprintf(s, fmt, ap);
03:36PM 
kraken
 +    if (vsnprintf(s, 2048, fmt, ap) >= 2048) {
03:36PM 
kraken
 +        gossip_err("%s: Format string too large.\n", __func__);
03:36PM 
kraken
 +        va_end(ap);
03:36PM 
kraken
 +        exit(1);
03:36PM 
kraken
 +    }
03:37PM 
kraken
 that same thing in 6 places
03:37PM 
kraken
 got a patch for that one if you want :)
robl
 kraken: yeah, or even better dust off your bugzilla acct :>
robl
 i just know i'm going to drop these fixes
03:41PM 
kraken
 hrm, where is bugzilla?
03:41PM 
kraken
 I knew at one point
03:45PM 
kraken
 nevermind, found it
03:54PM 
kraken
 bugs submitted :)
robl
 i see! thanks
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: gcc-2.95 doesn't expand '__LINE__,'    it will expand '__LINE__ ,' apparently
10:15AM 
kraken
 that's .... interesting
robl
 is it even worth getting pvfs2 to build with 2.95?  even debian ships with gcc-3.2 now
robl
 make that 3.3.5
10:22AM 
kraken
 and unstable is on 4.x now
10:28AM 
pcarns
 personally, I don't care too much about 2.95 :)
10:29AM 
pcarns
 it would be nice though if we detected at configure time and insisted people upgrade if its not corrected, though
10:29AM 
pcarns
 there's always going to be that one guy trying to compile on redhat 6.2 or something
robl
 darn. no AC_CHECK_GCC_VERSION macro
10:36AM 
bradles
 if you're running gcc 2.95, then chances are you're running an ancienct version of threads and DB anyway.  PVFS2 is unlikely to be alot of fun there
10:37AM 
bradles
 just more bug reports for crap we don't care about
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
10:49AM 
bradles
 hey, does the topic message need to be changed in here?
10:49AM 
bradles
 The topic for #pvfs2 is: pvfs2-1.1.0 is out!
 Topic 
36#pvfs2
50):
 changed by 
36kraken
 pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html2~
10:50AM 
kraken
 no +t so anyone can change it :)
10:50AM 
bradles
 oh, there you go
robl
 kraken: whats' up with your url?
 Topic 
36#pvfs2
50):
 pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html2~
 Topic 
36#pvfs2
50):
 set by 
36kraken
 at 
36Mon Aug  1 10:50:02 2005
 Topic 
36#pvfs2
50):
 changed by 
36robl
 pvfs2-1.2.0 is out! http://www.pvfs.org/pvfs2/download.html
10:52AM 
kraken
 oops
robl
 ok, well, making pvfs2 gcc-2.95 friendly wasn't too hard
robl
 probably a waste of time
robl
 but only a little time
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
08:22AM 
kraken
 Thank you for your reply.
08:22AM 
kraken
 I changed my program from fwrite() and fread()
08:22AM 
kraken
 to write() and read().
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
robl
 pcarns: nice set of patches there!
robl
 pcarns: the "pvfs2-client logs to file" in particular could have saved me some frustration on bgl :>
08:44AM 
pcarns
 yeah, I had about enough of "stop everything and restart pvfs2-client-core in foreground" to see error messages
08:45AM 
pcarns
08:46AM 
pcarns
 kraken: is that a reply off list from that guy about buffering?
08:46AM 
pcarns
 kraken: bound to sink in sooner or later I guess :)
09:20AM 
kraken
 he keeps replying off-list, constantly :)
robl
 pcarns: hey, can you think of any reason to not turn on pvfs2-client logging by default?
09:54AM 
kraken
 can pvfs1 be told to only bind to a specific interface?
09:54AM 
53pcarns
 robl: no, not really
09:55AM 
pcarns
 kraken: no, I don't think so
09:56AM 
pcarns
 kraken: you can force a given iod to always be accessed on a particular interface just by putting that hostname or ip in the iodtab file though
09:57AM 
kraken
 that's what I thought
09:57AM 
kraken
 pcarns: you've got a meeting at 1 :)
robl
 wow, i haven't thought about setting up pvfs1 in years!
09:58AM 
pcarns
 kraken and I are stuck in a bad episode of "quantum leap"
09:58AM 
kraken
 which one of us is Al?
robl
 that's a show sci-fi should carry more often
robl
 pcarns: ok, i'm going to make -l always be the on.  if someone wants to disable logging for some reason they can -L /dev/null
10:01AM 
pcarns
 I'm afraid I'm not up on my quantum lore
10:03AM 
pcarns
 but it was on my mind because I noticed my tivo decided I should watch it
10:03AM 
53pcarns
 robl: works for me
robl
 kraken: hm.  if you're feeding pcarns info, i guess that makes you Al
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
10:14AM 
kraken
 neat
10:14AM 
kraken
 I want a little gizmo that makes me disappear
10:14AM 
bradles
 but the real question is: who is ziggy?
10:15AM 
kraken
 robr?
10:17AM 
bradles
 Oh, a quick google shows that ziggy was just a program -- I always assumed it was a person -- darn
robl
 bradles: ziggy was the program, gushi was the admin
robl
 sorry, Gooshie
10:19AM 
bradles
 I always assumed it was supposed to be god or something
10:19AM 
bradles
 omniscient as it was
robl
 well, that's how they eneded the series
10:20AM 
bradles
 oh, did he get home -- or just die
robl
 nope, never got home. met some kinda god-like being and then kept on leaping, altering the past
10:22AM 
bradles
 I nominate RobL as Gushie then
10:22AM 
bradles
 (I mean to be God's programmer, that's a pretty big deal)
10:22AM 
bradles
 (maybe a significant pay raise in there for you or something)
robl
 dammit, now you've got me googling for quantum leap stuff
10:28AM 
bradles
 Yes, we should ban Nathan
10:28AM 
bradles
 but then he explains read/write, so maybe its a wash :)
10:29AM 
kraken
 ooover and oooover again
10:29AM 
bradles
 you should make your sig: setvbuf( ... )
10:33AM 
bradles
 oh, yea, here is a fun intro to perpendicular storage for anyone interested:
10:33AM 
bradles
 http://www.hitachigst.com/hdd/research/recording_head/pr/PerpendicularAnimation.html
10:34AM 
bradles
 you can thank me for wasting your morning later
10:35AM 
kraken
 hahah
10:35AM 
kraken
 the scary thing is that I've seen that
10:37AM 
bradles
 Instead of slide based presentations, conference presenters should have to produce animation and songs
10:37AM 
bradles
 supercomputing would be really cool then
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
11:03AM 
slang
 bradles: nice
robl
 it alway annoys me when torage capacity is given in "number of sogns"
robl
 what if i like to encode stuff to FLAC?
robl
 slang: now i've got 'dancing queen' in my head, as sung by perpinduclar magnetic bits
11:10AM 
53slang
 robl: heh
robl
 pcarns: on a system like bluegene, we don't have netdb.h and gethostbyname.  other than that, access-logging.patch looks ok to me
11:37AM 
kraken
 bgl sounds like such a freaky weird system :)
11:49AM 
pcarns
 ah, do you guys have any configure/ifdef majick that we can wrap that stuff in?
robl
 pcarns: sure do. it'll be no problem
robl
 pcarns: i know exactly what to change. will take me mere moments
robl
 kraken: bgl is indeed an oddball
robl
 kraken: but it introduces supercomputer architecture components that will quite likely be the way we attain petaflop computers
robl
 (especially if you want high hp-linpack scores)
 SWAP: Window 3 is not hidden!
robl
 pcarns: so i'm going to have BMI_tcp_addr_rev_lookup_unexpected return "UNKNOWN" if the system fails a configure-time test for gethostbyaddr
robl
 pcarns: i tried to come up with a good string to return, but kept comming back to "UNKNOWN"
12:59PM 
pcarns
 yeah, that's about all I could come up with
robl
 cool
01:32PM 
kraken
 sometimes I think I make phil and david sad pandas\
01:34PM 
pcarns
 heh- 30 minutes was enough time for us to talk about anything we were thinking about :)
01:34PM 
pcarns
 but its all good
01:35PM 
kraken
 I'm so disillusioned, can you tell?
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36H   
~kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57kraken
: #pvfs2 
Read error: 104 (Connection reset by peer)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56Inkedfx 
36~gerald@217.164.251.223
 has joined #pvfs2
SignOff 
57Inkedfx
: #pvfs2 
Read error: 110 (Connection timed out)
56Inkedfx 
36~gerald@217.164.251.223
 has joined #pvfs2
SignOff 
57Inkedfx
: #pvfs2 
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57tolkien.freenode.net 
3610:30pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57slang
: #pvfs2 
Read error: 104 (Connection reset by peer)
56slang 
36~slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36~laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36~pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
08:03AM 
laytonj
 Good morning sports fans. I need help with a quick concise definition of data server and metadata server for an article I'm writing.
08:42AM 
pcarns
 data servers: store file contents, usually striped across servers in 64KB increments
08:42AM 
pcarns
 meta servers: store information _about_ files and directories, such as  ownership, permissions, and location of data servers
08:43AM 
pcarns
 *shrug*
08:58AM 
laytonj
 pcarns: That's about what I wrote. Just checking to see if anyone had anything better or more consice. Thanks!
56bradles 
36~bsettlem@ogo.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57bradles   
36H   
~bsettlem
ogo.mcs.anl.gov (gaim)
53#pvfs2     
57pcarns    
36H   
~pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
~laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
~slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
11:05AM 
kraken
 David just pointed out to me that the guy I was explaining fread() to had referred to me as Dr. Poznick
 bradles 
~bsettlem@ogo.mcs.anl.gov
 has left #pvfs2 
02:41PM 
pcarns
 kraken: someone should tell Don its much quicker to get a phd just by answering mailing list questions :)
03:25PM 
kraken
 indeed!
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Global Notice] Hi all. I'll be posting something later, but I wanted to mention this while people are still around for Friday.... if all goes well, we may do final testing of Hyperion 1.0RC* on the production freenode network on Monday morning around 9am UTC. Testing will last from about 30 minutes up through, well, permanent cutover, depending on how well it goes. 8)
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Global Notice] Please let us know if this presents any insurmountable difficulties; feel free to /msg me. Thanks.
 pcarns 
~pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35lilo@levin-pdpc.staff.freenode
50)-
 [Global Notice] Hi all. There's a news item up on http://freenode.net/news.shtml .... we'll be experiencing some network disruption Monday morning, and we'll be doing our first test upgrade of the production system to Hyperion around that time. Please take a look at the news item for more detail, and have a great morning! :)
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56kraken 
36~kraken@24.144.40.22
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+n
 by 
57calvino.freenode.net
52Users
32#pvfs2
50)]
54 robl      
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.030 secs!!
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56kraken 
36N=kraken@24.144.40.22
 has joined #pvfs2
56robl 
36N=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 kraken    
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.128 secs!!
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56robl 
36N=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54ChanServ  
54 kraken    
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.253 secs!!
56kraken 
36N=kraken@24.144.40.22
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36N=yf@61.49.205.219
 has joined #pvfs2
53#pvfs2     
57yftty     
36H   
N=yf
61.49.205.219 (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57kraken    
36G   
N=kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
N=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56yftty 
36N=yf@61.49.205.219
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36N=slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36N=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36N=pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
N=pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
56slang 
36N=slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36N=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
09:21AM 
53kraken
 robl: so apparently RobR and Walt are here today and tomorrow
robl
 kraken: oh, that's today?  cool
robl
 kraken: we gotta get you guys contributing more... since you know, you phil and david don't really say much or send any patches or anything...
09:59AM 
kraken
 bunch of slackers, I tell you what
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 SWAP: Window 3 is not hidden!
robl
 kraken: how's the robr and walting?
robl
02:56PM 
kraken
 going good I suppose
02:57PM 
kraken
 there was beer last night
02:57PM 
kraken
 I think this morning they went on a datacenter tour
02:57PM 
kraken
 (they called to ask me to do it, but I'm working from home today so I pointed them at someone else)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-215-227-48.aep.bellsouth.net
 has joined #pvfs2
robl
 pcarns: did you get to hang w/ walt and rob in arkansas?
09:15AM 
53pcarns
 robl: yep- we had a good time
09:17AM 
53pcarns
 robl: I wish we could have gotten all of you down,
09:17AM 
53pcarns
 robl: but maybe David and I can make it up to ANL sometime eventually
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-215-227-48.aep.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
N=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57kraken    
36H   
N=kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57robl      
36H   
N=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: cool. rob's actually in town today so i guess slang and i will get filled in on what went down
09:33AM 
53pcarns
 robl: yeah, I think we've got some good stuff to coordinate on, but he can probably tell you quicker in person :)
56yftty 
36n=yf@61.149.48.87
 has joined #pvfs2
 yftty 
n=yf@61.149.48.87
 has left #pvfs2 
 pcarns 
n=pcarns@adsl-215-227-48.aep.bellsouth.net
 has left #pvfs2 
56yftty 
36n=yf@61.51.37.170
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-219-47-240.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-219-47-240.asm.bellsouth.net
 has left #pvfs2 
robl
 someone tell pcarns when he shows up that i really appreciate the pvfs2-genconfig patches he contributed last month. i'm using the --fsid option heavily right now
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
03:58PM 
slang
 [D 15:58:07.757623] dbpf_open_cache_get: called
03:58PM 
slang
 [D 15:58:07.757685] dbpf_open_cache_get: type: 2 | create_flag: 0
03:58PM 
slang
 [D 15:58:07.757734] dbpf_open_cache_get: found entry in unused list.
03:58PM 
slang
 [D 15:58:07.757775] dbpf_open_cache_get: moving to (or reordering in) used list.
03:58PM 
slang
 [D 15:58:07.757892] dbpf_cache_elem_lookup: cache elem matching 4 returned (num_elems=2)
03:58PM 
slang
 [D 15:58:07.757966] ** CANNOT cache data retrieved (key is lost+found)
03:59PM 
slang
 [D 15:58:07.758013] dbpf_open_cache_put: cached entry.
03:59PM 
slang
 [D 15:58:07.758051] dbpf_open_cache_put: move to unused list.
03:59PM 
slang
 [D 15:58:07.758175] (0x8110b18) lookup_path state: read_object_metadata
03:59PM 
slang
 [D 15:58:07.758274] dbpf_open_cache_get: called
03:59PM 
slang
 [D 15:58:07.758349] dbpf_open_cache_get: type: 2 | create_flag: 0
03:59PM 
slang
 [D 15:58:07.758397] dbpf_open_cache_get: found entry in unused list.
03:59PM 
slang
 [D 15:58:07.758432] dbpf_open_cache_get: moving to (or reordering in) used list.
03:59PM 
slang
 [D 15:58:07.758471] dbpf_open_cache_get: called
03:59PM 
slang
 [D 15:58:07.758510] dbpf_open_cache_get: type: 1 | create_flag: 0
03:59PM 
slang
 [D 15:58:07.758550] dbpf_open_cache_get: resetting entry from free list.
03:59PM 
slang
 [D 15:58:07.758598] dbpf_open_cache open_fd: opening fd 1048577, create: 0
03:59PM 
53slang
 robl: seems to be stuck there
03:59PM 
53slang
 robl: strace output loops on gettimeofday..
03:59PM 
slang
 futex(0x80d10b0, FUTEX_WAKE, 1)         = 0
03:59PM 
slang
 gettimeofday({1124139241, 780104}, NULL) = 0
03:59PM 
slang
 gettimeofday({1124139241, 780863}, NULL) = 0
03:59PM 
slang
 clock_gettime(CLOCK_REALTIME, {1124139241, 781616000}) = 0
03:59PM 
slang
 futex(0x80cf050, FUTEX_WAIT, 6614, {0, 99247000}) = -1 ETIMEDOUT (Connection timed out)
03:59PM 
slang
 futex(0x80d10b0, FUTEX_WAKE, 1)         = 0
03:59PM 
slang
 gettimeofday({1124139241, 885103}, NULL) = 0
03:59PM 
slang
 gettimeofday({1124139241, 885648}, NULL) = 0
03:59PM 
slang
 clock_gettime(CLOCK_REALTIME, {1124139241, 886015000}) = 0
03:59PM 
slang
 futex(0x80cf050, FUTEX_WAIT, 6615, {0, 99633000}) = -1 ETIMEDOUT (Connection timed out)
BitchX
: Ambiguous command: WH
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24.196.226.167
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@24.196.226.167
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3605:21pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57kraken
: #pvfs2 
"Lost terminal"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36N=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36N=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-24.mia.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has joined #pvfs2
56yftty 
36n=yf@221.219.60.230
 has joined #pvfs2
56Martyn 
36n=martinb@gateway.penguincomputing.com
 has joined #pvfs2
10:35AM 
Martyn
 hey all.
10:35AM 
Martyn
 Anyone awake?
53#pvfs2     
57Martyn    
36H   
n=martinb
gateway.penguincomputing.com (who?)
53#pvfs2     
57yftty     
36H   
n=yf
221.219.60.230 (gaim)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-24.mia.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 Martyn: hey
robl
 most of us are on CDT or EDT so yeah, we're awake :>
12:01PM 
Martyn
 Heh ..
12:01PM 
Martyn
 thanks.   I have a pvfs1 vs 2 question
12:02PM 
Martyn
 I've got a problem involving linux 2.4.   I have a 7Tb disk array I would like to use as a single contiguous filesystem.  due to the inherent limitations of the 2.4.21 RedHat kernel, I cannot mount it as a single volume.
12:03PM 
Martyn
 I have therefore formatted the array into 7 fiberchannel scsi LUNs, which 2.4 sees as "/dev/sdb,c,d,e,f,g,h"
12:04PM 
Martyn
 The LUNS are formatted with a single partition each, using the ext3 filesystem
12:04PM 
Martyn
 So "/dev/sdb1, sdc1 ... sdh1"
12:04PM 
Martyn
 I would like to use PVFS to stitch the seven filesystems into one large filesystem using seven IOD's on different ports.  Is this approach both sane and practical?
robl
 wow
robl
 ok, it's *possible*
robl
 but not exactly what pvfs1 or 2 was meant to do
robl
 what you want is what LVM would provide
12:18PM 
Martyn
 I know, but unfortunately LVM is subject to the same block-device limitation
robl
 but if there's a 2TB device limit, then yeah, i can see that would be a problem
12:18PM 
Martyn
 yep :}
12:19PM 
Martyn
 And yes, I know that this is a TOTAL bastardization of what PVFS is meant to do.
12:19PM 
Martyn
 -heh-
12:19PM 
Martyn
 I mean it would be nice to be using PVFS/mpio via ROMEO :}
robl
 well... ok, so start off playing with things this way
12:19PM 
Martyn
 but that's not what's needed in this case .. the application that's running isn't inherently MPI :P
robl
 but soon down the road you should bring on more servers who can see the same remote scsi device
robl
12:20PM 
Martyn
 heh, yes .. I know .. Bad Martyn, no donut.   -sigh-  :}  
12:20PM 
Martyn
 On the other hand, PVFS could solve the problem nicely, because the authors are good software writers who's documentation let me figure this out :}
robl
 well.. hey, give it a shot and let us know :>
robl
 it all sounds like it should work, though you'll incur a bit of overhead
12:22PM 
Martyn
 *nod*
robl
 (in the parallell case the overall speedup dwarfs the overhead, but in this case i don't think that will happen)
12:22PM 
pcarns
 I can vouch for the fact that this scenario does actually work, at least
robl
 in short, i know of no reason why it should *not* work :>
12:22PM 
pcarns
 not sure about the speed implications, though
12:23PM 
Martyn
 The underlying block devices are talking over fiberchannel .. and iSCSI over InfiniBand .. so the real overhead will be PVFS doing write/read shuffles between IOD's
12:23PM 
pcarns
 I've seen setups that do that with PVFS1
12:23PM 
pcarns
 (multiple iod's per node to get over 2TB limit)
12:23PM 
Martyn
 Right, I intend to use PVFS1 for the purpose.  It looks like it will work.
12:24PM 
Martyn
 Oh!  One other thing .. if I have seven IOD's running on one machine, but small files are being written .. do the writes get shuffled between the various IOD's?
12:24PM 
Martyn
 ie.. does PVFS1 manage to avoid writing them all to iodaemon0?
12:24PM 
Martyn
 (where the files are .. say .. 128K->1M)
robl
 Martyn: i think you have to make a few tweaks to a config file... it's somewhere in the mailing list archives
12:28PM 
53Martyn
 robl : Already there and reading
12:30PM 
pcarns
 there is a command line option to the mgr to make sure they start on random servers, I think
12:30PM 
pcarns
 oh yeah, "-r" is what you want
12:31PM 
pcarns
 that will make it pick a random starting iod for each new file that is created
12:31PM 
Martyn
 pcarns : Just use -r when spawning the meta server?
12:31PM 
pcarns
 yeah, I think so
12:32PM 
pcarns
 the mgr unfortunately doesn't have a config file- so you have to tell it things like that on the command line
01:17PM 
Martyn
01:18PM 
Martyn
 It's easy enough to do in the init script
53#pvfs2     
57Martyn    
36H   
n=martinb
gateway.penguincomputing.com (who?)
53#pvfs2     
57yftty     
36H   
n=yf
221.219.60.230 (gaim)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-24.mia.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57Martyn
: #pvfs2 
"Leaving"
 pcarns 
n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36n=yf@221.219.52.28
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-61-120-24.mia.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 SWAP: Window 3 is not hidden!
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.593 secs!!
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.339 secs!!
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36n=pcarns@adsl-34-55-141.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
Netjoined: 
57irc.freenode.net zelazny.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-55-141.asm.bellsouth.net (gaim)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Thank you for your patience during this test. You may need to reidentify to services, as it will have been offline during some of the server reups. ( http://freenode.net/news.shtml )
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-34-55-141.asm.bellsouth.net
 has left #pvfs2 
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.225 secs!!
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-55-141.asm.bellsouth.net
 has joined #pvfs2
robl
 our BoF submission was accepted
robl
 see you in seattle
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-55-141.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-55-141.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
09:39AM 
53slang
 robl: woo!
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
56Martyn 
36n=martinb@gateway.penguincomputing.com
 has joined #pvfs2
02:52PM 
Martyn
 Hey all.
02:52PM 
Martyn
 Anyone awake?
robl
 Martyn: hey
03:12PM 
Martyn
 hey there robl
03:12PM 
Martyn
 I want to make sure I can fail over pvfs between two nodes
03:12PM 
Martyn
 (head node, pvfs-meta)
03:12PM 
Martyn
 Now, I have a directory on the main head node called "/pvfs-meta" which contains the .iodtab and .pvfsdir
03:13PM 
Martyn
 I have replicated that dir onto the second (failover) node .. is there any other data I need to move?
03:13PM 
Martyn
 (in a failover scenario)
robl
 yes, that directory is the only thing the pvfs1 metadata server needs
robl
 so as long as you replicate that entire directory tree, you're cool
03:20PM 
Martyn
 are there any other dot-files in there?
03:20PM 
Martyn
 Or just those two?
robl
 each directory has two dotfiles in it
robl
 each subdirectory, i mean
robl
 (boy, it's been a while.  i *think* that's the case)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Good evening, all. We've resolved our segfault problems with 1.0.1 and will be upgrading to a new version which should be missing those problems. The high-impact part of the upgrade will be done early morning UTC. For more information, please see http://freenode.net/news.shtml .... thanks, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3603:45pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
03:48PM 
32lilo:*
 Two small server upgrades; affected users, about 60
SignOff 
57Martyn
: #pvfs2 
"Leaving"
 pcarns 
n=pcarns@adsl-34-55-141.asm.bellsouth.net
 has left #pvfs2 
 SWAP: Window 3 is not hidden!
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.898 secs!!
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56yftty 
36n=yf@61.49.205.210
 has joined #pvfs2
 yftty 
n=yf@61.49.205.210
 has left #pvfs2 
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57laytonj
: #pvfs2 
"Leaving"
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-55-141.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
05:01PM 
32lilo:*
 A problem exists with the NickServ 'SET UNFILTERED ON' flag, in connection with cloaking. If you have a cloak, this UNFILTERED may be set on as well. We're working on a patch and should have something fairly soon. Thanks.
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
Netjoined: 
57irc.freenode.net zelazny.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3609:22am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54ChanServ  
54 slang     
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 20.805 secs!!
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36G   
n=pcarns
adsl-61-120-81.mia.bellsouth.net (gaim)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
10:53AM 
32lilo:*
 Hi all. Hints: with services, server crashes can remove your identification to nickserv, and you may have to reidentify ("/msg nickserv identify yourpasswordhere") by hand in this case. We're working on solutions that will solve that problem, though we're not quite there yet.
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
56robl 
36n=robl@66.139.79.169
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 pcarns    
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
56slang 
36n=slang@140.221.11.69
 has joined #pvfs2
BitchX
: Join to #pvfs2 was synched in 23.008 secs!!
56laytonj 
36n=laytonj@24.196.226.167
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
24.196.226.167 (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-81.mia.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:41pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56kraken 
36n=kraken@24.144.40.22
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
12:43PM 
53kraken
 robl: psst
robl
 kraken: hi
12:46PM 
kraken
 I was poking around the kernel code, and it looks like the changes to support -o noatime are fairly minimal
12:47PM 
kraken
 the kernel module already uses the vfs layer update_atime option which automatically checks for S_NOATIME in inode->i_flags
12:48PM 
kraken
 the way ext2 does it is to have a function, ext2_set_inode_flags(), which sets the inode->i_flags accordingly, which is then called at the end of ext2_inode_read()
12:48PM 
kraken
 er, ext2_read_inode()
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:49pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
12:50PM 
kraken
 anyway, it's a bit beyond my casual kernel experience but I bet Murali could handle it somewhat easily, especially given ext2 as an example :)
53#pvfs2     
57kraken    
36H   
n=kraken
24.144.40.22 (I am Jack's $IRCNAME)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24.196.226.167 (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
robl
 kraken: yeah, good to know that the VFS does a lot of our work
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
55christel
35i=christel@freenode/staff/christel
50)-
 [Global Notice] Hi all! Are you waiting for a group contact form to be verified and approved? I have a large number of forms with incomplete contact details, if you believe one of these might belong to your group/project please re-submit. Also, remember that you can bump your priority by "squeeky wheeling" me either by PM or e-mail (christel@freenode.net). Thank you and have a great day!
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
 kraken 
n=kraken@24.144.40.22
 has left #pvfs2 
 pcarns 
n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
56pcarns 
36n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has joined #pvfs2
robl
 pcarns: welcome back, patch monster
12:11PM 
pcarns
 when it rains it pours :)
12:11PM 
pcarns
 I didn't realize we had that many; David and I have been stuck testing SAN deployments for a while now
robl
 pcarns: you poor guys... i'm forever scarrd from SANs after slogging through them in 2001
robl
 vixel makes a horrible FC switch, and emulex HBAs are garbage!
12:42PM 
pcarns
 ours seem to work ok
12:42PM 
pcarns
 all emc stuff I think
12:43PM 
pcarns
 but someone else has already done the hard part of configuring and setting up everything
12:43PM 
pcarns
 so easy for me to say I guess
01:40PM 
32lilo:*
 Hi all. A new, unofficial channel has been set up for discussion and support of grsecurity; access lists, features, etc. If you're interested and/or would like to help, please stop by ##grsecurity, idle a bit, discuss related topics. Thanks!
robl
 pcarns: i love having systems folks to worry about hardware
 pcarns 
n=pcarns@adsl-61-120-81.mia.bellsouth.net
 has left #pvfs2 
56yftty 
36n=yf@221.219.56.111
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
11:23AM 
50* 
53slang/#pvfs2 
pings clemson
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
10:10AM 
pcarns
 slang: did you forget part of your cvs commit the other day?
10:11AM 
pcarns
 slang: I saw something on cvs mailing list about the flow_clear issue, but the patch only had a whitespace change to sys-io.sm
01:58PM 
pcarns
 slang: oh, I see the list messages now, nvrmind
02:44PM 
slang
 pcarns: hey
02:44PM 
slang
 pcarns: you around?
02:44PM 
pcarns
 slang: yep, I'm here
02:46PM 
slang
 pcarns: it looks to me like FLOW_CLEANUP is cleaning up stuff that PINT_flow_clear tries to cleanup as well
02:46PM 
pcarns
 you talking about Pete's problem?
02:46PM 
slang
 yeah
02:48PM 
pcarns
 what stuff are the conflicting on?  (sorry, haven't dug through Pete's last emails yet)
02:52PM 
slang
 maybe not
02:52PM 
slang
 its hard to tell
02:52PM 
slang
 the flow_data->parent stuff confuses me
03:13PM 
pcarns
 I haven't stepped through to see what happens in those EOF cases in the sys-io state machine,
03:13PM 
pcarns
 maybe it isn't really following a good error path?
03:14PM 
slang
 pcarns: maybe
03:14PM 
slang
 pcarns: pete's debugging seems to suggest that the context array is getting freed elsewhere
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
05:01PM 
32christel:*
 : Happy 16th birthday to HauntedUnix! He'd be most thrilled if you congratulated him in ##trivia 
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
56yftty 
36n=yf@221.222.219.214
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
56bress 
36n=bress@redhat/bress
 has joined #c-60
 bress 
n=bress@redhat/bress
 has left #c-60 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56Martyn 
36n=martinb@adsl-63-203-69-169.dsl.snfc21.pacbell.net
 has joined #pvfs2
02:16AM 
Martyn
 Anyone nutty enough to be awake right now?
SignOff 
57Martyn
: #pvfs2 
"Leaving"
56slang 
36n=slang@140.221.11.69
 has joined #pvfs2
56slang 
36n=slang@140.221.11.69
 has joined #pvfs2
56hamza 
36n=hamza@81.214.142.180
 has joined #pvfs2
05:59AM 
hamza
05:59AM 
hamza
 anyone out there?
SignOff 
57hamza
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
56Martyn 
36n=martinb@gateway.penguincomputing.com
 has joined #pvfs2
03:55PM 
Martyn
 Quick PVFS v1 question
03:56PM 
Martyn
 Symbolic links are supported in version 1.6.3 ... if I installed a filesystem using 1.5.3, will I have to recreate the metadata to use them?
03:56PM 
Martyn
 Or can I just upgrade from 1.5->1.6.3 with no issues?
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
53#pvfs2     
57Martyn    
36H   
n=martinb
gateway.penguincomputing.com (who?)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
robl
 Martyn: there have been several metadata changes (1.5.4, 1.5.6).  you can upgrade the metadata with the tools in pvfs1 (migrate-<VERSION>-to-<VERSION>.c)
robl
 so you need to convert 1.5.6 to 1.5.7, then 1.6.2 to 1.6.3
06:24PM 
Martyn
 Thanks.
06:24PM 
Martyn
 I knew waiting in channel would be worth it :]
06:25PM 
Martyn
 Also, running executables from pvfs v1 mounted filesystems .. solved, not solved, or something best left to pvfs2?
SignOff 
57Martyn
: #pvfs2 
"Oh no! I've gone POOF!"
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
56hamza 
36n=hamza@81.214.142.180
 has joined #pvfs2
SignOff 
57hamza
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: you still on -internal?
09:21AM 
53pcarns
 robl: yep
robl
 pcarns: ok, cool. then you probably know my next question: any more patches pending from your end?
11:49AM 
53pcarns
 robl: sorry, was out for a bit
11:49AM 
53pcarns
 robl: we do have two more patches, but they aren't important enough to wait for
11:49AM 
53pcarns
 robl: no bugs or anything
robl
 pcarns: ok. rross wants the zero fill bug fixed by the next release... might take a bit of time to track things down
robl
 pcarns: hey
robl
 pcarns: we're looking at devpvfs2-req.c
robl
 pcarns: i just committed a fix for a possible memory leak in pvfs2_devreq_write
robl
 pcarns: the platofrm guys found a case where in an error condition, kmem_cache_free wasn't being called
robl
 pcarns: do you know if that's a real fix, or is that an error path where we don't want to free that memroy for some reason?
04:20PM 
53pcarns
 robl: hey, I'm pretty much in meetings today, but I will look at that cvs commit later
robl
 pcarns: no problem. just wanted to let you know i'm messing wit your code
 pcarns 
n=pcarns@adsl-218-104-183.asm.bellsouth.net
 has left #pvfs2 
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
56`fdog 
36n=go_away@211.97.205.68.cfl.res.rr.com
 has joined #pvfs2
robl
 frank?
08:47PM 
`fdog
08:47PM 
`fdog
 this place is pretty dead these days
08:48PM 
`fdog
 not a large need for irc support I see
robl
 no way, hoss. we have people hopping in here all the time. 
robl
 well, i guess relatively speaking it's dead
robl
 people hop in at 3am Chicago time, ask a question, and split
09:00PM 
`fdog
09:00PM 
`fdog
 I thought you were working on terragrid stuff for the most part anyways these days?
robl
 me? no way, tg is the suxors
robl
 bluegene
09:01PM 
`fdog
 I thought I saw something on /. about MCS getting a bunch of funding to do more terragrid stuff or something
robl
 heh. probably. what a clusterfuck
09:02PM 
`fdog
 so you're not at mcs anymore?
robl
 oh, yeah. i mean the teragrid is a clusterfuck
robl
 mcs still rocks most of the time
09:05PM 
`fdog
 cool
09:05PM 
`fdog
 have you seen the pictures of the old bridges getting torn down?
09:08PM 
`fdog
 http://www.parl.clemson.edu/~fshorte/cooper_river_bridge/demolition/
09:08PM 
`fdog
 couple shots from about a month ago
robl
 aw, sorry i missed it
robl
 kinda forgot about it
robl
 `fdog: holy crap!
09:13PM 
`fdog
 yea, it looks weird
09:13PM 
`fdog
 they're really taking them down fast
robl
 round holiday inn!
09:14PM 
`fdog
 can you see that in those pictures?
robl
 0155.jpg
09:14PM 
`fdog
 ha, off in the distance
robl
 cool. you did the first walk across the new bridge thing?
09:16PM 
`fdog
 yea, those pics should be one dir up
robl
 wow, tall bridge
09:17PM 
`fdog
 yea, its enormous
09:17PM 
`fdog
 1689.jpg shows how high up it is
53#pvfs2     
57`fdog     
36H   
n=go_away
211.97.205.68.cfl.res.rr.com (0690)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
09:18PM 
`fdog
 that the road surface is level with the top of the superstructures of the old bridges
robl
 astounding
robl
 maybe i'll get over there during thanksgiving
08:39PM 
50* 
53`fdog/#pvfs2 
blinks
08:39PM 
53`fdog
 robl
 hey, does robr still fool around with mythtv at all?
robl
 `fdog: not much. i don't think he's ever home long enough to play with it
10:07PM 
`fdog
 hrm
10:07PM 
`fdog
 did sarah say anything about being pissed at me?
10:08PM 
50* 
53`fdog/#pvfs2 
gets ignored
robl
 `fdog: i didn't think anyone could make sarah pissed
10:28PM 
50* 
53`fdog/#pvfs2 
bows
10:28PM 
`fdog
 ...
53#pvfs2     
57`fdog     
36H   
n=go_away
211.97.205.68.cfl.res.rr.com (0690)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
56yftty 
36n=yf@61.51.39.30
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
SignOff 
57`fdog
: #pvfs2 
"rebooting"
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey
robl
 pcarns: i'm about to commit a patch to the flow code that a guy in germany says prevents a segfault.  i've never seen a seg fault from this part of the code, and i'm not sure how to trigger immeidate completion of a write or read.
robl
 just a heads up
01:09PM 
53pcarns
 robl: hey, I looked at that patch earlier today, I think-
01:09PM 
53pcarns
 robl: I sent an updated version to robr
01:10PM 
53pcarns
 robl: I think he was going to ask them to try it out, you might want to check on that before committing patch
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
03:14PM 
53pcarns
 robl: any new guess on when you guys plan to release?
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey
robl
 pcarns: release plans... well, now that sam has zero fill fixed (we think), we'll probably release friday or early next week
08:26AM 
53pcarns
 robl: cool- if you guys get to a potential code freeze point, let us know and I will merge into our tree and test a little too
robl
 pcarns: wow, you're making me maybe be more legit and start a release branch :>
robl
 pcarns: i'm in raleigh today and tomorrow.  i'll tag a -pre on friday for you guys
08:28AM 
53pcarns
 robl: oh, you don't have to tag or anything
08:29AM 
53pcarns
 robl: you can just let us know when you guys think the patching etc. is kind of settled down
08:29AM 
pcarns
 I can merge anytime
robl
 pcarns: oh :>  ok, then go ahead and merge now...no wait
robl
 pcarns: still have to apply your protocol versioning patch. will do that at the break
08:59AM 
53pcarns
 robl: ok, no rush
08:59AM 
53pcarns
 robl: we aren't in a hurry or anything, just figured once you got whatever patches in we may as well start working with it before the release
robl
 pcarns: cool.  our testing is barely adequate, so i'm eager to get you guys to bang on it
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3604:02pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: thanks. that explanation helps a lot
08:37AM 
53pcarns
 robl: np
robl
 pcarns: ok, every outstanding patch i know about is in the tree
robl
 pcarns: we'll probably make some portablity fixes to the kernel module so we can build on suse's 2.6.5 kernel, but aside from that and bugfixes, that's the 1.3.0 release
08:44AM 
53pcarns
 robl: great!
08:45AM 
53pcarns
 robl: I'll probably do a vendor merge sometime today- I'll let you know if we run into anything between now and release time
robl
 pcarns: cool. looking for monday/tuesday time frame
10:55AM 
53pcarns
 robl: heads up- there is a problem building the 2.4 kernel driver in the current cvs tree
10:56AM 
53pcarns
 robl: I'm looking at it now, I will communicate a fix or patch when I figure out how to fix it
10:56AM 
53pcarns
 robl: something to do with the new acl stuff
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-57-242.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
robl
 pcarns: at one point it owrked against 2.4.31
11:00AM 
pcarns
 pcarns: that's what I am trying to build against
11:12AM 
53pcarns
 robl: also fails on redhat 2.4.21
robl
 dang. ok, i can get this working friday. murali is looking at 2.6.5 today.  can you email him and me with your findings/patches?  
robl
 (i'm still in raleigh and allegedly paying attention to this SDM meeting)
11:23AM 
pcarns
 sure thing
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56rross 
36n=rross@r910-sheratoncc.fu.nc.windchannel.com
 has joined #pvfs2
09:19AM 
rross
 anyone home?
09:23AM 
rross
 guess not so much
 rross 
n=rross@r910-sheratoncc.fu.nc.windchannel.com
 has left #pvfs2 
robl
 just missed him
10:07AM 
53slang
 robl: here and gone in 4 mins
10:07AM 
53slang
 robl: maybe we can setup an alert system when rob shows up ;-)
robl
 slang: not very patient
robl
 heh. an irc bot that calls our phones
robl
 slang: working from home todya?
10:08AM 
53slang
 robl: exactly!
10:08AM 
53slang
 robl: looks like it
10:08AM 
53slang
 robl: you're at the lab?
robl
 cool
10:09AM 
53slang
 robl: gotta go pickup my race packet at some point today
robl
 slang: yeah! just 2 more days
robl
 slang: do you know when you expect to hit mile 25?
robl
 slang: couldn't find any "track a runner" feature on the website
10:13AM 
53slang
 robl: I'm going to shoot for 7.5 mins/mile
10:13AM 
53slang
 robl: but its highly dependent on the temp
robl
 slang: cooler == faster?
10:13AM 
53slang
 robl: yeah
10:14AM 
53slang
 robl: last year was ~ 70, I did the first 20 miles @ 7:20
10:14AM 
53slang
 robl: then I hit the wall
10:14AM 
53slang
 robl: ended up with 3:30
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
10:15AM 
53slang
 robl: I think you can get runner updates sent to your cellphone somehow
10:16AM 
slang
 http://www.doitsports.com/results/MSG-signup.tcl?sub_event_id=2161
robl
 slang: cool. now i'm going to get splits sent to rlatham@gmail.com
robl
 wonder how laggy it'll be
10:21AM 
53slang
 robl: last year it was ~ 5 mins off or so iirc
10:21AM 
53slang
 robl: not too bad
10:22AM 
53slang
 robl: I think there are only 2 splits though
robl
 slang: really?  they wouldn't report every mile?
10:23AM 
slang
 heh.  40k*26 is too many messages for their little servers I guess
robl
 heh. good point
robl
 wait! no that's not a lot over 4 hours!
10:32AM 
53slang
 robl: so you say mr. hpc
robl
 slang: so changing topics, did you get tickets to the alcs?
10:44AM 
53slang
 robl: nope
10:44AM 
53slang
 robl: I tried but all lines (and web portals) were busy
robl
 slang: stinktastic man
robl
 pro sports need to do better about encouraging the individual fan
robl
 some lamer scalper has a giant block, no doubt
robl
 only 6 for ultimate
robl
 must be too cold
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
11:16AM 
53slang
 robl: well - I could have had postseason tix if I had gotten the 13 game plan instead of the 9 game plan :-<
11:18AM 
53slang
 robl: no one has responded to my operation id email...does it not make sense?
robl
 slang: i forgot about it, actually :<
11:34AM 
53slang
 robl: I tried to modify my procmailrc to redirect spam to /dev/null and I'm a little wary that I've screwed it up somehow
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
01:44PM 
53pcarns
 robl: hey, you around?
robl
 pcarns: howdy
01:45PM 
53pcarns
 robl: I worked up a patch that adds a configure test for the setxattr() prototype in the kernel
robl
 pcarns: pvfs2 is all messed up!
robl
 pcarns: oh, cool
01:45PM 
53pcarns
 robl: just giving you a heads up, I'll try to get it approved to get to you guys shortly
robl
 thanks. sounds great
01:46PM 
53pcarns
 robl: what's messed up?
robl
 pcarns: pvfs2-cp hasn't worked since monday apparently
01:52PM 
pcarns
 phhh- who needs I/O anyway
robl
 yeah, we should just short-circuit that routine anyway
02:14PM 
53slang
 robl: that pvfs2-cp error
02:14PM 
53slang
 robl: looks like its caused by the zero-fill commits I made
02:14PM 
53slang
 robl: is the automated test stuff just catching that now?
robl
 slang: no, caught it october 4th
robl
 slang: /i/ didn't catch it until today though :>
02:20PM 
pcarns
 what is the tinderbox url, by the way?
robl
 pcarns: http://lain.mcs.anl.gov/tinderbox2/PVFS2/status.html
robl
 pcarns: unfortunatly it's behind the anl firewall
02:21PM 
53pcarns
 robl: oh yeah, that's right
02:22PM 
53pcarns
 robl: I forgot
robl
 slang: so you're on the pvfs2-cp case?
02:27PM 
53slang
 robl: sorry my connection flamed out on me
02:28PM 
53slang
 robl: yeah looking at it
02:28PM 
53slang
 robl: I guess I shouldn't use the autobuilds as verification that my commits didn't break anything if I'm not going to look at the webpage :-|
robl
 slang: i'm lax about it too
02:31PM 
53slang
 robl: we need more bots!
robl
 i are a bot!
robl
 how do i tell gcc to not use /usr/include ?
robl
 i feel like there's a flag specifically for that
02:47PM 
53slang
 robl: -nostdinc?
50* 
57robl 
hugs slang
02:47PM 
pcarns
 telling gcc something is easy
02:47PM 
pcarns
 getting it to listen is hte hard part
02:54PM 
50* 
53slang/#pvfs2 
thwaps himself
02:55PM 
slang
 we don't really need to do writes, do we?
02:56PM 
50* 
53slang/#pvfs2 
fixes zero-fill reads
02:56PM 
50* 
53slang/#pvfs2 
breaks writes in the process
robl
 we can have reads or writes but not both!
robl
 "oh, you want to build pvfs2 with the --enable-writes option.  one warning, though... it disables reads"
02:58PM 
slang
 heh
02:58PM 
slang
 writes are overrated
02:58PM 
slang
 overwrited too!
02:58PM 
50* 
53slang/#pvfs2 
eyes himself warily
robl
 hm. so, -nostdinc was great, except some of the kernel headers bring in stdarg.h
robl
 which is burried away in some compiler-specific directory
robl
 all this because some systems have xattr_acl.h in /usr/include/linux...
03:00PM 
53slang
 robl: do we really need xattr support?
03:00PM 
53slang
 robl: I mean we don't even have write support at the moment..
robl
 pvfs-1.3.0 -- if it's all disabled, there can't be any bugs!
03:04PM 
pcarns
 hehehe
03:04PM 
pcarns
 you guys have fun with that
03:04PM 
pcarns
 I'm starting my weekend
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
03:10PM 
53slang
 robl: hmm
03:12PM 
53slang
 robl: I have a question about the semantics of PVFS_sys_read
robl
 slang: o...k
03:13PM 
53slang
 robl: (well PVFS_sys_io in the case of reads anyway)
03:15PM 
53slang
 robl: pvfs2-cp just passes in PVFS_BYTE as the file_req
03:15PM 
53slang
 robl: which obviously has an aggregate size of 1
03:19PM 
slang
 hmm..I need to think about this some more
SignOff 
57laytonj
: #pvfs2 
"Leaving"
robl
 slang: ok, i'll be around :>
robl
 ok, 2.6.13.3, 2.6.12.5, 2.6.11.10, 2.6.5, 2.4.31, and 2.4.19 now all configure/compile
robl
 no idea if the resulting kernel modules actually load...
robl
 -nostdinc +isysdir
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3604:24pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
robl
 slang: oh man, for your sake i hope the sox don't win tonight, but it'd be great if they did
06:04PM 
53slang
 robl: why don't win tonight?
robl
 slang: so you can see them play
06:10PM 
53slang
 robl: ah
06:10PM 
53slang
 robl: I probably won't go on sunday if it gets that far anyway
06:10PM 
53slang
 robl: I'd just end up falling asleep :-)
06:11PM 
53slang
 robl: I won't mind if they win tonight anyway ;-)
robl
 right on
robl
 4-3 in the 8th
robl
 slang: sweep!
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3611:50pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3604:09am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3607:46am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-57-242.asm.bellsouth.net (gaim)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
01:17PM 
53pcarns
 robl: hey, what version of tinderbox are you guys using?  
01:18PM 
53pcarns
 robl: David is trying to find something to kick around with a little bit
01:35PM 
53pcarns
 robl: nevermind, we found it in mozilla's cvs
01:51PM 
slang
 pcarns: we're using tinderbox2
01:52PM 
slang
 pcarns: I think I checked it out from mozilla's cvs
01:52PM 
pcarns
 slang: thanks- that's what we are trying
01:52PM 
slang
 pcarns: the TinderConfig.pm file has rcs revision 1.52 so you can get an idea of how old that is
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
56kraken 
36n=kraken@24.144.40.22
 has joined #pvfs2
robl
 kraken: hey. thanks for the suggestion, but that's not enough
robl
 kraken: the client tries to bind to the first address, which is not routable from that client, then gives up
12:55PM 
kraken
 ahh
robl
 kraken: i should clarify that on the ml
12:55PM 
kraken
 well, even if you get past that, the server will be confused due to the INADDR_ANY binding
robl
 kraken: really? i'm not convinced about that
12:56PM 
kraken
 yeah.
12:56PM 
kraken
 well...
12:57PM 
kraken
 so long as the bmi layer properly decides which home it's talking to, I suppose it's ok
12:57PM 
kraken
 what I'd be worried about is the server getting confused by trying to bind to the same port twice
12:58PM 
kraken
 it wouldn't necessarily be a bad thing though to be able to force pvfs2-server to only bind to a specific IP
12:59PM 
kraken
 for situations where you want to force all pvfs2 traffic through a specific interface
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
 kraken 
n=kraken@24.144.40.22
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3604:48am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57pcarns
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-57-242.asm.bellsouth.net (gaim)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
56yftty 
36n=yf@61.51.63.238
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
55alindeman
35i=adml@freenode/staff/gallery.alindeman
50)-
 {Global Notice} Hi all.  We are aware that some channels were cleared and are currently inaccessible.  We are isolating a cause currently and are correcting cmodes on channels that were affected.  If you are still having trouble joining an affected channel, let a freenode staffer ( /stats p ) know.  Thank you.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're having issues with an attack. We're restoring a previous services backup. Please bear with us.
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. As you are now aware, services are back up. This would be a good time to change your channel password if you can. Please check with first level support (/stats p) if you need help, and bear with us, as we might be a bit bogged down. Thank.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] This would be a good time to mention that freenode needs help with out 'freenode-registry' project, which would certainly help us avoid some compromises and recover more effectively. If you're interested in helping out, stop by #freenode-registry. I may have spotty availability for the next few hours or day, but will want to talk to you personally. Thanks.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] (and by the way, that channel name is #freenode-registry without the dots, thanks!)
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56yftty 
36n=yf@61.49.205.227
 has joined #pvfs2
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 You have already identified
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3605:13pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57yftty     
36H   
n=yf
61.49.205.227 (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
56yftt1 
36n=yf@221.219.58.194
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Read error: 110 (Connection timed out)
 yftt1 
n=yf@221.219.58.194
 has left #pvfs2 
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56yftty 
36n=yf@221.217.50.182
 has joined #pvfs2
56jak 
36n=jak@81-86-122-65.dsl.pipex.com
 has joined #pvfs2
11:51AM 
  I'm going to be configuring a cluster of three machines, 2 with disk arrays
11:51AM 
 So two of the machines will have a disk-array directly attached
11:51AM 
 is it possible to configure PVFS2, so that the data is duplicated on each disk array
11:51AM 
 so that the machines with direct-attached storage are able to read more quickly from their local copies?
robl
 jak: pvfs2 doesn't do that sort of replication (yet). people are working on it, but it's still a year away
robl
 jak: if you want that sort of replication, look into some of the distributed network block device efforts
04:11PM 
 interesting
04:11PM 
 i'll google that, thanks
SignOff 
57jak
: #pvfs2 
"Leaving"
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56yftty 
36n=yf@221.217.50.182
 has joined #pvfs2
 yftty 
n=yf@221.217.50.182
 has left #pvfs2 
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
01:49PM 
slang
 http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
140.221.11.69 (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
66.139.79.169 (Rob Latham)
02:44PM 
slang
 http://www.pvfs.org/cgi-bin/pvfs2/viewcvs/viewcvs.cgi/
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3611:42pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 22.747 secs!!
56slang 
36n=slang@140.221.11.69
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 #pvfs2  [freenode-info] if you need to send private messages, please register: http://freenode.net/faq.shtml#nicksetup
56slang 
36n=slang@140.221.11.69
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has joined #pvfs2
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
 pcarns 
n=pcarns@adsl-34-57-242.asm.bellsouth.net
 has left #pvfs2 
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
01:52PM 
32lilo:*
 Hi all. We seem to have a new sports-related channel courtesy of Hawkwind.... there's a Nascar race going on right now, and of course, bring your favorite sport. You're invited to stop by ##sports ....
56jak 
36n=jak@laptop74.dynip.doc.ic.ac.uk
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 104 (Connection reset by peer)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57jak
: #pvfs2 
Connection timed out
56jak_ 
36n=jak@81-86-122-65.dsl.pipex.com
 has joined #pvfs2
SignOff 
57jak_
: #pvfs2 
Client Quit
56jak_ 
36n=jak@81-86-122-65.dsl.pipex.com
 has joined #pvfs2
SignOff 
57jak_
: #pvfs2 
Remote closed the connection
SignOff 
57laytonj
: #pvfs2 
"Leaving"
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 quiet quiet
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 104 (Connection reset by peer)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-145-178-137.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 3 people! a local maximum
09:47AM 
53slang
 robl: harley appears to be off the fritz
robl
 slang: heh. that took me a whle to parse.
09:56AM 
53slang
 robl: you gunna be alright gettin back?
09:56AM 
53slang
 robl: maybe we'll end up doing that road trip to boston/ny after all?
robl
 slang: yeah. two thanksgivings ago i left my d/l in the car and made it to south carolina and back w/o any id
robl
 slang: oddly enough, the SC airport cared more than o'hare, but i made it through
robl
 should be a lot easier this time as i've actually got photo id
robl
 pcarns: somewhere betweeen o'hare security and the white plains rental car counter i lost my drivers license
10:30AM 
53slang
 robl: you think that's gunna work?
robl
 slang: i do
robl
 slang: but i might be too optimistic
10:31AM 
50* 
53slang/#pvfs2 
crosses his fingers
robl
 slang: i figure if someone gives me a hard time, i'll yell at them and say stuff like "i should shoot you right now with this gun!"
robl
 that'll speed things up
11:26AM 
53slang
 robl: heh
11:27AM 
53slang
 robl: kaitlyn was saying you could print out a copy of your passport if you could get access to a printer
robl
 slang: i thought i could  but now i can't find my passport image
robl
 apparently word gets out pretty fast aobut dumb ol' me.. robr sent me email too :>
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57pcarns    
36G   
n=pcarns
adsl-145-178-137.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
11:28AM 
53slang
 robl: heh - I just told him
11:29AM 
53slang
 robl: I thought there might be something we could do to help you out
11:29AM 
53slang
 robl: at this end
11:29AM 
53slang
 robl: I guess working at a govt. lab doesn't help much
 pcarns 
n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has left #pvfs2 
robl
 aggregate statistics:
robl
 ---------------------------------------
robl
         fs_id: 690151926
robl
         total number of servers (meta and I/O): 33
robl
         handles available (meta and I/O):       4294967288
robl
         handles total (meta and I/O):           4294967292
robl
         bytes available:                        22265.4G
robl
         bytes total:                            22265.4G
robl
 so we've got 22+ TB up and running at watson
02:33PM 
53slang
 robl: holly smokes!
02:33PM 
slang
 holy
02:38PM 
53slang
 robl: i've been looking for a good place to store my dvd collection
robl
 slang: no kidding. the hardware performs somewhat underwhelmingly, thouhg
robl
 slang: bonnie++ reports 70MB/sec block sequential I/O
robl
 slang: we kinda need 10x that
robl
 well, if we saturate the storage servers, that'll be kinda impressive too
02:52PM 
53slang
 robl: looks like pvfs.org is accepting tinderbox status submits again
02:53PM 
53slang
 robl: oh
02:53PM 
53slang
 robl: maybe you know this though
robl
 slang: ?
02:56PM 
53slang
 robl: remember the perms problems last week?
02:56PM 
53slang
 robl: I didn't know they had been resolved
02:56PM 
53slang
 robl: but it looks like they have
robl
 slang: cool.  i don't have the url on my laptop
robl
 slang: paste please?
03:00PM 
53slang
 robl: http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html
NetSplit: 
57irc.freenode.net
 split from 
57clarke.freenode.net 
3604:04pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57slang
: #pvfs2 
"Lost terminal"
50* 
57robl 
made it home
NetSplit: 
57irc.freenode.net
 split from 
57clarke.freenode.net 
3611:30pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net clarke.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55ChanServ
35ChanServ@services.
50)-
 [#c-60] ATTN: this channel has moved to EFnet. please visit us there
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
NetSplit: 
57irc.freenode.net
 split from 
57clarke.freenode.net 
3611:45pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net clarke.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55ChanServ
35ChanServ@services.
50)-
 [#c-60] ATTN: this channel has moved to EFnet. please visit us there
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
11:46PM 
32alindeman:*
 Hi all.  Looks like a server previously in main rotation is having some connection issues; it's been removed from main rotation for a while, but still has over 3000 users on it.  We'll try to track down the problem.  Thanks!
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57clarke.freenode.net 
3607:41am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey
08:15AM 
53pcarns
 robl: hey there
robl
 pcarns: it's crazy benchmarkinmg day ... we've got time on a 20*1024 node BGL system
10:01AM 
53pcarns
 robl: wow!
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
"Lost terminal"
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57clarke.freenode.net 
3605:32pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 22.066 secs!!
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Thu Oct 27 19:37:58 2005
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 0.337 secs!!
07:43PM 
32lilo:*
 Shutting down our poor former main rotation server that's stuck behind cogent. Shutting off new connects first.
07:50PM 
32lilo:*
 Shutting down the server now....
07:57PM 
32lilo:*
 restarting services; please bear with us
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3608:38pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
10:28PM 
32lilo:*
 Well, inadvertently-major upgrade in process on http://freenode.net/ 8)
11:09PM 
32lilo:*
 Btw, http://freenode.net/ is back up, though it may be up and down while I scratch my head and figure out the new config file layouts 8)
56yftty 
36n=yf@221.216.29.206
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56yftty 
36n=yf@221.216.29.206
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
03:11PM 
ronnocol
 Anyone here?
robl
 ronnocol: hey
robl
 for a bit
03:13PM 
ronnocol
 Hey... I'm trying to get pvfs2 deployed, and Im having a bit of a problem
03:13PM 
ronnocol
 If I create a directory on the pvfs2 mounted FS... it shoes up, but I can't use it
03:14PM 
ronnocol
 mkdir /pvfs2-fs/bt_torrents
robl
 fedora 3 or rhel 3 ?
03:14PM 
ronnocol
 gentoo for the client and ubuntu for the servers
03:14PM 
ronnocol
 ls /pvfs2-fs/bt_torrents
03:14PM 
ronnocol
 ls: /pvfs2-fs/bt_torrents/: No such file or directory
03:15PM 
ronnocol
 pvfs2 v. 1.2.0
03:15PM 
ronnocol
 I tried turning SyncData and SyncMeta on, but that didn't seem to help
03:17PM 
ronnocol
 root@pvfs0:~# /usr/local/sbin/pvfs2-server -v
03:17PM 
ronnocol
 1.2.0 (mode: aio-threaded)
robl
 hm.  sounds kinda similar to a problem some others have been having.  can you write this up to pvfs2-users@beowulf-underground.org? 
03:17PM 
ronnocol
 uhm sure
03:48PM 
ronnocol
 sent
03:48PM 
ronnocol
 I tried to include all of the data and config files that someone would ask for.
56yftty 
36n=yf@221.216.29.206
 has joined #pvfs2
10:50PM 
32lilo:*
 US users: "Spring forward, fall back." Before you go to sleep, set your non-computer clocks back one hour. We'll assume you've all got computer clocks configured to UTC and set to skip back on their own. Well, we hope. :)
10:51PM 
32lilo:*
 (I'm told Canadian users "fall back" at the same time. Thanks!)
10:53PM 
32lilo:*
 (parts of Western Europe have apparently switched as well.... apologies for not keeping on top of this; I guess it's easier to think about just your local timezones, because you have to go wind the clocks locally 8)
10:56PM 
32lilo:*
 For further information on daylight savings time transitions: http://www.timeanddate.com/time/dst2005b.html
56yftt1 
36n=yf@221.219.62.240
 has joined #pvfs2
SignOff 
57yftt1
: #pvfs2 
Remote closed the connection
SignOff 
57yftty
: #pvfs2 
Read error: 110 (Connection timed out)
56yftty 
36n=yf@221.219.62.240
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56yftty 
36n=yf@221.219.62.240
 has joined #pvfs2
SignOff 
57yftty
: #pvfs2 
Remote closed the connection
56yftty 
36n=yf@61.51.37.43
 has joined #pvfs2
11:05PM 
ronnocol
 evening all
02:47AM 
yftty
 evening
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-145-178-137.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
 yftty 
n=yf@61.51.37.43
 has left #pvfs2 
56yftty 
36n=yf@221.222.219.83
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57yftty
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:57am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-57-70.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-57-70.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
n=pcarns@adsl-34-57-70.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 i will strive to say at least one sentence every day in this channel.
02:10PM 
53slang
 robl: maybe it should at least have pvfs2 in it?
robl
 i am putting together pvfs2 patches
SignOff 
57laytonj
: #pvfs2 
"Leaving"
10:47PM 
ronnocol
 evening all
robl
 hi ronnocol 
10:52PM 
ronnocol
 hey
10:52PM 
ronnocol
 so... we determined what was causing the weird issues with being able to make a dirctory but not use it....
10:53PM 
ronnocol
 I had the guy working for me post the data to the users email list
10:53PM 
ronnocol
 but essentially he was trying to add new servers to the cluster by hand by manually changing which handles were assigned to which servers
10:53PM 
ronnocol
 That didn't work so well
10:54PM 
ronnocol
 So... the question is... if you need more space... how do you add a new server to the cluster
10:56PM 
ronnocol
 1.08T
10:56PM 
ronnocol
 err.. wrong window
robl
 ronnocol: the handle space is 64 bits but we only assign 32 bits through genconfig
robl
 so... if you add a server, you keep all the existing handles th esame, and assign handle 4billion-5billion (roughly) to it
11:00PM 
ronnocol
 He thought that's what he did... he posted the configs to the users list
robl
 ronnocol: i can't find his message. what's his name?
11:10PM 
ronnocol
 Uday 
11:11PM 
ronnocol
 Sent at 11:24 this morning
11:11PM 
ronnocol
 Uday Shingwekar
robl
 ah, ok, got it
robl
 ok, sounds like maybe theory doesn't match practice? i'll take a look at it on our test machines
11:14PM 
ronnocol
 I'd really appreciate that
11:20PM 
ronnocol
 I do however like this output (from df -h):
11:20PM 
ronnocol
 tcp://pvfs00:3334/pvfs2-fs
11:20PM 
ronnocol
                       8.5T  1.1G  8.5T   1% /mnt/pvfs2
robl
 always fun to have a TB or so to play with :>
11:25PM 
ronnocol
 With pvfs2, it cost us about $25K for servers and man-hours... For a 8.5T netapp solution it would have been closer to $160K
robl
 wow, didn't realize netapp was so expensive
robl
 what are you going to ue all the space for anyway?
robl
 (often nice to hear what apps people toss at our file system)
11:31PM 
ronnocol
 I work at Macrovision, our clients are movie studios, recording studios, game publishers, etc.
11:32PM 
ronnocol
 We need somewhere to put CD-rips, DVD rips, etc.
11:32PM 
ronnocol
 We have a 900 node diskless netbooted cluster that needs access to the data
11:32PM 
ronnocol
 Pointing 900 nodes at a single NFS server was killing the box
11:33PM 
ronnocol
 (and we couldn't scale the diskspace in any cost-effective way) and having multiple mount points (for multiple nfs servers) wasn't practical for the application
11:34PM 
ronnocol
 luckily we have no need to backup the data, just have it readilly avaialable to all of the nodes
robl
 cool. sounds like a decent app for pvfs2, as long as you read/write in big chunks
11:35PM 
ronnocol
 only 1 node really has any need to write, everything else is read-only essentially
11:35PM 
ronnocol
 Are there any optimizations we should know about to optimize for reads?
11:36PM 
ronnocol
 We couldn't find any documentation on the Attr* keywords for example
robl
 ronnocol: none really yet.  lots of ideas, nothing in practice at this time
11:41PM 
ronnocol
 ah; ok
robl
 hey, i'm off to bed. see you later
11:42PM 
ronnocol
 ok; thanks for all your help
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
01:32PM 
32lilo:*
 A small EU server was just split, affected users, 240.... it's just rejoined
01:34PM 
32lilo:*
 We've lost a couple more small servers, they're coming and going....
04:06PM 
53slang
 robl: ...
04:08PM 
slang
 why did the pvfs2 server cross the road?
robl
 slang: i don't know slang.  why did the pvfs2 server cross the road?
04:11PM 
53slang
 robl: I can't think of anything remotely funny
robl
 haha. 'remote' like 'remote file system' like distributed storage?
04:11PM 
53slang
 robl: yeah like that kind of not funny
04:16PM 
53slang
 robl: that's where the u-stor-it was maybe?
robl
 slang: knock knock
04:35PM 
ronnocol
 Hey Rob... how goes it?
05:03PM 
slang
 ronnocol: hey!
05:03PM 
53slang
 robl: who's there?
robl
 slang: pvfs
05:05PM 
53slang
 robl: ...pvfs...who?
robl
 ronnocol: no news yet, but i'm just about to dive in
robl
 slang: pvfs who is the next generation parallel file system!
05:07PM 
50* 
53slang/#pvfs2 
eyes robl warily
robl
 WHO == 2 !
05:10PM 
53slang
 robl: heh!
robl
 ronnocol: hey so i started w/ one server, did some stuff, shut down that server, added a new handle range,  copied the "fs.conf" file to a 2nd server, made a storage space on that 2nd server (pvfs2-server -f ...), then started the 1st and 2nd servers
robl
 ronnocol: that worked ok for me
robl
 ronnocol: i'll double-check your emails to see if there's a step missing in there (on either your end or my end)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3609:10pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3609:17pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
55dmwaters
35i=dmwaters@freenode/staff/gentoo.dmwaters
50)-
 {global notice} Hi all! one of our sponsors is doing some router maintenence, this is scheduled maintenence. In the process, I'm going to upgrade one of the main rotation servers. this won't effect anyone, since the server has already dropped it's users. Thank you for your patience, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3609:53pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
11:12PM 
53slang
 robl: welcome back
11:12PM 
53slang
 robl: or maybe its me that's back
robl
 slang: i think we're both back
12:12AM 
53ronnocol
 robl: not sure what we did wrong then... essentially what happened, both times we manually added a server, we encountered the problem where we could create a directory, but not use it.
56pcarns 
36n=pcarns@adsl-215-229-136.aep.bellsouth.net
 has joined #pvfs2
robl
 ah, direcotries. forgot about that one.  will get back to you
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 SWAP: Window 3 is not hidden!
 SWAP: No such window: 4
 SWAP: No such window: 5
 SWAP: Window 3 is not hidden!
robl
 ronnocol: i don't know what to tell you. we did have a lot of permissions bugs that we have fixed since 1.2.0 (we also introduced a few, but we've fixed those in CVS)
robl
 ronnocol: as uday found, re-creating the storage space is one way to get things working again
robl
 ronnocol: and in the future (like with the upcomming 1.3.1 release) it should all "just work"
56Deedee 
36n=Didi@center.shumen.spnet.net
 has joined #pvfs2
57Deedee 
is now known as 
36Dafny
57Dafny 
is now known as 
36SwEeTesT_KisS
 SwEeTesT_KisS 
n=Didi@center.shumen.spnet.net
 has left #pvfs2 
robl
 wierd
12:33PM 
pcarns
 unhunh
 pcarns 
n=pcarns@adsl-215-229-136.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3608:12pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
01:05AM 
53ronnocol
 robl: Thanks for looking into it. We are at 8.5T of storage and hope that should last us for a little while. (meaning we shouldn't have to add any servers anytime soon) We saw a couple I/O Errors today but we will continue forward and see how things go
01:06AM 
53ronnocol
 robl: but so far, things look good.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3612:10am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're experiencing some hub <-> hub routing problems, we're looking at it now
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] We're going to experiment with a bit of latency reduction, please bear with us.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3612:22am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Please bear with us while we rehub to complete the resolution of a routing problem we experienced earlier in the day. Thanks for your patience, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3607:20am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Our rehubbing should be complete, barring any other problems.... thanks again for your patience, and thank you for using freenode!
56pcarns 
36n=pcarns@adsl-215-229-109.aep.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey. after all the bugs in 1.3.0, i think i'm going to put out a 1.3.1 w/ just bug fixes
robl
 pcarns: i'll deal with the feature patches you sent after the release
robl
 pcarns: er, after sc
10:10AM 
53pcarns
 robl: that sounds like a great idea
10:11AM 
53pcarns
 robl: I think taking the feature patches at this point would just break everything again before SC :)
56owen 
36n=owen@S010600095bdadbc7.gv.shawcable.net
 has joined #pvfs2
02:13PM 
owen
 so, is there a pvfs2 tutorial at sc05 guys?
robl
 owen: not pvfs2 by itself, but a more general "high performance i/o" tutorial on sunday
robl
 owen: there's also the birds of a feathe session tuesday evening
02:30PM 
53owen
 robl: yeah, double booked for that BOF
02:30PM 
owen
 i need to go to the eclipse bof
02:30PM 
owen
 what tutorial?
02:30PM 
owen
 the IB tutorial?
robl
 owen: uh, hold on
02:31PM 
owen
 nope
02:31PM 
owen
 it isnt
02:31PM 
owen
 shit
robl
 http://sc05.supercomputing.org/schedule/event_detail.php?evid=5124
02:32PM 
owen
 double booked on that one too :(
02:32PM 
owen
 shoulda just searched for latham :P
03:31PM 
53slang
 robl: or maybe its me that's back
robl
 slang: gonna guess you, since i only saw the 'maybe its me' 
robl
 slang: you've got a lot of pvfs2 messages scrolling by on lain
 pcarns 
n=pcarns@adsl-215-229-109.aep.bellsouth.net
 has left #pvfs2 
06:46PM 
ronnocol
 w00t
06:46PM 
ronnocol
 wrong channel... sorry
53#pvfs2     
57owen      
36H   
n=owen
S010600095bdadbc7.gv.shawcable.net (Owen Stampflee)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 heh. it's cool.  w00t for 50 people signed up for my tutorial
robl
 (well 'our', but the other 3 guys aren't in this channel)
11:57PM 
owen
 lol
 #pvfs2  There isn't a topic.
 Topic 
36#pvfs2
50):
 changed by 
36robl
 SC2005 events: I/O tutorial Sunday (8-5); BoF Tuesday (17:15-18:45)
SignOff 
57owen
: #mklinux,#pvfs2 
"Client exiting"
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 SWAP: No such window: 4
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57ronnocol
: #pvfs2 
Remote closed the connection
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 SC2005 events: I/O tutorial Sunday (8-5); BoF Tuesday (17:15-18:45)
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Nov  9 07:18:58 2005
robl
 slang: i had no idea why the jazz tests were failing. thanks
12:13PM 
53slang
 robl: heh - yep
12:13PM 
53slang
 robl: hopefully its all good now :-)
12:38PM 
slang
robl
 slang: you feeling ok about a release in thenext 10 mins?
robl
 slang: the last week hasn't been confidence inspiring :>  guess that's why we should sit on this stuff
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3611:58pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're experiencing some routing problems between Europe and the US. We may need to reroute. Please bear with us.
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
12:04AM 
32dmwaters:*
 Hi all! looks like we've got some routing trouble between 2 major hubs. Got to love level3!
Mode change 
57-w
 for user 
36robl
01:13AM 
53slang
 robl: I thought I had removed that include .. sorry
robl
 slang: that's why we're testing this release :>
56pcarns 
36n=pcarns@adsl-61-120-183.mia.bellsouth.net
 has joined #pvfs2
01:58PM 
pcarns
 slang: I am trying to remember- did you work on something at one point that would associate a string name with each state machine transition, so you could print out what state a state machine is on?
02:26PM 
slang
 pcarns: yes
02:27PM 
slang
 pcarns: I originally made those changes to a branch that never got merged to trunk
02:28PM 
slang
 pcarns: I've gone back and redone them in my small I/O branch
02:28PM 
slang
 pcarns: slang-sio-branch
02:28PM 
pcarns
 slang: excellent!
02:28PM 
slang
 pcarns: that version will most likely get merged
02:28PM 
pcarns
 slang: I was just pondering how to implement something like that
02:28PM 
slang
 pcarns: I can send you a diff of the changes to the statecomp and state machine code if you'd like to have a look
02:29PM 
pcarns
 slang: that would be great if you don't mind
02:29PM 
slang
 pcarns: no problem
02:29PM 
pcarns
 slang: what I want to do is keep track of all the state machine instances that are running at a given time (puttting them in a linked list or something),
02:29PM 
pcarns
 slang: so that I can have a request that dumps the state of the server
02:29PM 
pcarns
 slang: what state machines are running, what state they are on, etc.
02:30PM 
pcarns
 slang: we have had some operations hang, and I can't track down how they derailed, largely because I can't grab a pointer to the s_op struct in gdb
02:30PM 
pcarns
 slang: but I can see the op in the request scheduler, and i can tell that there aren't any trove, bmi, flow jobs posted
02:31PM 
pcarns
 slang: thus my interest in figuring out what in the world some state machines are up to
02:38PM 
slang
 pcarns: that's cool
02:39PM 
slang
 pcarns: right now I just use the state name string to print out enter/exit debugging info for the state actions
02:41PM 
pcarns
 slang: that looks awesome
02:41PM 
pcarns
 do you happen to know,
02:41PM 
slang
 pcarns: what you want sounds like it might fit in with the per-request unique id stuff rob has suggesting
02:41PM 
pcarns
 if I grap a state machine structure (s_op) while it is in between states (waiting on a job to finish, for example),
02:42PM 
pcarns
 is the math still the same to get to the right name ((s_op->current_state - 3)->state_name))
02:42PM 
pcarns
02:42PM 
pcarns
 slang: I assume it is, but I havn't looked at the code to confirm when that s_op->current_state pointer actually changes
02:42PM 
slang
 pcarns: after PINT_state_machine_next has been called?
02:43PM 
pcarns
 I guess state_machine_next() isn't called until the job completes eh?
02:43PM 
slang
 pcarns: I'm pretty sure it will always be 3
02:44PM 
pcarns
 slang: awesome
02:44PM 
pcarns
 slang: you are my hero
02:45PM 
slang
 pcarns: the _next and _locate functions should be the only 2 that increment the current_state
02:45PM 
pcarns
 slang: I think maybe we will at a new option to the setparam request, that will iterate through the request scheduler (printing all of the request queues) and iterate through all state machines telling where they are
02:45PM 
pcarns
 slang: so if something gets hung we can get a snapshot of what the server is up to
02:45PM 
slang
 pcarns: that's a cool idea
02:45PM 
pcarns
 slang: ok
02:46PM 
pcarns
 slang: in addition we should then also be able to gdb attach and actually find an s_op pointer in the server
02:46PM 
pcarns
 slang: nearly impossible at the moment
02:46PM 
50* 
53slang/#pvfs2 
nods.
02:46PM 
pcarns
 slang: we don't keep references to the s_ops hanging around anywhere right now
02:47PM 
slang
 pcarns: right
02:47PM 
slang
 pcarns: you're thinking of having a static array of a few thousand that you can just push s_ops onto?
02:48PM 
pcarns
 pcarns: I haven't really thought about what data structure to use- probably just quicklist since things can be appended or removed in O(1)
02:48PM 
pcarns
 pcarns: and we won't be searching it for anything time sensitive
02:49PM 
pcarns
 just put hooks in the functions that allocate/complete state op structures to add/delete them from the quicklist
02:50PM 
pcarns
 *shrug*
02:51PM 
pcarns
 whoops, I addressed a couple of those to my own user id
02:51PM 
pcarns
02:52PM 
slang
 heh
02:52PM 
slang
 yeah makes sense
02:54PM 
pcarns
 slang: are you planning to remove all those little macros at the top of each state machine function in the server when this stuff is in the trunk?
02:54PM 
slang
 pcarns: yeah
02:54PM 
pcarns
 slang: double cool
02:54PM 
slang
 pcarns: most of them anyway
02:54PM 
slang
 pcarns: some of them print extra sm specific stuff
03:12PM 
pcarns
 slang: is there a diff of the state machine compiler to go with this?
03:12PM 
pcarns
 slang: I assume there needs to be something to put the string names in the state arrays?
03:22PM 
slang
 pcarns: its in there
03:22PM 
slang
 pcarns: codegen.c
03:24PM 
pcarns
 slang: oh, duh
03:25PM 
pcarns
 slang: I see now- I think my brain automatically filters out printf statements
03:25PM 
pcarns
 slang: which was exactly what I needed to look for in this case
03:25PM 
50* 
53slang/#pvfs2 
grins
03:25PM 
pcarns
 slang: thanks
03:37PM 
slang
 printf("<insert jokes about phil here");
robl
 printf("wow! conversation\n");
 pcarns 
n=pcarns@adsl-61-120-183.mia.bellsouth.net
 has left #pvfs2 
05:49PM 
53slang
 robl: I didn't really think his brain would ignore my joke
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3606:18pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3607:40pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56janx 
36n=jan@d5152D086.access.telenet.be
 has joined #pvfs2
SignOff 
57janx
: #pvfs2 
Client Quit
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3607:02pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
SignOff 
57ronnocol
: #pvfs2 
"Changing server"
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-183.mia.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-61-120-183.mia.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:32pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3611:52pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56pcarns 
36n=pcarns@adsl-211-217-243.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
56slang_ 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 104 (Connection reset by peer)
56laytonj_ 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 104 (Connection reset by peer)
53#pvfs2     
57laytonj_  
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang_    
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57slang_
: #pvfs2 
"leaving"
53#pvfs2     
57laytonj_  
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj_  
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3605:31pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57laytonj_
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3602:20am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
 Topic 
36#pvfs2
50):
 changed by 
36slang
 happy thanksgiving!
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 Topic 
36#pvfs2
50):
 happy thanksgiving!
 Topic 
36#pvfs2
50):
 set by 
36slang
 at 
36Tue Nov 22 22:42:32 2005
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 phew... 1.3.1 *almost* out
robl
 and it's off
 Topic 
36#pvfs2
50):
 happy thanksgiving!
 Topic 
36#pvfs2
50):
 set by 
36slang
 at 
36Tue Nov 22 22:42:32 2005
 Topic 
36#pvfs2
50):
 changed by 
36robl
 Topic 
36#pvfs2
50):
 changed by 
36robl
 PVFS2-1.3.1 is out at last
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Remote closed the connection
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 104 (Connection reset by peer)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:04am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
11:17AM 
53slang
 robl: we should get Murali in here
robl
 slang: he's been on once or twice
robl
 slang: ok, he's gonna sign on soon
11:33AM 
53slang
 robl: woohoo!
56vilayann 
36n=vilayann@csi0332384.mcs.anl.gov
 has joined #pvfs2
11:34AM 
vilayann
 hi guys!
 Topic 
36#pvfs2
50):
 PVFS2-1.3.1 is out at last
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Mon Nov 28 15:51:23 2005
11:35AM 
slang
 vilayann: hey man!
11:35AM 
vilayann
 finally, I have logged in!
11:37AM 
slang
 vil: now I can bug you without having to be at the lab ;-)
11:37AM 
vilayann
 cool! hey, it is usually me bugging you :)
11:47AM 
vilayann
 Off for lunch!!
11:47AM 
slang
 vil: are you still having failures when you try to do an out of tree build?
11:47AM 
slang
 vil: ok
11:47AM 
vilayann
 yup
11:47AM 
slang
 vil: see ya
11:47AM 
slang
 vil: hmm
11:47AM 
vilayann
 see ya in about half an hour
11:47AM 
slang
 vil; yep
robl
 slang: how come you don't complete vilayann ?
robl
 vl: slang has a busted irc client!
50* 
57robl 
is stupid
robl
 vilayann: that
11:49AM 
53slang
 robl: or my 'ayn' keys are busted?
11:49AM 
slang
 something is busted somewhere..
12:23PM 
vilayann
 hehe! back after a frosty lunch
12:24PM 
50* 
53slang/#pvfs2 
waves
12:25PM 
53slang
 robl: does myrinet on chiba have privileged vs. non-privileged ports?
12:25PM 
53slang
 robl: 6 seems to be only accessible by root at least..
robl
 slang: wierd. i don't know of any such restriction
01:50PM 
53slang
 robl: I was able to chmod 666 /dev/gm* to fix it but I don't know if that's the right thing
01:50PM 
53slang
 robl: email systems i guess
01:51PM 
53slang
 robl: don't mean you
01:51PM 
50* 
53slang/#pvfs2 
will
robl
 slang: that sounds like a familiar problem...
02:08PM 
vilayann
 how do you guys type stuff like "waves", "will"? I am IRC disadvantaged :(
02:08PM 
50* 
53slang/#pvfs2 
uses /me
50* 
57robl 
02:11PM 
slang
 vl: I've got irssi running in screen too, so it looks like I'm always here ;-)
02:13PM 
50* 
53vilayann/#pvfs2 
I see
02:14PM 
vilayann
 okay, got it! thanks
02:14PM 
vilayann
 help me
02:14PM 
50* 
53slang/#pvfs2 
hehs
02:14PM 
vilayann
 this cross compilation stuff is broken on all my machines :(
02:15PM 
vilayann
 Have tons of pvfs2 trees floating around, and cant track which one has what!
02:15PM 
slang
 vl: cross compliation stuff?
02:15PM 
vilayann
 Oh sorry, out of tree builds... duh
02:16PM 
slang
 vl: what error do you get?
02:16PM 
vilayann
 linker error.
02:16PM 
vilayann
 some objects dont seem to get pulled in
02:17PM 
slang
 vl: for src or tests?
02:17PM 
vilayann
 src for sure. I havent tried tests in a while
robl
 oh wow, i haven't trid building the tests in a long time either
02:18PM 
53vilayann
 robl: looks like we wont need the disable-aio patch then?
02:18PM 
slang
 vl: so you do something like: cvs co pvfs2; mkdir pvfs2-build; cd pvfs2-build; ../pvfs2/configure ...?
02:19PM 
slang
 vl: and that gives linking errors?
02:19PM 
vilayann
 Oh does pvfs2-build have to be under pvfs2? I tried it outside of pvfs2
02:19PM 
vilayann
 and it gives linker errors
02:19PM 
slang
 vl: right
02:19PM 
slang
 vl: hmm
02:19PM 
50* 
53slang/#pvfs2 
shrugs
02:19PM 
slang
 vl: not able to reproduce
02:20PM 
vilayann
 oh really.. have you tried this? have a src tree, create 2 dirs one for x86 and one for x86_64
02:20PM 
vilayann
 and then do a configure on an x86 and a x86_64 in each of these dirs..
02:20PM 
slang
 vl: yeah I've started using the out-of-tree method of late
02:21PM 
slang
 vl: oh I haven't tried multiple out-of-tree from same source
02:21PM 
slang
 vl: lemme try that
02:21PM 
vilayann
 Oh sorry. I should have been clear about that..
02:33PM 
slang
 vl: seems to work ok for multiple builds too..
02:34PM 
slang
 vl: which linking errors do you get? libdb stuff?
03:08PM 
53pcarns
 robl: are you about to do another quick release?
03:08PM 
53pcarns
 robl: if so, hang tight for a pair of very small patches (one from me, one from David)
03:08PM 
53pcarns
 robl: should be on list in next 24 hrs
03:09PM 
pcarns
 (just noticed cvs log on ChangeLog come across)
robl
 pcarns: yup, too many "I CAN'T BUILD ON SLES 9" posts...
robl
 pcarns: i can definitely wait 24 hrs
03:12PM 
pcarns
 thanks, composing email now
03:12PM 
pcarns
 David will send his by this evening
SignOff 
57vilayann
: #pvfs2 
"Leaving"
03:38PM 
53pcarns
 robl: I will have some big patches next week, but those will clearly need some test time :)
03:38PM 
pcarns
 some perf counter magic, and a rewrite of some of the service functions in kernel module
robl
 pcarns: cool. slang and vilayann have been looking long and hard at performance issues
03:42PM 
53pcarns
 robl: real soon now (maybe tomorrow or monday) we are going to share some ideas for trove too
03:42PM 
53pcarns
 robl: we have some good benchmark results to motivate
03:43PM 
pcarns
 should be a big deal for getattr performance on the server side
robl
 pcarns: cool!
03:48PM 
pcarns
 we have a new guy (Derek) who has been focusing on berkeley db stuff lately
03:48PM 
pcarns
 anyway, we'll hopefully have our thoughts collected on that shortly, I think we have enough benchmark data to proceed with implementation
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3603:56pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-218-108-248.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: hey, so w/ your patch, the pvfs2_client_sysint_getattr_sm 'dowork' state has two states with the same transistion?
robl
     state dowork
robl
     {   
robl
         jump pvfs2_client_getattr_sm;
robl
         success => set_sys_response;
robl
         default => set_sys_response; 
robl
     }   
robl
04:10PM 
53pcarns
 robl: oh, yeah, 
04:10PM 
53pcarns
 robl: you could replace them with just a "default => set_sys_response;" transition
04:11PM 
53pcarns
 robl: the success one is redundant
04:11PM 
53pcarns
 robl: since both outcomes should go to the same state
 pcarns 
n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has left #pvfs2 
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3608:11am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
50* 
57robl 
hungry
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-218-108-248.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 HUNGRY FOR A NEW PVFS2 RELEASE
10:30AM 
53slang
 robl: woah
10:30AM 
53slang
 robl: plenty of chocolates
robl
 slang: we're fresh out of pvfs2-1.3.2. i'll have to make some more
11:08AM 
pcarns
 hahaha
56rross 
36n=rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
12:57PM 
53rross
 robl: you around?
SignOff 
57rross
: #pvfs2 
Read error: 104 (Connection reset by peer)
56rross 
36n=rross@216-80-122-127.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 rross: hi
SignOff 
57rross
: #pvfs2 
Read error: 104 (Connection reset by peer)
 pcarns 
n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3608:32pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
08:42AM 
pcarns
 hey guys, anyone able to connect to the pvfs2 cvs repository this morning?
robl
 pcarns: looks unreachable to me, too
robl
 well, down.  i can traceroute to parlweb
08:44AM 
53pcarns
 robl: ok, I'll email some folks
08:48AM 
53pcarns
 robl: doh
08:48AM 
53pcarns
 robl: that box also hosts mailing lists
08:49AM 
53pcarns
 robl: perhaps I will try emailing again without using a list this time :)
robl
 pcarns: huh. might have to call brad directly :>
08:57AM 
53pcarns
 robl: I emailed Walt, Brad, and Will
 pcarns 
n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: crap, cvs has been down all weekend
SignOff 
57laytonj
: #pvfs2 
"Leaving"
 pcarns 
n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has left #pvfs2 
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.1 is out at last
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Mon Nov 28 15:51:23 2005
 Topic 
36#pvfs2
50):
 changed by 
36robl
 PVFS2-1.3.2 is out
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
03:14PM 
slang
 what is that, irc spam?
robl
 bad pcarns!
03:53PM 
slang
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
"leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3602:58am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-218-108-248.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-218-108-248.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
56ronnocol_ 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56laytonj_ 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Connection timed out
SignOff 
57ronnocol
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57pcarns
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3603:52pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57laytonj_  
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol_ 
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57laytonj_
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3608:47pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:17pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:18pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol_ 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:22pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56ronnocol_ 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3610:40pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
12:11AM 
ronnocol_
 evening all
57ronnocol_ 
is now known as 
36ronnocol
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
12:16AM 
ronnocol
 Evening slang_ 
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56laytonj 
36n=laytonj@24.196.226.167
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has left #pvfs2 
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-218-107-239.asm.bellsouth.net (gaim)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 ronnocol: hey (sorry, don't pay much attention here over the weekends)
11:56AM 
53ronnocol
 robl: morning
11:56AM 
53ronnocol
 robl: or afternoon... depending on where you are I suppose
11:58AM 
53ronnocol
 robl: We have an application that does a lot of stat() calls (because it's written in Java, and there doesn't seem to be a way to do a single stat() it does lot's of stat()'s)
11:59AM 
53ronnocol
 robl: is there a way to speed these types of file accesses up?
12:01PM 
53ronnocol
 robl: According to time, it took 0m3.366s to deterimine if the file was a directory, it's size, and if it was readable on PVFS
12:01PM 
53ronnocol
 robl: for comparison.. my C code took 0m1.976s, so obviously java just sucks :)
12:02PM 
53ronnocol
 robl: I was reading in the FAQ about the AttrCache configs and optimizations that can be enabled (if the app can deal with out-of-sync caches)
12:03PM 
53ronnocol
 robl: But it doesn't say how to enable those optimizations, and I was wondering if there was any info on what to set the AttrCache settings to as a SWAG setting
12:03PM 
ronnocol
 gotta run to a meeting... I'll check back in a bit later.
robl
 ronnocol: yeah, not something i'm terribly familiar with.  Might want to ask on -users.  
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56Fobax 
36i=Fobax@d198-166-49-97.abhsia.telus.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has joined #pvfs2
01:57PM 
53pcarns
 robl: you guys are about to get an avalanche of patches
01:57PM 
53pcarns
 robl: we may need to talk about how to integrate some of them if you guys are interested
robl
 pcarns: heh. nice!
robl
 pcarns: what problems do you anticipate?
02:10PM 
53pcarns
 robl: well, I have a couple of patch sets that are big changes,
02:11PM 
53pcarns
 robl: one is the rewrite of the lowest level acache piece,
02:11PM 
53pcarns
 robl: and another is a significant rewrite/update of the performance counters (motivated so that they can be used more easily on the client side)
02:13PM 
53pcarns
 robl: I have a 3rd major change in our tree, which is an overhaul of the service_* macros in the kernel code, but that I am going to sit on until the others are sorted out one way or another
02:14PM 
53pcarns
 robl: some of these might be hard to apply at this point, but if you guys decide you want them I can redo the patches so they are back in sync with the clemson tree, or help get them applied in a branch of the clemson tree or something
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
 SWAP: No such window: 4
 SWAP: Window 3 is not hidden!
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3605:30pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-218-107-239.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56Elwell 
36n=elwell@rhum.elwell.org.uk
 has joined #pvfs2
07:13AM 
Elwell
 Quickie Q - What version of linux requires least hacking to work as a PVFS2 server presently?
robl
 Elwell: 2.4.19 or newer, 2.6.<anything>
robl
 Elwell: we also work with just about any vendor kernel
robl
 Elwell: the pvfs2 kernel module compiles out-of-tree, so there really isn't any patching or hacking to speak of
 Fobax 
i=Fobax@d198-166-49-97.abhsia.telus.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-211-251-106.asm.bellsouth.net
 has joined #pvfs2
01:40PM 
53Elwell
 robl: cool. Am probably going to use debian for our servers with 2.6.`whatevers in sarge`
robl
 Elwell: that'll work fine. it's one of our nightly test environments
01:49PM 
Elwell
 what I like to hear. almost as good as "there's a .deb on the FTP site" :-)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-211-251-106.asm.bellsouth.net (gaim)
53#pvfs2     
57Elwell    
36H   
n=elwell
rhum.elwell.org.uk (Andrew Elwell)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: so i'm finally taking a look at your acache patch
robl
 pcarns: might take me a hile
02:48PM 
53pcarns
 robl: ok, let me know if you need anything, I can clean up patches or whatever if needed
SignOff 
57pcarns
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
05:50PM 
Elwell
 Hi folks - Trying to build 1.3.2 for the BGL js20 frontends (client only)
05:50PM 
Elwell
 ./configure --with-kernel=/usr/src/linux --disable-server
05:51PM 
Elwell
 uname -r is 2.6.5-7.201-pseries64
05:51PM 
Elwell
 I'm getting  make kmod
05:51PM 
Elwell
   Building modules, stage 2.
05:51PM 
Elwell
   MODPOST
05:51PM 
Elwell
 *** Warning: ".mmgrab" [/home/z01/andrewe/compile/pvfs2-1.3.2/src/kernel/linux-2.6/pvfs2.ko] undefined!
05:58PM 
Elwell
 and when I try and insmod I get:
05:58PM 
Elwell
 insmod: error inserting './src/kernel/linux-2.6/pvfs2.ko': -1 Unknown symbol in module
06:51PM 
Elwell
 oh... and finally for the night... Should I be using 1.3.2 or 1.2.0 with the latest zeptoos client?
robl
 Elwell: http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-December/001110.html and
robl
 http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-December/001108.html
02:03AM 
Elwell
 meh - close but ./pvfs2-client -f -p ./pvfs-client-core is barfing on a /dev error looking at the log and keeps looping
02:16AM 
Elwell
 Dec 16 07:25:28 bglfen3 kernel: pvfs2: module not supported by Novell, setting U taint flag.
02:16AM 
Elwell
 Dec 16 07:25:28 bglfen3 kernel: pvfs2: module version 1.3.2 loaded
02:16AM 
Elwell
 Dec 16 07:28:55 bglfen3 kernel: ioctl32(pvfs2-client-co:7206): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req
02:16AM 
Elwell
 Dec 16 07:28:57 bglfen3 kernel: ioctl32(pvfs2-client-co:7207): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req
02:16AM 
Elwell
 Dec 16 07:28:58 bglfen3 kernel: ioctl32(pvfs2-client-co:7208): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req
02:16AM 
Elwell
 Dec 16 07:28:59 bglfen3 kernel: ioctl32(pvfs2-client-co:7209): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req
02:16AM 
Elwell
 Dec 16 07:29:00 bglfen3 kernel: ioctl32(pvfs2-client-co:7210): Unknown cmd fd(5) cmd(00000003){00} arg(1008d598) on /dev/pvfs2-req
02:16AM 
Elwell
 Dec 16 07:37:55 bglfen3 kernel: pvfs2: module version 1.3.2 unloaded
02:17AM 
Elwell
 crw-------  1 root root 254, 0 Dec 16 07:28 /dev/pvfs2-req
robl
 Elwell: if you google for 'pvfs2 ppc64' you'll find this one:
robl
 http://www.beowulf-underground.org/pipermail/pvfs2-users/2005-April/000611.html
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We momentarily opened up irc.freenode.net, but as you may have noted, we're still seeing heavy spambot activity. We're reverting again. If you're running an infobot here, or are having trouble connecting, please take a look at http://freenode.net/news.shtml .... thank you for your patience, and thank you for using freenode!
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 You have already identified
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3607:08pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57laytonj
: #pvfs2 
"Leaving"
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. In a few moments we're going to test a patch on one main rotation server which will hopefully result in our being able to reopen irc.freenode.net .... we'll have to reup the server...affected users about 2400.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] If all goes well, we may reup the rest of the servers at some point over the weekend, perhaps this morning. Thanks.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3604:26am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Our patch was not as successful as we might have hoped. We're going to be tweaking the config lines and trying again, but it doesn't look hopeful. Thanks for your patience.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Okay, it's time to reup that server once more. We're going to tweak the patch, but it looks like we're getting about 20% of the bots or less. IF this tweak doesn't work, we'll go back to chat.freenode.net . For more information on why irc.freenode.net isn't working, and how to connect to freenode (please spread the word), see http://freenode.net/news.shtml .... thank you.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3604:38am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Okay, folks. We can use your help now. It *looks* as if we've solved our problem, at least until the bots change. But would you please message me if you get any spambots or spam that you are sure occurred *after* this global notice? Thank you!
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. It's looking as if we should now be recompiling the rest of the servers and reupping the main rotation servers one at a time. I've had no reports of problems since the upgrade. That's not to say that the bots won't mutate sometime soon, but for now we can run irc.freenode.net.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Okay, here goes. In just a few moments, a rather large main rotation server will be restarted. It will be followed by another, and another, and then by smaller servers. Please bear with us.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3605:26am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3605:30am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 Elwell    
54 ronnocol  
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.864 secs!!
 #pvfs2  [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks!
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56Elwell 
36n=elwell@rhum.elwell.org.uk
 has joined #pvfs2
 #pvfs2  [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks!
56Elwell 
36n=elwell@rhum.elwell.org.uk
 has joined #pvfs2
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
06:24AM 
32lilo:*
 kline adjustments; you may see a few bots
08:18AM 
32lilo:*
 More kline adjustment; you may see the occasional spambot for a second. Thanks.
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-159.mia.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-159.mia.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57Elwell    
36H   
n=elwell
rhum.elwell.org.uk (Andrew Elwell)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-159.mia.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-61-120-159.mia.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57Elwell    
36H   
n=elwell
rhum.elwell.org.uk (Andrew Elwell)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: hey, i think this is your stuff: HAVE_PROC_HANDLER_SIX_ARG
robl
 pcarns: but somewhere along the line we missed the configure test
robl
 pcarns: can you resend
robl
 pcarns: ?
robl
 (well, just the configure test)
09:57AM 
53pcarns
 robl: yeah, let me figure out what patch I've got it in, just a minute
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3610:45am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
10:49AM 
53pcarns
 robl: looks like we need an "extern int op_timeout_secs" in waitqueue.c as well
 pcarns 
n=pcarns@adsl-61-120-159.mia.bellsouth.net
 has left #pvfs2 
04:38PM 
32lilo:*
 Hi all. If you're seeing spambots that are not getting klined, please let us know. so far we've removed about 8500 IP's (maybe 24,000 bots) with the new patch, but if they're getting smarter we'll need to know about it.... thanks
04:39PM 
32lilo:*
 please feel free to message at this nick .... thanks!
SignOff 
57laytonj
: #pvfs2 
"Leaving"
Mode change 
57-w
 for user 
36robl
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3612:14pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54 Elwell    
54 ronnocol  
54ChanServ  
 #pvfs2  [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks!
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.730 secs!!
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
04:20PM 
32lilo:*
 restart, affected users 86
Mode change 
57-w
 for user 
36robl
SignOff 
57laytonj
: #pvfs2 
"Leaving"
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Good morning, everyone. We'll be restarting a number of servers later this morning, and the restarts will affect most of our users. For more information, please see the news page: http://freenode.net/news.shtml . Thanks for your patience, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:06am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Per the news item from earlier this morning ( http://freenode.net/news.shtml ), we're about to have a fairly large, though hopefully quick, break in service.... it should all hit in roughly five minutes. Thanks.
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:13am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56Elwell 
36n=elwell@rhum.elwell.org.uk
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57zelazny.freenode.net 
3612:14am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 Elwell    
Netjoined: 
57irc.freenode.net zelazny.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.546 secs!!
56ronnocol 
36n=lance@216.58.72.60
 has joined #pvfs2
SignOff 
57ronnocol
: #pvfs2 
Killed by ballard.freenode.net (Nick collision)
56ronnocol 
36n=lance@216.58.72.60
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54 ronnocol  
54ChanServ  
54 Elwell    
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.247 secs!!
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
216.58.72.60 (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57Elwell    
36H   
n=elwell
rhum.elwell.org.uk (Andrew Elwell)
 You are not on a channel.  Use /WHO ** to see everybody.
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54 ronnocol  
54ChanServ  
54 Elwell    
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 1.134 secs!!
 SWAP: No such window: 4
 SWAP: Window 3 is not hidden!
 You are not on a channel.  Use /WHO ** to see everybody.
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+nt
 by 
57irc.mzima.net
52Users
32#pvfs2
50)]
54robl      
 Channel #pvfs2 was created at Thu Dec 22 15:43:05 2005
BitchX
: Join to #pvfs2 was synched in 0.202 secs!!
 robl 
~robl@ninjak.clustermonkey.org
 has left #pvfs2 
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54 ronnocol  
54ChanServ  
54 Elwell    
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 5.171 secs!!
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Thu Dec 22 15:45:22 2005
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 laytonj   
54 ronnocol  
54ChanServ  
54 Elwell    
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 0.998 secs!!
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3612:53am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. On behalf of the staff and volunteers of Peer-Directed Projects Center, I wanted to take this opportunity to wish you all, "Happy holidays!" 
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Our first level support ( http://freenode.net/faq.shtml#gettinghelp ) may be a bit light through the beginning of the year
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Have a great holiday season, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3601:06pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3606:32pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ronnocol 
36n=lance@216.58.72.60
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3606:36pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're experiencing server issues....there may be some server recycles needed. Please bear with us.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3606:52pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Our problems are a little less broad than we've thought.... affected users, about 7,000, and we should be stable. We're removing one server from the main rotation and we've shut it down. Apologies for any inconvenience. If there are no more high-impact problems, any further messages will be on wallops.
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3607:10am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57Elwell
: #pvfs2 
Nick collision
Netjoined: 
57irc.freenode.net calvino.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56Elwell 
36n=elwell@rhum.elwell.org.uk
 has joined #pvfs2
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
07:42AM 
32lilo:*
 Added two new items to the freenode channel guidelines. See "Look for the best in people" and "Set a good example". Maybe intuitive stuff, but it never hurts to lay things out. http://freenode.net/channel_guidelines.shtml .... 
56pcarns 
36n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57calvino.freenode.net 
3602:45am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has joined #pvfs2
08:14AM 
53pcarns
 robl: are you able to get to parl cvs this morning?
08:16AM 
pcarns
 looks like the file server is down over there
robl
 pcarns: heh. it's vacation dude, i haven't tried in days :>
robl
 pcarns: but yeah, tinderbox is out
10:52AM 
53pcarns
 robl: I should have asked santa for a more reliable parl network :)
 pcarns 
n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has left #pvfs2 
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 ronnocol  
54 Elwell    
54ChanServ  
 #pvfs2  [freenode-info] If you're at a conference, please contact freenode staff to make sure we've made special allowance for many users coming into our network from a single internet address ( http://freenode.net/faq.shtml#gettinghelp ). Private messages from unregistered users are currently blocked, except to network staff, services and participating registered users ( http://freenode.net/faq.shtml#privmsg )... Thanks!
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 16.694 secs!!
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
56pcarns 
36n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:55pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
11:20PM 
32lilo:*
 annoyance attack in process, apologies for any inconvenience....please relay to new users when they're able to connect
56pcarns 
36n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: so you working this week?
08:53AM 
53pcarns
 robl: yep
08:53AM 
53pcarns
 robl: ANL still out for the week?
robl
 pcarns: yeah. it's nice :>
08:57AM 
53pcarns
 robl: I'm like the only one working at Acxiom this week, seems like :)
 pcarns 
n=pcarns@adsl-145-179-39.asm.bellsouth.net
 has left #pvfs2 
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Good morning all....please take a look at the news page when you get a chance. Happy holidays. :) http://freenode.net/news.shtml
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. In about 45 minutes, it will be 2006 on Kiritimati (Christmas Island).... don't forget to go get your invitation to freenode's New Year's celebration.... http://freenode.net/news.shtml :)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Okay, folks, this is it. We are approaching New Year's on Kiritimati, which is pretty much the first moment it's 2006 on Planet Earth. Please come by #freenode-newyears and help us celebrate! :)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3602:22am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57ronnocol
: #pvfs2 
Read error: 110 (Connection timed out)
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-34-58-210.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-34-58-210.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-34-58-210.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-34-58-210.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarn1 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57Elwell
: #pvfs2 
Remote closed the connection
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
 pcarn1 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
SignOff 
57ronnocol
: #pvfs2 
Read error: 104 (Connection reset by peer)
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36G   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
robl
 pcarns: hey man
11:30AM 
53pcarns
 robl: hey
robl
 pcarns: in your acache tests, do you often run with mutiple metadata servers?
11:30AM 
pcarns
 I ran some this weekend, actually
11:30AM 
pcarns
 15 servers, each doing meta and i/o
11:31AM 
pcarns
 I haven't looked at results yet (that was a 60 client run) but,
11:31AM 
pcarns
 I did look at some single client results
11:31AM 
pcarns
 got one oddball- removing files seemed to be _slower_ with cache enabled
11:31AM 
pcarns
 otherwise I haven't seen anything funny
11:32AM 
53pcarns
 robl: what's up?
11:34AM 
50* 
53pcarns/#pvfs2 
is heading to lunch
robl
 pcarns: i'm trying to track down something where pvfs2-cp, reading from pvfs2, triggers an assertion
robl
 pcarns: cool (re: lunch). i'm off to ultimate
12:17PM 
53pcarns
 robl: hmm, I don't know
12:17PM 
pcarns
 I just started some LTP tests after merging from the clemson tree and I am seeing some problems too
12:17PM 
53pcarns
 robl: with single server and single client
12:41PM 
53pcarns
 robl: you hitting this assertion?  sys-small-io.sm:183
12:41PM 
pcarns
 I am getting that from pvfs2-client-core while running the read01 test from LTP project
12:42PM 
pcarns
 ohhh
12:42PM 
53pcarns
 robl: that was just fixed in clemson cvs, wasn't it...
12:43PM 
53pcarns
 robl: yep, ok, let me try with that change
12:56PM 
53pcarns
 robl: I took out that assertion (as in cvs) and it seems to just get stuck elsewhere
12:57PM 
53pcarns
 robl: ah- its then on to server side:
12:57PM 
pcarns
 [E 19:56:37.776476] ../pvfs2_src/src/io/description/pint-request.c line 89: PINT_process_request: NULL segmax or bytemax!
12:58PM 
pcarns
 <some backtrace stuff>
12:58PM 
pcarns
 [E 19:56:37.776654] small_io: Failed to process file request
01:17PM 
pcarns
 hmm, one problem is that server state machine won't send negative acks, I think
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
robl
 12:57PM <pcarns> robl: ah- its then on to server side:
robl
 12:57PM <pcarns> [E 19:56:37.776476]
robl
           ../pvfs2_src/src/io/description/pint-request.c line 89:
robl
           PINT_process_request: NULL segmax or bytemax!
robl
 12:58PM <pcarns> <some backtrace stuff>
robl
 12:58PM <pcarns> [E 19:56:37.776654] small_io: Failed to process file request
robl
 01:17PM <pcarns> hmm, one problem is that server state machine won't send
robl
           negative acks, I think
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
03:05PM 
pcarns
 slang: you there?
03:06PM 
slang
 pcarns: yep
03:06PM 
pcarns
 slang: I see something weird in sys-small-io.sm,
03:07PM 
pcarns
 slang: in small_io_setup_msgpairs(), the regions variable is always zero unless it is a write operation
03:07PM 
pcarns
 slang: does there need to be an else block to go with the "io_type == PVFS_IO_WRITE" if block?
03:07PM 
pcarns
 to handle the read case?
03:08PM 
pcarns
 the regions variable being set to zero leads to the total_size being set to zero, which leads to bytemax being set to zero on the server side, and then the error I posted on pvfs2-developers, I think
03:09PM 
slang
 ah ok
03:09PM 
slang
 pcarns: it should be zero for reads
03:09PM 
slang
 pcarns: but bytemax shouldn't be
03:09PM 
slang
 pcarns: so the change is probably on the server
03:09PM 
slang
 pcarns: to set bytemax correctly
03:10PM 
pcarns
 slang: ok, I had a feeling I didn't really grasp what was supposed to happen there :)
03:10PM 
pcarns
 slang: yeah, bytemax on the server is set directly from the total_bytes field, which will be set to zero by the SMALL_IO_FILL macro if regions is zero
03:11PM 
slang
 right
03:11PM 
slang
 SET_FINAL also uses total_bytes
03:11PM 
slang
 (on the server)
03:12PM 
slang
 should probably be ds_attr.b_size for both
03:12PM 
slang
 (both SET_FINAL and bytemax in the case of a read)
03:15PM 
pcarns
 mmm, not sure
03:15PM 
slang
 pcarns: except that the filereq might be tiled
03:15PM 
pcarns
 what will tell server where the end of the read should be? (for example, if you ask to read 5 bytes from the beginning of a 500 byte file)
03:15PM 
pcarns
 yeah
03:16PM 
pcarns
 filereq is always tiled
03:16PM 
pcarns
 by default
03:16PM 
slang
 pcarns: not if its the same size as the memreq, but yeah
03:16PM 
pcarns
 right
03:16PM 
slang
 so I should probably set total_bytes to memreq.agg_size for a read
03:16PM 
pcarns
 memreq isn't tiled, so it will form the limit if the two don't match
03:17PM 
pcarns
 that would probably work
03:17PM 
pcarns
 I think the regular I/O function does something like that
03:18PM 
50* 
53pcarns/#pvfs2 
is kind of winging it - I don't really remember all this stuff 100%
03:19PM 
pcarns
 PINT_REQUEST_TOTAL_BYTES(sm_p->u.io.mem_req) can tell you the total for a mem req
03:23PM 
50* 
53slang/#pvfs2 
nods
03:55PM 
slang
 pcarns: well that fixes the PINT_request error
03:56PM 
slang
 pcarns: but now when I try to untar a big tarball I get an EOF error at some point
03:57PM 
pcarns
 hmm
03:57PM 
slang
 although that may be unrelated
03:57PM 
pcarns
 read01 passes with that fix
03:57PM 
slang
 I noticed writes were returning 0 sometimes with small io
03:57PM 
slang
 last friday
03:57PM 
slang
 I'll commit this fix and go investigate that
03:59PM 
pcarns
03:59PM 
pcarns
 if you commit what you have so far I'll sync up and keep looking at it too
04:01PM 
pcarns
 thanks
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
12:43AM 
32lilo:*
 Looks as if we'll be restarting another main rotation server soon; this time about 1,300 users affected. If you're on the server in question, your status/notices window should have information on it.
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:03am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:14am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
01:17AM 
32lilo:*
 in the middle of preparations, we had one of our hubbing problems in Australia.... affected users, about 320
01:18AM 
32lilo:*
 those users are now back....meanwhile, the scheduled server restart has been performed, and we're about 500 users short....they're slowly trickling back
01:22AM 
32lilo:*
 looks as if we're just about back up to speed.... thanks everyone
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Hi all. Please be aware that the server you're on, brown.freenode.net, is due for a scheduled restart as soon as we can get the user count down a bit. Please help us out by disconnecting and reconnecting to the main rotation, chat.freenode.net , as soon as you're able.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Have a great afternoon, and thank you for using freenode!
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
08:49AM 
pcarns
 slang: I merged again this morning but now I am getting server crashes
08:49AM 
pcarns
 slang: you guys seeing anything like that up there?
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
10:02AM 
50* 
53slang/#pvfs2 
waves
10:02AM 
slang
 pcarns: you there?
10:02AM 
pcarns
 slang: yep
10:02AM 
slang
 pcarns: do you know where the server is crashing?
10:03AM 
slang
 pcarns: or what you're doing to make it happen?
10:03AM 
pcarns
 different places, seems to be a memory corruption
10:03AM 
slang
 pcarns: ah
10:03AM 
slang
 pcarns: how can I reproduce?
10:03AM 
pcarns
 slang: I'm running read01 from LTP test, but I don't know how easy that is to run for you
10:04AM 
pcarns
 you can skip running the whole test- just build LTP, go to testcases/bin dir, set TMPDIR env var to your pvfs2 mount point, and ./read01
robl
 slang: looks like pvfs2-cp is enough to trigger it
10:04AM 
53slang
 robl: hmm...not for me..
10:07AM 
pcarns
 I don't think there is anything special about read01, looks like it is just trying to read 512 bytes from beginning of a file when I run into trouble
10:08AM 
pcarns
 but I'm not entirely sure
10:09AM 
pcarns
 slang: I think I see the problem
10:09AM 
pcarns
 read_list is called with result.bytes as the amount to be read
10:10AM 
pcarns
 but the memalloc right before it is allocating s_op->req->u.small_io.total_bytes bytes
10:10AM 
pcarns
 the latter is 0, the former is 512
10:10AM 
pcarns
 in my case
10:10AM 
pcarns
 so not enough memory allocated to read data into
10:12AM 
pcarns
 slang: yep, I changed BMI_memalloc() to use result.bytes as size argument and it doesn't crash any more
10:12AM 
pcarns
 is that the correct fix, though?
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
10:28AM 
pcarns
 hello?
10:28AM 
pcarns
 I think my irc client broke :)
10:31AM 
slang
 pcarns: hi
10:31AM 
slang
 pcarns: sorry
10:31AM 
slang
 pcarns: bossman was inna office
10:32AM 
pcarns
 slang: np- my irc session did something weird, so I wasn't sure if it was working
10:33AM 
slang
 pcarns: hmm...on a read total bytes is zero..yeah I think you need result.bytes
10:38AM 
pcarns
 slang: I've got some other less critical failures now
10:38AM 
pcarns
 different tests
10:39AM 
pcarns
 slang: access02 test from LTP triggers this in pvfs2-client
10:39AM 
pcarns
 [E 01/10 17:33] ../pvfs2_src/src/io/description/pint-request.c line 89: PINT_process_request: NULL segmax or bytemax!
10:39AM 
pcarns
 not sure what its up to yet
10:39AM 
slang
 pcarns: again!
10:39AM 
pcarns
 different place, though :)
10:39AM 
pcarns
 last time was on server
10:40AM 
slang
 right
10:49AM 
pcarns
 slang: this one is happening from io_find_total_size; may not have anything to do with small-io
10:50AM 
slang
 pcarns: maybe not
10:51AM 
slang
 pcarns: the small-io sm returns from being jumped-to before that function is called though
10:51AM 
slang
 pcarns: does access02 create holes in the logical file?
10:52AM 
pcarns
 *shrug*
10:52AM 
pcarns
 the strace is confusing
10:52AM 
pcarns
 and I haven't stepped through it with gdb yet
10:54AM 
pcarns
 grr, something weird is going on, not seeing extra gossip statements I am adding...
10:55AM 
pcarns
 I'll tackle this again after lunch
10:55AM 
slang
 pcarns: heh..ok
10:55AM 
slang
 pcarns: I'll try to reproduce it in the meantime
10:56AM 
50* 
53slang/#pvfs2 
always forgets if its PVFS2_DEBUGMASK or PVFS2DEBUG_MASK
10:56AM 
slang
 I usually end up setting both
robl
 slang: testing
31msg
51slang
50)] 
SignOff 
57slang
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
11:15AM 
50* 
53slang/#pvfs2 
frrs
11:15AM 
slang
 pcarns: access02 doesn't cause any errors on the client when I run it
11:15AM 
slang
 pcarns: assuming I'm running it right
11:23AM 
slang
 pcarns: how many servers do you have running?
11:40AM 
pcarns
 slang: just one server
11:41AM 
pcarns
 slang: I'll pull the stock cvs tree and make sure its not just something in my tree
12:05PM 
pcarns
 slang: access2 breaks worse on the official tree for me
12:08PM 
pcarns
 slang: are you guys turning off acache or something?
12:09PM 
pcarns
 slang: official tree still needs fix from this email: 
12:09PM 
pcarns
 http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-December/001737.html
12:10PM 
pcarns
 slang: if I turn off acache in official tree then I see access02 failure that I get on my tree
12:18PM 
slang
 pcarns: ah ok
12:19PM 
slang
 pcarns: somehow I missed that mail
12:19PM 
slang
 pcarns: I think I may have just deleted all emails received while on vacation ;-)
12:19PM 
pcarns
12:19PM 
slang
 pcarns: I'm not turning off acache specifically, no
12:20PM 
slang
 pcarns: but only the handles are cached by default right?
12:20PM 
pcarns
 I don't know what's different about our setup...
12:20PM 
slang
 pcarns: I thought -a had to be specified to pvfs2-client to make the cache timeout nonzero
12:20PM 
pcarns
 slang: how are you starting pvfs2-client?
12:20PM 
pcarns
 slang: if you run pvfs2-client -p ./pvfs2-client-core, for example, it tacks on a -a for your
12:21PM 
pcarns
 "your" -> "you"
12:21PM 
slang
 pcarns: ah
12:21PM 
pcarns
 defaults to 5 ms
12:21PM 
slang
 pcarns: I'm just running pvfs2-client-core directly :-)
12:22PM 
pcarns
 if you make the fix from that email, you might as well grab this one too while you are at it: 
12:22PM 
pcarns
 http://www.beowulf-underground.org/pipermail/pvfs2-developers/2006-January/001741.html
12:22PM 
pcarns
 both emails are just to fix little things from the merge
12:22PM 
pcarns
 although the first one is pretty important (the cache miss one)
12:23PM 
slang
 pcarns: by official tree, you just mean pvfs2's cvs HEAD, right?
12:23PM 
pcarns
 yeah
12:23PM 
pcarns
 slang: I just say "official" to keep myself straight- I am usually running out of a modified tree we maintain at acxiom
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. For reference, MacWorld coverage: #apple-x in English, #macbidouille en Francais
12:27PM 
pcarns
 slang: ok, I see how to trigger it!
12:27PM 
pcarns
 cd /mnt/pvfs2
12:27PM 
pcarns
 touch foo
12:27PM 
pcarns
 chmod a+x foo
12:27PM 
pcarns
 ./foo
12:28PM 
pcarns
 or "cat foo" even works
12:28PM 
pcarns
 something to do with 0 byte file
12:28PM 
pcarns
 slang: access02 happened to be trying to exec the file, but I think just reading a zero byte file was the issue
12:29PM 
slang
 pcarns: ok that makes sense
12:29PM 
slang
 pcarns: I guess I need a check in find_total_size
12:39PM 
slang
 pcarns: that seems to fix it
12:40PM 
pcarns
 slang: fix for the "reading a zero byte file" issue?
12:40PM 
slang
 pcarns: yeah
12:40PM 
pcarns
 slang: awesome
12:42PM 
slang
 btw, what irc command do you use for slang: ?
12:42PM 
pcarns
 just typing it
12:42PM 
slang
 I've just been typing 'pcarns:'
12:42PM 
slang
12:42PM 
slang
 hmm
12:43PM 
pcarns
 does it show up right on your end?
12:43PM 
pcarns
 (beep or colorize or something)
12:43PM 
pcarns
 mine does, but I think it just beeps when my username shows up anywhere in a message
12:43PM 
slang
 pcarns: I'm using MacIrssi which has a growl plugin that gives me notifications on my desktop when you talk to me directly, but when robl tries it doesn't show up
12:45PM 
50* 
53slang/#pvfs2 
shrugs
robl
 slang: did you commit that result.bytes change you and pcarns were discussing earlier?
12:47PM 
53slang
 robl: hey now it works!
12:47PM 
53slang
 robl: yes committed
12:47PM 
pcarns
 slang: ok, assuming the fix works for me, I still have one last LTP failure (pwrite04)
50* 
57robl 
sees it now
robl
 pcarns: i bet i know what that's about
12:48PM 
53pcarns
 robl: oh yeah?  have you guys seen some problems with pwrite?
robl
 pcarns: http://www.parl.clemson.edu/pipermail/pvfs2-users/2006-January/001163.html
robl
 pcarns: but i committed murali's fix
12:50PM 
slang
 pcarns: pwrite04 works for me
12:50PM 
slang
 (with client-core -a)
12:50PM 
pcarns
 everything works for slang!
12:50PM 
50* 
53pcarns/#pvfs2 
is all alone with his troubles...
12:51PM 
slang
 pcarns: heh - that either makes me the best beta tester or the worst..
12:51PM 
slang
 pcarns: depending on which side of the code you are I suppose
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] At the same time Macworld Expo started, FSF announced the addition of Gnash, a flash player and firefox plugin ( http://tinyurl.com/a6mev ).... it's one of the FSF's priority projects ( http://www.fsf.org/campaigns/priority.html ) and a real FOSS milestone
12:52PM 
pcarns
 you sure the pwrite04 is hitting your pvfs2 mount point?
12:52PM 
pcarns
 slang: maybe strace to confirm?
12:52PM 
pcarns
 slang: I only suggest b/c I have had that happen before (set env var wrong or something and it just hit /tmp or something)
12:52PM 
53pcarns
 robl: I think I have the fix in my tree
12:54PM 
slang
 open("pwrite04_file.31236", O_RDWR|O_CREAT, 0666) = 3
12:54PM 
slang
 pwrite(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024, 0) 
12:54PM 
slang
 = 1024
12:54PM 
slang
 I'm sitting in the pvfs2 mountpoint
12:55PM 
slang
 its opening other files in /tmp, but I don't see any pwrites on those
12:56PM 
slang
 pcarns: oh
12:56PM 
slang
 pcarns: chdir
12:56PM 
slang
 pcarns: how do I specify a different dir?
12:56PM 
pcarns
 slang: set env variable TMPDIR to point to the directory you want it to work in
12:57PM 
slang
 $pwri/pwrite04   
12:57PM 
slang
 pwrite04    1  FAIL  :  file size is 4096 != K4
12:57PM 
pcarns
 slang: yes! that's the failure I am getting
12:57PM 
50* 
53pcarns/#pvfs2 
isn't crazy after all
12:58PM 
pcarns
 slang: that test did not always fail
12:58PM 
pcarns
 slang: msg that gets printed is actually a typo, but it should succeed
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] (sorry, I think we nailed that news site....here's the release on the Gnash flash player and firefox plugin: http://www.fsf.org/news/gnash.html )
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Thank you for using freenode, and have a great evening!
12:59PM 
pcarns
 slang: pwrite04.c:203 in my version of LTP (rather old)
01:02PM 
pcarns
 granted, the code doesn't make much sense to me
01:02PM 
pcarns
 (didn't realize pwrite() honored O_APPEND)
01:03PM 
slang
 pwrite(3, "\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1"..., 1024, 1024) = 1024
01:03PM 
slang
 close(3)                                = 0
01:03PM 
slang
 open("pwrite04_file.31275", O_RDWR|O_APPEND) = 3
01:03PM 
slang
 fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0
01:03PM 
slang
 lseek(3, 2048, SEEK_SET)                = 2048
01:04PM 
slang
 pwrite(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 1024, 0) = 1024
01:04PM 
slang
 lseek(3, 0, SEEK_CUR)                   = 2048
01:04PM 
slang
 fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0
01:04PM 
slang
 fstat64(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 9), ...}) = 0
01:04PM 
slang
 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7fe9000
01:04PM 
slang
 write(1, "pwrite04    1  FAIL  :  file siz"..., 48pwrite04    1  FAIL  :  file size is 4096 != K4
01:04PM 
slang
 ) = 48
01:04PM 
slang
 pcarns: so mmap2 is failing?
01:04PM 
slang
 pcarns: why is the fd -1?
01:04PM 
pcarns
 slang: its not the mmap failing
01:05PM 
pcarns
 slang: the test program is checking st_size from one of those fstat64 calls and finding a wrong size
01:05PM 
pcarns
 slang: this one: fstat64(3, {st_mode=S_IFREG|0644, st_size=4096, ...}) = 0
01:06PM 
pcarns
 slang: according to test proram, st_size should be 5 k rather than 4 k
01:07PM 
pcarns
 slang: it did a pwrite with an offset of zero, but says that since it was open with O_APPEND set that the data should have been appended to the end of the file
01:07PM 
pcarns
 slang: which is news to me, but apparently we passed this test before somehow
01:08PM 
slang
 pcarns: I think Murali made some changes re: O_APPEND a while back
01:14PM 
pcarns
 slang: any chance you can go ahead and commit the 0 byte file read fix?
01:14PM 
slang
 pcarns: i thought I did
01:14PM 
pcarns
 oh..
robl
 pcarns: Members:
robl
         src/client/sysint/sys-getattr.sm:1.93->1.94
robl
         src/client/sysint/sys-io.sm:1.136->1.137
robl
         src/common/misc/pint-perf-counter.c:1.9->1.10
robl
         src/server/small-io.sm:1.10->1.11
01:15PM 
53pcarns
 robl: doh! I was watching wrong mail folder
01:15PM 
pcarns
 slang: thanks!
01:18PM 
pcarns
 merging up here now (need to roll some rpms)
01:30PM 
slang
 pcarns: murali is now looking at pvfs2_file_write
01:31PM 
slang
 pcarns: it appears that generic_write_checks modifies the offset value
01:31PM 
slang
 pcarns: and the current code doesn't reset it correctly in the case of pwrite
01:31PM 
slang
 although
01:32PM 
slang
 when I try to do:  *offset = original_offset;
01:32PM 
slang
 right after generic_write_checks
01:32PM 
slang
 pwrite04 still fails
01:40PM 
slang
 removing the generic_write_checks altogether also does not help
02:18PM 
pcarns
 slang: I think this is where we are getting snagged:
02:18PM 
pcarns
     /* for whatever reason, count is being set to inode->i_size in
02:18PM 
pcarns
      * generic_write_checks with O_APPEND opens.  So if we want that to work,
02:18PM 
pcarns
      * we would have to do a getattr for the size which is ridiculous.
02:18PM 
pcarns
      * So we work that around here...
02:18PM 
pcarns
      */
02:18PM 
pcarns
     if ((file->f_flags & O_APPEND) && (*offset != file->f_pos))
02:18PM 
pcarns
     {
02:18PM 
pcarns
         *offset = file->f_pos;
02:18PM 
pcarns
     }
02:19PM 
pcarns
 the comment describes it, normally in O_APPEND mode we are supposed to set the *offset to the size of the file at the beginning of pvfs2_file_write()
02:22PM 
pcarns
 so I guess really this is an optimization- we don't really want to "fix" it :)
02:23PM 
pcarns
 is there a common app that writes in O_APPEND mode?  (probably cp or something with our luck)
02:33PM 
slang
 pcarns: I tried removing that if block
02:34PM 
slang
 pcarns: didn't fix it
02:34PM 
slang
 pcarns: you're saying keep the if block?
02:34PM 
pcarns
02:34PM 
pcarns
 I don't know
02:35PM 
slang
 pcarns: the way murali described it, offset was being reset to file->f_pos because generic_write_checks was modifying it
02:35PM 
pcarns
 the fix would probably be to remove if block and also update i_size (by way of getattr) before calling write checks
02:35PM 
slang
 pcarns: ah right
02:36PM 
slang
 pcarns: I think murali was trying to aviod the getattr
02:36PM 
slang
 avoid
02:36PM 
pcarns
 slang: yeah
02:36PM 
pcarns
 slang: so I don't really know what the pros and cons are
02:36PM 
pcarns
 slang: if it is worth the getattr or not
02:39PM 
pcarns
 slang: although it seems like at least in the single client case we should be able to keep i_size more or less acurate on our own
02:39PM 
pcarns
 slang: not sure why it doesn't have the value we want if we remove the if block
02:40PM 
pcarns
 slang: maybe it should be updated on the way out of pvfs2_file_write()?
02:40PM 
slang
 pcarns: oh
02:40PM 
slang
 pcarns: well I was resetting offset
02:41PM 
pcarns
 slang: what do you mean?
02:41PM 
slang
 pcarns: I didn't just remove the if block
02:41PM 
slang
 pcarns: I replaced it with *offset = original_offset;
02:43PM 
pcarns
 slang: I'm going to try adding an if statement to set i_size() on the way out of file_write() and then remove the if block (without resetting offset) to see what that does
02:48PM 
pcarns
 that seemed to work for this test program, but I don't know what else it might have broken
02:48PM 
pcarns
 slang: do you remember why murali made this fix originally?  is there a mailing list post?
02:52PM 
pcarns
 slang: ah, I found it, 11-18-2005
02:56PM 
pcarns
 slang: yeah, I think I have a solution that works for both LTP and the original problem
02:57PM 
pcarns
 slang: I added this to the end of pvfs2_file_write() (just before returning total_count):
02:57PM 
pcarns
     if(file->f_pos > inode->i_size)
02:57PM 
pcarns
     {       
02:57PM 
pcarns
         inode->i_size = file->f_pos;
02:57PM 
pcarns
     }       
02:58PM 
pcarns
 then I completely removed the "if ((file->f_flags & O_APPEND...." block 
02:58PM 
pcarns
 slang: do you want to try it and see if it works on your end too?
02:59PM 
pcarns
 pvfs1 did something very similar
03:09PM 
slang
 pcarns: yeah lemme try it
03:11PM 
slang
 pcarns: yeah seems to work
03:12PM 
pcarns
 slang: I tried it against the original shell script append problem described by T M Tran and it seemed to work ok too
03:12PM 
pcarns
 http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-November/001654.html
03:13PM 
pcarns
 (towards the bottom of the email)
03:13PM 
slang
 pcarns: ok Ill commit
03:14PM 
pcarns
 slang: great, thanks!
03:14PM 
pcarns
 slang: these conversations on IRC this week have been about 40x faster than me having to go through patch process over here
03:14PM 
pcarns
 actually probably even more than that
03:15PM 
50* 
53slang/#pvfs2 
cools.
03:35PM 
slang
 pcarns: murali pointed out that the update to i_size has to go at the beginning of pvfs2_file_write
03:35PM 
pcarns
 slang: why is that?
03:36PM 
slang
 pcarns: putting it at the end fixes the pwrite04 test, but Trach-Minh's date test breaks
03:37PM 
pcarns
 slang: the thing with the "w" script?
03:38PM 
slang
 pcarns: I think its because generic_write_checks modifies the f_pos value?
03:38PM 
slang
 pcarns: yes
03:38PM 
pcarns
 slang: the w script worked correctly for me with it at the end
03:39PM 
pcarns
 is there anything besides pvfs2_file_write() that can extend f_pos and i_size?
03:40PM 
slang
03:40PM 
slang
 dunno
03:40PM 
pcarns
 hmm
03:40PM 
pcarns
 my thinking was that i_size should just be updated continuously as needed, rather than trying to sort it out when the write happens
03:41PM 
pcarns
 maybe it needs to be updated in more places though?  writev, aio, truncate?
03:45PM 
pcarns
 slang: the problem with putting it at the beginnnig is that anyone can change f_pos with an lseek, I think
03:46PM 
pcarns
 slang: we don't really want to update it when f_pos changes, just when someone writes beyond eof (f_pos just happens to be a handy way to get that info at the end of file_write()
03:46PM 
pcarns
 slang: in file_write() case we can determine if someone extended the file by checking if file position is beyond what we thought the size was when we started
03:47PM 
pcarns
 slang: what kind of system is the "w" test failing on?
03:47PM 
pcarns
 slang: I may be confused
03:47PM 
slang
 pcarns: errr...2.6
03:48PM 
slang
 pcarns: instead of:
03:48PM 
slang
 1 Tue Jan 10 15:34:07 CST 2006
03:48PM 
slang
 2 Tue Jan 10 15:34:09 CST 2006
03:48PM 
slang
 3 Tue Jan 10 15:34:11 CST 2006
03:48PM 
slang
 1 Tue Jan 10 15:34:16 CST 2006
03:48PM 
slang
 2 Tue Jan 10 15:34:19 CST 2006
03:48PM 
slang
 3 Tue Jan 10 15:34:21 CST 2006
03:48PM 
slang
 pcarns: which is the correct result, putting the update at the end of write gives:
03:49PM 
slang
 1 Tue Jan 10 15:25:32 CST 2006
03:49PM 
slang
 2 Tue Jan 10 15:25:34 CST 2006
03:49PM 
slang
 3 Tue Jan 10 15:25:36 CST 2006
03:49PM 
slang
 2 Tue Jan 10 15:26:06 CST 2006
03:49PM 
slang
 3 Tue Jan 10 15:26:08 CST 2006
03:49PM 
pcarns
 slang: hunh, that didn't happen on my box (2.4)
03:49PM 
pcarns
 slang: sorry about that
03:49PM 
pcarns
 I got this:
03:49PM 
pcarns
 1 Tue Jan 10 21:53:05 CET 2006
03:49PM 
pcarns
 2 Tue Jan 10 21:53:07 CET 2006
03:49PM 
pcarns
 3 Tue Jan 10 21:53:09 CET 2006
03:49PM 
pcarns
 1 Tue Jan 10 21:53:35 CET 2006
03:49PM 
pcarns
 2 Tue Jan 10 21:53:37 CET 2006
03:49PM 
pcarns
 3 Tue Jan 10 21:53:39 CET 2006
03:50PM 
slang
 pcarns: its 10 p.m.!  time to go home!
03:51PM 
pcarns
 heh
robl
 nice. pcarns is working from europe
03:51PM 
53pcarns
 robl: no, I have just come to grips with the fact that the clock on my computer can never be right
03:51PM 
53pcarns
 robl: no matter what, clock goblins mess up my time zone and date
03:52PM 
slang
 pcarns: I think with 2.4, instead of generic_write_checks, pvfs2_precheck_file_write doesn't modify the f_pos value
03:52PM 
slang
 pcarns: which is why it worked for you?
robl
 nice guys: nightly tests pass on gil for the first time in 3 weeks :>
03:54PM 
53slang
 robl: they take so long on gil we should probably call them night-and-day tests
robl
 goodl ol' crappy crappy gil
robl
 valued at 3,000 US dollars
robl
 that kills me
03:56PM 
53pcarns
 robl: that box is still running?
robl
 pcarns: yup. it's our FC4 test box
03:56PM 
53pcarns
 robl: wow, swanky software and all
03:57PM 
pcarns
 slang: I'm so confused
03:57PM 
slang
 pcarns: me too!
03:57PM 
pcarns
 slang: if f_pos is wrong at the end of pvfs2_file_write() on 2.6 kernels, what in the world gets it set right?  somehow it has to be correct before the user calls write again, no?
03:58PM 
slang
 I think I've filled up my bug-murali quota for the day..his door is locked! :-)
03:58PM 
pcarns
 slang: perhaps he has noticed something my stomach has been pointing out the last few minutes; it is almost beer 'o clock
03:58PM 
pcarns
 even here in europe
03:58PM 
slang
 pcarns: heh
03:59PM 
slang
 pcarns: I don't know anything about the kernel module code
03:59PM 
slang
 pcarns: esp. regarding what happens outside of pvfs2_file_write
04:00PM 
pcarns
 slang: I can fire up my centos vmware image in the morning and look at what's going on
04:01PM 
pcarns
 (that's my 2.6 test environment- I have to approximate rhel4 for our deployment but don't actually have a rhel4 license myself)
04:07PM 
pcarns
 have a good one guys, I'm out of here
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Hi all. Reminder: we're going to be restarting the server you're on, brown.freenode.net, as soon as we get the user count down more. Please help us speed up the process by disconnecting, and reconnecting to chat.freenode.net, first chance you get. Thanks, and thank you for using freenode!
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Client Quit
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Hi all. Just a reminder. The server you're on, brown.freenode.net, is scheduled for maintenance and will need to be re-upped. You can help by disconnecting and reconnecting to chat.freenode.net so that we can get the user count down.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Thanks in advance for your help, and thank you for using freenode!
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We've had another main rotation server scheduled for restart for a couple of days, and will be doing that in the next few minutes. Affected users, just under 2000, so you'll notice it. Apologies for the inconvenience, and thank you for using freenode!
03:00AM 
32lilo:*
 about to do that restart
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Hi all. Here we go. We'll see you on the other side!
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
52[freenode]
  *** Looking up your hostname...
52[freenode]
  *** Checking ident
52[freenode]
  *** No identd (auth) response
52[freenode]
  *** Found your hostname
BitchX
: For more information about 
BitchX
 type 
/about
 Welcome to the freenode IRC Network robl 
 Your host is brown.freenode.net[brown.freenode.net/6667], running version hyperion-1.0.2 
52[freenode]
  *** Your host is brown.freenode.net[brown.freenode.net/6667], running version hyperion-1.0.2
 This server was created Sat Dec 17 11:03:59 UTC 2005 
 brown.freenode.net hyperion-1.0.2 aAbBcCdDeEfFGhHiIjkKlLmMnNopPQrRsStTuUvVwWxXyYzZ01234569*@ bcdefFhiIklmnoPqstv 
 IRCD=dancer CAPAB CHANTYPES=# EXCEPTS INVEX CHANMODES=bdeIq,k,lfJD,cgijLmnPQrRstz CHANLIMIT=#:20 PREFIX=(ov)@+ MAXLIST=bdeI:50 MODES=4 STATUSMSG=@ KNOCK NICKLEN=16 :are supported by this server 
 SAFELIST CASEMAPPING=ascii CHANNELLEN=30 TOPICLEN=450 KICKLEN=450 KEYLEN=23 USERLEN=10 HOSTLEN=63 SILENCE=50  are supported by this server
local users on irc
50)]
 100%
global users on irc
50)]
 94%
invisible users on irc
50)]
ircops on irc
50)]
total users on irc
50)]
unknown connections
50)]
total servers on irc
50)]
avg. 0 users per server
total channels created
50)]
avg. 33 users per channel
 Current local  users: 33  Max: 33 
 Current global users: 33  Max: 33 
Highest client connection count
50) 
50)]
52[freenode]
  Server is currently split, channel modes are limited
 Unknown MODE flag 
Mode change 
57+iw
 for user 
36robl
 Due to a network split, you can not obtain channel operator status in a new channel at this time 
 Due to a network split, you can not obtain channel operator status in a new channel at this time 
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+ns
 by 
57brown.freenode.net
52Users
32#pvfs2
50)]
54 robl      
52[freenode]
  TS for #pvfs2 changed from 1136970103 to 1123487510
51ServerMode
36#pvfs2 
57-s
 by 
57irc.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
 Topic 
36#pvfs2
50):
 changed by 
36irc.freenode.net
 PVFS2-1.3.2 is out
52[freenode]
  TS for #mklinux changed from 1136970103 to 1059948526
55NickServ
35NickServ@services.
50)-
 This nickname is owned by someone else
55NickServ
35NickServ@services.
50)-
 If this is your nickname, type /msg NickServ 
IDENTIFY
 <password>
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
 #pvfs2  [freenode-info] if you need to send private messages, please register: http://freenode.net/faq.shtml#privmsg
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.498 secs!!
56ronnocol 
36n=lance@i216-58-72-60.cybersurf.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
 Closing Link: robl[~robl@ninjak.clustermonkey.org] irc.Prison.NET (Ping timeout: no data for 585 seconds)
 Connection closed from irc.efnet.us: Success
 Connecting to port 6667 of server irc.efnet.us [refnum 1]
52[Prison]
  *** Processing connection to irc.ptptech.com
52[Prison]
  *** Looking up your hostname...
52[Prison]
  *** Checking Ident
52[Prison]
  *** No Ident response
52[Prison]
  *** Found your hostname
52[Prison]
  You need to install identd to use this server
 Closing Link: 127.0.0.1 (Install identd)
 Connection closed from irc.efnet.us: Success
 Connecting to port 6667 of server irc.efnet.us [refnum 1]
52[Prison]
  *** Processing connection to irc.blessed.net
52[Prison]
  *** Looking up your hostname...
52[Prison]
  *** Checking Ident
52[Prison]
  *** No Ident response
52[Prison]
  *** Found your hostname
BitchX
: For more information about 
BitchX
 type 
/about
 Welcome to the EFNet Internet Relay Chat Network robl (from irc.blessed.net)
 Your host is irc.blessed.net[irc.blessed.net/6667], running version ircd-ratbox-2.1.7 (from irc.blessed.net)
 This server was created Wed Oct 26 2005 at 16:57:25 PDT (from irc.blessed.net)
 irc.blessed.net ircd-ratbox-2.1.7 oiwszcerkfydnxbauglZCD biklmnopstveI bkloveI 
 CHANTYPES=&# EXCEPTS INVEX CHANMODES=eIb,k,l,imnpst CHANLIMIT=&#:40 PREFIX=(ov)@+ MAXLIST=beI:100 NETWORK=EFNet MODES=4 STATUSMSG=@+ KNOCK CALLERID=g :are supported by this server 
 SAFELIST ELIST=U CASEMAPPING=rfc1459 CHARSET=ascii NICKLEN=9 CHANNELLEN=50 TOPICLEN=160 ETRACE CPRIVMSG CNOTICE DEAF=D MONITOR=60  are supported by this server
 TARGMAX=NAMES:1,LIST:1,KICK:1,WHOIS:1,PRIVMSG:4,NOTICE:4,ACCEPT:,MONITOR: :are supported by this server 
local users on irc
3469
50)]
global users on irc
9470
50)]
 11%
invisible users on irc
74694
50)]
 89%
ircops on irc
50)]
total users on irc
84164
50)]
unknown connections
50)]
total servers on irc
50)]
avg. 1558 users per server
total channels created
36944
50)]
avg. 2 users per channel
 3469 4567  Current local users 3469, max 4567
 84164 92258  Current global users 84164, max 92258
Highest client connection count
4568
50) 
4567
50)]
57> 
52B-Drone 
32bdrone@blessed.drone.mon
32 requested VERSION  from robl
Mode change 
57+isw
 for user 
36robl
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #c-60
 Topic 
36#c-60
50):
 ppl who watch tv should die
 Topic 
36#c-60
50):
 set by 
36dsp!~dsp@dorado.c-60.org
 at 
36Sun Jan  8 21:50:33 2006
52Users
32#c-60
3213
50)]
54 robl      
54bress     
54ksb       
54sdh       
54sergent   
54gah       
54|az       
54epg       
54hideaway  
54ajk       
54notdsp    
54mrbsk     
54dsp       
 Channel #c-60 was created at Tue Aug 30 22:07:37 2005
BitchX
: Join to #c-60 was synched in 0.410 secs!!
 You are not on a channel.  Use /WHO ** to see everybody.
BitchX
: You are now talking to channel #c-60
53#c-60      
57robl      
36H   
~robl
ninjak.clustermonkey.org (Rob Latham)
53#c-60      
57bress     
36H@  
~bress
cpe-65-26-183-127.indy.res.rr.com (Josh Bressers)
53#c-60      
57ksb       
36H@  
~ksb
rrcs-24-56-87-2.ma.biz.rr.com (K S Braunsdorf)
53#c-60      
57sdh       
36H@  
csociety.ecn.purdue.edu (Seth Heckard)
53#c-60      
57sergent   
36H@  
sergent
csociety.ecn.purdue.edu (Jonathan Sergent)
53#c-60      
57gah       
36H@  
~held
ns1.upin.com (Garrett Held)
53#c-60      
57|az       
36G@  
~laz
ninjak.clustermonkey.org (Adam Lazur)
53#c-60      
57epg       
36H@  
~epg
gould.diplodocus.org (*Unknown*)
53#c-60      
57hideaway  
36H*@ 
petef
free.bsd (Come get some of this glowing)
53#c-60      
57ajk       
36H@  
~ajk
rikers.itso.iu.edu (Ay Jay Kay)
53#c-60      
57notdsp    
36H@  
~dsp
volans.c-60.org (dsp)
53#c-60      
57mrbsk     
36H@  
~mrb
mixtec.wiredsoul.org (*Unknown*)
53#c-60      
57dsp       
36H@  
~dsp
dorado.c-60.org (Doug Porter)
WINDOW: Invalid option: [close]
 Window 3
 	Server: [1] <None>
 	Screen: 0x817dda4
 	Geometry Info: [0 42 0 41 41 41]
 	CO, LI are [79 45]
 	Current channel: #c-60
 	Query User: <None> 
 	Prompt: <None>
 	Second status line is ON
 	Split line is ON triple is ON
 	Logging is ON
 	Logfile is ~/.BitchX/irc-chat/#pvfs2.log
 	Notification is OFF
 	Hold mode is OFF
 	Window level is NONE
 	Lastlog level is ALL
 	Notify level is ALL
 ADD           BACK          BALANCE       BEEP_ALWAYS   BIND         
 CHANNEL       CREATE        DELETE        DESCRIBE      DISCON       
 DOUBLE        ECHO          FIXED         GOTO          GROW         
 HELP          HIDE          HIDE_OTHERS   HOLD_MODE     KILL         
 KILL_OTHERS   KILLSWAP      LAST          LASTLOG       LASTLOG_LEVEL
 LEVEL         LIST          LOG           LOGFILE       MENU         
 MOVE          NAME          NEW           NEW_HIDE      NEXT         
 NOSERV        NOTIFY        NOTIFY_LEVEL  NUMBER        POP          
 PREVIOUS      PROMPT        PUSH          QUERY         REFNUM       
 REFRESH       REMOVE        SERVER        SET           SCRATCH      
 SCROLL        SCROLLBACK    SHOW          SHOW_ALL      SHRINK       
 SIZE          SKIP          SPLIT         STACK         STATUS_SPECIA
 SWAP          TRIPLE        UNBIND        UPDATE                     
 Usage: /WINDOW  help 
command
 to get help on specific commands
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Wed Jan 11 14:24:32 2006
robl
  ,who
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
03:19PM 
32lilo:*
 Hi all. New channel: ##fastcgi , an unofficial support channel which will cover configuration and application development with fastcgi for your webserver and language of choice.... if you'd like to help out, please stop by!
Mode change 
57-w
 for user 
36robl
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ronnocol  
36H   
n=lance
i216-58-72-60.cybersurf.com (Lance O'Connor)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57ronnocol
: #pvfs2 
"leaving"
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:02pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
02:18PM 
53pcarns
 robl: hey, do you happen to know approximately what the threshold is for small-io?
robl
 pcarns: sam says it's 16k
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
02:21PM 
pcarns
 great, thanks
robl
 pcarns: thanks for your help this week. nightly tests completed last night with 0 unexpected errors
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
02:22PM 
53pcarns
 robl: no, thank you for helping to get that stuff fixed so quick
02:23PM 
53pcarns
 robl: there is one more new bug fix on the list now
02:23PM 
pcarns
 everything is humming down here now, but we are still a few fixes ahead
02:24PM 
pcarns
 I am about to embark on some serious file system smack-down, we need some performance numbers here pronto
02:25PM 
pcarns
 need to start narrowing down some pvfs2 footprints, ext3 options, etc.
robl
 pcarns: what's nate up to these days?
robl
 haven't seen him around much on line
02:44PM 
53pcarns
 robl: he's still doing the same stuff, actually in a seperate section from me now (reorg shortly after I was hired)
02:45PM 
53pcarns
 robl: I guess he doesn't really have much time for pvfs2 tinkering
02:45PM 
pcarns
 *shrug*
02:45PM 
pcarns
 he is the jack of all trades node level O/S speciallist really here
02:46PM 
53pcarns
 robl: I guess he is doing ok, I actually haven't talked to him in several months now myself
robl
 pcarns: cool. glad he didn't get fired or anything like that :>
02:47PM 
53pcarns
 robl: did you guys here that we are EMC minions in training now?
02:47PM 
53pcarns
 robl: google for EMC acxiom partnership if not
robl
 pcarns: does that mean you get good deals on vmware now? :>
02:58PM 
pcarns
 pcarns: every new hire gets 10 copies of vmware and a SAN box to take home
02:58PM 
pcarns
 j/k of course :)
02:58PM 
pcarns
 pcarns: EMC new hires now get a DVD full of incomprehensible grid software source code
02:59PM 
53pcarns
 robl: nothing has really changed, though we are going to hire more folks and put more focus on making software sturdy enough to be deployed outside of our site
robl
 pcarns: that's a pretty big change for acxiom
03:01PM 
53pcarns
 robl: yeah
03:01PM 
53pcarns
 robl: and something we couldn't do without a big name vendor that already sells software and support to people
03:02PM 
53pcarns
 robl: acxiom got an indefinite license for whatever the end result is- I think eventually they would like to just hand off the whole thing to EMC in a couple of years
03:02PM 
53pcarns
 robl: acxiom doesn't make any money off of creating grid software directly- it is just a big cost for them along the way to selling data products
03:03PM 
53pcarns
 robl: that's my 2c
03:04PM 
53pcarns
 robl: for the next 2 years we are all still acxiom employees, not clear after that
robl
 oh!
03:05PM 
53pcarns
 robl: yeah, that's the real serious part, which isn't really clear from press releases
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
robl
 parl is down again :<
09:42AM 
pcarns
 someone needs to go whip the mules to generate more electricity
09:42AM 
pcarns
 probably turned on the football stadium lights and overloaded the system
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 slang: hey
10:41AM 
53slang
 robl: hi
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
53#pvfs2     
57slang_    
36H   
n=slang
216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
02:06PM 
53slang
 robl: is cvs.parl.clemson.edu down for you as well?
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
02:12PM 
50* 
53slang/#pvfs2 
has identity issues today
02:23PM 
pcarns
 slang: cvs .parl is down for me at least
02:25PM 
slang
 pcarns: ok thanks
robl
 pcarns: huh. it was up for about an hour there around noon :>
02:32PM 
53pcarns
 robl: yeah, I saw you snuck a commit in there somehow
robl
 pcarns: so the ANL->PARL link seems to be ok
robl
 pcarns: maybe that's because we're on I2 ?
02:35PM 
53pcarns
 robl: hunh, now everything is up for me
02:36PM 
pcarns
 Your I2 has nothing on me
02:36PM 
pcarns
50* 
57robl 
just grasping for explanations
robl
 heh. now lain can't get to parl
robl
 that's probably related to some network mesups at argonne
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:35am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net brown.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:46am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net brown.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Server Notice] Hi all. The server you're on, brown.freenode.net, just experienced some major packet loss. We're investigating. You may want to disconnect and reconnect to chat.freenode.net .... thanks!
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We just experienced loss of bandwidth on a main rotation server. We've rearranged things accordingly. Apologies for the inconvenience, and thank you for using freenode.
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:31am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3604:45am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3604:49am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Remote closed the connection
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3606:05am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. It's worth noting that the Free Software Foundation's GPLv3 draft is now available for reading and comment on http://gplv3.fsf.org/comments/ .... channel #gplv3 is available for discussion. Thanks!
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
24-196-226-167.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: any pvfs2 breakage over the weekend?
02:29PM 
53pcarns
 robl: yeah, I got some patches I need to get out
02:30PM 
53pcarns
 robl: should be ready today or tomorrow
robl
 pcarns: parl fell off the net so the nightly tests didn't run (weren't able to pull from cvs and bailed)
robl
 pcarns: i'm only up to dec 13 on your submitted patches :>
02:32PM 
53pcarns
 robl: these things probably wouldn't break nightly
robl
 pcarns: no, it would surprise me too
02:35PM 
53pcarns
 robl: don't worry, you have all of hte big scary patches for a while at least
50* 
57robl 
guesses it's release time soon
 SWAP: Window 3 is not hidden!
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@24-196-226-167.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 slang_: 100% faster! cool :>
10:06AM 
53slang
 robl: oh that was supposed to be 10%
10:06AM 
slang
 woopsie
10:06AM 
slang
10:07AM 
53slang
 robl: eh?
robl
 slang_: oh, well look at that. 10% it is
10:18AM 
53slang
 robl: if only all our 10s were 100s
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56samlang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
samlang_       
50] [
samlang        
50] [
               
50] [
               
robl
 samlang: you're having an identity crisis today?
SignOff 
57samlang
: #pvfs2 
Read error: 113 (No route to host)
03:07PM 
53samlang_
 robl: well, I thought I had figured out a way to get my irc client to always use 'slang'
03:08PM 
53samlang_
 robl: but I don't remember the IDENTIFY password anymore
03:08PM 
samlang_
 rob: so I tried just starting over
03:08PM 
53samlang_
 robl: seems to not have worked
03:32PM 
samlang_
 pcarns: what's the runtime error?
robl
 tar: linux-2.4.31/CREDITS: Cannot change ownership to uid 573, gid 573: No      
robl
 such file or directory             
robl
 (sorry! overzealous trimming!)
03:34PM 
samlang_
 its the very first file?
robl
 ok, big paste
03:35PM 
samlang_
 maybe something related to the suid bit changes
robl
 bash-2.05b# tar -xvjf /usr/src/linux-2.4.31.tar.bz2
robl
 linux-2.4.31/
robl
 linux-2.4.31/Makefile
robl
 linux-2.4.31/MAINTAINERS
robl
 linux-2.4.31/CREDITS
robl
 tar: linux-2.4.31/CREDITS: Cannot change ownership to uid 573, gid 573: No
robl
 such file or directory
robl
 linux-2.4.31/Rules.make
robl
 tar: linux-2.4.31/Rules.make: Cannot change ownership to uid 573, gid
03:38PM 
53samlang_
 robl: works on 2.6 though eh?
03:43PM 
pcarns
 oh hey guys, sorry was away from irc
03:44PM 
pcarns
 that should be fixed with the "acache miss" patch
03:44PM 
pcarns
 I was seeing that exact same thing
03:44PM 
pcarns
 hmm, what was the name of that patch...
03:45PM 
pcarns
 I think you guys put it in already
robl
 pcarns: yeah, i know you were seeing it.  it's your bug report :>
03:46PM 
samlang_
 pcarns: you're seeing it with cvs HEAD on 2.4?
03:46PM 
50* 
53samlang_/#pvfs2 
confused
03:47PM 
pcarns
 I don't remember, I don't think it shows up in HEAD anymore but I haven't checked
03:51PM 
53pcarns
 robl: oh wait, I am confused
03:51PM 
53pcarns
 robl: so you didn't just see that just now yourself, you are just looking at my old email?
03:52PM 
53pcarns
 robl: if so, then it is fixed now
03:52PM 
53pcarns
 robl: you guys applied the changes I suggested to fix it, I believe
robl
 pcarns: ok, cool
03:54PM 
53pcarns
 robl: I don't have the email handy anymore, but it was the one that suggested adding js_p->error_code = GETATTR_ACACHE_MISS somewhere
robl
 pcarns: yeah, i'm cleaning up outstanding issues in my mutt-as-bugzilla world
03:54PM 
53pcarns
 robl: thanks for checking up on it though
robl
 pcarns: no problem
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang_
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56samlang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang
: #pvfs2 
Read error: 113 (No route to host)
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang_
: #pvfs2 
Read error: 113 (No route to host)
56samlang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang
: #pvfs2 
Read error: 113 (No route to host)
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang_
: #pvfs2 
Read error: 110 (Connection timed out)
56samlang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang
: #pvfs2 
Read error: 113 (No route to host)
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang_
: #pvfs2 
Read error: 113 (No route to host)
56samlang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@68-190-33-221.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
56samlang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57samlang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57samlang
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
08:35AM 
pcarns
 slang: I think you mis-spelled experiments :)
08:35AM 
slang
 heh woopsie
08:36AM 
slang
 pcarns: thanks
08:36AM 
slang
 pcarns: ments that expire?
08:37AM 
pcarns
 slang: heh
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
robl
 pcarns: wierd. is remount our only high-priority kernel operation?
11:35AM 
53pcarns
 robl: yeah, I think so
11:35AM 
53pcarns
 robl: the theory being that if you restart pvfs2-client, you have to do the remount before re-attempting any other operations
robl
 pcarns: ok, makes sense
11:45AM 
53pcarns
 robl: thanks for all of the patch wranglin'
robl
 pcarns: no problem a'tall
11:45AM 
53pcarns
 robl: still waiting on signoff on last couple of small bug fix patches here, hopefully won't be too long
robl
 pcarns: asside from metheny's test patches, i think i've gotten everthing in that you've submitted
robl
 pcarns: let me know if we missed anything
11:51AM 
53pcarns
 robl: I think that is all the patches
11:52AM 
53pcarns
 robl: I do have one more suggestion, though
11:52AM 
53pcarns
 robl: not given as a patch, was buried in a long email:
11:52AM 
pcarns
 http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-July/001349.html
11:52AM 
53pcarns
 robl: just the part regarding PVFS_NAME_MAX and PVFS_SEGMENT_MAX
11:53AM 
53pcarns
 robl: we set SEGMENT_MAX to match NAME_MAX here so that we could support longer file names
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:44pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
robl
 pcarns: i'll check it out just as soon as PARL comes back on the net
SignOff 
57laytonj
: #pvfs2 
"Leaving"
03:53PM 
53slang
 robl: so much for the new parlweb server, eh?
robl
 slang: yeah... this time it came back in less than a day though
robl
 slang: oh! my mistake.  i think the downtime was walt's switchover to the new server
04:09PM 
53slang
 robl: ah
robl
 (based on my new "HOLY CRAP! SOMETHING CHANGED" banner when i cvs diff :>
04:10PM 
53slang
 robl: I thought that was yesterday
04:10PM 
53slang
 robl: heh
04:11PM 
pcarns
 my cvs client says "OMFG itz the HAXORS"
robl
 pcarns: ok, there we go. thanks for the heads up about name_max
04:44PM 
53pcarns
 robl: thanks for putting that in
04:45PM 
pcarns
 I guess pvfs2-cvs list isn't up yet
04:45PM 
pcarns
 how am I supposed to eavesdrop on development now? :)
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
robl
 slang_: uh-oh!
robl
 slang_: 404 for tinderbox
10:26AM 
53slang_
 robl: heh
robl
 guess they didn't copy *everything* over
10:26AM 
53slang_
 robl: tinderbox didn't make the transition
10:27AM 
53slang_
 robl: the files are still there
10:28AM 
53slang_
 robl: probably just haven't configured apache as it was before
11:36AM 
53slang_
 robl: viewcvs is back
11:36AM 
53slang_
 robl: tinderbox seems to be having a little trouble still though..
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
02:41PM 
pcarns
 slang_: there was a viewcvs and tinderbox at clemson???
02:56PM 
slang_
 pcarns: yeah
robl
 pcarns: slang set it all up
02:58PM 
pcarns
 sweet!
02:58PM 
pcarns
 I'll need urls when it is up and running again :)
02:58PM 
slang_
 pcarns: http://www.pvfs.org/cgi-bin/pvfs2/viewcvs/viewcvs.cgi/
02:59PM 
slang_
 pcarns: still something wrong with tinderbox
02:59PM 
pcarns
 slang_: that is the tenderbox you guys send nightlies to now?
02:59PM 
slang_
 pcarns: was, hes
02:59PM 
slang_
 pcarns: was, yes
03:00PM 
pcarns
 actually, if you have hte url I'll bookmark it for later
03:00PM 
slang_
 pcarns: we still do I guess, but it doesn't appear to be working at present
robl
 http://www.pvfs.org/pvfs2/pvfs2-nightly-builds/tinderbox2/PVFS2/status.html
03:02PM 
slang_
 oh maybe it is working
03:02PM 
53slang_
 robl: I think I had the wrong url
03:02PM 
slang_
 woops
03:04PM 
53slang_
 robl: hmm...although some things definitely aren't working
03:04PM 
53slang_
 robl: the cgi scripts appear to be still having trouble being accessed from outside
03:08PM 
pcarns
 slang_: neat! so where would I click to see output from a build if it were working?
03:08PM 
pcarns
 slang_: the status lights are at least right for each host and you can click to see when build was
03:09PM 
slang_
 pcarns: http://tinderbox.mozilla.org/showbuilds.cgi?tree=SeaMonkey
03:10PM 
slang_
 pcarns: it kind of looks like that when its working
03:10PM 
slang_
 pcarns: with build times and L/C links to click on to see the logs
03:10PM 
pcarns
 ahhh
03:10PM 
pcarns
 I seeeee
03:10PM 
slang_
 pcarns: we don't show the developers guilty for breakage though
03:11PM 
slang_
 :-)
03:11PM 
pcarns
 it only takes 3 or 4 guesses anyway :)
03:11PM 
slang_
 because then it would just be:
03:12PM 
pcarns
 I'm lucky; rob commits my patches so it will always look like his fault when I break something
03:12PM 
50* 
53pcarns/#pvfs2 
blames it all on robl
robl
 pcarns: it's cool. something breaks and i get to publicly shame you on the lists :>
03:13PM 
pcarns
 oh the humanity
03:14PM 
53slang_
 robl: unless those are broken too
03:15PM 
50* 
53slang_/#pvfs2 
discovers a convenient way to hide his mistakes..take down parl
03:15PM 
pcarns
 I keep all the subscribers memorized just in case
52[choopa]
  *** Looking up your hostname...
52[choopa]
  *** Checking Ident
52[choopa]
  *** No Ident response
52[choopa]
  *** Found your hostname
 robl  Nickname is already in use.(from irc.he.net)
52[choopa]
  You need to install identd to use this server
 Closing Link: 127.0.0.1 (Install identd)
 Connection closed from irc.efnet.us: Success
 Connecting to port 6667 of server irc.efnet.us [refnum 1]
 You are not on a channel.  Use /WHO ** to see everybody.
 ADD           BACK          BALANCE       BEEP_ALWAYS   BIND         
 CHANNEL       CREATE        DELETE        DESCRIBE      DISCON       
 DOUBLE        ECHO          FIXED         GOTO          GROW         
 HELP          HIDE          HIDE_OTHERS   HOLD_MODE     KILL         
 KILL_OTHERS   KILLSWAP      LAST          LASTLOG       LASTLOG_LEVEL
 LEVEL         LIST          LOG           LOGFILE       MENU         
 MOVE          NAME          NEW           NEW_HIDE      NEXT         
 NOSERV        NOTIFY        NOTIFY_LEVEL  NUMBER        POP          
 PREVIOUS      PROMPT        PUSH          QUERY         REFNUM       
 REFRESH       REMOVE        SERVER        SET           SCRATCH      
 SCROLL        SCROLLBACK    SHOW          SHOW_ALL      SHRINK       
 SIZE          SKIP          SPLIT         STACK         STATUS_SPECIA
 SWAP          TRIPLE        UNBIND        UPDATE                     
 Usage: /WINDOW  help 
command
 to get help on specific commands
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Thu Jan 19 15:41:11 2006
53#pvfs2     
57slang_    
36H   
n=slang
216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
04:10PM 
50* 
53pcarns/#pvfs2 
is getting dizzy
04:10PM 
pcarns
 seeing double...
robl
 double?
robl
 (dammit.. should have typed ddoouubbllee
04:24PM 
pcarns
 good test results today
04:24PM 
pcarns
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
04:24PM 
pcarns
 running a distributed small files test (60 clients create,read,write,mkdir,rmdir,list massive number of files and directories)
04:25PM 
pcarns
 got a 30% improvement overall by going from a 1 meta and 15 io setup,
04:25PM 
pcarns
 to a 15 server setup, where all do both meta and io
robl
 wow, sweet!
04:26PM 
pcarns
 the only thing that was slower with the "all meta" setup was creating files
04:26PM 
pcarns
 I suspect lookup to be the culprit (having to bounce around servers to walk the path) but I don't know yet
robl
 pcarns: that jives with our benchmarks
04:27PM 
pcarns
 recursive long listing time dropped by 66%
04:27PM 
50* 
53pcarns/#pvfs2 
wants to give hte name cache some tcache lovin'
04:28PM 
pcarns
 for what its worth, we are now defaulting to an acache timeout of 200 ms
04:28PM 
pcarns
 found that beyond that we didn't get any more speedup
04:28PM 
pcarns
 but there was more to be had above the 5 ms that the stock pvfs2 defaults to
04:29PM 
pcarns
 I am trying to narrow down what our default deployment is going to look like here
04:30PM 
pcarns
 # of meta servers and acache settings are settled, still need to resolve ext3 options, sync options, DefaultNumDfiles option (for small files scenarios), maybe a few others
04:30PM 
pcarns
 maybe I can contribute some info to a tuning guide eventually
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Remote closed the connection
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
11:14AM 
pcarns
 man, the pvfs2 web site looks nekkid
11:14AM 
pcarns
 or naked, as folks in chicago might say
11:15AM 
slang
 pcarns: woah
11:16AM 
slang
 what happened?
11:16AM 
slang
 pcarns: www.pvfs.org is ok
11:16AM 
slang
 and pvfs1 seems ok
11:17AM 
pcarns
 the server side #include stuff isn't working
11:17AM 
pcarns
 you can check out pvfs2-web from cvs and see how it pulls in the "style" kind of stuff
11:18AM 
pcarns
 the sort of thing that whippersnappers do with css nowadays
11:18AM 
pcarns
 us old-uns did it with apache substitutions
11:18AM 
pcarns
 or whatever you call it
11:19AM 
pcarns
 pvfs1 style is accomplished by pasting the exact same big hunk of html into every page, so it is even older style technology :)
11:20AM 
slang
 pcarns: yeah
11:20AM 
slang
 pcarns: paste has been around for a looong time ;-)
11:21AM 
pcarns
 slang: and when the chips are down, lo and behold its hte one that works
11:21AM 
slang
 pcarns: heh
56laytonj 
36n=laytonj@68-190-33-221.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
robl
 also, anoncvs seems to be broken :>
robl
 we need brad to hop on irc so we can harrass him in realtime
robl
 guess it's email for now
11:42AM 
pcarns
 have you guys looked at that new bug report from Brian Smith?
robl
 pcarns: he's a butthead so i'm stalling on it :>
11:42AM 
53pcarns
 robl: heh, ok :)
robl
 pcarns: at first pass, sounds like the stat stuff is fixed
11:44AM 
53pcarns
 robl: yeah, I don't have any trouble cp'ing stuff on and off right now
11:44AM 
53pcarns
 robl: but I am using 2.4 kernel
12:18PM 
pcarns
 slang: are you going to submit that patch to the ethereal folks?
01:58PM 
slang
 pcarns: I gave him an earlier one but it turned out to have mods right after I sent it
01:58PM 
slang
 pcarns: so I figured I would wait for a release
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-189.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-189.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're experiencing problems with one of our main rotation servers. It's been removed from rotation and will be shut down in a couple of minutes. Affected users: about 3,700. Thanks.
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3607:53pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.595 secs!!
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+nt
 by 
57irc.easynews.com
52Users
32#pvfs2
50)]
54robl      
 Channel #pvfs2 was created at Tue Jan 24 20:06:30 2006
BitchX
: Join to #pvfs2 was synched in 3.752 secs!!
53#pvfs2     
57robl      
36H@  
~robl
ninjak.clustermonkey.org (Rob Latham)
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 5.959 secs!!
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Tue Jan 24 20:59:33 2006
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 1.275 secs!!
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:40am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
09:54AM 
32lilo:*
 Hi all. Channel note about ##xen (our local channel for Xen, the operating system virtualizer application).... it's a small channel, but growing. If you know Xen and you'd like to help support it to random passers-by, please stop in. We can use your help. Thanks!
Mode change 
57-w
 for user 
36robl
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Thu Jan 26 16:32:08 2006
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 4.097 secs!!
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
robl
  ,who
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
 SWAP: Window 3 is not hidden!
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:14pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
03:38PM 
32lilo:*
 Neoneurone has set up an unofficial sourceforge channel, for users to compare notes and assist each other....if you're interested in participating, please stop by ##sourceforge .... thanks
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:01am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
01:03AM 
32lilo:*
 two small EU regional servers dropped off, total users affected, about 400
SignOff 
57ChanServ
: #pvfs2 
ACK! SIGSEGV!
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
robl
 slang: hey, how's it going?
02:30PM 
53slang
 robl: hiya
robl
 slang: one of these nights i'll get the nightly builds all passing
03:06PM 
53slang
 robl: doesn't look like its anything major
robl
 slang: nah, it's fixed now
03:07PM 
53slang
 robl: maybe I should just change the test-failed color to green ;-)
robl
 slang: no cheating!
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3611:50pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 slang: back from purdue already?
12:37AM 
53slang
 robl: already?
12:38AM 
53slang
 robl: its 1238
12:38AM 
50* 
53slang/#pvfs2 
tired
12:39AM 
53slang
 robl: I see Alito was voted in
12:39AM 
53slang
 robl: did Bush say anything about increasing research funding?
robl
 slang: didn't catch the whole sotu and haven't seen a transcript yet.  tribune says he called for more funding for math and science teachers
robl
 which would indicate some recognition of the importance of technology
12:48AM 
53slang
 robl: looks like its on cspan now
robl
 slang: no time for current events. gotta finish these cookies
robl
 (making, not eating)
01:08AM 
53slang
 robl: heh
01:09AM 
50* 
53slang/#pvfs2 
waves
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Apologies for not getting back with you on that main rotation server split. We're looking at the problem. Meanwhile, US donor tax receipts for paypal donations have been sent to your paypal email address. If you need a receipt and haven't received one, please message me. Thanks!
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Those are the 2005 tax receipts. We're about to start our 2006-2007 fundraiser for PDPC, so if you would like to help get us going a bit early, please take a look at the freenode website ( http://freenode.net/pdpc_donations.shtml ). Thanks, and have a great morning!
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
07:36AM 
32lilo:*
 Hi all. Need Turkish-English translation in #freenode. Thanks!
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
ACK! SIGSEGV!
03:28PM 
slang
 oh dear
03:28PM 
slang
 irc is segfaulting
03:28PM 
slang
 that can't be good
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
robl
 ChanServ: what the hell man?
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36G   
n=pcarns
adsl-152-212-72.asm.bellsouth.net (gaim)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
robl
 we need something exciting in #pvfs2 so pcarns sticks around after hours
05:46PM 
53slang
 robl: ChanServ SIGSEGV isn't exciting enough I guess
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:22am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3608:42am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang_ 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-212-72.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
50* 
57robl 
is gonna try to knock out the sftp bug
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
11:44AM 
32lilo:*
 Hi all. We seem to be having an influx of spambots. Most of you are SET UNFILTERED OFF with nickserv, so you won't be noticing the spam messages. If you are noticing the messages, though, please feel free to message a staffer, or first level support if available, to let us know about any spambots we've missed. Thanks!
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. If you have a moment, please stop by #freenode-survey and answer a few questions which may help us with feature design. Please check the topic or join notice for the questions and answer briefly on channel. Thanks.
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
03:01PM 
32lilo:*
 If you're in Houston, Texas, USA and have an automobile and time to provide assistance to PDPC this afternoon, please message me. Thanks!
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
06:54AM 
32lilo:*
 New channel set up for folks with group cloaks: #freenode-groups .... please stop by when you get a moment! Thanks, and have an excellent afternoon.
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
08:28AM 
53pcarns
 robl: hey rob, you there?
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
robl
 pcarns: hey
09:42AM 
53pcarns
 robl: is a concall this afternoon rather than 10am going to work?
robl
 pcarns: works for us, yea
09:48AM 
53pcarns
 robl: any particular time preference?
09:49AM 
53pcarns
 robl: I don't think we care, but I can throw out 2pm central as a suggestion
robl
 pcarns: 1pm perhaps?
09:50AM 
pcarns
 ok, that works
09:50AM 
pcarns
 I'll pass the word here
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-212-72.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
robl
 slang: 1pm concall
robl
 that's all you missed
09:55AM 
53slang
 robl: k
09:55AM 
pcarns
 are you guys in the same office?
robl
 pcarns: well, yeah
10:43AM 
pcarns
 did you guys tell RobR in case he can make it?
robl
 pcarns: now we did :>
10:46AM 
53pcarns
 robl: thanks :)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
04:04PM 
32lilo:*
 We've added a channel ( #freenode-groups ) for folks with group cloaks to compare notes.... if you fall in that category, please stop by when you get a chance.... thanks!
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3610:43am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@c-71-194-159-89.hsd1.il.comcast.net
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
11:28AM 
32lilo:*
 Slight modification to the channel guidelines, http://freenode.net/channel_guidelines#sensitivematerial
11:30AM 
32lilo:*
 The freenode channel guidelines are a list of do's and don'ts, based on the experience which went into the creation of freenode, and we urge you to adopt them for your channel. Thanks.
11:31AM 
32lilo:*
 Whoops, that url should read: http://freenode.net/channel_guidelines.shtml#sensitivematerial
11:31AM 
32lilo:*
 Thanks.
11:34AM 
32lilo:*
 please read http://tinyurl.com/axxvl and let's talk before you're voiced again on ##linux
11:34AM 
32lilo:*
 whoops, sorry, that one was intended as a private message :)
11:35AM 
32lilo:*
 I must say, some days are a little more tiring than others. :)
 pcarns 
n=pcarns@adsl-152-212-72.asm.bellsouth.net
 has left #pvfs2 
05:04PM 
32lilo:*
 New channel notes.... the former #help has moved to ##anything, a channel stuffed with people who want to help you with any and all questions about, well, anything. 8)
05:06PM 
32lilo:*
 Another interesting new channel is ##prepress, a resource for folks in the FOSS community who are preparing digital media for professional print publication. You should find some good experience to tap there if you have questions on the subject.
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56slang 
36n=slang@71.194.159.89
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. If you're interested in tracking the near term winter storms and blizzard conditions in the northern US, you might try ##earth .... it's not that busy at the moment, but you can make it so. :)
56pcarns 
36n=pcarns@adsl-218-106-103.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
08:21AM 
32lilo:*
 Hi all. Reminder for folks with primary group cloaks....please do stop by #freenode-groups when you get a chance--it's a general social channel for project participants, and you can probably find a staffer or two.
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
robl
 slang: ugh. i'm finally back from nj
11:22AM 
53slang
 robl: got back this morn?
11:23AM 
53slang
 robl: if you leave now you can still make ultimate ;-)
robl
 slang: yeah
robl
 slang: thought about it
robl
 but it's nice to be in one place for a bit
11:23AM 
53slang
 robl: heh
11:24AM 
53slang
 robl: I haven't seen dr. ross yet today either
11:26AM 
slang
 (6) Verifying that fsid 740873510 is acceptable to all servers...
11:26AM 
slang
 PVFS_mgmt_setparam_all: Detailed per-server errors are available
11:26AM 
slang
 Failure: not all servers accepted fsid 740873510
11:26AM 
slang
         Host: tcp://ccsto5:9991: Success
11:26AM 
53slang
 robl: you remember what causes that?
robl
 slang: stale storage spaces?
11:29AM 
53slang
 robl: hmm...still get it when I reset them
11:29AM 
53slang
 robl: oh well
11:29AM 
53slang
 robl: ultimate time
 pcarns 
n=pcarns@adsl-218-106-103.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:01pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-218-106-103.asm.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang_ 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
09:38AM 
slang
 i don't know why MacIrssi has to log me in as two different nicks
09:39AM 
pcarns
 slang: are you trying to outnumber us?
09:40AM 
pcarns
 slang: one more and you will control majority
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57slang_    
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-218-106-103.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: don't forget ChanServ
09:44AM 
slang
 pcarns: all we need now is a voting system
09:45AM 
slang
 pcarns: so creates are slow because each one is syncing the entire db to disk, right?
09:45AM 
53pcarns
 robl: ChanServ usually abstains from voting, he is no threat to slang's regime
09:45AM 
slang
 pcarns: at least the entire cached portions of the db
09:46AM 
pcarns
 slang: it seems like once most of it is synced, then then only thing hitting the disk subsequently would be the dirty pages, no?
09:47AM 
slang
 pcarns: I think that's true for the db portion of the sync
09:47AM 
pcarns
 slang: ahh, the cache itself may have more changes in it?
09:47AM 
slang
 pcarns: but db->sync also does an fsync to flush the in-core stuff to disk
09:47AM 
pcarns
 slang: ok, I see
09:48AM 
slang
 pcarns: I'm guessing that ext3 isn't smart enough to only sync the portions that changed?
09:48AM 
pcarns
 slang: it should be, I think
09:48AM 
slang
09:49AM 
pcarns
 slang: the one odd thing it does is sync in order, it can't sync any data block without syncing all previous data blocks
09:49AM 
pcarns
 slang: but i don't think it will "re-sync" any data blocks that are already consistent between disk and buffer cache
09:49AM 
slang
 pcarns: hmm ok
09:49AM 
slang
 pcarns: so much for my theory
09:50AM 
pcarns
 slang: the default journalling mode (data=ordered) is what causes the semantics of how writes end up getting flushed in order
09:50AM 
slang
 pcarns: seems strange that creates and getattrs would be inverses of each other though
09:50AM 
pcarns
 slang: we could always repeat the test without sync, or with transactions instead as an experiment
09:51AM 
pcarns
 slang: actually, turning off sync can be done via command line, I might as well kick it off and see what happens
09:51AM 
slang
 pcarns: cool
09:51AM 
pcarns
 slang: yeah, whatever the cause, it is definitely strange
09:51AM 
slang
 pcarns: nice graphs btw!
09:52AM 
pcarns
 heh, those are pretty quick and dirty
09:52AM 
pcarns
 but they do the job
09:58AM 
pcarns
 slang: running w/o sync is mad fast, actually shouldn't take very long to finish
09:58AM 
pcarns
 2 seconds to create rather than 2000 seconds
robl
 pcarns: any theory about why 270256 kb took 2999.501082 sec but 260256 took 2778.219992 ?
robl
 pcarns: is that a hardware thing?
10:01AM 
53pcarns
 robl: I have no idea
10:02AM 
53pcarns
 robl: this is all run on a single scsi disk, for what its worth
10:02AM 
53pcarns
 robl: I don't have any decent modern distros on machines with raid or san right now
robl
 that inflection point is just shy of 256 MiBytes
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
10:04AM 
pcarns
 ok, sync is definitely the main factor in this inverted create result, I'll send an email w/ details
robl
 the second inflection point is not so clear
robl
 maybe somewhere just shy of 30 MB
robl
 bleah, i have no idea what that means. maybe something to do with linux VM knobs?
SignOff 
57pcarns
: #pvfs2 
Read error: 113 (No route to host)
robl
 slang_: you burried him in so much email it broke his irc connection?
02:45PM 
53slang
 robl: perhaps I should have done some coalescing before sending them off
robl
 slang_: i think 'coalescing' has been a part of every optimization we've ever done since i've worked here
02:46PM 
53slang
 robl: time to switch to conglomerating?
robl
   121 Moby Thesaurus words for "coalesce":
robl
      act in concert, act together, add, adhere, admix, affiliate, alloy,
robl
      ally, amalgamate, assimilate, associate, band, band together,
robl
      be in league, bemingle, blend, bracket, cleave, cling,
robl
 ...
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
SignOff 
57slang
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
SignOff 
57slang_
: #pvfs2 
"Get MacIrssi - http://www.g1m0.se/macirssi/"
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:05pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:52am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
01:54AM 
32lilo:*
 A small regional server has split and rejoined...we're waiting to see if there's significant packet loss. Affected users: about 310. Thanks.
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@crusoe-57.mcs.anl.gov
 has joined #pvfs2
01:52PM 
32lilo:*
 Hi all....if you've seen spam recently from someone with the nick SolarMRqI, please paste it to me and let me know what channel it was on....thanks!
Mode change 
57-w
 for user 
36robl
53#pvfs2     
57slang     
36H   
n=slang
crusoe-57.mcs.anl.gov (Sam Lang)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-215-223-2.aep.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56pw1v 
36n=pw@d60-77-190.col.wideopenwest.com
 has joined #pvfs2
04:18PM 
53pw1v
 robl
 change the topic
50* 
57robl 
knew he forgot something
 Topic 
36#pvfs2
50):
 PVFS2-1.3.2 is out
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Tue Dec  6 11:23:40 2005
BitchX
: Unknown command: TOPOC
 Topic 
36#pvfs2
50):
 changed by 
36robl
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
04:20PM 
pw1v
 What's the deal with the release branch process?  I saw you modified the changelog to look like we are starting on 1.4.1pre in that branch.  Are you going to merge that release branch back to head soon?
robl
 pw1v: that's the plan, yep
50* 
57robl 
forgot to do that too
04:21PM 
pw1v
 Oh, twas genuine ignorance on my part.
robl
 i should drop a note to pvfs2-internal about that. we've been releasing from a branch for the last few versions.  seems to work pretty well
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
57pw1v 
is now known as 
36pw
SignOff 
57pw
: #pvfs2 
"pw has no reason"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang__ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang___ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
SignOff 
57slang_
: #pvfs2 
Read error: 110 (Connection timed out)
SignOff 
57slang
: #pvfs2 
Read error: 113 (No route to host)
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
10:57PM 
slang_
 gotta be kidding me
SignOff 
57slang_
: #pvfs2 
Client Quit
SignOff 
57slang
: #pvfs2 
Client Quit
SignOff 
57slang__
: #pvfs2 
Read error: 113 (No route to host)
SignOff 
57slang___
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
56slang 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
robl
 slang: gotta be kidding me about what?
10:20AM 
slang
 irc client went kinda haywire last night
10:20AM 
slang
 I was 'logged in' as slang, slang_, slang__, slang___, and slang____
50* 
57robl 
sees now
robl
 slang: heh. so you figured out where that 120 queued ops came from? :>
10:23AM 
slang
 yeah
10:23AM 
slang
 wasn't subtracting for every add
robl
 slang: i see why you wanted a moving average. that would help show just how common the 1 and 2 queed are
10:27AM 
53slang
 robl: yep
robl
 wonder why the bias towards early intervals?
robl
 clients are more in sync early on?
robl
 slang: you should point joshua mora towards the perfbase submission scripts you've written for pvfs2
10:37AM 
53slang
 robl: I think all the clients submit right away so it ends up getting the server backed up
10:38AM 
53slang
 robl: but then the queue kind of rate limits itself because a client can't submit another create until the previous one has completed
10:38AM 
53slang
 robl: yeah I was going to clean them up a bit and send them off
10:39AM 
53slang
 robl: they're not as nice as what joachim described, but its a start
robl
 slang: so the worst possible case scenario is 1 server, 128 clients, all repeatedly creating a file and then calling MPI_Barrier.  Not terribly likely :>
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
10:59AM 
slang_
 here we go again
SignOff 
57slang_
: #pvfs2 
Client Quit
56slang_ 
36n=slang@216-80-33-95.drb-bsr1.chi-drb.il.cable.rcn.com
 has joined #pvfs2
10:59AM 
slang_
 pfft
SignOff 
57slang_
: #pvfs2 
Client Quit
56slang_ 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
11:02AM 
50* 
53slang_/#pvfs2 
goes back to using irssi
robl
 slang_: i'm surprised ichat doesn't have irc support
11:05AM 
53slang_
 robl: that would be nice
robl
 bwoop
SignOff 
57slang
: #pvfs2 
Read error: 110 (Connection timed out)
53#pvfs2     
57slang_    
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36G   
n=pcarns
adsl-215-223-2.aep.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57slang_
: #pvfs2 
"leaving"
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
11:23AM 
slang
11:23AM 
slang
 I'll try to behave from now on
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-114-35-133.static.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-215-223-2.aep.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 i don't think any of us have the operator bit anyway
11:33AM 
53slang
 robl: to give me the boot?
12:00PM 
53slang
 robl: actually it looks more like the request scheduler is what's getting backed up
12:01PM 
slang
 not the actual trove metadata ops
12:01PM 
50* 
53slang/#pvfs2 
is regenerating data/graphs
01:13PM 
pcarns
 slang: in your tests, are all the creates in the same directory, or different directories?
01:13PM 
pcarns
 slang: I imagine that the performance characteristics would be different because of contention on parent dir
01:16PM 
50* 
53pcarns/#pvfs2 
sneaks in some irc during the world's longest meeting
robl
 pcarns: dude, you're WFH. you could sneak in some gamecube if you wanted
03:55PM 
slang
 pcarns: all the same dir
03:56PM 
pcarns
 slang: how hard would it be to repeat one of the scenarios with different subdirs for each client?
03:57PM 
pcarns
 slang: just to see if it makes a difference, not for all scenarios
03:57PM 
slang
 pcarns: easy
03:57PM 
slang
 pcarns: I'm trying to regenerate the graphs with seperate data for keyval and dspace
03:58PM 
pcarns
 slang: cool
04:04PM 
slang
 pcarns: any thoughts on trove keys stuff
04:05PM 
pcarns
 slang: haven't quite gotten around to digesting that email yet :)
04:05PM 
slang
 pcarns: ok :-)
04:06PM 
pcarns
 slang: I'll get back to it in the morning
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@68-114-35-133.static.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Just a reminder: news article up at http://freenode.net/news.shtml .... group registrations, staff channels, 2006-2007 fundraising .... have a great evening, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:19am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
01:08PM 
pcarns
 slang: I have some tests running now with the struct/union based key format
01:09PM 
pcarns
 slang: I'll post later today or early tomorrow what the results are
01:15PM 
slang
 pcarns: cool
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3607:14pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-215-223-2.aep.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns: can you fix david's problem for us?
robl
 pcarns: sam and i are out of ideas
03:23PM 
53pcarns
 robl: yeah, we can dig into it some more
robl
 pcarns: oh, hah, i was kinda joking
03:33PM 
pcarns
 hahaha
03:34PM 
pcarns
 we really kinda threw it out there on the list b/c its been hanging around and we haven't found time to work on it yet
03:34PM 
pcarns
 hoping someone might just spot what the problem is
03:35PM 
53pcarns
 robl: by the way, I will hopefully have a bunch of xattr patches for you next week
03:35PM 
53pcarns
 robl: wrapping up a bunch of bug fixing and tweaking
robl
 pcarns: cool. thanks!
03:38PM 
53pcarns
 robl: we are working on some new fsck tools now too, though that is going to take a while to pull together
robl
 pcarns: cool. the existing fsck sure hasn't seen a lot of development (or probably even use)
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3606:10am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3610:55pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
08:08AM 
pcarns
 slang: how is the dbpf stuff coming along?
08:08AM 
pcarns
 slang: I see a lot of good stuff coming through cvs
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has left #pvfs2 
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3604:42pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-215-223-2.aep.bellsouth.net
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarn1 
36n=pcarns@adsl-34-56-88.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarn1    
36H   
n=pcarns
adsl-34-56-88.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarn1: patch avalanche!
robl
 pcarn1: we just a couple days ago ran up against the mpi objects issue
SignOff 
57pcarn1
: #pvfs2 
Read error: 110 (Connection timed out)
56Mathman 
36n=Mathman@certdhcp17.cert.ucr.edu
 has joined #pvfs2
03:43PM 
Mathman
03:44PM 
Mathman
 ping is telling me it can't retrieve info about my pvfs2tab entry.  any know what that might mean?
03:45PM 
Mathman
 oops.  anyone know I mean.
robl
 Mathman: do you have an entry in /etc/fstab?
robl
 Mathman: something along the lines of "tcp://some_server:3331/pvfs2-fs /mnt/pvfs2 pvfs2 defaults,noauto 0 0"  ?
03:59PM 
Mathman
 no, pvfs2tab.  it says it parses that just fine though
robl
 Mathman: ok, what's your pvfs2tab look like?
04:00PM 
Mathman
 tcp://c2-9:3334/pvfs-fs /mnt/pvfs2 pvfs2 default,noauto 0 0
robl
 Mathman: and c2-9 is up and running? pvfs2-server is running happily on port 3334 ?
04:00PM 
Mathman
 yep
04:01PM 
Mathman
 hmm, should I change it to c2-9:3334/pvfs2-fs perhaps?
robl
 Mathman: yeah, good eye
04:02PM 
Mathman
 that was it.
04:02PM 
Mathman
 thanks.  =)
robl
 Mathman: surprised we don't see more of that
robl
 Mathman: pvfs2-ping isn't terribly helpful with that typo
04:04PM 
Mathman
 I blame that genconfig thing.  it had some other stuff screwed up like that.
04:05PM 
Mathman
 shoot.  mounting the stuff still times out though.
04:05PM 
Mathman
 mount: connection timed out
04:05PM 
Mathman
 that's from this command: mount -t pvfs2 tcp://c2-9:3334/pvfs2-fs /mnt/pvfs2
robl
 Mathman: you got pvfs2-client and pvfs2-client-core running?
04:06PM 
Mathman
 no...
04:07PM 
Mathman
 you know the install docs mentioned something or other about those.  but I don't even have those in my install directory.
04:07PM 
Mathman
 I figured that was some older stuff or something that went away.
robl
 Mathman: a 'make kmod install' will install pvfs2.ko, pvfs2-client-core and pvfs2-client
robl
 those damn docs... i need to rewrite a lot of them
robl
 (it's all accurate, just rather scattered)
04:14PM 
Mathman
 excellent.  I'm up and running.
04:14PM 
Mathman
 really appreciate it.
robl
 no problem. have fun 
04:16PM 
Mathman
 well, one more question.  what's the limit on the size of filesystem I can have with this stuff?
04:16PM 
Mathman
 I was hoping for around 4 terabytes or so.
04:17PM 
Mathman
 maybe more, maybe less.
04:17PM 
Mathman
 depends on how much all the spare partitions on my machines add up to.
robl
 Mathman: yeah, each server will probably be able to contribute no more than 1, maybe 2 TB
robl
 Mathman: but if you have enough servers.. well, i really don't know what the limit is.  definitely above 4 tb
04:18PM 
Mathman
 ah.  great.
04:18PM 
Mathman
 hehe, I'm gonna hold you to that now.
robl
 well if you run into any problems there's the irc channel and also the pvfs2 mailing lists (where a lot more people pay attention)
04:20PM 
Mathman
 guess I oughta mention.  I'm going for probably your more unconventinal uses.  I just want to back stuff up to pvfs2.  nightly snapshots or something.
04:20PM 
Mathman
 and I know it might be kinda unreliable as back up media goes.  but with that in mind.  you think I'm nuts here?
04:21PM 
Mathman
 maybe there's something else I oughta look into instead?
04:22PM 
Mathman
 basically I just want some way to utilize all the space that's going to waste in our rocks cluster.  each machine has a 120 gig disk or so, so each one has 80 gigs or so completely free and ready to be put to use.
robl
 well.. pvfs2 has no software redundancy (i can't think of any parallel file system that does) so a hardware failure on one node is bad news for your backup
robl
 still, people do it all the time :>
robl
 makes me a bit nervous myself but tb of data is just hard to manage
04:24PM 
Mathman
 yeah, I figured that.  but all I need is for it to work most of the time so I can snapshot a few things.  that way when people do stupid stuff like rm -rf /home/bob /file, I can help them out.
04:24PM 
Mathman
 if my pvfs2 stuff happens to be screwed at the same time, well, tough luck.  it's still better than no backups at all like we're currently doing.
robl
 Mathman: as long as you understand the tradeoffs, then great!
04:25PM 
Mathman
 the people I work for are nuts by the way.  we have all this data and most all of it isn't backed up because they don't want to spend the money.
04:25PM 
Mathman
 well, long as you're not telling me I'm out of my mind, sounds like it's a go.
robl
 writing backups will take a while unless you can increas the blocksize of whatever backup tool you're using
04:25PM 
Mathman
 thanks again.
04:26PM 
Mathman
 k, I'll keep that in mind.  thanks.
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3605:39pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-19-120-2.asm.bellsouth.net
 has joined #pvfs2
 Mathman 
n=Mathman@certdhcp17.cert.ucr.edu
 has left #pvfs2 
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-19-120-2.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 pcarns 
n=pcarns@adsl-19-120-2.asm.bellsouth.net
 has left #pvfs2 
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
52Users
32#pvfs2
50)]
54 robl      
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 16.702 secs!!
 #pvfs2  [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
Netjoined: 
57irc.freenode.net herbert.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+nt
 by 
57irc.colosolutions.net
52Users
32#pvfs2
50)]
54robl      
 Channel #pvfs2 was created at Sat Mar  4 17:07:23 2006
BitchX
: Join to #pvfs2 was synched in 3.804 secs!!
56robl 
36~robl@ninjak.clustermonkey.org
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+nt
 by 
57irc.mzima.net
52Users
32#pvfs2
50)]
54robl      
 Channel #pvfs2 was created at Mon Mar  6 01:55:05 2006
BitchX
: Join to #pvfs2 was synched in 3.054 secs!!
 Starting logfile /home/robl/.BitchX/irc-chat/#pvfs2.log
IRC log started Tue Mar  7 09:38:46 2006
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
52Users
32#pvfs2
50)]
54 robl      
54 slang     
54ChanServ  
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 1.519 secs!!
 SWAP: No such window: 4
56rross 
36n=rross@rrcs-67-52-72-134.west.biz.rr.com
 has joined #pvfs2
02:47PM 
rross
 anyone awake?
 rross 
n=rross@rrcs-67-52-72-134.west.biz.rr.com
 has left #pvfs2 
02:55PM 
slang
 pfft
02:56PM 
slang
 on for 4 minutes??
robl
 sheesh
robl
 we need a bot
robl
 "hi %s!\n"
robl
 "that question about %s is interesting. did you check the %s and %s?\n"
robl
 rross would probably catch on pretty quick
04:31PM 
53slang
 robl: hi robl!
04:32PM 
53slang
 robl: that question about being awake is interesting!  did you check the mailing list and faq?
04:32PM 
53slang
 robl: yeah..dunno..
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3604:40am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
57neillm
 No such nick/channel
12:51PM 
32lilo:*
 <ltc-flam> "on recherche un monteur ou un PC/MAC puissant avec port FW pour derush et montage de video ce soir (4h de taf, le rea peut monter au cas ou) sur PARIS / site lestelechargements fr contre la loi DADVSI"
12:51PM 
32lilo:*
 lilo merci
12:51PM 
32lilo:*
 (whoops) 8)
Mode change 
57-w
 for user 
36robl
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:13am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. One of our main rotation servers is misbehaving. It's back, but dropping users, and has been removed from rotation. We're looking at the issue. Any additional info will be on wallops ( /mode yournick +w )....thanks.
SignOff 
57slang
: #pvfs2 
Read error: 104 (Connection reset by peer)
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:53pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:06pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3602:49pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3602:52pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We just experienced a routing outage on a main rotation server. We're moving it out of main rotation and substituting other resources. You'll see people pinging out and coming back. Apologies for the inconvenience.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] We'll provide further information on wallops ( /mode yournick +w ) and if needed another global notice later. Thanks.
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pcarns your country needs you!
SignOff 
57slang
: #pvfs2 
Read error: 104 (Connection reset by peer)
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
robl
 0,who
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. In a moment we're going to be performing some quick maintenance. About 4,000 users on a main rotation server will be detached from the network and reconnected. Please bear with us.
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:10pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3605:39am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
55Md
35i=md@freenode/staff/md
50)-
 [GlobalNotice] Hi. we are missing a couple of servers because of a network outage, and services too. if your channel needs emergency mode changes (e.g. -R) please /msg me
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. Apologies for the inconvenience, but IRC services (nickserv and chanserv) are currently down; we're missing contact with some key servers. We're working to restore service and will keep you informed. Thanks.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Now would be a good time to mention that freenode could use more institutional server sponsors. Freenode is a service of Peer-Directed Projects Center, an IRS 501(c)(3) (not-for-profit) org in the US. If your organization would like to help, please message me. Thanks much.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi, folks. We are currently getting little tiny bits of bandwidth and high packet loss from our missing servers and, if you can believe it, that's actually good news. Stay with us and we'll keep you posted.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] For a bit more detailed information as available, please see wallops messages, which can be turned on via '/mode YOURNICK +w' on most clients
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. All service has been restored to the network and, so far, everything appears stable. A sponsor power outage caused most of our problems.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Again, I want to take the opportunity to note that freenode could use additional large institutional sponsors, to help us provide more redundant services---if your organization is interested, please email me (levin@pdpc.us) with your particulars and we'll talk.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] In the meantime, your client may not currently be identified to services; please identify or restart your client if that's more convenient. Thank you for your patience, and thank you for using freenode!
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:46am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:54am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3609:59am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56pcarns 
36n=pcarns@adsl-219-18-234.asm.bellsouth.net
 has joined #pvfs2
10:19AM 
pcarns
 hey, have you guys played with the io scheduler options on 2.6 kernels any?
10:20AM 
pcarns
 I fell into a rabbit hole last week (and so far this week) trying to track down big time stalls while doing read/write tests,
10:20AM 
pcarns
 wrote some benchmarks outside of PVFS2 stack and found that the stalls have nothing to do with pvfs2 code- its a system problem
10:21AM 
pcarns
 trying to find cause today, looks like changing io scheduler (and maybe settings with it) might help, but I need to do a lot more testing
robl
 pcarns: haven't played with it much
robl
 pcarns: the anticipitory scheduler as a gut feeling didn't sound right for pvfs2
robl
 pcarns: none of the standard schedulers did, actually
10:38AM 
53pcarns
 robl: I have no clue
10:38AM 
53pcarns
 robl: but so far it looks like anticipatory is actually doing the best
10:38AM 
pcarns
 trying noop next
10:40AM 
pcarns
 I'll post something on developers list if I find anything concrete
robl
 pcarns: what does noop do? just run io requessts as soon as they show up?
10:41AM 
pcarns
 I guess so- it probably doesn't reorder disk queue any, or batch anything together
10:41AM 
pcarns
 there are 4 options in 2.6: cfq (default), as, deadline, and noop
10:41AM 
pcarns
 deadline didn't help my situation any
10:41AM 
pcarns
 noop running now
10:42AM 
pcarns
 basically my benchmark is trying to stream either 8G or 36G to disk in 256K chunks (like a flow would do)
10:42AM 
pcarns
 I have a version that uses aio, and version that uses pwrite
10:42AM 
pcarns
 aio version allows 16 concurrent ops (like flow does)
10:43AM 
pcarns
 I suspected aio as the problem at first, but it wasn't exactly
robl
 pcarns: oh man, look slike there are infinity knobs yhou can turn for anticipatory, too
10:43AM 
pcarns
 anyway, depending on disk speed, ram, cpu speed, etc., I see some writes in the set stall for as long as 45 seconds
10:43AM 
pcarns
 which is longer than the flow timeout by default on server side (30 seconds)
10:43AM 
pcarns
 == boom
10:44AM 
pcarns
 the box I am testing on now sees stalls as long as 8 seconds with default scheduler,
10:44AM 
pcarns
 but it dropped to a max of 1.7 seconds when using as
10:44AM 
pcarns
 (but that's only a few test runs)
10:47AM 
pcarns
 hehe, noop wasn't very helpful
10:48AM 
pcarns
 I'm going to go back to as and try twiddling some more and confirming results
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3611:22am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3612:55pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:02pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:07pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:37pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:43pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3601:50pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-219-18-234.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
52.--------
52--
32--
32---------
32--
50--
50------------ --  -
52| 
57laz 
n=laz@pdpc/supporter/active/laz
50) 
57unknown
52: 
rcname  : Adam Lazur
50| 
erver   : irc.freenode.net (http://freenode.net/)
 laz  is identified to services 
SignOff 
57pcarns
: #pvfs2 
Remote closed the connection
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3603:59am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57brown.freenode.net 
3604:51am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
Read error: 110 (Connection timed out)
56pcarns 
36n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has joined #pvfs2
09:28AM 
slang
 pcarns: I'll look into that tar problem
09:29AM 
slang
 pcarns: the stuff currently in that branch does a cursor get next for each of the entries in the directory up the position on *each* readdir
09:29AM 
slang
 pcarns: pretty expensive
09:30AM 
slang
 pcarns: I've written some code that fixes it (caches the pos->keyname pair), but it hasn't been committed yet
09:30AM 
pcarns
 slang: yeah, that seems like a reasonable first cut
09:30AM 
pcarns
 slang: oh, ok
09:32AM 
slang
 pcarns: anyway .. if the server restarts it has to fallback on the walking through approach, so that bug is still relevant
09:33AM 
pcarns
 slang: you think that bug has to do with the readdir?
09:34AM 
slang
 pcarns: dunno
09:34AM 
slang
 pcarns: just a first guess
 pcarns 
n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has joined #pvfs2
12:17PM 
slang
 pcarns: is it exactly 32 files into the tar file?
12:17PM 
slang
 pcarns: readdir does 32 entries at a time..
12:22PM 
pcarns
 I think it is 32 files into it
12:22PM 
pcarns
 hmm
12:23PM 
pcarns
 maybe I can try to trigger by making a subdir,
12:23PM 
pcarns
 then creating 31,32,33 entries
12:23PM 
slang
 pcarns: well not readdir, but the kernel module has MAX_DIRENT_COUNT set to 0x20
12:23PM 
pcarns
 and listing at each point to see what happens
12:23PM 
slang
 pcarns: ok
12:24PM 
pcarns
 slang: I'll try that in a minute and let you know (rebuilding now with -g cflags)
12:24PM 
50* 
53slang/#pvfs2 
grins
robl
 it drives me crazy that -g isn't in our CFLAGS by default, though -O2 -g is pretty often not helpful
12:25PM 
50* 
53slang/#pvfs2 
uses --enable-strict
12:25PM 
slang
 unless I'm doing perf tests
12:28PM 
53pcarns
 robl: our build wrappers here automatically tack on -g, so I forget when I look at the clemson cvs tree
12:28PM 
pcarns
 slang: whoops
12:28PM 
pcarns
 slang: couple more warnings:
12:28PM 
pcarns
 ../pvfs2/src/io/trove/trove-dbpf/dbpf-open-cache.c:525: warning: long long unsigned int format, different type arg (arg 4)
12:29PM 
pcarns
 ../pvfs2/src/server/crdirent.sm:494: warning: passing arg 10 of `job_trove_keyval_write' from incompatible pointer type
12:29PM 
pcarns
 arg 10 - sweet!
12:29PM 
pcarns
 will have to use all fingers to count that one
12:33PM 
pcarns
 looks like it is using an int type for job id, rather than job_id_t
12:33PM 
pcarns
 32 bit vs 64 bit
12:33PM 
slang
 pcarns: I can fix that
12:35PM 
pcarns
 slang: I fixed it in my tree temporarily to continue testing,
12:36PM 
pcarns
 slang: but I run into a problem before I get to try the 32 entry test:
12:36PM 
pcarns
 pcarns-vm pvfs2 # mkdir foo
12:36PM 
pcarns
 pcarns-vm pvfs2 # cd foo
12:36PM 
pcarns
 pcarns-vm foo # touch 1 2 3
12:36PM 
pcarns
 pcarns-vm foo # ls
12:36PM 
pcarns
 2  3
12:36PM 
slang
 hrm
12:37PM 
pcarns
 pcarns-vm foo # cd ../
12:37PM 
pcarns
 pcarns-vm pvfs2 # ls
12:37PM 
pcarns
 lost+found  tmp
12:37PM 
slang
 pcarns: foo == tmp?
12:38PM 
pcarns
 no, doesn't look like it- it is a dir from something I did before what I pasted above
12:38PM 
pcarns
 has different stuff in it
12:39PM 
slang
 pcarns: oh
12:39PM 
pcarns
 in general, it looks like when I start creating things in a directory the first one is getting lost?
12:39PM 
slang
 pcarns: foo just isn't there
12:39PM 
slang
 pcarns: off-by-1 I guess
12:39PM 
slang
 pcarns: see if you can cd foo
12:39PM 
pcarns
 slang: ahh, it is just a problem in readdir- the objects are actually there
12:39PM 
pcarns
 pcarns-vm pvfs2 # ls
12:39PM 
pcarns
 blah  blah2  lost+found  tmp  yeah
12:39PM 
pcarns
 pcarns-vm pvfs2 # ls foo
12:39PM 
pcarns
 2  3
12:39PM 
pcarns
 pcarns-vm pvfs2 # cd foo
12:40PM 
pcarns
 pcarns-vm foo # ls
12:40PM 
pcarns
 2  3
12:40PM 
pcarns
 pcarns-vm foo # ls -alh 1
12:40PM 
50* 
53slang/#pvfs2 
nods
12:40PM 
pcarns
 -rw-r--r--  1 root root 0 Mar 14 11:52 1
12:42PM 
pcarns
 slang: yep, and if I create too many entries in the dir, ls hangs
12:42PM 
pcarns
 slang: 30 works, 40 doesn't
12:42PM 
slang
 pcarns: too many == >32?
12:43PM 
slang
 pcarns: yeah I think that's related to the position stuff
12:43PM 
pcarns
 slang: whoops, wait
12:43PM 
pcarns
 slang: it eventually came back with 40
12:43PM 
pcarns
 slang: but says "no such file or directory" on one of the files
12:43PM 
slang
 slang: maybe 40 is just that much slower?
12:43PM 
slang
12:44PM 
slang
 now I've done something bad and I get SIGTRAP when I restart the server
12:45PM 
pcarns
 slang: I can believe it would be slower, but it can't take _that_ long to iterate through 32 entries, can it?
12:45PM 
slang
 pcarns: probably not no
12:48PM 
pcarns
 slang: I just timed an ls in that directory; took 24 seconds, but then didn't list anything
12:48PM 
slang
 pcarns: if it did a readdir after each new entry though..
12:48PM 
slang
 pcarns: that would be 32*32
12:49PM 
pcarns
 slang: oh, does it restart if it sees that something changed?
12:49PM 
slang
 pcarns: I don't know when the readdirs happen
12:50PM 
pcarns
 slang: uh oh, my setup imploded after messing around with ls for a while:
12:51PM 
pcarns
 slang: got a msgpair failed out of pvfs2-ls,
12:51PM 
pcarns
 slang: then saw this in server logs:
12:51PM 
pcarns
 [E 12:06:25.852038] Error: accept: Too many open files
12:51PM 
pcarns
 [E 12:06:25.852096] ../pvfs2/src/io/bmi/bmi.c line 964: Error: critical BMI_testcontext failure.
12:51PM 
pcarns
 [E 12:06:25.852120] critical BMI failure.
12:51PM 
pcarns
 : Too many open files
12:51PM 
pcarns
 [E 12:06:25.852138] bmi_thread_function thread terminating
12:51PM 
pcarns
 slang: that wasn't very polite of bmi to react that way
01:03PM 
slang
 pcarns: no it wasnt
01:03PM 
slang
 pcarns: which errno is Too many open files?
01:05PM 
pcarns
 slang: ENFILE or EMFILE?
01:06PM 
pcarns
 slang: never actually heard of those, looking at accept man page
01:06PM 
pcarns
 slang: I think I see why it is running out of file descriptors though,
01:07PM 
pcarns
 slang; it looks like every trove operation is opening a new db reference
01:07PM 
slang
 pcarns: !!
01:07PM 
pcarns
 slang: I put a print in front of db_create() in the open cache code, and it gets triggered all the time
01:08PM 
pcarns
 slang: can we just toss the open cache now?
01:08PM 
pcarns
 slang: or well, maybe just not use it for db's any more?
01:09PM 
slang
 pcarns: yes
01:09PM 
pcarns
 slang: seems like we could open the db's at startup time and just hang onto them
01:09PM 
50* 
53slang/#pvfs2 
nods
01:09PM 
pcarns
 slang: might be easier than fixing whatevers wrong with it
01:09PM 
slang
 pcarns: I was too lazy to change all the open cache stuff to just bstream handles
01:10PM 
pcarns
 slang: I've got a task on our todo list to test pvfs2 behavior when we run out of sockets, looks like I need to boost the priority on it a bit since it goes boom
01:11PM 
slang
 pcarns: I think I know what the off-by-1 ls error is
01:12PM 
slang
 pcarns: I'd like to make the fixes to the version I have that caches the position though
01:12PM 
slang
 pcarns: is that cool
01:12PM 
slang
 pcarns: ?
01:13PM 
pcarns
 slang: yep, sounds good to me
01:13PM 
slang
 pcarns: ok I'll commit that stuff to the onekeyval branch
01:13PM 
slang
 pcarns: the cache is based on the tcache
01:13PM 
slang
 pcarns: which I had to modify a bit to suit my needs
01:13PM 
pcarns
 slang: neat!
robl
 valgrind --track-fds=yes  ... oh, you guys figured it out already
01:22PM 
pcarns
 slang: anything I can do to help on the dbpf stuff for now, or just touch base again after commit?
01:24PM 
slang
 pcarns: yeah let me commit stuff first
01:24PM 
slang
 pcarns: shouldn't be more than an hour or so
01:24PM 
pcarns
 slang: no rush
02:55PM 
slang
 pcarns: well, the missing first entry is fixed
02:55PM 
slang
 pcarns: but now I'm getting multiple listings for the second to last entry
02:55PM 
slang
 :-)
03:08PM 
pcarns
 slang: I guess extra files are better than missing files :)
03:10PM 
pcarns
 slang: if it did it for all files you could just stop where you are at; we will tell people it is the new redundancy scheme
03:20PM 
50* 
53slang/#pvfs2 
hehs
03:21PM 
slang
 pcarns: it seems to only happen via the vfs too
03:21PM 
slang
 pcarns: pvfs2-ls appears to behave
03:26PM 
slang
 good grief
03:27PM 
slang
 no wonder ls is so slow
03:27PM 
slang
 its calling readdir 3 times!
03:27PM 
slang
 even though all the entries were returned in the first call
03:31PM 
pcarns
 slang: yuck- is it not detecting when it has hit the end properly?
03:31PM 
50* 
53pcarns/#pvfs2 
has never looked at the vfs readdir path...
03:44PM 
slang
 pcarns: vfs code never looks at the token for _END
03:48PM 
slang
 pcarns: murali showed me how to fix it
03:48PM 
slang
 maybe
03:53PM 
pcarns
 slang: would this have been causing extra readdirs all along?
 pcarns 
n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has left #pvfs2 
04:13PM 
slang
 pcarns: yes!
04:14PM 
slang
 pcarns: man if I can get this changed and do a DB_MULTIPLE_NEXT instead of DB_NEXT ls could get a lot faster
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has joined #pvfs2
02:34PM 
slang
 theres some weirdness now with the ordering of the directory entry lost+found
02:34PM 
slang
 before it was always first
02:34PM 
slang
 now it appears in lexical order
02:37PM 
pcarns
 slang: does it matter?
02:37PM 
50* 
53slang/#pvfs2 
shrug
02:37PM 
pcarns
 slang: what is lexical order?  alphabetical?
02:37PM 
slang
 pcarns: right
02:37PM 
slang
 pcarns: it doesn't matter to me
02:40PM 
pcarns
 slang: looks like ext3 does that too
02:40PM 
slang
 pcarns: ok cool
02:44PM 
pcarns
 slang: did the new "end of dir" detection work ok for the vfs readdir?
02:44PM 
slang
 pcarns: yeah!
02:44PM 
slang
 pcarns: it works good
02:44PM 
slang
 pcarns: so that should save us an extra roundtrip
02:44PM 
slang
 pcarns: does save us
02:44PM 
slang
 pcarns: I tested it
02:44PM 
slang
 pcarns: I just committed a bunch of that stuff
02:44PM 
pcarns
 slang: awesome
02:45PM 
slang
 pcarns: I'll send an email to dev-int to keep people up-to-date on all that
02:45PM 
50* 
53slang/#pvfs2 
should probably add some documentation in places too..
02:52PM 
pcarns
 slang: looks like a nice big commit on the dbpf branch :)
02:53PM 
pcarns
 slang: I'll try to test it out some in a little bit
robl
 slang: you ever gonna merge into the trunk? :>
03:03PM 
slang
 pcarns: heh
03:03PM 
slang
 pcarns: someday
03:03PM 
slang
 pcarns: I feel a little more confident about the stuff in my recent commit than previously
03:04PM 
slang
 pcarns: that other stuff was pretty buggy (as you discovered)
03:08PM 
slang
 pcarns: can you let me know if the tcache changes I made are cool?
03:08PM 
pcarns
 slang: will do
03:33PM 
pcarns
 slang: looks like I won't get to look at this stuff until tomorrow
03:33PM 
slang
 pcarns: that's fine
03:33PM 
slang
 pcarns: no rush
 pcarns 
n=pcarns@adsl-61-120-100.mia.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-145-176-27.asm.bellsouth.net
 has joined #pvfs2
09:33AM 
pcarns
 slang: did you forget to add dbpf-keyval-pcache.h to cvs?
09:34AM 
pcarns
 slang: actually, I guess the .c file too
09:40AM 
slang
 pcarns: oops
09:42AM 
slang
 pcarns: ok, added.  sorry about that
09:42AM 
pcarns
 slang: no prob
09:43AM 
pcarns
 slang: thanks
10:04AM 
pcarns
 slang: I am still getting this warning:
10:04AM 
pcarns
 ../pvfs2/src/io/trove/trove-dbpf/dbpf-open-cache.c:525: warning: long long unsigned int format, different type arg (arg 4)
10:10AM 
pcarns
 slang: and now I get a different hang when trying tar -xvjf /usr/src/linux-2.6.15.4.tar.bz2 ...
10:11AM 
pcarns
 slang: this time it got 68 files/directories into the untar and is just stuck, no error messages yet
10:13AM 
pcarns
 slang: it eventually timed out: tar: linux-2.6.15.4/Documentation/aoe/mkshelf.sh: Cannot write: Connection timed out
10:16AM 
pcarns
 slang: I just sent an email with server log snippet (storage logging only)
10:18AM 
slang
 slang: ok I'll look at it, thanks
10:31AM 
pcarns
 slang: looks like maybe we are still hitting the open cache a good bit?
10:32AM 
pcarns
 slang: I got this after playing around some more:
10:32AM 
pcarns
 tar: linux-2.6.15.4/Documentation/SubmittingPatches: Cannot open: Too many open files
10:34AM 
pcarns
 slang: I added a msg before db_create again, then restarted everything and ran untar until it hung:
10:34AM 
pcarns
 pcarns-vm server # cat /tmp/pvfs2-server.log  |grep "DB_CREATE CALLED" |wc
10:34AM 
pcarns
     647    2588   24586
10:40AM 
pcarns
 slang: messing around a little bit more (creating new directories, cd'ing to them, listing contents) I get another hang with this message on the server:
10:40AM 
pcarns
 [E 09:53:00.400133] ../pvfs2/src/io/trove/trove-dbpf/dbpf-keyval.c line 747: dbpf_keyval_iterate_op_svc: DB_NOTFOUND: No matching key/data pair found
10:40AM 
slang
 pcarns: oh dear
10:41AM 
slang
 pcarns: dspace hits the open cache
10:41AM 
slang
 pcarns: I'm fairly sure keyval ops shouldn't
10:42AM 
pcarns
 slang: ah, some clarification on that last one: it looks like there is a bug in listing empty directories:
10:42AM 
pcarns
 # /mnt/pvfs2> mkdir foo1
10:42AM 
pcarns
 # /mnt/pvfs2> touch foo1/file1
10:42AM 
pcarns
 # /mnt/pvfs2> mkdir foo2
10:42AM 
pcarns
 # /mnt/pvfs2> ls foo1
10:42AM 
pcarns
 file1
10:42AM 
pcarns
 # /mnt/pvfs2> ls foo2
10:42AM 
pcarns
 <hang here>
10:42AM 
slang
 pcarns: oh I think I know what the problem is there
10:43AM 
slang
 pcarns: I wasn't initializing the dirdata_size to zero
10:43AM 
pcarns
 slang: ah, ok
11:12AM 
slang
 hmm
11:13AM 
slang
 I want to be able to use MULTIPLE_NEXT when iterating through all the directory's entries
11:14AM 
slang
 but in order to that I have to specify (by mallocing the result data to the right size) the number of entries I want returned
11:15AM 
slang
 so I needed the number of the dir ents
11:15AM 
slang
 which I decided to store in the directory's keyval
11:15AM 
slang
 (as 'dirdata_size')
11:16AM 
slang
 and update it on crdirent and remove
11:16AM 
pcarns
 ah, but that's actually a different handle, though, right?
11:16AM 
pcarns
 from the one that has the entries stored in it
11:16AM 
slang
 pcarns: correct
11:17AM 
slang
 but I didn't feel like the dbpf keyval interface allowed me to pass the size into the iterate function
11:17AM 
pcarns
 what happens if you just ask for a fixed number with MULTIPLE_NEXT every time, but there aren't necessarily that many there?
11:17AM 
slang
 pcarns: it fills in the ones that are there and returns the size
11:18AM 
pcarns
 which iterate function are we talking about?
11:18AM 
slang
 pcarns: dbpf_keyval_iterate_op_svc
11:19AM 
slang
 pcarns: the get call doesn't know about different handles though
11:19AM 
slang
 pcarns: so with multiple directories a MULTIPLE_NEXT will most likely return the number I asked for
11:19AM 
slang
 pcarns: and then I would have to go and find only the ones that match the handle I want
11:20AM 
slang
 pcarns: I didn't want to have to do that
11:20AM 
slang
 pcarns: so I tried to set the dirent_count to be <= available entries
11:20AM 
slang
 pcarns: but then iterate never returns _ITERATE_END
11:21AM 
pcarns
 slang: I'm not sure I follow...
11:21AM 
pcarns
 slang: why would it give you more than the handle you ask for?
11:21AM 
pcarns
 slang: oh, I see
11:22AM 
slang
 pcarns: i.e. I'm decrementing s_op->req->u.readdir.dirent_count in readdir.sm if the dirdata_size and position show that there aren't enough entries available
11:22AM 
pcarns
 slang: the MULTIPLE_NEXT doesn't really have a stopping condition- it starts wherever the cursor is and keeps going?
11:22AM 
slang
 pcarns: right
11:22AM 
slang
 pcarns: as long as their are entries in the DB
11:24AM 
pcarns
 slang: what if you did something like this:
11:24AM 
pcarns
 slang: in the state machine, set the inout_count to dirent_count +1
11:25AM 
pcarns
 slang: in the iterate function, then just do multiple next ffor inout_count db entries,
11:25AM 
pcarns
 slang: and put in logic to eliminate the ones for the wrong handle,
11:25AM 
pcarns
 slang: but start from the rear of the list to get rid of those,
11:25AM 
pcarns
 slang: because of the count that the caller set, you should only have 1 at most to strip off
11:26AM 
slang
 pcarns: hmm
11:26AM 
pcarns
 slang: (although logic would need to accomodate that their could be more- it would just stop when it found a matching handle when iterating backwards through array)
11:26AM 
slang
 pcarns: that's a good idea
11:26AM 
slang
 pcarns: then _ITERATE_END would still get triggered
11:27AM 
pcarns
 slang: so basically you are doing what you didn't want to (having to find only the matching handles after the db calls), but the caller is setting it up the count such that it shouldn't be a big perf penalty
11:27AM 
slang
 pcarns: right
11:27AM 
pcarns
 slang: yeah, you could stick _ITERATE_END in there at the appropriate time
11:29AM 
pcarns
 pcarns: in the state machine (before calling iterate), do we already know the dirent_count?
11:29AM 
pcarns
 slang: or would there be an extra step to get it?
11:29AM 
slang
 pcarns: I get it from the parent keyval, yes
11:29AM 
slang
 pcarns: extra step
11:30AM 
slang
 pcarns: you think that's a big deal?
11:30AM 
pcarns
 slang: so there are possibly two (small?) penalties to setting things up like this then: having to retrieve the dirent_count, and possibly reading one extra entry
11:30AM 
pcarns
 slang: but the benefit is getting all the entries in one call rather than N
11:30AM 
slang
 pcarns: right
11:31AM 
pcarns
 slang: it is probably worth it
11:32AM 
slang
 pcarns: I might be able to only get the dirdata_size when the directory is big
11:32AM 
slang
 pcarns: where big means more than one readdir
11:32AM 
slang
 pcarns: by checking that pos != _ITERATE_START
11:33AM 
pcarns
 slang: then again, I guess we are assuming that MULTIPLE_NEXT is actually faster than just doing going through the cursor one at a time
11:33AM 
pcarns
 slang: I would assume that's true but db is kinda tricky like that sometimes :)
11:34AM 
slang
 pcarns: oh
11:34AM 
pcarns
 slang: *shrug* if it was me I would probably be inclined to do it the old fashioned way for now and come back later with the optimization
11:34AM 
slang
 pcarns: yeah I'm assuming that too
11:34AM 
slang
 pcarns: but I did want to run the tests to verify
11:35AM 
pcarns
 slang: oh ok, that's cool
11:36AM 
50* 
53pcarns/#pvfs2 
is off to lunch
11:38AM 
50* 
53slang/#pvfs2 
waves
12:35PM 
pcarns
 slang: oh I forgot, the tcache changes look fine
12:36PM 
pcarns
 slang: thanks for the updates
12:56PM 
slang
 slang: cool
12:57PM 
slang
 pff
12:57PM 
slang
 pcarns: cool
12:57PM 
slang
 pcarns: the hanging behavior is caused by the kernel module retrying readdir until 0 is returned
12:58PM 
slang
 pcarns: but in this case readdir is returning an error (<0)
12:58PM 
slang
 pcarns: seems like the kernel module should be smarter about checking for errors
01:06PM 
slang
 pcarns: might be able to get murali to fix it :-)
01:32PM 
pcarns
 slang: its worth a shot :)
03:20PM 
slang
 pcarns: committed some fixes
03:20PM 
slang
 pcarns: cp seems to be broken now
03:20PM 
slang
 pcarns: though
03:21PM 
slang
 pcarns: the server keeps getting SIGTRAP at any rate
03:51PM 
slang
 slang@lain:~/BUILD-pvfs2-ok$ ./src/apps/admin/pvfs2-ls
03:51PM 
slang
03:51PM 
slang
 lost+found
03:51PM 
slang
 eth2.tar.bz2
03:51PM 
slang
 pvfs2-ls now shows entries in reverse order..
robl
 slang: we can ship pvfs2-ls as a shell script that pipes 'real' pvfs2-ls to sort?
04:22PM 
53slang
 robl: heh
04:30PM 
slang
 pcarns: tar gets pretty far for me now
04:30PM 
slang
 pcarns: still hangs at some point though
05:10PM 
pcarns
 slang: thanks for working on this stuff again; I'll check back in with you tomorrow...
 pcarns 
n=pcarns@adsl-145-176-27.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-145-176-27.asm.bellsouth.net
 has joined #pvfs2
56_Gandalf 
36i=1000@ptr-68-179-18-98.ptr.terago.ca
 has joined #pvfs2
10:53AM 
_Gandalf
 hi all, hope your day is going well!
10:53AM 
slang
 _Gandalf: pretty well, how are you?
10:53AM 
_Gandalf
 anyone around that i could ask a pvfs2 related question?
10:53AM 
_Gandalf
 good thanks
10:54AM 
slang
 _Gandalf: what's up?
10:54AM 
_Gandalf
 well i'm getting seg faults with 1.4.0 on 2.6.15.6
10:55AM 
slang
 _Gandalf: oh dear
10:55AM 
_Gandalf
 hahaha
10:55AM 
slang
 _Gandalf: what's your usage scenario?
10:56AM 
_Gandalf
 i've seen it mentioned on the mailing list but nothing other than "go download the cvs" wich i've done and it still has the same issue...
10:56AM 
_Gandalf
 well testing right now
10:57AM 
_Gandalf
 but i would like to use it in a production environment eventually serving pdfs from a set of clustered document servers...
10:58AM 
_Gandalf
 theres never a situation where 2 people would be modifying the same doc so from what i've read pvfs2 would be almost a perfect fit
10:58AM 
_Gandalf
 and the docs are to numerouse for coda metadata goes thru the roof
10:58AM 
slang
 _Gandalf: ok
10:59AM 
slang
 _Gandalf: what are you doing to cause the segfault?
10:59AM 
_Gandalf
 trying to create the array
10:59AM 
_Gandalf
 pvfs2-server -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1
10:59AM 
_Gandalf
 then start and segfault
11:00AM 
_Gandalf
 nothing in dmesg or syslog or its log
robl
 _Gandalf: what distribution?
11:00AM 
_Gandalf
 and when i strace it i can't see anything usful but i'm not a coder unfortunatly
11:00AM 
_Gandalf
 slackware 10.2
robl
 _Gandalf: this is a longshot, but try setting the LD_ASSUME_KERNEL environment variable to 2.4.1 and try again
robl
 _Gandalf: also, what does 'ldd pvfs2-server' say?
11:04AM 
_Gandalf
 root@www1:~/pvfs2-1.4.0/src/server# ldd pvfs2-server
11:04AM 
_Gandalf
         linux-gate.so.1 =>  (0xffffe000)
11:04AM 
_Gandalf
         librt.so.1 => /lib/librt.so.1 (0xb7fa8000)
11:04AM 
_Gandalf
         libpthread.so.0 => /lib/libpthread.so.0 (0xb7f57000)
11:04AM 
_Gandalf
         libdb-4.3.so => /usr/lib/libdb-4.3.so (0xb7e73000)
11:04AM 
_Gandalf
         libc.so.6 => /lib/libc.so.6 (0xb7d5a000)
11:04AM 
_Gandalf
         /lib/ld-linux.so.2 (0xb7fd5000)
11:05AM 
_Gandalf
 root@www1:~/pvfs2-1.4.0# export LD_ASSUME_KERNEL=2.4.1
11:05AM 
_Gandalf
 root@www1:~/pvfs2-1.4.0# pvfs2-server -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1
11:05AM 
_Gandalf
 [D 11:43:56.506703] PVFS2 Server version 1.4.0 starting.
11:05AM 
_Gandalf
 Segmentation fault
11:09AM 
slang
 _Gandalf: can you run that in the debugger for us?
11:09AM 
slang
 _Gandalf: first: gdb pvfs2-server
11:09AM 
slang
 _Gandalf: then: run -f /etc/pvfs2-fs.conf /etc/pvfs2-server.conf-www1
11:09AM 
slang
 _Gandalf: when it segfaults, do: bt
11:10AM 
_Gandalf
 #0  0xb7e29b3c in __dbenv_get_errpfx () from /usr/lib/libdb-4.3.so
11:10AM 
_Gandalf
 #1  0xb7e18c39 in __dbh_am_chk () from /usr/lib/libdb-4.3.so
11:10AM 
_Gandalf
 #2  0x0809980e in dbpf_db_open ()
11:10AM 
_Gandalf
 #3  0x08099536 in dbpf_storage_lookup ()
11:10AM 
_Gandalf
 #4  0x08097adf in dbpf_initialize ()
11:10AM 
_Gandalf
 #5  0x08066b25 in trove_initialize ()
11:10AM 
_Gandalf
 #6  0x08078f5b in pvfs2_mkspace ()
11:10AM 
_Gandalf
 #7  0x080766a9 in PINT_config_pvfs2_mkspace ()
11:10AM 
_Gandalf
 #8  0x08051f65 in main ()
11:12AM 
slang
 _Gandalf: looks like a problem in berkeley db
11:12AM 
_Gandalf
 spiffy
11:13AM 
slang
 _Gandalf: what was your configure line for pvfs2?
11:13AM 
_Gandalf
 ./configure --with-kernel=/usr/src/linux
robl
 _Gandalf: where'd you get db-4.3? slack 10.2 ships with 4.2.52, right?
11:18AM 
_Gandalf
 yeah i'm not sure this is a fresh install... i don't remember upgrading it... hmm...
11:19AM 
_Gandalf
 yeah i'm a retard i must have upgraded it.
11:19AM 
_Gandalf
 maybe when i did apache and php
11:20AM 
slang
 _Gandalf: can you do: locate db.h
11:22AM 
_Gandalf
 updating db just a sec
11:25AM 
_Gandalf
 ./usr/include/db4/db.h
11:26AM 
slang
 _Gandalf: can you try to do ./configure ... --with-db=/usr
robl
 _Gandalf: please grep for 'DB_VERSION_STRING' in ./usr/include/db4/db.h ?
11:26AM 
slang
 _Gandalf: and recompile and try the pvfs2-server -f ... again?
11:27AM 
slang
 _Gandalf: do what robl says first :-)
11:32AM 
_Gandalf
 i missed this befor too /usr/include/db.h as well
11:33AM 
slang
 _Gandalf: I thought so ;-)
11:33AM 
_Gandalf
 Sleepycat Software: Berkeley DB 4.3.29: (September  6, 2005)
11:33AM 
_Gandalf
 that was for /usr/include/db4
11:33AM 
_Gandalf
 root@www1:~/pvfs2-1.4.0# cat /usr/include/db.h|grep DB_VERSION_STRING
11:33AM 
_Gandalf
 #define DB_VERSION_STRING       "Sleepycat Software: Berkeley DB 3.3.11: (July 12, 2001)"
11:33AM 
_Gandalf
 root@www1:~/pvfs2-1.4.0#
11:34AM 
slang
 _Gandalf: heh
11:34AM 
slang
 _Gandalf: --with-db=/usr should work for you
11:34AM 
_Gandalf
 k gonna try now
11:35AM 
_Gandalf
 btw thanks for all your help guys i really appreciate it!
11:37AM 
_Gandalf
 nope same seg fault
11:38AM 
slang
 _Gandalf: grep CFLAGS Makefile
11:38AM 
_Gandalf
 #0  0x00000000 in ?? ()
11:38AM 
_Gandalf
 #1  0x0809981c in dbpf_db_open ()
11:38AM 
_Gandalf
 #2  0x08099536 in dbpf_storage_lookup ()
11:38AM 
_Gandalf
 #3  0x08097adf in dbpf_initialize ()
11:38AM 
_Gandalf
 #4  0x08066b25 in trove_initialize ()
11:38AM 
_Gandalf
 #5  0x08078f5b in pvfs2_mkspace ()
11:38AM 
slang
 _Gandalf: in the pvfs2 builddir
11:38AM 
_Gandalf
 #6  0x080766a9 in PINT_config_pvfs2_mkspace ()
11:38AM 
_Gandalf
 #7  0x08051f65 in main ()
11:40AM 
_Gandalf
 CFLAGS =  -O2 -DGOSSIP_ENABLE_BACKTRACE
11:40AM 
_Gandalf
 PICFLAGS = -fPIC
11:40AM 
_Gandalf
 CFLAGS += -D__STATIC_METHOD_BMI_TCP__
11:40AM 
_Gandalf
 #CFLAGS += -D__STATIC_FLOWPROTO_DUMP_OFFSETS__
11:40AM 
_Gandalf
 CFLAGS += -D__STATIC_FLOWPROTO_MULTIQUEUE__
11:40AM 
_Gandalf
 CFLAGS += -D_FILE_OFFSET_BITS=64 -D_LARGEFILE64_SOURCE
11:40AM 
_Gandalf
 CFLAGS += -I .
11:40AM 
_Gandalf
 CFLAGS += -I $(srcdir)/include -I include -I $(srcdir)
11:40AM 
_Gandalf
 CFLAGS += $(patsubst %,-I$(srcdir)/%,$(INCLUDES))
11:40AM 
_Gandalf
 CFLAGS += -DPVFS2_VERSION="\"1.4.0\""
11:40AM 
_Gandalf
 INTEL_CFLAGS := -Wall -wd279
11:40AM 
_Gandalf
 GCC_CFLAGS := -Wall -Wstrict-prototypes -pipe
11:41AM 
_Gandalf
 #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_JOB_THREADED__ \
11:41AM 
_Gandalf
 #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_JOB_THREADED__ \
11:41AM 
_Gandalf
 #SERVERCFLAGS = -D__GEN_POSIX_LOCKING__ -D__PVFS2_TROVE_SUPPORT__
SignOff 
57_Gandalf
: #pvfs2 
Excess Flood
56_Gandalf 
36i=1000@ptr-68-179-18-98.ptr.terago.ca
 has joined #pvfs2
11:41AM 
_Gandalf
 that was super
11:44AM 
_Gandalf
 i could try installing the db4.4.16 package for db...
robl
 _Gandalf: you've got db-3 and db-4 stuff in /usr/lib and /usr/include... try building a berkely db from source, but install into, say, /usr/local/db4
robl
 then you'll know for sure you aren't mixing headers and libraries
robl
 (configure pvfs2 with  the --with-db= option)
robl
 we're off to lunch. let us know how it goes
11:47AM 
_Gandalf
 have a good lunch gents
11:47AM 
_Gandalf
 thanks again
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
12:18PM 
_Gandalf
 it worked!
12:18PM 
_Gandalf
 super thanks for all your help robl & slang
12:53PM 
slang
 _Gandalf: cool
 pcarns 
n=pcarns@adsl-145-176-27.asm.bellsouth.net
 has left #pvfs2 
02:48PM 
_Gandalf
 should this be showing me the drives sizes added together
robl
 roughly
03:04PM 
_Gandalf
 nice
03:05PM 
_Gandalf
 works well too
robl
 _Gandalf: how big are your typical pdf files?
03:05PM 
_Gandalf
 is there any reason i wouldn't see the tcp connection in iptraf?
03:05PM 
_Gandalf
 around 10k each
robl
 _Gandalf: about how many in a given directory?
03:08PM 
_Gandalf
 uhm
03:08PM 
_Gandalf
 just a sec
03:12PM 
_Gandalf
 anywhere from about 300 - 2000
03:12PM 
_Gandalf
 in total almost 800,000 pdfs
robl
 _Gandalf: the total isn't too alrming, but 'ls' on that 2000 entry directory will take a few seconds (just wanted to warn you what to expect)
03:26PM 
_Gandalf
 there shouldn't ever be any ls'in just read and writes as agents move pdfs into customer account dirs and stuff like that...
03:26PM 
_Gandalf
 and the clients are local to the servers...
03:26PM 
_Gandalf
 this is basically so i can replicate my raid 5 in real time
robl
 ok, cool
SignOff 
57laytonj
: #pvfs2 
"Leaving"
 Connection closed from irc.freenode.net: Success
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
 Unable to connect to port 6667 of server irc.freenode.net: unknown host
BitchX
: Servers exhausted. Restarting.
 Connecting to port 6667 of server irc.freenode.net [refnum 0]
52[freenode]
  *** Looking up your hostname...
52[freenode]
  *** Checking ident
52[freenode]
  *** No identd (auth) response
52[freenode]
  *** Found your hostname
BitchX
: For more information about 
BitchX
 type 
/about
 Welcome to the freenode IRC Network robl (from kornbluth.freenode.net)
 Your host is kornbluth.freenode.net[freenode.freenode.net/6667], running version hyperion-1.0.2 (from kornbluth.freenode.net)
52[freenode]
  *** Your host is kornbluth.freenode.net[freenode.freenode.net/6667], running version hyperion-1.0.2
 This server was created Sat Dec 17 11:04:34 UTC 2005 (from kornbluth.freenode.net)
 kornbluth.freenode.net hyperion-1.0.2 aAbBcCdDeEfFGhHiIjkKlLmMnNopPQrRsStTuUvVwWxXyYzZ01234569*@ bcdefFhiIklmnoPqstv 
 IRCD=dancer CAPAB CHANTYPES=# EXCEPTS INVEX CHANMODES=bdeIq,k,lfJD,cgijLmnPQrRstz CHANLIMIT=#:20 PREFIX=(ov)@+ MAXLIST=bdeI:50 MODES=4 STATUSMSG=@ KNOCK NICKLEN=16 :are supported by this server 
 SAFELIST CASEMAPPING=ascii CHANNELLEN=30 TOPICLEN=450 KICKLEN=450 KEYLEN=23 USERLEN=10 HOSTLEN=63 SILENCE=50  are supported by this server
local users on irc
4334
50)]
 16%
global users on irc
13186
50)]
 49%
invisible users on irc
13556
50)]
 51%
ircops on irc
50)]
total users on irc
26742
50)]
unknown connections
50)]
total servers on irc
50)]
avg. 0 users per server
total channels created
10804
50)]
avg. 2 users per channel
 Current local  users: 4334  Max: 6736 
 Current global users: 26742  Max: 30067 
Highest client connection count
6737
50) 
6736
50)]
 Unknown MODE flag 
Mode change 
57+iw
 for user 
36robl
56robl 
36n=robl@ninjak.clustermonkey.org
 has joined #pvfs2
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
52Users
32#pvfs2
50)]
54 robl      
54 _Gandalf  
54ChanServ  
54 slang     
55NickServ
35NickServ@services.
50)-
 This nickname is owned by someone else
55NickServ
35NickServ@services.
50)-
 If this is your nickname, type /msg NickServ 
IDENTIFY
 <password>
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
 #pvfs2  [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup
 Channel #pvfs2 was created at Mon Aug  8 02:51:50 2005
BitchX
: Join to #pvfs2 was synched in 14.332 secs!!
08:13AM 
32lilo:*
 Hi all. If you have any information on the current status of Larry, please message me. Thanks!
08:15AM 
32lilo:*
 Hi all. If you're following Larry (a cat 4 storm heading for Australia's northeast coastline), please stop by ##earth .... thanks!
31msg
51nickserv
50)] 
identify password
55NickServ
35NickServ@services.
50)-
 Password accepted - you are now recognized
mode
36robl 
57+e
 by 
57services.
55MemoServ
35MemoServ@services.
50)-
 You have no new memos
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3608:13pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3610:21pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57_Gandalf  
36G   
i=1000
ptr-68-179-18-98.ptr.terago.ca (* I'm too lame to read BitchX.doc *)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3610:12am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
Netjoined: 
57irc.freenode.net kornbluth.freenode.net
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56_Gandalf 
36i=1000@ptr-68-179-18-98.ptr.terago.ca
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
57> 
52freenode-connect 
32freenode@freenode/bot/connect
32 requested VERSION  from robl
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57_Gandalf
: #pvfs2 
"BitchX-1.1-final -- just do it."
56pcarns 
36n=pcarns@adsl-34-59-188.asm.bellsouth.net
 has joined #pvfs2
03:34PM 
32lilo:*
 congrats to BearPerson: it's his birthday, and he gets to be our newest staffer....now that he's Ancient :)
03:59PM 
32lilo:*
 it's also a birthday for fedora's cds .... happy birthday, clair :)
Mode change 
57-w
 for user 
36robl
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-34-59-188.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
SignOff 
57pcarns
: #pvfs2 
Read error: 113 (No route to host)
56pcarns 
36n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has joined #pvfs2
09:32AM 
slang
 pcarns: ok so its a bstream problem now
09:33AM 
slang
 pcarns: I think part of my confusion with all this has been that I haven't made any changes to the open cache code itself
09:33AM 
slang
 pcarns: so it seems like it shouldn't suddenly go hog wild with open fds
09:40AM 
pcarns
 slang: now on dvd: "open caches gone wild"
09:40AM 
50* 
53slang/#pvfs2 
laughs
09:41AM 
pcarns
 slang: I didn't actually check to make sure that's what's happening, just assuming that error code is genuine
09:41AM 
pcarns
 slang: might need to check lsof once it hits the hang
09:42AM 
pcarns
 slang: but I've been pulled off onto something else for a while this morning
09:42AM 
slang
 pcarns: yeah the log agrees with you
09:42AM 
slang
 pcarns: I added a debug statement in open_fd
09:45AM 
slang
 pcarns: I'll keep digging, thanks
09:49AM 
pcarns
 slang: cool, good luck
56pw 
36n=pw@quasar.osc.edu
 has joined #pvfs2
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
01:15PM 
50* 
53hozer/#pvfs2 
<- Troy Benjegerdes
01:18PM 
 hozer
 how do you chsh on these machines?  Complaint: "Cannot lock the password file; try again later.
01:18PM 
hozer
 heh
01:18PM 
hozer
 you ask your friendly admin ;)
01:18PM 
hozer
 what shell?
01:18PM 
hozer
 (we are using ldap for passwd lookups)
01:19PM 
 chsh, asks for my password, asks for shell, then that complaint;  all on opteron1
01:20PM 
hozer
 what shell do you want?
01:21PM 
hozer
 bash I assume?
01:21PM 
 yeah,
01:22PM 
hozer
 changed
 SWAP: Window 3 is not hidden!
01:22PM 
 kewl
robl
 hey guys
01:23PM 
hozer
 I suppose the next question is what should we start benchmarking this with?
01:24PM 
hozer
 pw: all you really wanted was access to the repository, right?
01:24PM 
 What've you got for openib-running NICs and storage?
01:24PM 
 (Yeah, just the repo; but it seems to be in ~kschoche somewhere I can't read, I'm guessing.)
01:24PM 
hozer
 dual opteron with dual Areca controllers 
01:25PM 
 Enough server machines with interesting disk to get good numbers?
01:25PM 
hozer
  you should be able to read /afs/scl.ameslab.gov/project/infiniband/pvfs2/pvfs2-openib-dev
01:26PM 
 Yeah, but it's old.  No openib files around.  I found processes running by kschoche on d5 that point into /afs/scl.ameslab.gov/user/kschoche, but acls won't let me see.
01:26PM 
hozer
 hrrm
01:26PM 
53pw
 robl
 hiya.  We're hijacking #pvfs2 for a while.  :)
01:28PM 
hozer
 pw: I just updated the working copy
01:28PM 
hozer
 the stuff is in the repository, but the working copy hadn't been updated
01:30PM 
hozer
 pw: da5/da6 also have DDR infiniband cards
01:30PM 
hozer
 opteron1/2 have old PCI-X IB cards
01:32PM 
 Hrm.  I've got 40 dedicated SDR PCI-E, but those machines only have one SATA Drive each.  I was hoping for both lots of IB nodes and reasonable storage.
robl
 pw: excelent. 
 pcarns 
n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has left #pvfs2 
01:34PM 
hozer
 we have around 12 of those storage servers, each with 16 sata drives
01:34PM 
hozer
 but some are not configured up yet.
01:35PM 
hozer
 and Brett is running production GAMESS jobs on pvfs2 over IPoIB on 3 of them as well
01:36PM 
hozer
 so ideally, we'll end up with 8-10 storage servers and 10 IBM 4cpu Power5's as clients 
01:37PM 
hozer
 the IBM's have IBM's ehca driver.. and I need to update the kernel and openib info on those first
01:37PM 
 Oh my, that sounds like some risk, but it should work.
01:38PM 
hozer
 yes
01:39PM 
hozer
 but we should be able to do a nice 4 client to 4 server test with the DDR opterons
01:40PM 
 I guess so.  At least you've got good disk, but I was hoping for some SUPERcomputing.
01:42PM 
hozer
 we'll be happy if the disk(s) can go fast enough to feed a 4 cpu IBM box running GAMESS in direct SCF mode 
01:43PM 
hozer
 if I can max out the 12X infiniband links on one of the IBM nodes, I think we can find a GAMESS job that could be run on this system that we can't run anywhere else
01:45PM 
 crazy, good app paper
01:47PM 
hozer
 the annoying thing is there's a 64 node IB cluster in the same building, but in the basement. (we are on the 4th floor)
01:48PM 
 How much work would it be to drag everything down to the basement for the next month or so?  Enough switch ports to hook it all up?
01:49PM 
hozer
 we could take 8-10 storage servers down to the basement
01:50PM 
hozer
 the 64 node cluster isn't technically ours though
01:50PM 
hozer
 I think if we find out sometime this week or early next that everything works, it might be worth tryingg
56pcarns 
36n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has joined #pvfs2
04:19PM 
53pw
 robl
 I've never understood your ChangeLog format.  New things go on top of old things in a particular release?  Have you seen the GNU-standard ChangeLog format?
04:21PM 
hozer
 pw: do you know anything about Linux async I/O?
04:21PM 
hozer
 and/or libaio?
04:24PM 
 Yeah, implemented by a separate thread in glibc, or via very recent unmerged kernel pathches
04:25PM 
hozer
 AIO has been in the kernel since at least 2.6.14 or so, I think
robl
 pw: oh yeah, it's quite ad-hock
robl
 hoc even
04:25PM 
hozer
 which is old by my standards at least ;)
robl
 pw: i respect what the gnu changelog format does, but i find it too verbose
robl
 pw: probably because i make heavy use of cvsps... w/o that i'd be all over the gnu format
04:26PM 
53pw
 robl
 no big deal to me, just wondered if I was doing it wrong.
robl
 pw: nope. as far as i can tell, you and i are the only ones who make changes to ChangeLog.  Thanks for doing that, btw
04:28PM 
 hozer
 you mean there should be a sys_aio_read etc that can be called directly from userspace?  I've not seen that yet, but maybe I'm just missing it in the source.
04:28PM 
hozer
 pw: yeah.. what you want to be doing (especially on our 8-disk raidset machines) is open a file with O_DIRECT and use the aio_read functions
04:30PM 
hozer
 pw: look in /usr/src/aio on opteron1
04:30PM 
hozer
 the 'aiocp' program
04:31PM 
hozer
 we can get close to 400MB/sec with aiocp, but only 200-300 useing regular reads
04:32PM 
 Oh, via io_submit etc rather than the posix aio_read calls, I see.  This may require some porting work to get pvfs2 to talk it.
04:35PM 
hozer
 yep
04:35PM 
hozer
 if you do it right you avoid any memory copies
04:36PM 
hozer
 I believe you can use io_submit on TCP sockets as well and you might be able to get zero copy on regular TCP that way
04:36PM 
hozer
 at least on send
04:37PM 
hozer
 I had heard that someone had a posix aio_read implementation that used the linux io_submit underneath, but I've not been able to verify this yet
04:39PM 
 That would be ideal.  It is a hassle to shift stuff around as APIs change.
SignOff 
57pw
: #pvfs2 
"pw has no reason"
04:53PM 
pcarns
 hey guys, I am about to head out, but I just skimmed over end of conversation
04:53PM 
pcarns
 http://www.bullopensource.org/posix/
04:53PM 
pcarns
 might be something to look at
04:54PM 
pcarns
 they have patches for kernel, and a posix compliant aio implementation to use the kernel aio stuff
04:54PM 
pcarns
 doesn't require O_DIRECT if patches are used
 pcarns 
n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has left #pvfs2 
SignOff 
57hozer
: #mklinux,#pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56pcarns 
36n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has joined #pvfs2
56pw 
36n=pw@quasar.osc.edu
 has joined #pvfs2
SignOff 
57pw
: #pvfs2 
"pw has no reason"
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
robl
 hozer: more infiniband work?
10:33AM 
hozer
 yeah
10:33AM 
hozer
 we're working on getting OpenIB working
robl
 hozer: hey, can you send robl@mcs.anl.gov your async i/o benchmark? (if you don't mind)
11:46AM 
hozer
 http://developer.osdl.org/daniel/AIO/
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
 SWAP: Window 3 is not hidden!
56_Gandalf 
36n=rtoomer@205-200-1-20.static.mts.net
 has joined #pvfs2
03:20PM 
_Gandalf
 hey guys hows your day?
robl
 _Gandalf: hi. going ok. what's up?
03:29PM 
_Gandalf
 i have a question, i've got pvfs2 setup and working (again thanks to you and slang) but when 1 server goes down the other cannot write to the file system... is this me doing something wrong or is it that pvfs2 doesn't have any kind of allowance for disconnected opperation?
robl
 _Gandalf: yeah, that's totally expected behavior
03:37PM 
slang
 _Gandalf: you mean you have 1 filesystem (call it A) with servers A1,A2,A3 and another (call it B) with servers (B1,B2,B3) and when A1 goes away you can't talk to fs B?
robl
 _Gandalf: no software redundancy in pvfs2 (yet. maybe it'll be in place a year from now?)
robl
 _Gandalf: pvfs2 is like raid 0
03:41PM 
_Gandalf
 ahhh k so is like drdb only you can mount both sides read write
03:41PM 
_Gandalf
 k cool
03:41PM 
hozer
 not really
03:42PM 
hozer
 my understanding is drdb is a *replicated* block device
03:42PM 
hozer
 there's no replication in pvfs2
03:42PM 
_Gandalf
 ahh cool interesting to know thanks for the info hozer
 pcarns 
n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has left #pvfs2 
05:42PM 
hozer
 hrrrm
05:42PM 
hozer
 local disk I/O of a 8GB file: 600MB/sec
05:44PM 
hozer
 pvfs2-cp of a 1.8GB file over IB: 100MB/sec
05:44PM 
hozer
 ... needs some tuning, I think ;)
SignOff 
57hozer
: #mklinux,#pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56pcarns 
36n=pcarns@adsl-215-227-62.aep.bellsouth.net
 has joined #pvfs2
08:01AM 
pcarns
 slang: thanks for getting those patches in
08:01AM 
pcarns
 slang: I'm going to beat on the dbpf branch with LTP some today
08:09AM 
pcarns
 slang: it looks like rename04 and rmdir02 tests from the latest LTP release are breaking now
08:11AM 
pcarns
 slang: ahh, must be something with dirent_count; I can trigger the first problem that rmdir02 finds manually:
08:11AM 
pcarns
 io/trove> mkdir dir1
08:11AM 
pcarns
 io/trove> touch dir1/foo
08:11AM 
pcarns
 io/trove> rmdir dir1
08:12AM 
pcarns
 we should get "directory not empty"
56pcarn1 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
08:50AM 
pcarn1
 slang: I have a couple more updates (for dirent_count handling in server sm's) that I'll email along shortly
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
SignOff 
57pcarns
: #pvfs2 
Read error: 110 (Connection timed out)
09:05AM 
slang
 pcarn1: ok
09:05AM 
slang
 pcarn1: thanks again for those patches
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
09:15AM 
pcarn1
 slang: no problem- thank _you_ for doing all this dbpf work
09:15AM 
pcarn1
 slang: its looking really good
09:45AM 
pcarn1
 slang: heh, I suspect I should have added a state in crdirent.sm that sets the dirent_count to zero if a new dirdata object is created
09:57AM 
slang
 pcarn1: there's an init_dirdata_count in mkdir.sm
09:59AM 
slang
 pcarn1: I thought it would be better there
09:59AM 
pcarn1
 ahh, ok
09:59AM 
slang
 pcarn1: I think the old code used to set the size to 0 if the the keyval db file wasn't there
09:59AM 
pcarn1
 good deal
10:00AM 
pcarn1
 slang: yeah, I don't know what went wrong in that patch I sent you, maybe you are better off ignoring it :)
10:00AM 
slang
 pcarn1: well I think you're right about where the dirent_count increment should go though
10:00AM 
pcarn1
 slang: it fixed that one case (rmdir on empty/nonempty directories), but something else went haywire instead, not sure what yet
10:01AM 
pcarn1
 slang: ohh, duh, I think my server is dying
10:01AM 
pcarn1
 slang: must have goofed some memory in there somewhere
11:08AM 
slang
 pcarn1: yeah things seem ok to me with the patch
11:09AM 
slang
 pcarn1: maybe your storage locations were old?
11:09AM 
pcarn1
 slang: there is no telling
11:09AM 
pcarn1
 slang: I keep starting and stopping 3 different server builds
11:09AM 
pcarn1
 slang: probably end user error :)
11:10AM 
pcarn1
 slang: it was reassuring to see the server running well in valgrind
11:11AM 
pcarn1
 slang: we get some false positives out of pwrite within berkeley db, but no true problems
11:11AM 
50* 
53slang/#pvfs2 
nods
SignOff 
57_Gandalf
: #pvfs2 
"cheers gents thanks again for all your help"
12:37PM 
pcarn1
 slang: oh, I jus t realized,
12:38PM 
pcarn1
 slang: the migration util needs to write out those new keyvals for the dirent count
12:38PM 
pcarn1
 slang: I'll look into that
12:43PM 
slang
 pcarn1: cool
12:47PM 
pcarn1
 slang: hmm, there isn't any way for a given dirdata object, to find out what directory object goes with it, is there?
12:47PM 
slang
 pcarn1: no
12:47PM 
pcarn1
 slang: ok
12:48PM 
slang
 pcarn1: we could store the handle as a common key for dirdata handle
12:48PM 
pcarn1
 slang: nah, that's ok
12:49PM 
pcarn1
 slang: it really isn't needed, it just would have made the migration a tad easier
12:49PM 
pcarn1
 I can just keep seperate lists of the dirdata objects and the dir objects while iterating through the old collection, then combine them to figure out where to write what size
12:53PM 
pcarn1
 slang: oh wait, no, its easier than that
12:53PM 
pcarn1
 slang: heh, I'll figure something out :)
12:53PM 
50* 
53slang/#pvfs2 
grins
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
03:32PM 
pcarn1
 slang: have you committed those last patches yet?
 pcarn1 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
robl
 topic
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
10:52PM 
55bress
35n=bress@redhat/bress
50)]
 epg misses you in #c-60
SignOff 
57slang
: #pvfs2 
Remote closed the connection
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
BitchX
: Unknown command: MGS
31msg
51bress
50)] 
hah! tell him i'll be back soon
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-217.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
 SWAP: No such window: 4
 SWAP: Window 3 is not hidden!
 SWAP: Window 3 is not hidden!
56elventails 
36i=elventai@elventails.COM
 has joined #pvfs2
02:32PM 
slang
 elventails: hello
02:32PM 
elventails
 slang: hi
02:35PM 
slang
 elventails: anything we can help out with regarding pvfs2?
02:35PM 
elventails
 slang: :) thx! I'll be with you in a bit - phone call..
02:39PM 
slang
 elventails: take your time :-)
03:08PM 
elventails
 slang: hey :) sorry about that
03:08PM 
elventails
 slang: how are you?
03:09PM 
slang
 elventails: its cool.  I'm doin good
03:09PM 
elventails
 so my name is Joy Khoriaty
03:09PM 
elventails
 I'm at MIT
03:09PM 
elventails
 and we've been looking at PVFS2 for some time now
03:10PM 
elventails
 ur whois shows that you're at anl, right?
03:10PM 
slang
 elventails: yes
03:10PM 
elventails
 I've been trying the 1.4 server with 1.3.x clients
03:10PM 
elventails
 and ran a few tests, bonnie++, mpi-io-test
03:11PM 
slang
 elventails: oh ok
03:11PM 
elventails
 and this morning, the client seemed pretty dumbstruck
03:11PM 
elventails
 specifically
03:11PM 
elventails
 [E 13:48:17.625291] Failed to umount via host tcp://192.168.2.14:3339
03:11PM 
elventails
 [E 13:49:22.575222] *** msgpairarray_completion_fn: msgpair failed, no retry: Connection refused
03:11PM 
elventails
 [E 13:49:22.575304] PINT_server_get_config failed: Connection refused
03:11PM 
elventails
 [E 13:49:22.575327] Failed to mount via host tcp://192.168.2.14:3339
03:11PM 
elventails
 [E 13:49:22.575348] Mount failed: Connection refused
03:11PM 
elventails
 [E 13:49:51.097907] *** msgpairarray_completion_fn: msgpair failed, no retry: Connection refused
03:11PM 
elventails
 [E 13:49:51.097970] PINT_server_get_config failed: Connection refused
03:11PM 
elventails
 [E 13:49:51.097992] Failed to mount via host tcp://192.168.2.14:3339
03:11PM 
elventails
 [E 13:49:51.098014] Mount failed: Connection refused
03:11PM 
elventails
 any clues?
03:12PM 
elventails
 it seems that the 1.4 server stopped serving..
03:12PM 
slang
 elventails: are the servers still running?
03:12PM 
elventails
 with this log on the server
03:12PM 
elventails
 [E 15:48:11.673873] src/server/io.sm line 130: Server: IO SM: PINT_encode() failure.
03:12PM 
elventails
 [E 15:48:11.729635]     [bt] /usr/local/sbin/pvfs2-server [0x433a3b]
03:12PM 
elventails
 [E 15:48:11.729684]     [bt] /usr/local/sbin/pvfs2-server(main+0xf6b) [0x40e31b][E 15:48:11.729698]     [bt] /lib64/tls/libc.so.6(__libc_start_main+0xda) [0x2aaaaafef5aa]
03:12PM 
elventails
 [E 15:48:11.729712]     [bt] /usr/local/sbin/pvfs2-server [0x40befa]
03:12PM 
elventails
 [E 13:17:54.836076] src/proto/PINT-le-bytefield.c line 573: lebf_decode_req: improper input buffer size: 0x1f9dd48 != 0x1f9dd18 + 76
03:12PM 
elventails
 so the 1.4 server was stopped
03:12PM 
elventails
 I restarted it
03:13PM 
elventails
 and the client needed restarting too (otherwise it was giving a too many filesystems mounted or something like that)
03:13PM 
elventails
 so I was wondering how stable 1.4 is
03:13PM 
elventails
 and whether we should stick to 1.3.2
03:13PM 
slang
 elventails: 1.4 has been pretty stable
03:14PM 
slang
 elventails: we haven't gotten any serious bug reports since its been out
03:14PM 
elventails
 well - i think :q
03:14PM 
elventails
 that
03:15PM 
elventails
 i got something to report
03:15PM 
elventails
 cause the log says Mar 22 18:20:43 fs00 kernel: BUG! Please contact pvfs2-developers@beowulf-underground.org
03:15PM 
slang
 elventails: the over the wire protocol changed from 1.3.2 to 1.4 I believe
03:15PM 
elventails
 this is for another event that happened a few days back
03:16PM 
elventails
 what do you mean by that?
03:16PM 
elventails
 I had sent out a question asking about compatibility between the 1.3.x/1.4 client/servers but had received no replies..
03:16PM 
elventails
 note: where the client/servers can be running on ppc/intel
03:16PM 
slang
 elventails: but I think 1.3.x clients should work with 1.4 servers..
03:17PM 
elventails
 so are you running 1.4 on your bgl?
03:17PM 
elventails
 or both?
03:19PM 
slang
 elventails: hmm..rjl should know the answer to that
robl
 elventails: still running 1.3.2 (client and servers)
03:20PM 
53elventails
 robl: hi!
robl
 elventails: hello
03:21PM 
53elventails
 robl: i've been looking into 1.4 last week and so far it hasn't been that stable
03:22PM 
elventails
 i'll forward the logs I got to the mailing list
03:22PM 
elventails
 but I was wondering whether it was worth sticking with 1.4 for bgl - or putting 1.3.2 for this new partition - since it needs to start holding production runs soon
03:23PM 
elventails
 is there any serious benefit for using 1.4 now over 1.3.2?
03:23PM 
elventails
 e.g. in a bgl environment?
robl
 elventails: the biggest improvement would be slang's small-io optimizations
robl
 elventails: which might help a lot on bgl... i haven't benchmarked it though
robl
 (because we haven't installed 1.4, and because i've been doing other stuff)
03:25PM 
elventails
 ok - thx - i guess we might fall back on 1.3.2 for now - will see
03:26PM 
elventails
 in both cases - i'll be benchmarking pvfs2 here - 
03:26PM 
elventails
 so it will be nice to stay in touch and compare results
robl
 elventails: are you running zeptoos?
03:26PM 
elventails
 I guess you posted the ones on the anl wiki?
03:26PM 
elventails
 yes
robl
 elventails: or did you roll your own pvfs2 deployment?
robl
03:26PM 
elventails
 through zepttos
03:27PM 
elventails
 what are the tyipcal arguments you use when running bonnie++?
03:27PM 
elventails
 it would be nice to have them posted on that benchmark page
03:27PM 
elventails
 so that I can easily compare
robl
 elventails: hm. i don't know. I don't run bonnie++ on pvfs2 very much since it's not typical of scientific workloads.  when i do, i just run it with the default parameters
03:35PM 
elventails
 cool - thx
robl
 elventails: mpi-io-test (part of pvfs2) is a good way to get an upper-bound for performance, but there's no reason 1.4.0 should be much different from 1.3.2 for that workload
robl
 elventails: sorry for not getting back to you about 1.3.2 vs 1.4.0.  just dropped the ball there
robl
 ah, those bonnie++ nubmers on http://www-unix.mcs.anl.gov/~robl/bgl/pvfs2.html are for the storage disks
robl
 in theory you could take 'block sequential', multiply by the number of I/O servers, and that would be your upper bound for PVFS2 performance
robl
 (but in practice we usually see only 50% of that)
03:42PM 
53elventails
 robl: np for the compatibility thing
03:42PM 
53elventails
 robl: so from what i understand the servers are backward compatible but not the clients?
03:43PM 
slang
 elventails: from 1.3.2 to 1.4 that's true
03:43PM 
slang
 elventails: other releases may be different
03:44PM 
elventails
 slang: thx
03:47PM 
elventails
 this is a log of a crash on the 1.4 server some time back - wasn't sure how useful this would be for you
03:47PM 
elventails
 http://elventails.com/joy-pvfs2-1.4-crash-log
03:48PM 
elventails
 this happened when the client "froze" (e.g wasn't responding to ls /data/P2)
03:48PM 
elventails
 umounting the fs would stall too
03:49PM 
elventails
 this was with the 1.4 client
03:49PM 
elventails
 i though i'd share it with you guys now just in case there's anything useful there
03:49PM 
elventails
 *thought
robl
 elventails: this with SLES 9?
03:51PM 
elventails
 elventails: fs00:~ # cat /etc/issue
03:51PM 
elventails
03:51PM 
elventails
 Welcome to SUSE LINUX 10.0 (X86-64) - Kernel \r (\l).
robl
 ok, cool. our BGL is suse 9
03:52PM 
elventails
 hehe
robl
 elventails: this is on the login nodes?
 SWAP: No such window: 10
robl
 it might be related to kernel aio
04:04PM 
elventails
 this is on the fileservers
robl
 elventails: what does uname -r report?
04:05PM 
elventails
 2.6.13-15-smp
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
robl
 huh, yeah, i cry uncle.  maybe the mailing list knows
robl
 elventails: do you work with Andrew Pochinsky ?
04:16PM 
53elventails
 robl: yes
04:16PM 
53elventails
 robl: you guys know each other?
robl
 elventails: i've met him once, but mostly I know him from the mailing list
04:18PM 
53elventails
 robl: I joined almost 2 months back - I used to work in Edinburgh, EPCC
robl
 elventails: big change
04:19PM 
elventails
 in what sense? :)
robl
 elventails: well, country mostly
04:20PM 
elventails
 yeah - haven't been drinking much here lately
04:20PM 
elventails
 meeting at the pub was heavily part of the culture back there
04:21PM 
elventails
 u been to Edinburgh?
robl
 elventails: nope, would like to though
04:31PM 
elventails
 lovely place
04:31PM 
elventails
 boston wasn't such a big difference really
04:32PM 
elventails
 i also knew it as a tourist - so the terrain wasn't that different
04:33PM 
elventails
 u guys in chicago right?
robl
 right.  live in chicago, work about 25 miles SW of the city
05:15PM 
elventails
 i rebuilt the pvfs2 servers (with 1.3.2)
05:15PM 
elventails
 mounted them on bgl and ran an mpi-io-test
05:15PM 
elventails
 all fine -
05:15PM 
elventails
 except for one client
05:15PM 
elventails
 where /etc/init.d/pvfs2-client start
05:15PM 
elventails
 fails with [E 18:01:10.612077] Failed to mount via host fs04.bgl:3340
05:15PM 
elventails
 [E 18:01:10.612112] Mount failed: Protocol not available
05:15PM 
elventails
 although mounting from the command line works - i.e mount -t pvfs2 tcp://...etc..
05:16PM 
elventails
 "protocol not available".. is it not seeing the "tcp" in some config file?
05:17PM 
slang
 elventails: did you do pvfs2-client start with the right privs?
05:17PM 
elventails
 /etc/sysconfig/pvfs2/clients/fs-P2.conf
05:17PM 
elventails
 has PROTOCOL=tcp
05:17PM 
elventails
 slang: root
robl
 elventails: the mount syntax is really really picky
robl
 elventails: is there a port number in /etc/init.d/pvfs2-client ?
05:19PM 
elventails
 the script doesn't have a port number it seems
05:19PM 
elventails
 but I'm using port number 3340
05:20PM 
elventails
 i.e. a different one that's specified in the etc files
05:20PM 
50* 
53elventails/#pvfs2 
is debugging the script to check that its getting the right args
robl
 mount -t pvfs2 tcp://testhost:3334/pvfs2-fs /mnt/pvfs2
robl
 unfortunately, all fields have to be present. there's no way for mount to guess the right values
05:21PM 
elventails
 yeah - clearly the script isn't getting the port #
05:22PM 
elventails
 cause the command line (like the one u just wrote works fine)
05:27PM 
elventails
 hmm - is the /etc/init.d/pvfs2-client script supplied by you guys?
05:27PM 
elventails
 how does the client know which port to access?
05:33PM 
elventails
 actually i'm wrong about the script not knowing the port number..since the logs say
05:33PM 
elventails
 [E 18:01:10.611992] PVFS_sys_fs_add: Failed to initialize any appropriate BMI methods.
05:33PM 
elventails
 [E 18:01:10.612077] Failed to mount via host fs04.bgl:3340
05:33PM 
elventails
 [E 18:01:10.612112] Mount failed: Protocol not available
05:42PM 
elventails
 okie - figured it out - my bad
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3601:59am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
robl
 hozer: hey. back for more IB hacking?
10:27AM 
hozer
 yep
10:27AM 
hozer
 well, I was going to see if pw was around
robl
 hozer: he's only on IRC if you drag him onto it
10:33AM 
hozer
 I'm noticeing that
10:33AM 
hozer
 what sort of systems do people tend to run pvfs servers on
10:35AM 
hozer
 I am wondering what the peak bandwith out of a single server
10:35AM 
hozer
 that people have been seeing
robl
 well, when the disks are the crappy hard drives in the jazz compute node, we get 50% of peak (as measured by bonnie++ block sequential throughput)
robl
 i'm afraid that's all the quantitative data i've got offhand
10:40AM 
hozer
 okay
10:40AM 
hozer
 we have servers that are getting close to 600mb/sec with DD
robl
 wow, that's awesome
robl
 we have servers that get close to 20 MB/sec :>
10:48AM 
hozer
 yeah
10:48AM 
hozer
 except I'm afraid I'm going to be limited by overhead in kernel->userspace copies to pvfs-server
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
12:27PM 
elventails
 hi - running the suite of mpi-io-test and the results don't look too good
12:27PM 
elventails
 still - the system/filesystem hasn't been tweaked at all yet
12:28PM 
elventails
 do you know what CIOD_RDWR_BUFFER_SIZE your using on BGL?
robl
 elventails: how many compute nodes to io nodes?
12:28PM 
elventails
 128
robl
 elventails: we use 4 MB
12:28PM 
53elventails
 robl: ok - we're still on the default 87600 bytes I think - I'll start by changing that - it should give a decent improvement right?
robl
 elventails: seems to work ok for 32 compute nodes per io node.  we can go as high as 8 before the io node chokes
robl
 elventails: oh man, the default 87k is definitely gonna kill performance
12:29PM 
elventails
 cool - did you try 256k, 512k, etc..
12:30PM 
elventails
 any figures out there/papers/presentation showing the results of varying the buf size?
12:35PM 
elventails
 actually - another question - are you running LVM across your fileservers?
12:36PM 
elventails
 specifically, did you play around with the volume's groups PE size?
robl
 elventails: i didn't play around too much with CIOD_RW_BUFFER_SIZE, only to see that making it bigger helped large i/o
robl
 elventails: and i was lazy and did not graph the data
robl
 elventails: we are not running LVM.  hardware raid
12:42PM 
elventails
 thanks
robl
 elventails: i'm absolutely sure you could tweak LVM settings and have a great impact on pvfs2 performance
12:42PM 
elventails
 yeah - another layer of things to play around with - a great birthday cake :)
12:43PM 
elventails
 i'll post some results as soon they're out
robl
 elventails: that would be great
robl
 pcarns: did you ever get Differential profiles with opreport working
01:49PM 
53pcarns
 robl: not sure what a differential profile is (which probably answers your question) :)
robl
 pcarns: ok, the oprofile docs make it sound really cool but i can't reproduce it ..  http://oprofile.sourceforge.net/doc/opreport.html#opreport-diff
robl
 stupid oprifile... you always tempt me into thinking i'll get useful information out of you!
01:54PM 
pcarns
 oh, no we didn't try that,
01:54PM 
pcarns
 we just did a opcontrol --reset between every run,
01:54PM 
pcarns
 and just compared snapshots manually
01:55PM 
pcarns
 we used the --seperate-kernel to be able to show library and kernel accesses attributed to particular processes rather than as one big lump, that is probably the only interesting feature we really played with
01:55PM 
53pcarns
 robl: I have kind of a strange question
01:56PM 
53pcarns
 robl: do you guys have any small changes or anything laying around that need to go into trunk (not counting any patches from us)?  I need a change in the tree from you guys to test out some new merge processes down here :)
01:57PM 
53pcarns
 robl: we just switched to subversion and I did one vendor merge last night, but need to do another one to try some stuff out
01:58PM 
53pcarns
 robl: doesn't matter what it is (could be one line change)
robl
 pcarns: nothing's pending, but i'll make some changes for you to play with
02:04PM 
53pcarns
 robl: many thanks!
robl
 pcarns: that change enough for you or do you need something more?
02:28PM 
53pcarns
 robl: thats perfect- thanks!
03:11PM 
53elventails
 robl: where do you actually set CIOD_RDRW_BUFFER_SIZE from? the S50ciod file?
03:12PM 
elventails
 I took a peek at /etc/sysconfig/ciod that's on the IO nodes through allocating a block and redirectiing IO with the MMCS console - and it seems to be already set to 4MB - but I can't find from where..
03:23PM 
elventails
 I see - we have 8 Gb links from the fileservers to the switch
03:24PM 
elventails
 so we already have an upper bound of 1GB i guess..
03:25PM 
elventails
 what's the interconnect bandwidth on your side?
robl
 elventails: ZeptoOS sets CIOD_RW_BUFFER_SIZE somewhere in its init scripts (it's been a while so i forget where exactly)
robl
 we have gige links, too. not sure what the bisection bandwidth is
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57ChanServ
: #pvfs2 
Shutting Down
56ChanServ 
36ChanServ@services.
 has joined #pvfs2
51ServerMode
36#pvfs2 
57+o ChanServ
 by 
57irc.freenode.net
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3605:18am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
11:24AM 
slang
 pcarns: fyi, I'm still trying to fix the problem where keyval entries weren't getting deleted properly
11:24AM 
slang
 pcarns: my solution is to do iterate over all the keyvals for a handle (in remove.sm) and then delete them one at a time
11:25AM 
slang
 pcarns: that way we get rid of xattr keyvals as well
11:25AM 
slang
 pcarns: at the state machine doesn't seem to want to do recursive states..
11:27AM 
slang
 pcarns: that should be 'at the moment the state machine...'
01:02PM 
pcarns
 slang: so you are doing the deletes at the state machine level rather than inside of trove?
01:02PM 
pcarns
 slang: (sorry, was out to lunch for a while)
01:08PM 
slang
 pcarns: no worries
01:14PM 
pcarns
 slang: would it be possible to just delete the keys from within trove? 
01:15PM 
slang
 pcarns: you mean break the trove abstraction bits
01:15PM 
slang
 pcarns: ?
01:16PM 
50* 
53slang/#pvfs2 
managed to generate an error code he hasn't seen before:
01:16PM 
50* 
53slang/#pvfs2 
| rm: cannot remove `t1': Machine is not on the network
01:19PM 
pcarns
 slang: haha- you didn't know your db keys were being copied over the network? :)
01:19PM 
pcarns
 slang: I was just thinking of keeping the old trove semantics, where if you destroy a dspace it takes all of the keys with it implicitly rather than having to manually delete them
01:19PM 
slang
 pcarns: who knows what's happening underneath my gets and puts
01:20PM 
slang
 pcarns: ah
01:20PM 
slang
 pcarns: so add keyval code to the dspace code?
01:21PM 
slang
 pcarns: my impression of the way the interfaces were designed is that was a no-no
01:22PM 
pcarns
 slang: oh, I don't know- I never really thought of the different pieces below the trove api as being abstracted from each other...
01:22PM 
pcarns
 slang: but I'm not sure
01:23PM 
pcarns
 slang: oh, you mean calling the API from underneath the api?
01:23PM 
pcarns
 slang: yeah, I wouldn't do that, I was thinking make berkeley db calls from within the dspace code to clean up
01:24PM 
slang
 slang: right
01:24PM 
slang
 slang: I guess I always looked at the dspace and keyval pieces as completely separate
01:24PM 
slang
 pff
01:25PM 
slang
 pcarns: I had meant to talk to you not myself
01:25PM 
pcarns
 slang: hehe
01:26PM 
pcarns
 slang: yeah, I don't know about the seperation, might be a question for robr- I think all of that stuff is still more or less in the layout he came up with
02:27PM 
slang
 pcarns: is it not possible to set non-zero error-codes and return 0 from a state?
02:27PM 
slang
 pcarns: i.e. js_p->error_code = STATE_TYPE_DATAFILE; return 0;
02:28PM 
slang
 pcarns: the state machine code seems to ignore my error_code value
02:29PM 
slang
 it looks like the job_status for that operation gets reset in the job_test code
02:29PM 
slang
 which makes sense I guess
02:29PM 
slang
 but kind of limiting..
02:39PM 
pcarns
 slang: yeah, you can either get the status by setting it manually and returning 1 in your sm function, _or_ you can post a job and have it fill in the status when it finishes; not both
02:39PM 
slang
 pcarns: right
02:39PM 
pcarns
 if you need to carry some information across sm functions but also want to get the job status, then you need to add a flag to the s_op structure and stick it there
02:39PM 
slang
 pcarns: so I need a separate state just to go to where I can set the error_code back to zero and return
02:40PM 
pcarns
 slang: depends on what you are doing, but that may be the case
02:41PM 
pcarns
 slang: keep in mind that the status value is what determines what transition you take too, so you can't really overload it much
02:41PM 
slang
 pcarns: in this case I'm trying to use it to take a different transition
02:42PM 
pcarns
 slang: sounds like you would want to set your status value and return 1, then have the next state be the one that posts the job
02:43PM 
pcarns
 slang: but I would probably need to see sm to understand better
02:43PM 
slang
 pcarns: its in the remove code...right now I jump to get_keyvals from remove_dspace after it completes
02:43PM 
slang
 pcarns: but if the handle is a datafile, there are no keyvals to remove
02:44PM 
slang
 pcarns: so I'm just going to set error_code and return at the beginning of get_keyvals
02:44PM 
slang
 pcarns: and then have a separate cleanup state to jump to that sets the error_code back to zero before returning
02:44PM 
slang
 pcarns: unless you have a better way to do that of course ;-)
02:45PM 
pcarns
 slang: ah ok, I see
02:46PM 
pcarns
 slang: sounds like that would work
02:46PM 
pcarns
 slang: the only other option would be to have a state that checks the type before the remove, and triggers different transition there (set error code and return 1),
02:46PM 
pcarns
 slang: so that you remove keyvals before removing dspace, and kind of avoid the funky transition
02:47PM 
slang
 slang: hmm yeah that makes sense
02:47PM 
pcarns
 if the type were datafile it would jump straight to remove dspace
02:48PM 
pcarns
 the state function that posts the remove wouldn't care what hte error_code coming in is, so  no cleanup step needed
02:49PM 
pcarns
 slang: I guess there will be a sync after each keyval remove, since they look independent from trove's point of view?
02:50PM 
pcarns
 slang: or is there a trove function to remove multiple keys at one time?
02:50PM 
slang
 pcarns: there's not, not
02:51PM 
slang
 pcarns: there's not, no
02:52PM 
slang
 pcarns: I was thinking about adding a new trove_keyval interface that would either allow removing a set of entries
02:53PM 
slang
 pcarns: or alternatively all the entries for the given handle
02:55PM 
pcarns
 slang: all of the entries for a given handle would be nice for this case :)
02:55PM 
slang
 pcarns: yep
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
robl
 wierd, oprofile says -dbpf-onekeyval spends a ton more time in the kernel
robl
 (ton more time than -HEAD)
robl
 i wonder if i'm archiving results the wrong way or doing something else
11:55AM 
53slang
 robl: yeah that seems strange
11:56AM 
53slang
 robl: I think I have alignment problems
01:42PM 
elventails
 hi - here are some of the first numbers i'm getting
01:42PM 
elventails
 http://elventails.com/BGL/pvfs2/
01:43PM 
elventails
 going to do another set of runs to verify them
01:43PM 
elventails
 but i think they should give a first impression of the current system status pvfs-wise
01:44PM 
elventails
 it seem to do well for small block sizes..
robl
 elventails: cool
01:44PM 
elventails
 any feedback appreciated
01:44PM 
elventails
 sill want to play around with so many different variables..including checking the switch
01:44PM 
elventails
 and LVM
robl
 the dropoff for large block sizes seems unusually bad, but I haven't run mpi-io-test on our BGL for a year now
01:47PM 
elventails
 i agree - i'm going to do another set of runs just to double check
01:47PM 
elventails
 i had started with your best case of 32mb on 1024..
01:47PM 
elventails
 and that didn't look good :)
01:48PM 
elventails
 which gives a lot of room for improvement hopefully :)
01:49PM 
elventails
 any other test runs you find useful? these are good to help me figure the different tuning parameters across BGl
robl
 elventails: mpi-io-test is a good starting point. should give an upper-bound for performance
robl
 after that, perofrmance is so application-driven that it's hard to suggest good benchmarks
02:13PM 
elventails
 yes - i agree - luckily enough our users run mainly Scidac QCD codes - so one of the next steps is looking there
robl
 elventails: quantum chromodynamcis? (i'm just googling here)
02:16PM 
53elventails
 robl: yep :)
02:17PM 
53elventails
 robl: http://www.linuxworld.com/story/48131.htm?DE=1
50* 
57robl 
's head explodes contemplating the color of anti-red
02:27PM 
elventails
 ?anti-red?
robl
 maybe this guy is misleading me
robl
 http://webphysics.davidson.edu/mjb/qcd.html
02:29PM 
elventails
 hehe
02:29PM 
elventails
 the particle adventure is fun actually
02:30PM 
elventails
 http://particleadventure.org/particleadventure/
02:30PM 
elventails
 ..a classic :P
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3612:34am
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hmmm. You know, I could do an April Fool's Day joke, but maybe instead we should make this a group effort. Let's all just go to irc.oftc.net channel #oftc, and tell them that freenode has shut down and has repointed its servers to OFTC, and ask if they're going to be adding more facilities to handle the load. 8)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Okay guys, thanks for the fun, let's let those poor guys on OFTC off the hook. :)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Okay guys, give the folks on OFTC a rest, it was a good joke, time to go home. :)
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. On behalf of my self and all 200 or so people who participated in that April Fool's prank on OFTC, please accept our apology. I know that when you're the person pranked, it doesn't seem all that funny. So, apologies and bygones!
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Erm, assuming anyone from OFTC is still here. 8)
SignOff 
57hozer
: #mklinux,#pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-217.asm.bellsouth.net (gaim)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 no pvfs2 april fools this year
robl
 too bad
12:39PM 
53elventails
 robl: :)
robl
 http://www.beowulf-underground.org/pipermail/pvfs2-developers/2005-April/001160.html
12:50PM 
elventails
 lol
01:11PM 
slang
 pcarns: hey phil are you around?
01:15PM 
pcarns
 slang: hey, I'm here
01:16PM 
slang
 pcarns: hi
01:16PM 
slang
 pcarns: just wondering how the dspace db gets synced when meta sync is off
01:16PM 
pcarns
 slang: what's up?
01:16PM 
pcarns
 slang: I don't think it ever does :)
01:17PM 
slang
 pcarns: ah
01:17PM 
slang
 pcarns: ok
01:17PM 
slang
 pcarns: it didn't look like it
01:17PM 
slang
 pcarns: there's no dspace_flush
01:17PM 
pcarns
 slang: yeah, turns out it is pretty dangerous
01:17PM 
slang
 pcarns: so even the flush operation doesn't do it
01:18PM 
pcarns
 slang: oh, ok
01:18PM 
slang
 pcarns: I was thinking of adding a dspace_flush
01:18PM 
pcarns
 slang: never thought about that- that would make sense to have a flush operation
01:18PM 
slang
 pcarns: and then do dspace_flush from flush.sm
01:18PM 
pcarns
 slang: seems reasonable,
01:19PM 
slang
 pcarns: also I'm adding a meta-sync timer that will flush periodically (keyval and now dspace) if the meta-sync option is off
01:19PM 
pcarns
 slang: but you would probably also want to add the check at creation time to make sure that old .bstream files aren't laying around
01:19PM 
pcarns
 slang: bogus bstream files are the biggest danger we ran into when testing with meta sync disabled
01:20PM 
pcarns
 slang: the timer would be cool, particularly if the time interval is configurable from conf file
01:20PM 
slang
 pcarns: right
01:21PM 
slang
 pcarns: I guess the open cache did something similar in the past
01:21PM 
pcarns
 slang: similar to what?
01:21PM 
slang
 pcarns: when open fds and bds got pushed out of the cache they were flushed at that point
01:21PM 
pcarns
 slang: ohh, not sure
01:21PM 
pcarns
 slang: I don't think they were actually, but they may have been
01:22PM 
slang
 pcarns: isn't that why old bstream files remain after removes?
01:22PM 
pcarns
 slang: no, it just seems like creating new files on ext3 seems to not need a flush to stick around after a crash- but changes to an existing db file do
01:23PM 
slang
 pcarns: oh I see
01:23PM 
pcarns
 slang: ie, you are more likely to lose changes to particular blocks than lose an entire file
01:23PM 
pcarns
 slang: I guess something in the kernel or somewhere tends to flush things that modify the name space more so than data buffers
01:24PM 
slang
 pcarns: so what should create do if it finds old bstreams that it doesn't know about? just delete them?
01:24PM 
pcarns
 yes
01:24PM 
pcarns
 slang: in my opinion
01:25PM 
pcarns
 slang: we don't have enough information to rescue them in any useful way, I don't think
01:25PM 
slang
 pcarns: could try to recover with default attributes I guess
01:25PM 
pcarns
 slang: pvfs1 used .saveme files, but everyone always just deleted them anyway
01:25PM 
pcarns
 *shrug*
01:26PM 
slang
 pcarns: ok I'll delete them for now, maybe send an email about it later :-)
01:26PM 
pcarns
 slang: once you hit the point where you discover an existing .bstream file that collides with something you want to create, you have the additional problem of needing to back up a little and pick a new handle
01:26PM 
pcarns
 slang: if you try to save the old bstream, that is
01:27PM 
slang
 pcarns: ah right
01:27PM 
pcarns
 slang: we could have a conf file option to enable "saveme" mode :)
01:28PM 
pcarns
 slang: at acxiom they actually had to write scripts to delete the old .saveme files on pvfs2 because some of them would be huge if a server crashed while you were trying to delete a multi-terabyte file
01:28PM 
pcarns
 slang: err, pvfs1, not pvfs2
01:29PM 
slang
 pcarns: heh
01:30PM 
slang
 pcarns: rewrite open to return an fd to /dev/null if fname==*.saveme?
01:30PM 
pcarns
01:58PM 
slang
 pcarns: I don't know that I can check if the bstream files are there
02:01PM 
pcarns
 slang: no?
02:01PM 
slang
 pcarns: maybe I can
02:01PM 
slang
 pcarns: jumped the gun on that one
02:01PM 
pcarns
 slang: maybe an access() check within dspace create fn?
02:01PM 
pcarns
 slang: ok
02:02PM 
slang
 pcarns: kind of breaks the open cache stuff though
02:05PM 
pcarns
 slang: it does?
02:05PM 
slang
 pcarns: since whether the file exists or not is hidden in open_fd..
02:06PM 
pcarns
 slang: oh, ok- would it need like a truncate flag or something passed to it at create time so it knows that the file shouldn't exist (or should at least be empty) at that point?
02:07PM 
pcarns
 slang: actually, that may be slightly better anyway rather than having an extra system call to check existance
02:07PM 
slang
 pcarns: yeah I guess that would work
02:07PM 
pcarns
 slang: I don't know, just throwing ideas out there
02:07PM 
slang
 pcarns: except will that cause touch to behave badly?
02:08PM 
pcarns
 slang: how so?
02:08PM 
slang
 pcarns: touch is supposed to just update timestamps, not truncate the file to zero right?
02:09PM 
slang
 pcarns: I guess it depends on how we implement it
02:09PM 
pcarns
 slang: yeah, but I don't think trove would tell the open cache to use truncate mode in that case
02:10PM 
slang
 pcarns: ok
02:10PM 
pcarns
 slang: the dspace db entry gets created before the bstream file anyway, right? so you should be able to tell if the bstream file is supposed to exist
02:11PM 
pcarns
 we really just need to catch the particular case where the db entry does not exist but the bstream file does
02:11PM 
slang
 pcarns: err...from the client?
02:11PM 
pcarns
 slang: no, I don't think the client knows about any of that
02:11PM 
slang
 pcarns: what about all the servers that are just data servers?
02:11PM 
pcarns
 slang: it just asks the server to create a datafile
02:11PM 
pcarns
 slang: even the data servers have to have something in the db to say that the file exists, in addition to jsut having the bstream file ther
02:12PM 
pcarns
 slang: that's why we have the opportunity for skewed state: a data server who's db entries don't match what bstream files are there
02:12PM 
pcarns
 its ok to have a db entry but no bstream file but not the other way around
02:12PM 
slang
 pcarns: ok
02:13PM 
slang
 pcarns: I didn't realize that data servers wrote dspace attrs as well
02:13PM 
pcarns
 slang: the client, or the server for that matter, don't really realize the seperation between the db and the flat file
02:13PM 
pcarns
 slang: yeah, they do- no attributes are set except for the "type" field though
02:14PM 
pcarns
 slang: it doesn't fill in the uid, gid, or any of that stuff
02:14PM 
slang
 pcarns: why is necessary to store the type?
02:14PM 
slang
 pcarns: doesn't that get passed along in the requests?
02:15PM 
pcarns
 slang: I guess it isn't technically
02:15PM 
pcarns
 slang: but the trove design assumes that every object is going to have an attr structure
02:15PM 
pcarns
 slang: the iterate_handles functions for example use that as an indication of what files exist (by iterating through the dspace db)
02:16PM 
slang
 pcarns: wouldn't creates be a lot faster if we didn't have to do that?
02:17PM 
pcarns
 slang: I guess so, now that we know how expensive the db syncs are relative to everything else
02:26PM 
pcarns
 slang: might be worth considering if we don't really need the type field
02:26PM 
pcarns
 slang: I guess we could even make it implicit- if you ask for attribs on an object, and it finds that the bstream file is there but the dspace attr isn't, then it "makes up" an attr structure with the type set to dfile
02:27PM 
pcarns
 slang: would look the same from the trove user point of view but wouldn't need a sync on create
02:29PM 
slang
 pcarns: why is the dspace attr needed for the datafile at all?
02:29PM 
slang
 pcarns: is it just a 'for future use' kind of thing?
02:30PM 
pcarns
 slang: I don't think any technical reason, but some stuff depends on it now, for example
02:30PM 
pcarns
 slang: you have to do a getattr on a datafile object to find out its size (its a dynamic field that gets filled into the attr structure as if it came off of disk that way)
02:30PM 
slang
 pcarns: ah right
02:31PM 
pcarns
 slang: but yeah, I don't think there is any practical technical use for having true attributes on a datafile
02:31PM 
slang
 pcarns: and I guess dspace_create is the only way to get a handle for it
02:31PM 
pcarns
 slang: from the api point of view yes, I think you would still want to do a dspace_create to create it, regardless of what's happening with db or file under the covers
02:32PM 
slang
 pcarns: right
02:32PM 
pcarns
 slang: and you would need to make sure that the iterate_handles functions still showed the datafile as a full fledged object (right now it depends on the dspace db entry)
02:32PM 
pcarns
 slang: would need to readdir in bstreams directories to find them instead of iterating through db
 SWAP: Window 3 is not hidden!
02:35PM 
slang
 pcarns: oh I see
02:35PM 
slang
 pcarns: that's maybe not so nice
02:35PM 
slang
 pcarns: maybe the coalescing syncs solution is a better answer
02:39PM 
pcarns
 *shrug* I don't know
02:40PM 
pcarns
 slang: how is the time frame looking on the dbpf merge to trunk, by the way?  Still a good ways off?
02:41PM 
slang
 pcarns: I could do it now probably..
02:41PM 
slang
 pcarns: I was going to add the sync timer stuff first but I can merge if it makes life easier for you guys
02:45PM 
pcarns
 slang: would the sync timer stuff change on disk compatibility any?
02:45PM 
pcarns
 slang: and did you guys get some perf results to be comfortable w/ the merge?
02:47PM 
slang
 pcarns: I've gotten some preliminary results that are encouraging
02:47PM 
pcarns
 slang: we are interested b/c we are supposed to go code complete on our supported version of pvfs2 here around the end of this week,
02:47PM 
slang
 pcarns: got them about 10 mins ago :-)
02:47PM 
pcarns
 slang: if the trunk merge happens before then, then we will take those changes and include them in our testing that follows, otherwise we will have to wait before we can do anything with it for stability reasons
02:48PM 
pcarns
 slang: cool about the perf results
02:48PM 
slang
 pcarns: let me send an email and see if there are any objections about merging now
02:48PM 
pcarns
 slang: ok, I don't want you to feel like I am rushing you guys,
02:48PM 
pcarns
 slang: but I just figured it wouldn't hurt to ask
robl
 the only oddity is that the onekeyval nightly tests on gil (yeah a real workhorse, that one) take 60% longer than HEAD
robl
 but since nightly tests are for correctnes and not perf, i'm not saying it's a real issue. just a curiosity
02:52PM 
50* 
53slang/#pvfs2 
shrugs
02:52PM 
53slang
 robl: more code to build? ;-)
02:52PM 
53pcarns
 robl: are you guys running on any other boxes?
robl
 pcarns: now that they all pass on gil i'll try jazz again
 SWAP: Window 3 is not hidden!
02:57PM 
53pcarns
 robl: cool
03:21PM 
53pcarns
 robl: thanks again for sticking some commits in last week to help us test some stuff,
03:21PM 
53pcarns
 robl: fwiw, we are really pleased with subversion so far
robl
 pcarns: we'll convert to svn the day rross retires probably
03:22PM 
53pcarns
 robl: makes it easier for us to manage vendor merges, and so far is better at generating patches too
robl
 pcarns: cool! those are svn advantages i had not heard before
03:23PM 
53pcarns
 robl: heh, we didn't run into significant enough reasons to bother taking the time to switch until pretty recently
03:25PM 
53pcarns
 robl: the biggest vendor merge difference is that svn is nice enough to let you drop the new merged code into one big tree and look at it (resolving conflicts etc.) before you have to commit anything at all
03:26PM 
53pcarns
 robl: with cvs we had a period of madness during vendor merge, because it would put some stuff in the tree in one commit, then you have to fix conflicts in another commit, etc.
03:26PM 
53pcarns
 robl: now its atomic, and a good bit safer
03:26PM 
53pcarns
 robl: on generating patches, its just good because we don't have to use cvsps anymore
03:27PM 
53pcarns
 robl: cvsps can get terribly confused when you have enough branches running around, particularly vendor branches
03:27PM 
53pcarns
 robl: cvsps can't always tell where change sets come from- the authors just didn't think about all of those cases, I believe
robl
 pcarns: good to know! i always assumed that cvsps was "close enough" to svn changesets
 SWAP: Window 3 is not hidden!
03:54PM 
53pcarns
 robl: yeah, svn will pretty much do what cvsps does with a little bit of wrapper script, but does a better job
03:55PM 
53pcarns
 robl: you have to use a wrapper script because the normal svn diff commands won't let you just cherry pick an arbitrary set of disjoint commits- you have to glue that together yourself by doing a diff for each commit and combining them into the same patch
03:56PM 
53pcarns
 robl: nothing 10 lines of perl won't fix
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Hi all. We're working on the problems with Tor abuse. We ask that you only ban "*@tor/session/*", rather than adding a global ban on "*@tor/*" . Freenode continues to support the Electronic Frontier Foundation's Tor project and will work on ways to filter out the abuse without causing problems for legitimate users.
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Our policy on Tor is here: http://freenode.net/policy.shtml#tor .... thanks!
55lilo
35i=levin@freenode/staff/pdpc.levin
50)-
 [Global Notice] Clarification: we definitely don't recommend you ban tor nodes if you can avoid doing so; if you do need to, we recommend you quiet them (+q instead of +b). And we recommend you make those quiets temporary. Please be aware: there are a number of legitimate Tor users on the network. Thanks!
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
56pw_ 
36n=pw@quasar.osc.edu
 has joined #pvfs2
53#pvfs2     
57pw_       
36H   
n=pw
quasar.osc.edu (pw)
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-217.asm.bellsouth.net (gaim)
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
robl
 pw_: hey. hozer keeps looking for you :>
01:26PM 
 I can't seem to manage to pay much attention to this irc thing, even when I do remember to start it up.
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
02:38PM 
 heya hozer.  I was doing the kerberos thing fine, just wanted you to shut up the legalese on every login.  No hope on that, I figure.
02:51PM 
hozer
 ssh -q
02:51PM 
hozer
 did you get an email from me today?
02:51PM 
hozer
 I found a way to shut it up from .ssh/config
02:51PM 
hozer
 did you get logged into p5l1 ?
02:52PM 
hozer
 I was going to try to look at that endian thing sometime, but I have about 3 other things I need to do first
02:52PM 
 msg nickserv identify pw
02:52PM 
hozer
 .. and I'm going to a (late) lunch
02:52PM 
50* 
53hozer/#pvfs2 
hands pw a /
02:53PM 
hozer
 bbl..
02:53PM 
 hozer
  did not find that your changes to .ssh/config shut it up, hence my confusion.  I will also go try p5l1 now.  (Thanks for the /, this irc stuff is too tough.)
02:53PM 
hozer
 hrrm.. does 'ssh -q' shut it up?
02:54PM 
 I'll be damned, it does.  Except for these two lines it is very nice now:
02:54PM 
 id: cannot find name for group ID 34205
02:54PM 
 id: cannot find name for group ID 43847
02:55PM 
hozer
 that looks like AFS pag ID's..
02:55PM 
hozer
 I don't seem to get that, and I'm not sure why
02:55PM 
hozer
 I am using this ssh version:
02:55PM 
hozer
 troy@talia:~$ ssh -v
02:55PM 
hozer
 OpenSSH_4.2p1 Debian-5, OpenSSL 0.9.8a 11 Oct 2005
02:55PM 
hozer
 ... bbl
02:55PM 
 here:  OpenSSH_4.3p2, OpenSSL 0.9.8a 11 Oct 2005
02:56PM 
 LogLevel QUIET  makes me mostly happy, thanks.
SignOff 
57pcarns
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57pw_
: #pvfs2 
"pw_ has no reason"
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
10:02AM 
pcarns
 slang: do you happen to know where the INTPTR_MIN definition is coming from in your 2.6 kernel version?
10:02AM 
pcarns
 slang: just wondering if there is something that replaced it that we could grab,
10:02AM 
pcarns
 slang: otherwise I'll look at doing something like Nathan suggested
robl
 pcarns: what's check_common_0_0_1 supposed to do? and if it's not being used, is it ok to remove?
10:13AM 
53pcarns
 robl: hmm, it used to be used...
10:14AM 
53pcarns
 robl: ohh, I think Sam made some changes where it isn't necessary any more
10:14AM 
53pcarns
 robl: it was being used to figure out what "type" flag to stick on trove key/val pairs in new dbpf code
10:14AM 
53pcarns
 robl: so yeah, it can be removed
robl
 pcarns: ok, thanks
10:23AM 
53pcarns
 robl: that "common_key_names" array can be removed too
robl
 one more for you guys
robl
 aiocb_print
10:29AM 
53pcarns
 robl: heh, looks like a cleaner version of something I submitted in a patch, just isn't plugged into anything
10:30AM 
53pcarns
 robl: I would like it if something like that hung around (without build warning of course)
robl
 pcarns: ok, when either slang or i merge that patch, we'll use aiocb_print instead
10:40AM 
53pcarns
 robl: sounds good
10:40AM 
53pcarns
 robl: you might be able to make that function an inline or something if those strings are moved to global vars, so people don't complain about overhead (I didn't do that in my patch either though)
robl
 pcarns: hah. our overheads are in disk-head activity, not a couple extra symbols in the library :>
10:42AM 
53pcarns
 robl: hehe, I agree
10:56AM 
pcarns
 hmm, looks like we picked up a bunch of misc. warnings on x86_64 with the dbpf merge 
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
01:39PM 
slang
 pcarns: oh yeah lots of warnings
01:39PM 
slang
 pcarns: those can't be good
01:52PM 
pcarns
 slang: luckily most are easy to fix, just missing llu(...)'s and such
01:54PM 
50* 
53slang/#pvfs2 
nods
NetSplit: 
57irc.freenode.net
 split from 
57kornbluth.freenode.net 
3603:12pm
BitchX
: Press 
 to see who left 
 to change to [irc.freenode.net]
56pw_ 
36n=pw@quasar.osc.edu
 has joined #pvfs2
03:28PM 
hozer
 pw: how's 4 gigabits sound?
56KyleSchochenmaie 
36n=kschoche@ohm.scl.ameslab.gov
 has joined #pvfs2
03:44PM 
hozer
 there we go
03:46PM 
KyleSchochenmaie
 alright :-)
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
04:17PM 
 4 Gb/s is a big number.
04:18PM 
 p5l1 does not like me much
04:18PM 
 pw@p5l1:/$ cd ~pw
04:18PM 
 -bash: cd: /afs/scl/user/GUEST/pw: Permission denied
04:18PM 
 pw@p5l1:/$ ls -lad ~pw
04:18PM 
 drwxrwxr-x  7 mukul admin 2048 Apr  5 16:12 /afs/scl/user/GUEST/pw
04:19PM 
hozer
 run 'aklog'
04:19PM 
hozer
 hrrrm
04:20PM 
hozer
 someone messed up your userid
 KyleSchochenmaie 
n=kschoche@ohm.scl.ameslab.gov
 has left #pvfs2 
56KyleSchochenmaie 
36n=kschoche@ohm.scl.ameslab.gov
 has joined #pvfs2
04:25PM 
 pw@p5l1:/$ aklog -d         
04:25PM 
 Authenticating to cell scl.ameslab.gov (server hal.scl.ameslab.gov).
04:25PM 
 We've deduced that we need to authenticate to realm SCL.AMESLAB.GOV.
04:25PM 
 Getting tickets: afs/scl.ameslab.gov@SCL.AMESLAB.GOV
04:25PM 
 Using Kerberos V5 ticket natively
04:25PM 
 Identical tokens already exist; skipping.
04:25PM 
 pw@p5l1:/$ getent passwd pw
04:25PM 
 pw_
*:3129:4001:Pete Wyckoff:/afs/scl/user/GUEST/pw:/bin/bash
04:25PM 
 pw@p5l1:/$ getent passwd mukul
04:25PM 
 mukul:*:3126:4001:Mukul Sabharwal:/afs/scl/user/mukul:/bin/tcsh
04:25PM 
 pw@p5l1:/$ id
04:25PM 
 uid=3129(pw) gid=4001(scl) groups=4001(scl)
04:26PM 
hozer
 type 'tokens'
04:26PM 
 I would just set happy ACLs on ~pw if I could figure out how to do that...
04:26PM 
hozer
 fs sa
04:26PM 
 pw@p5l1:/$ tokens
04:26PM 
 Tokens held by the Cache Manager:
04:26PM 
 User's (AFS ID 3129) tokens for afs@scl.ameslab.gov [Expires Apr  9 08:47]
04:26PM 
    --End of list--
04:26PM 
hozer
 okay, you have the right afs id but wrong unix id
04:26PM 
 Oh, helpful.
04:26PM 
 fs la ~pw  says I have everything.
04:27PM 
hozer
 you should be able to 'cd ~pw' now
04:27PM 
 Yay, works and logged in and everything.  Still ~pw owned by mukul, but he's probably a friendly sort.
04:27PM 
hozer
 ... I'm going in to talk to kyle .. bbl..
04:31PM 
hozer
 now, if you can figure out the endian stuff, we can start testing on the IBM nodes ;)
04:34PM 
KyleSchochenmaie
 I got my netpipe module running over pvfs O:-)
04:34PM 
KyleSchochenmaie
 145: 134217725 bytes     45 times -->   5231.57 Mbps in  195734.58 usec
04:34PM 
 Yeah, I'm trying to find the openib build now so I can try compyling.
04:35PM 
 Latest hg changeset is 13, 30 mar, right?
04:38PM 
KyleSchochenmaie
 lemme check
04:39PM 
KyleSchochenmaie
 i had the permissions stuff fixed for your dir, it should work now
04:41PM 
KyleSchochenmaie
 yes
04:41PM 
KyleSchochenmaie
 kschoche@ohm:~/pvfs2/pvfs2-cvs-openib$ hg history | head
04:41PM 
KyleSchochenmaie
 changeset:   13:4def4a9c1d64
04:41PM 
KyleSchochenmaie
 tag:         tip
04:41PM 
KyleSchochenmaie
 user:        kschoche@ohm.scl.ameslab.gov
04:41PM 
KyleSchochenmaie
 date:        Thu Mar 30 11:17:21 2006 -0600
04:41PM 
KyleSchochenmaie
 summary:     made a few more changes, now have everything synced up w/ Pete's Code.
04:43PM 
 Great; got that.  What do you use for ./configure --with-openib=... ?
04:43PM 
 On p5l1, that is.
04:44PM 
KyleSchochenmaie
 ./configure --with-kernel=/usr/src/linux-2.6.16 --with-openib=/usr
04:44PM 
KyleSchochenmaie
 kschoche@ohm:/afs/scl.ameslab.gov/project/nodeimg/ppc64/usr/src/pvfs2-cvs-openib$ head config.log
04:44PM 
 duh, didn't think of /usr.  :)
04:56PM 
 Does p5l1 have an openib nic?
04:56PM 
 [E 16:52:07.451959] Error: BMI_ib_initialize: ibv_open_device error number: 0
04:58PM 
KyleSchochenmaie
 good question, lemme ask Troy real quick
05:12PM 
KyleSchochenmaie
 yes it has a mellanox card, but it's acking weird
05:13PM 
KyleSchochenmaie
 hey pete... p5l0 is 'working', try that instead of p5l1
05:13PM 
KyleSchochenmaie
 ..for now at least
05:14PM 
 That's got the uid issues, can you fix me there too?
05:14PM 
 opteron1$ ssh p5l0
05:14PM 
 Could not chdir to home directory /afs/scl/user/GUEST/pw: Permission denied
05:14PM 
 -bash: /afs/scl/user/GUEST/pw/.bash_profile: Permission denied
05:15PM 
KyleSchochenmaie
 you have to aklog manually for now
05:15PM 
KyleSchochenmaie
 :'(
05:19PM 
 Oh, I see what that is now, got it.
05:22PM 
KyleSchochenmaie
 you keeeled it!
05:22PM 
KyleSchochenmaie
 da10:/tmp# tail pvfs2-server.log
05:22PM 
KyleSchochenmaie
 [E 17:19:54.917894] Error: encourage_recv_incoming: unknown message header type 33554432 my bufnum 0 len 40.
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919138]     [bt] sbin/pvfs2-server(error+0xca) [0x44132a]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919155]     [bt] sbin/pvfs2-server [0x43e787]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919167]     [bt] sbin/pvfs2-server [0x43e9cf]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919178]     [bt] sbin/pvfs2-server(BMI_testunexpected+0x117) [0x41a347]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919189]     [bt] sbin/pvfs2-server [0x42301c]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919200]     [bt] /lib/libpthread.so.0 [0x2aaaaacd2b1c]
05:22PM 
KyleSchochenmaie
 [E 17:19:54.919211]     [bt] /lib/libc.so.6(__clone+0x73) [0x2aaaab19f273]
05:31PM 
 oops, just did pvfs2-ls one time.  I'll kill my own stuff then send you a patch.  Sholud have expected that.
SignOff 
57pw_
: #pvfs2 
"pw_ has no reason"
 KyleSchochenmaie 
n=kschoche@ohm.scl.ameslab.gov
 has left #pvfs2 
SignOff 
57laytonj
: #pvfs2 
"Leaving"
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
Netjoined: 
57irc.freenode.net kornbluth.freenode.net
56elventails 
36i=elventai@elventails.COM
 has joined #pvfs2
56slang 
36n=slang@harley.mcs.anl.gov
 has joined #pvfs2
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
56pw_ 
36n=pw@quasar.osc.edu
 has joined #pvfs2
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
56pcarns 
36n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has joined #pvfs2
53#pvfs2     
57pcarns    
36H   
n=pcarns
adsl-152-197-217.asm.bellsouth.net (gaim)
53#pvfs2     
57hozer     
36G   
n=troy
narn.hozed.org (gaim)
53#pvfs2     
57pw_       
36H   
n=pw
quasar.osc.edu (pw)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
01:08PM 
 Did anybody look at that set of patches from batayl@gmail?  The genconfig changes might be worth it, but not the rest.  I just feel bad about leaving him hanging, since he's trying to help.
robl
 pw_: and further, slang already did the same with his --ioports and --metaports patches
robl
 s/patches/changes/
robl
 pw_: i'll respond. thanks for reminding me
01:14PM 
 Oh, okay, thanks.
01:14PM 
 His rhel casts are completely wrong, but he could add llu() here and there if that's needed.
01:14PM 
 The whitespace changes we could all do without, although cleanup is always nice, this is just below the margin of interesting.
robl
 pw_: what about the "continue if pvfs2-ping finds a bad server" part?
01:18PM 
 I totally missed it buried in the whitespace changes.  Does it make sense to you?
robl
 pw_: heh. i almost missed it too. takiing a closer look at it now
01:19PM 
 Looks reasonable, just have to do it by hand since the patch is so hairy.
robl
 right. well, i'll try to let the guy down nicely :>
01:32PM 
pcarns
 hey guys
01:33PM 
pcarns
 fyi, batayl is one of us
01:33PM 
pcarns
 we can get the patched cleaned up based on some feedback, though
01:34PM 
pcarns
 we meant to have the whitespace seperate from the other changes, but I goofed something
01:34PM 
pcarns
 when donig some cvs->svn conversion, and it got combined
01:34PM 
pcarns
 I think I can seperate it though
robl
 pcarns: you guys and your lack of acxiom email addresses! :>
01:36PM 
53pcarns
 robl: yeah, its sneaky
01:36PM 
53pcarns
 robl: sorry if I didn't introduce him yet, can't remember who you guys have met
01:37PM 
53pcarns
 robl: but definitely just give some feedback on the patches, and I'll see if I can help get them cleaned up for another go at it
robl
 pcarns: done!
01:39PM 
53pcarns
 robl: are you interested in a seperated version of that one patch, or you just going to manually do the changes?
01:39PM 
pcarns
 on pvfs2-ping, that is
robl
 pcarns: i'll manually do it, that's cool
01:42PM 
53pcarns
 robl: awesome, thanks
01:43PM 
 The gmail thing is unnerving.  Not just batayl, but in general.  I tend to give those users lower credence due to their unwillingness to divulge their affiliation.  Maybe it's just curmudgenosity on my part though.
robl
 pw_: it's years and years of associating hotmail and aol and others with a low quality individual on the other end.  21st century prejudice i guess
01:53PM 
53pcarns
 robl: hehehe
01:53PM 
53pcarns
 robl: um, I guess another heads up- trohed is an acxiomer too
01:53PM 
53pcarns
 robl: he didn't even put his name in the email, I see
01:54PM 
53pcarns
 robl: probably the only patch you will ever see from him, we only manage to steal his time from another project long enough to get that one thing (state dumper) going
01:55PM 
53pcarns
 robl: batayl will be working with pvfs2 stuff more in the future
robl
 pcarns: cool. slang liked the state dumper i recal
robl
 pcarns: it's cool to have more acxiomers but i was kinda thinking pvfs2 had hit /. or something to get all these new patches all of a sudden :>
01:57PM 
53pcarns
 robl: it could use more improvements (ie, dumping stuff from more subsystems, and maybe a little more sophisticated output), but its pretty helpful in its current form
 SWAP: Window 3 is not hidden!
robl
 pcarns: is trohed's patch format indicative of typical svn patches?
robl
 pcarns: instead of a diff relative to HEAD, includes every incremental revision between point A and HEAD?
03:40PM 
pcarns
 its the same (I think?) as what we would have had to do with cvsps
03:40PM 
53pcarns
 robl: the problem is that those changes were scattered over a long time,
03:40PM 
53pcarns
 robl: so it wasn't just diff from A to B, because that would have caught a pile of other unrelated stuff
03:41PM 
53pcarns
 robl: we had to cherry pick revisions
03:41PM 
53pcarns
 robl: in retrospect that should have been done in a branch to isolate, but we didn't realize it was going to be in progress that long
robl
 pcarns: gotcha
robl
 pcarns: ok, cool. that makes sense
robl
 pcarns: tell trohed i'm really not as mean as the email i'm about to send makes me sound :>
03:56PM 
53pcarns
 robl: heh, ok
 pcarns 
n=pcarns@adsl-152-197-217.asm.bellsouth.net
 has left #pvfs2 
SignOff 
57hozer
: #pvfs2 
"Download Gaim: http://gaim.sourceforge.net/"
SignOff 
57pw_
: #pvfs2 
"pw_ has no reason"
56laytonj 
36n=laytonj@68-191-242-87.dhcp.gwnt.ga.charter.com
 has joined #pvfs2
56KyleSchochenmaie 
36n=kschoche@ohm.scl.ameslab.gov
 has joined #pvfs2
 KyleSchochenmaie 
n=kschoche@ohm.scl.ameslab.gov
 has left #pvfs2 
53#pvfs2     
57laytonj   
36H   
n=laytonj
68-191-242-87.dhcp.gwnt.ga.charter.com (laytonj)
53#pvfs2     
57slang     
36H   
n=slang
harley.mcs.anl.gov (Samuel Lang)
53#pvfs2     
57elventails
36H   
i=elventai
elventails.COM (elven)
53#pvfs2     
57ChanServ  
36H@  
ChanServ
services. (Channel Services)
53#pvfs2     
57robl      
36H   
n=robl
ninjak.clustermonkey.org (Rob Latham)
 Topic 
36#pvfs2
50):
 PVFS2-1.4.0 is out: http://www.pvfs.org/pvfs2/download.html
 Topic 
36#pvfs2
50):
 set by 
36robl
 at 
36Wed Feb 15 16:18:48 2006
56hozer 
36n=troy@narn.hozed.org
 has joined #pvfs2
SignOff 
57laytonj
: #pvfs2 
"Leaving"
56KyleSchochenmaie 
36n=kschoche@ohm.scl.ameslab.gov
 has joined #pvfs2
SignOff 
57hozer
: #pvfs2 
Remote closed the connection
 KyleSchochenmaie 
n=kschoche@ohm.scl.ameslab.gov
 has left #pvfs2