DIRACGrid/DIRAC — Issue #334: DataStorage accounting plots have a problem for LFN files/size plots
Author: elisal
Created: 2011-11-30 09:54:29+00:00
State: open

Hi,
there is a problem with the accounting plots of DataStorage, when plotting the LFN space/files.
The problem is that the value displayed changes depending on the metric chosen to group.
Just to show an example:
the run 99983 has 243 files (as StorageUsageDB reports):
mysql> select sum(Files) from su_Directory where Path like '/lhcb/data/2011/RAW/%/99983/';
+------------+
| sum(Files) |
+------------+
| 243 |
If I do the plot of the LFN files, grouping by EventType, and selecting Production/run=99983, the result is correct, 243:
https://lhcbweb.pic.es/DIRAC/LHCb-Development/lhcb_user/systems/accountingPlots/plotPage?typeName=DataStorage#ds9:_plotNames9:LFN%20filess9:_groupings9:EventTypes13:_timeSelectors6:604800s11:_Productions5:99983s9:_typeNames11:DataStoragee
(please use the Development setup for the plots, there another bug has been fixed, which is still present in Production).

but if I group by another metric (e.g. DataType) the total is 62
https://lhcbweb.pic.es/DIRAC/LHCb-Development/lhcb_user/systems/accountingPlots/plotPage?typeName=DataStorage#ds9:_plotNames9:LFN%20filess9:_groupings8:DataTypes13:_timeSelectors6:604800s11:_Productions5:99983s9:_typeNames11:DataStoragee

the same result if grouping by any other metric, it always gives this wrong result.
thank you for your help debugging this.
I will try again this afternoon to look more into this problem. I will report here if I find any progress.
As said before, in the instance running in production there is another bug, which is fixed in Development, so I think it is better to look directly at the plots of the development instance. The agent producing the plots is the DataManagement/StorageHistoryAgent running on volhcb12, and also the accounting server is on this machine.
thanks and cheers