jzerbe/Nebula-DataStoreService — Issue #3: check return of HttpCmdClient putFile(namespace, filename) in servlets/FileManager.java
Author: jzerbe
Created: 2011-12-16 03:29:55+00:00
State: open

I have verified that this still occurs with the new JAR. When I look at the initial posting (in this case: for a file
23154.txt) the response is: Saved: namespace = 'NSsmall', filename = '23154.txt'
The file is also in the default-fs-store directory (and retrievable if you know where it is)

My guess is that the issue seems to stem from not checking the value of posting to the master server servlets/FileManager.java:130
If the putFile fails, there is never another attempt to inform the master server of the data, as far as I can tell.

>>> Second, in certain cases, when files are added to the DSS, they are
>>> never registered by the master server. This has caused us to, in some
>>> cases, hardcode files to skip, but in others (when our jobs are adding
>>> files and later trying to use them) the files aren't retreivable and
>>> the entire process halts. This is currently a showstopper.