LU-4093 tests: prevent zombie requests when stopping CT

Fix to prevent any current requests to become zombie when stopping
copytool and thus not to sometimes to induce failures during next
sanity-hsm sub-tests.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I3274e5864469251e6f2040377b84429e4f218f47
Reviewed-on: http://review.whamcloud.com/8157
Tested-by: Jenkins
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: jacques-Charles Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Reviewed-by: Aurelien Degremont <aurelien.degremont@cea.fr>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-4219 mdd: limit os_namelen to the max of NAME_MAX

While running pathconf(".", _PC_NAME_MAX) on ldiskfs-based
Lustre filesystem, it returns 255 (NAME_MAX). However, on
zfs-based Lustre filesystem, it returns 256 (MAXNAMELEN).
Since Lustre can not handle the name length large than
NAME_MAX, this patch limits the value of os_namelen in
mdd_statfs() to the max of NAME_MAX.

Test-Parameters: envdefinitions=SLOW=yes \
mdtfilesystemtype=zfs mdsfilesystemtype=zfs ostfilesystemtype=zfs \
ostcount=2 testlist=posix

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I13b5398eff5b15c74b0e08e2a3394b79a3ff6a44
Reviewed-on: http://review.whamcloud.com/8217
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-4179 mdt: skip open lock enqueue during resent

Skip open lock enqueue, if the open lock has been
acquired(mdt_intent_fixup_resent) during resent.

Signed-off-by: wang di <di.wang@intel.com>
Signed-off-by: Keith Mannthey <keith.mannthey@intel.com>
Change-Id: I78228112b0ba8f93e05930fdd042763d77700626
Reviewed-on: http://review.whamcloud.com/8142
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-2149 llog: lctl to work with llogs from command line

- mgs_list_logs() is introduced to get all of configs and
  mgs_iocontrol handles that and also cancel/remove ioctl
- remove obsoleted code from mdc_iocontrol
- add handler to list llog catalogs from mdt_iocontrol too
- lctl llog_print outputs records in YAML format

Signed-off-by: Amir Shehata <amir.shehata@intel.com>
Change-Id: Ic6e392403da18a2d7578aafdddf01007c3b3c30e
Reviewed-on: http://review.whamcloud.com/4254
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-4047 build: fix 'memory' errors

Fix 'memory corruption' defects found by Coverity version 6.6.1:
Out-of-bounds write (OVERRUN)
Overrunning array at byte offset using index.
Fix 'memory illegal accesses' defects found by Coverity version 6.6.1:
Read from pointer after free (USE_AFTER_FREE)
Dereferencing freed pointer.
Readlink used insecurely (READLINK)
buffer[sizeof(buffer)] is an off-by-one error.

Signed-off-by: Sebastien Buisson <sebastien.buisson@bull.net>
Change-Id: I91af9fae93f89275cf6d3ad97bdc37958c0d709e
Reviewed-on: http://review.whamcloud.com/7822
Reviewed-by: Dmitry Eremin <dmitry.eremin@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-1199 rpm: don't clean up $RPM_BUILD_ROOT in %build

The %clean macro cleans up the buildroot. Doing it manually
makes the SUSE build system complain and breaks short-circuiting.

Signed-off-by: Jeff Mahoney <jeffm@suse.com>
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I4a6b5ebfa34d9fcfddfb0608d4f7dcce3f88a3ef
Reviewed-on: http://review.whamcloud.com/5491
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-3373 osd-ldiskfs: struct file add f_inode member

struct file has a f_inode member. Need initalize
before use it.

Signed-off-by: yang sheng <yang.sheng@intel.com>
Change-Id: I290aaea09c4ff9be7f9d044bf972eb43510933d2
Reviewed-on: http://review.whamcloud.com/7727
Tested-by: Jenkins
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-4109 tests: raise out-of inode LOV EA detection threshold

Sanity sub-test 57b sometimes failed because the threshold (< 8K
of MDT space) it used to detect if LOV EA has been stored out-of
inode is too short (vs space also allocated for llog files, ChangeLog,
etc). So raising threshold to 16.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I0f59328d59da69911473433769ff683ff4fdf452
Reviewed-on: http://review.whamcloud.com/8156
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-2800 autoconf: remove LC_PROCFS_DELETED

The procfs deleted member in the procfs entry struct
has been removed since kernel version 2.6.27. We can
removed this test since it is no longer needed.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I1dbf8cabfa85d31ea5f1386710dfcb7012946b91
Reviewed-on: http://review.whamcloud.com/5374
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
LU-2800 autoconf: remove LC_HAVE_QUOTAIO_H

fs/quota/quotaio_v2.h has been in the upstream kernel since v2.6.30.
We can remove the test. The result is only used for another test
that will also be removed.

Signed-off-by: Jeff Mahoney <jeffm@suse.com>
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I4e8c4be20548cd546c5787deb8a75f36ea4f1c9f
Reviewed-on: http://review.whamcloud.com/5371
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-2800 autoconf: remove bio_endio args test

Since linux kernel version 2.6.24 the bio api has been
taking one less argument than in previous versions. Since
we no longer support kernels earlier than 2.6.32 we can
drop this test and simplify the code using the bio api.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Ieedface5065d660284c5dfb9a61cb81e4174c61d
Reviewed-on: http://review.whamcloud.com/8104
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-3467 ofd: use unified handler for OST requests

Switch OST/OFD request processing to the unified request
handle.

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: I27a2f8c2345b1aad3d714eab1e138d0c9d2ec258
Reviewed-on: http://review.whamcloud.com/7130
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
LU-2829 tests: Decrease load on zfs for sanityn/33a-b

Decrease number of files when testing sanityn/33a and 33b when using
ZFS due to performance issues (cf LU-2887).  ZFS performance when
commit_on_sharing is enabled is very slow.

Test-Parameters: ostcount=2 envdefinitions=SLOW=yes testlist=sanityn mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: I55b9267a3df68abc631b7d47886fb4b0f7e81594
Reviewed-on: http://review.whamcloud.com/8161
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-2353 tests: Introduce back end mount/unmount helpers

Some tests need to access back end file systems directly.  Currently,
for ldiskfs targets, they either mount the devices as ldiskfs or
invoke the ldiskfs-specific debugfs tool; for ZFS targets, they simply
skip forward.  Many of them could actually work on both back end
types.  Since the mount/unmount procedures diff for ldiskfs and ZFS
back ends, this patch introduces a pair of generic helpers,
mount_fstype()/unmount_fstype(), to hide the differences from tests.
Then, sanity 27z is adapted to work with ZFS targets using the new
helpers, as an example.

Test-Parameters: mdsfilesystemtype=zfs ostfilesystemtype=zfs mdtfilesystemtype=zfs
Change-Id: I0b6b358b147240519f28852ba2c8fea85c09aab3
Signed-off-by: Li Wei <wei.g.li@intel.com>
Reviewed-on: http://review.whamcloud.com/5785
Tested-by: Jenkins
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-3853 tests: mpiexec requires strict global/local args order

Put -machinefile option ahead of other mpiexec options, since some
version of mpiexec (at least 1.90) requests global options be put
before its local options, and -machinefile is a global options.

Signed-off-by: Bobi Jam <bobijam.xu@intel.com>
Change-Id: Ib188881a78a2b345552e8c6070f7dfa7a086ce5d
Reviewed-on: http://review.whamcloud.com/7493
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-3885 ldlm: check all errors during ldlm_proc_setup()

Fix ignorig errors from lprocfs_add_vars() function.

Signed-off-by: Dmitry Eremin <dmitry.eremin@intel.com>
Change-Id: Ie2429f91ad5ac6de8d7e9027a0cd2907588294d3
Reviewed-on: http://review.whamcloud.com/8115
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-3810 obd: Cleanup client import if client_obd_setup fails

client_obd_setup() allocates an obd_import which should be cleaned up
if there is any failure afterwards in callers of client_obd_setup().
This patch fixes the bug in osc_setup(), mgc_setup(), mdc_setup() and
lwp_setup(). The fix is to call obd_cleanup_client_import() before
calling client_obd_cleanup() in case of an error.

Signed-off-by: Swapnil Pimpale <spimpale@ddn.com>
Change-Id: Ib8c2194d80fd14538d4ca42fb8084c93dd575199
Reviewed-on: http://review.whamcloud.com/7561
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-4176 tests: do not wait for deleted HSM request record

restore_and_check_size() function of sanity-hsm was systematically
waiting for restore request status, even if already flagged as
succeed. This extra wait can become forever if request record has
already been deleted.
Also fix wrong restore timing msg.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I9709d9e665b66fb5d16e93c7139fa8d95fa92589
Reviewed-on: http://review.whamcloud.com/8154
Tested-by: Jenkins
Reviewed-by: jacques-Charles Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Reviewed-by: James Nunez <james.a.nunez@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-4028 quota: improve lfs quota output

- print the total allocated block/inode limit for all OSTs/MDTs
  when the verbose option is specified;
- add 'h' option to print used space in human readable format;

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Idc9cd3d92a50744885f65e82c9ce53b332c1959a
Reviewed-on: http://review.whamcloud.com/8152
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>