dynamobi/dynamobi — Issue #389: [FNL-82] Intermittent failures in BackupRestoreTest
Author: dynamobi-build
Created: 2011-12-30 03:11:51+00:00
State: open
Labels: FNL, Segment

[reporter="zfong", created="Mon, 17 Nov 2008 11:24:30 -0500 (GMT-05:00)"]
The Fennel unit test BackupRestoreTest intermittently fails in automated cruise control builds. The failures are random and the error stacks from the failures are not consistent. Here's one of the traces:

[BackupRestoreTest] ENTER: testHeaderBackupRestore

[database] Fennel build: --without-optimization

[database] opening database; process ID = 28228

[database] online UUID = 67458b6b-0000-0000-0000-000000000000

[database] database opened; page version = 0

[database] closing database

[database] database closed; page version = 6

[BackupRestoreTest] LEAVE: testHeaderBackupRestore

[BackupRestoreTest] ENTER: testBackupCleanup

[database] Fennel build: --without-optimization

[database] opening database; process ID = 28228

[database] online UUID = c6237b32-0000-0000-0000-000000000000

[database] database opened; page version = 0

[database] closing database

[database] database closed; page version = 8

[BackupRestoreTest] LEAVE: testBackupCleanup

[BackupRestoreTest] ENTER: testBackupRestoreUncompressed

[BackupRestoreTest] LEAVE: testBackupRestoreUncompressed

[BackupRestoreTest] ENTER: testBackupRestoreCompressed

[backtrace] *** CAUGHT SIGNAL 6; BACKTRACE:

/home/build/cc/depot/bootstrap/build/open/fennel/libfennel/.libs/libfennel_common.so(fennel::AutoBacktrace::signal_handler(int)+0x37) [0x4bc35]

[0xffffe420]

[0xffffe410]

/lib/tls/i686/cmov/libc.so.6(gsignal+0x55) [0x40d7a875]

/lib/tls/i686/cmov/libc.so.6(abort+0x101) [0x40d7c201]

/lib/tls/i686/cmov/libc.so.6(__assert_fail+0xee) [0x23b6e]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(fennel::CacheTestBase::closeDevice(fennel::OpaqueInteger, boost::shared_ptr&)+0xc2) [0xfd866]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(fennel::CacheTestBase::closeStorage()+0x31) [0xfd8d5]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(fennel::SegStorageTestBase::closeStorage()+0x4b) [0x1a6087]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(BackupRestoreTest::closeStorage()+0x384) [0x8062ff6]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(BackupRestoreTest::backup(stlpd_std::basic_string, stlpd_std::allocator >, fennel::OpaqueInteger, fennel::OpaqueInteger, bool)+0x3b0) [0x8061afe]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(BackupRestoreTest::testBackupRestore(bool)+0x854) [0x80623ce]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(BackupRestoreTest::testBackupRestoreCompressed()+0x19) [0x8062ac7]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(fennel::TestWrapperTemplate::runTest(void (BackupRestoreTest::*)())+0x11b) [0x80733eb]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::user_param_tc_method_invoker, void (BackupRestoreTest::*)()>::operator()(void (BackupRestoreTest::*)())+0x67) [0x807148f]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::unused boost::unit_test::ut_detail::invoker::invoke, void (BackupRestoreTest::*)()>, void (BackupRestoreTest::*)()>(boost::unit_test::ut_detail::user_param_tc_method_invoker, void (BackupRestoreTest::*)()>&, void (BackupRestoreTest::*)())+0x1f) [0x80714b1]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::callback1_impl_t, void (BackupRestoreTest::*)()> >::invoke(void (BackupRestoreTest::*)())+0x31) [0x80714e9]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::callback1::operator()(void (BackupRestoreTest::*)()) const+0x36) [0x8071566]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::test_func_with_bound_param::operator()()+0x2a) [0x80715a0]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::unused boost::unit_test::ut_detail::invoker::invoke >(boost::unit_test::ut_detail::test_func_with_bound_param&)+0x11) [0x80715b9]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/lt-BackupRestoreTest(boost::unit_test::ut_detail::callback0_impl_t >::invoke()+0x22) [0x80715e2]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::callback0::operator()() const+0x32) [0x19d74e]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::(anonymous namespace)::zero_return_wrapper::operator()()+0x26) [0x19d782]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(int boost::unit_test::ut_detail::invoker::invoke(boost::unit_test::(anonymous namespace)::zero_return_wrapper&)+0x1d) [0x19d7ad]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::ut_detail::callback0_impl_t::invoke()+0x27) [0x19d7db]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::callback0::operator()() const+0x2b) [0x19e0bf]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::execution_monitor::catch_signals(boost::unit_test::callback0 const&, bool, int)+0xbf) [0x16eda5]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::execution_monitor::execute(boost::unit_test::callback0 const&, bool, int)+0x44) [0x16f2a0]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::unit_test_monitor_t::execute_and_translate(boost::unit_test::test_case const&)+0x7e) [0x1700bc]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::framework_impl::visit(boost::unit_test::test_case const&)+0x529) [0x1a11f9]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::traverse_test_tree(boost::unit_test::test_case const&, boost::unit_test::test_tree_visitor&)+0x1c) [0x16302a]

/home/build/cc/depot/bootstrap/build/open/fennel/test/.libs/libfenneltestdyn.so(boost::unit_test::traverse_test_tree(unsigned long, boost::unit_test::test_tree_visitor&)+0x43) [0x16c411]

I don't have stacks from other failures, but I remember them having different stacks. As they're encountered in the future, I'll include them in comments.