Init commit

Current code were moved from a previous project

commit 53899d4eb3cae37326f6785d83f6da637fc87b73
Author: jingmi
Date:   Thu Jun 14 15:18:02 2012 +0800

    Add temp source codes

commit cf7560f039d06a96bf036bcc4ee6b89e6072dd1b
Author: jingmi
Date:   Wed Mar 7 19:00:31 2012 +0800

    Update Makefile for async_coro

commit 069982e85aca7ad5e610f15820f4ab1da971e2b2
Author: jingmi
Date:   Wed Mar 7 17:49:50 2012 +0800

    Rename imgstack to dataname

    1. Rename output executive file
    2. Rename log name
    3. Update Makefile
    4. Update tests
    5. Update deploy script: buildenv.sh
    6. Rename related funcations in global.c caller

commit 1525200d4f0b61fd013b67fc02392a29729c3001
Author: jingmi
Date:   Tue Mar 6 10:55:23 2012 +0800

    Fixed a bug in  indexlog.c: index_logger_fetch()

    If index log was empty(only magic header) and call index_logger_fetch(),
    the subsequent index_logger_fetch() will try to read magic header again.

commit b6fab303f2f8f362d406fe3af9dc28551569255f
Author: jingmi
Date:   Wed Feb 29 19:29:32 2012 +0800

    Workaround key length problem

    Current, query thread will truncate key to 8 bytes, fixed it.
    But better codes are needed.

commit f4e1380a0ebb50dcd4766a29cd076d2dc2776b36
Author: jingmi
Date:   Wed Feb 29 17:47:53 2012 +0800

    Checkout import.pl from imgstack_HashIndex

commit 1502f25cb6ac884c5fefb1b761dfeb56654f9fa0
Author: jingmi
Date:   Thu Feb 23 14:54:50 2012 +0800

    Add replay_journal so that we can view indexlog

    1. Read and print indexlog
    2. Update log.c

commit 0a95de1eee051b45bb070ce5220cec0c4f396f3b
Author: jingmi
Date:   Thu Feb 23 12:09:46 2012 +0800

    Launch indexlog(journal)

    1. Add more op_type_t in indexlog.h
    2. More error handling in indexlog
    3. Fixed some bugs including memory leak in storage.c
    4. Improve test suites

commit 0915d6dc1091416e05211677d4aaea7385e44a11
Author: jingmi
Date:   Tue Feb 21 17:32:51 2012 +0800

    Merged some improvements from imgstack_HashIndex

    1. Fixed bugs in slab allocator
    2. Explode interfaces in slab.[ch] for tests
    3. Avoid warning on RH series platform
    4. Improved tests framework
    5. Update test_indexlog.c

commit 0face3c7a28e6a41ef9914332eac699fa9c98e2f
Author: jingmi
Date:   Mon Feb 20 16:29:13 2012 +0800

    First commit of indexlog

commit 72e04e1d7c9bfdff8bdd6a68b6285cb4375872b0
Author: jingmi
Date:   Mon Feb 20 16:27:31 2012 +0800

    Change download sites for GNU parallel

commit 2363042084518a58beab000de92f1f6a06fb8179
Author: jingmi
Date:   Mon Feb 13 16:27:17 2012 +0800

    Fixed bugs in bsdqueue.h

commit d49c2e18871629524d149e10e8e7ba496676ae66
Author: jingmi
Date:   Sun Jan 15 19:00:53 2012 +0800

    Add bsdqueue.h

    1. This is a generic list in fact
    2. Support FIFO, FILO, LILO, LIFO, etc

commit bf49841e8000c84da8d9ff396b2578c7730c0a39
Author: jingmi
Date:   Wed Jan 11 17:39:29 2012 +0800

    Fix a bug while handle memcached protocol

    1. PHP memcached extension will send spaces as tailing char, e.g: "get key \r\n"
    2. Add "\r\n" after send back content
    3. Add PHP integration test scripts: get / set
    4. Fixed bugs in perl integration test script

commit a5b9c55e5f29111be44324d7212bc8683f7e35af
Author: jingmi
Date:   Thu Dec 29 11:14:12 2011 +0800

    Update output stat chart

commit f536bd44df2d91a9ea26481df2e12af4abcff8e6
Author: jingmi
Date:   Wed Dec 28 18:55:29 2011 +0800

    small updates

commit 1e500e850799587a9ef637ead8c4e456b8c2ba99
Author: jingmi
Date:   Tue Dec 27 15:42:06 2011 +0800

    Add time cost distribution analyse and will generate bar chart using gnuplot

commit 929f1be226df4ddb352ea71f4961f68a789f76d2
Author: jingmi
Date:   Tue Dec 27 02:16:16 2011 +0800

    Update Makefile & simple_set_then_get.sh

    1. Makefile is more stable: use include/lib files under utils
    2. simple_set_then_get.sh can accept count now

commit 5d890395a98765ee22cca017358feed1ed9076e6
Author: jingmi
Date:   Mon Dec 26 17:04:25 2011 +0800

    Set log buffer in BDB

commit cefee6aef6f78fc4721ed22a61dabd7da5fc1ca8
Author: jingmi
Date:   Mon Dec 26 15:54:15 2011 +0800

    Better buildenv script and integration tests

    1. Add filenames in .gitignore
    2. Improve buildenv.sh
    3. Open BDB cache and set size to 128M
    4. Better integration load tests

commit 418053d140590845a81e7ce4e4e0c649bf99ce15
Author: jingmi
Date:   Sun Dec 25 19:41:27 2011 +0800

    Alpha-0.1 version

    1.  Change global libev entity to multi-entities per thread.
    2.  Add TODO
    3.  Add cmd_type_name()
    4.  Reduced logs so that only 2 logs will be written in normal cases
    5.  More and better error logs in many critical code blocks
    6.  Fixed bugs that will stop receiving data in some case
    7.  Fixed a bug that g_pipe_fd is not allocated enough
    8.  Change BerkeleyDB transaction to memory transaction
    9.  Fixed a bug caused by incorrect unlock operations
    10. Update corresponding tests

commit 8f4e081c936b5d47a8019b043a00167bec08dd81
Author: jingmi
Date:   Wed Dec 21 17:55:54 2011 +0800

    Merge the code so that we can build imgstack now.

commit 725c386747f9266b9c6f382c469cbfb86b0df44b
Author: jingmi
Date:   Tue Dec 20 18:37:03 2011 +0800

    finish query_thread & tests

    1. auto extend/shrink key size to KEY_LEN
    2. fixed bugs
    3. add is_valid_mem() in slab allocator
    4. re-style code
    5. add test for query_thread.c

commit d84e7fbd58881ecc091e16834ebcd107513ac401
Author: jingmi
Date:   Tue Dec 20 11:49:39 2011 +0800

    add query thread in imgstack, haven't done yet

commit 307cd41bd417c1d056948ea1b8ea8026336cd1b9
Author: jingmi
Date:   Mon Dec 19 16:53:09 2011 +0800

    add deploy_api.sh for api deployment

commit 191bfd843181c2908d09092524b3c0005bf90b7d
Author: jingmi
Date:   Wed Dec 14 10:48:26 2011 +0800

    fixed a bug in storage that data file is corrupt while deleting

commit 8a1a86d9c77eb0420cedc100a2b8098bc9c2a00b
Author: jingmi
Date:   Mon Dec 12 10:51:06 2011 +0800

    assign thread is done

    1. finished assign thread
    2. fixed buffer overflow in memcached_protocol
    3. add tests for assign thread

commit a93e6b157d5f090b07ce289aeb8c09633e2b1679
Author: jingmi
Date:   Wed Dec 7 15:57:12 2011 +0800

    add more tests for atomic, but i disabled them in the testsuites

commit 0742214b73c82ea42660e28e712b999045c5e375
Author: jingmi
Date:   Tue Dec 6 12:13:38 2011 +0800

    update memcached_protocol

    1. update memcached_protocol
    2. add more testsuites
    3. update runtest.sh

commit 1b941c4651715f065f12531e25165a8a53fb5986
Author: jingmi
Date:   Mon Dec 5 20:10:13 2011 +0800

    add memcached protocol parser

    1. memcached protocol parser
    2. add iolayer
    3. add more stats in g_runtime_vars
    4. add test suites

commit 1ecf68ab33145322b6f2c4180d7e1c9b62a0acbc
Author: jingmi
Date:   Fri Dec 2 17:09:32 2011 +0800

    many updates

    1. fixed bugs in atomic lib
    2. add tests for utils
    3. add test for assign_thread

commit cde8b17b221a00df472374bedd3bcb1488a389bb
Author: jingmi
Date:   Fri Dec 2 15:01:09 2011 +0800

    add assign_thread

commit 46dfa8ece1a0526c43737330aeff8e5d60eee8e6
Author: jingmi
Date:   Wed Nov 30 11:22:15 2011 +0800

    add assign_thread

commit 6938e6a6f2d4221fe4df756f9782eec502f27e8a
Author: jingmi
Date:   Tue Nov 29 13:36:13 2011 +0800

    add storage test suites

commit 2a8db0a93869f97e8015877b31974ca52f69d18e
Author: jingmi
Date:   Mon Nov 28 18:22:05 2011 +0800

    update output of run_test.sh

commit 9e85b12f793eecb43ef7dcbc3c62f0376562168a
Author: jingmi
Date:   Thu Nov 24 15:39:26 2011 +0800

    fixed a bug when append data: if append larger than 2 times of current block size

commit 5e5c1e8c32e7a925bce019135d9ecad4be5745e5
Author: jingmi
Date:   Mon Nov 21 10:28:55 2011 +0800

    add index lock in storage module

    1. add slab_init()
    2. add index lock
    3. still need to amend the lock policy, potential dead-lock & incorrect
       lock now

commit 12f32d63ee635841f5d603b004a254835e4e4e92
Author: jingmi
Date:   Thu Nov 17 17:33:20 2011 +0800

    add sync_data_file_header()

commit 706ffb64287e5784acd795aec670086e6b0e5a65
Author: jingmi
Date:   Thu Nov 17 15:03:38 2011 +0800

    remove include queue.h in table.c

commit bbf981b4bfcf2dadd062fb2717f5c64993fe35ed
Author: jingmi
Date:   Thu Nov 17 13:12:07 2011 +0800

    remove global index_db in storage.c

commit 7e3edd7fe5bbc8c5cdf7647c94c726d7e2cc1eec
Author: jingmi
Date:   Wed Nov 16 10:14:40 2011 +0800

    fixed a bug that block cnt is not increased after free slot used in storage.c

commit bb1888104b1b9c1a9d6b9272f69f8052052725c0
Author: jingmi
Date:   Tue Nov 15 15:44:33 2011 +0800

    add timing in storage

    1. in find_block()
    2. in delete_block()
    3. in update_block()

commit fe82384ea0e7fc5b2219c90a709cf4a77cdb0c55
Author: jingmi
Date:   Tue Nov 15 12:54:40 2011 +0800

    will mkdir automatically while open storage

commit b40e074bbf1db47d9d09563ddcf2538830e84bc6
Author: jingmi
Date:   Wed Nov 9 18:20:10 2011 +0800

    add read_block_file.pl

commit 0df2106dbc8c15fc6d1e98c24f32b901a769fceb
Author: jingmi
Date:   Wed Nov 9 16:40:20 2011 +0800

    upgrade update_block()

    1. can add new record now
    2. calc_block_size()

commit 056544506fcccee8298ac43e575caf8a1cb87e15
Author: jingmi
Date:   Wed Nov 9 15:37:58 2011 +0800

    add open_storage()

commit 03dd3ba470a533ab764d77cf82186d8ef3c36da3
Author: jingmi
Date:   Wed Nov 9 14:35:48 2011 +0800

    hide open_data_files() & open_index_file()

commit 9237fa24e08ab61b86404344d419315fd77c44a1
Author: jingmi
Date:   Tue Nov 8 17:13:29 2011 +0800

    add test_multhr_bdblib.c

commit 78db6d0a7ce8b28233d76d5d532abe263c024fe9
Author: jingmi
Date:   Tue Nov 8 16:44:29 2011 +0800

    implement storage

    1. modify_block
    2. delete_block
    3. update_block

commit c637a9ea740235f957e6a08a578a3e178a7dab57
Author: jingmi
Date:   Tue Nov 8 09:11:45 2011 +0800

    add find_block()

    1. add DB_NOTFOUND in find_record()
    2. update log prompt
    3. update log format
    4. find_block()

commit 8ca5a3c18c4f8c71392fb036c8a6aea79fca925b
Author: jingmi
Date:   Mon Nov 7 17:47:56 2011 +0800

    add append block

    1. add crc32
    2. add append block
    3. add bdb index insert/query
    4. better colorized run_test.sh output
    5. many testsuites

commit 37b2de36443aa506914f339bb4df94db68a95e6b
Author: jingmi
Date:   Sat Nov 5 15:08:06 2011 +0800

    add index management in storage.c

    1. add open_index_file()
    2. add free_slots_cnt in struct block_file_t
    3. update close_storage()

commit 1e03849c67b28036ad4e7b334f8040fc0aa3e5a6
Author: jingmi
Date:   Sat Nov 5 13:51:17 2011 +0800

    add hard disk storage implementation, not finish yet

commit 47d539f636ed6b771e6742c2830dbd8521a6d6f6
Author: jingmi
Date:   Fri Nov 4 10:40:01 2011 +0800

    add ignore .*swp to .gitignore