Use TransportBulkAction for internal request from IndicesTTLService

This prevents executing bulks internal autocreate indices logic
and ensures that this internal request never creates an index
automaticall.

This fixes a bug where the TTL purger thread ran after the actual
index it was purging was already closed / deleted and that re-created
that index.

Closes #5766
Remove jsr166y now that we on Java 7, cleanup jsr166e to classes we use
Remove FileSystemUtils#maxOpenFiles

This method basically forcefully creates as many files as possible
to find out the process limit in a brute-force manner. The number of
possible probles with this approach would exceed the number of lines
left on this commit message.

This commit uses a JMX based alternative to print the process limit.
Cleanup FileSystemUtils#mkdirs(File)

This methods had some workarounds for bugs that seem to be fixed
in Java 7 [1]. There seem to be other problems on shared file-systems
which are not really supported by lucene anyway or rather not
recommeded. Yet the current solution that interrupts a static thread
reference is too dangrous given all the usage of NIO across
elasticsearch.

[1] http://bugs.java.com/bugdatabase/view_bug.do?bug_id=4742723
Update clusterstate if mapping service has local changes

If the during percolating a new field was introduced
in the local mapping service, then those changes should
be updated in cluster state of the master as well.

Closes #5776
Updated date_formats to new dynamic_date_formats
Update core-types.asciidoc

Missing bracket
Update percolate.asciidoc

fix typo
[TEST] Wait for shards to be allocated before running testUpdateMappingDynamicallyWhilePercolating.

If the percolate request is executed soon enough, all shards fail and the
mapping is not actually updated.
Switch back to ConcurrentMergeScheduler

Load tests showed that SerialMS has problems to keep up with
the merges under high load. We should switch back to CMS
until we have a better story to balance merge
threads / efforts across shards on a single node.

Closes #5817
[DOCS] Update merge docs to reflect the max_merge_at_once property
[TEST] Don't delete data dirs after test - only delete their content.

Closes #5815
Remove garbage
[TEST] Wait for green, and refresh after indexing in percolator test
[TEST] Fix PercolatorTests#testSimple2

This test requires a mapping since otherwise if there is no mapping
added the percolator query might not be parsed as a query on a numeric
field since the query might arrive on a node before the dynamic mapping
reached that node.

This commit also moves the `indexService.readAllowed()` call up before
the number of percolation queries is check to make sure we fail if reads
are not allowed - there might be a query in-flight which means we need
to check another node rather than return an empty result.
Better deal with invalid scroll ids.

Closes #5738
[TEST] Reduce the amount of docs being indexed.
add debug logs if failed shards can not be resolved.
Ensure close is called under lock in the case of an engine failure

Until today we did close the engine without aqcuireing the write lock
since most calls were still holding a read lock. This commit removes
the code that holds on to the readlock when failing the engine which
means we can simply call #close()
[TEST] catch exceptions if TTL already expired when indexing

TTLPercolatorTests indexes docs with small TTLs which can trigger
AlreadyExpiredException exception. This is expected while rare and
we should just catch them.