changed timeout from 9999 to self.opts['timeout'] which is the user specified timeout or defaults to 5. With timeout 9999 the loop (almost) never ends if a previously detected
minion vanishes/shuts down during the actual batch run.

Also added a minion_tracker dict which keeps track of the cmd_iter_no_block-iterators and their minions.
- the cmd_iter_no_block-iterators are now cleaned during every run if the have finished (iterating iters[] gets faster).
- minions that did not respond within the given timeout are taken care of by removing them from active[] and updating ret{} with empty returns.

These two additions enable the main while loop to actually finish before 9999 seconds are over (ret{} and self.minions are eventually the same size)
if a minion which was previously detected does not respond properly.

This also fixes the problem of <batch_count> unresponsive minions blocking the progression of the batch run. Example: if batch=10 and 10 minions are unresponsive,
range(bnum - len(active) ) always evaluates to zero and no more minions are added to next_.
Fix some formatting (line length)
Document how top files are compiled from different envs
Sort 'comps' and 'line' when comparing Debian repos, Fix #5517
Only sort everything after the URL in the line
Add a 4th step to the states tutorial

This adds a step showing how file roots can be used to "promote" states
from dev -> QA -> prod.
No general exception catching while rendering pillar. Refs #6305. Refs #5910.

* All errors while processing pillar data are now logged besides being returned.
* Removed the general exception catch. All we need to is check for the expected data type. If it ain't, log the error and continue to the next iteration.
* Added a mocked test case which besides testing the issue reported on #5910, also tests for the proper includes data format and if salt fails accordingly and even if common data is merged.
added load tag, and revamped parsing
added doc
Don't sort the repo title
Merge pull request #6321 from basepi/pkgrepo5517

Sort 'comps' and 'line' when comparing Debian repos, Fix #5517
Merge pull request #6308 from s0undt3ch/hotfix/malformed-pillar-sls

No general exception catching while rendering pillar
Merge pull request #6311 from felskrone/add_minion_tracking_and_timeout

changed timeout from 9999 to self.opts['timeout'] which is the user spec...
Merge pull request #6328 from johnnoone/load-jinja-tag

Load jinja tag
Add practical example
Add link to step 4 of walkthrough to main docs index page
Make state.show_{highstate,lowstate,sls} work with PyDSL

PyDSL needs an active HighState. If you have any sls file that uses the "pydsl" renderer you cannot use state.show_highstate, state.show_lowstate and state.show_sls at the moment.
Pushing the HighState on the active queue fixes this.
Merge pull request #6332 from d--j/patch-1

Make state.show_{highstate,lowstate,sls} work with PyDSL
Merge pull request #6331 from terminalmage/docs

Lots of docs on salt fileserver environments
Escape the $s because they're being interpolated