OSv Init: http client

The http client is loosely based on the boost http client example.
The original example can be found here:
http://www.boost.org/doc/libs/1_55_0/doc/html/boost_asio/example/cpp03/http/client/sync_client.cpp

The client class redirect its output to an output stream so if the c is
a client the following can be done:
std::cout << c;

The client is used to retrieve init files from a remote server. It can
be replaced by a library client if need arises.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSv Init: the osvinit class

The osvinit object uses command from a yaml parser to either call an API
command or to perform internal command.
The supported options are:
Each command contains: GET, PUT, POST or DELETE with a url of the
command. Path parameters comes as part of the url.
Query parameteres follow as a yaml parameters.

The osvinit can be set to stop on errors or ignore them.

When opening the api, the osv init creates a new thread for that, it
would wait for that thread to terminate.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSv Init: the main

The main starts an osvinit task. It should get in the command line
either a file name or a server name and path on the server as the init
file.

It uses a parser for passing the configuration to the osvinit

It call the osvinit wait, it would return imidiatialy if the httpserver
was not run.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSv Init: A basic configuration file

The default configuration file is empty. When the osvinit will be in use
it should replace the httpserver and the osvinit would start the api
server when the configuration is done.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSv Init: Makefile

Adding the make file. It create the osvinit.so for use with the image
and the osvinit for standalon testing.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSv Init: add the module.py

Package the yaml-cpp lib, the osvinit.so and the osvinit.yaml init file.
By default the osvinit will not be started, but the httpserver will.

To change that, the starting line can be uncommentted or the osvinit can
be started with a -e directly.

The osvinit and httpserver should not be both started.

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>

module.py need merge
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
OSvInit: add directory of the yaml-cpp library

Add the directory of the yaml-cpp library to the path

Signed-off-by: Amnon Heiman <amnon@cloudius-systems.com>
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
mgmt: compile osvinit after httpserver

Explicitly specify to the build system that the osvinit module needs
to be compiled after the httpserver module. Otherwise, we may randomly
get opposite order, and the compilation will fail.

Signed-off-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
osvinit: fix compilation error

handle() returns void now.

Signed-off-by: Tomasz Grabiec <tgrabiec@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
osvinit: express compilation-time dependency on httpserver with require()

Reviewed-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Tomasz Grabiec <tgrabiec@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
osvinit: update location of httpserver module

This fixes 'make' in osv.git

Signed-off-by: Tomasz Grabiec <tgrabiec@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Add ncurses module

A requirement for libedit, which is required by the cli.

Reviewed-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Or Cohen <orc@fewbytes.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Add libedit module

Required by the cli.

Reviewed-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Or Cohen <orc@fewbytes.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Add lua module

Required by cli. Downloads and builds Lua 5.2.

Lua's original Makefile comes without a target to create a shared-object.
For this, this build extract the sources to `src/` which contains a Makefile
that creates the shared-object.

Also adds the following modules:

* LuaSocket
* LPeg
* LuaJSON

Reviewed-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Or Cohen <orc@fewbytes.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Add cli module code

cli.c embeds Lua as the engine of the CLI. It makes it dynamic and scriptable.
The added benefit is that Lua maintains its own state, which enables us to
treat it as a single entity that can be reset when needed.

The cli takes a command with libedit and passes it to cli() in cli.lua. If an
error occures (assert() or error()), it is being taken care of with a proper
message.

Some utilities are available, like table/column printing (see table_print())
and getopt_long()-like method (see echo commands for usage example).

It is possible to use this cli locally (outside OSv), but you need to build
its dependencies first: modules/{ncurses,libedit,lua}.

Commands are placed under commands/ folder.
More documentation is placed under docs/, currently.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Build code for cli module

Signed-off-by: Or Cohen <orc@fewbytes.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
Some documents created while working on the CLI

Signed-off-by: Or Cohen <orc@fewbytes.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
command line: don't wait for disowned threads

If we run

        run.py -e "command1 & command2"

This runs command1 and command2 in parallel. Only when the two commands
return from main(), OSv will shut down.

But for some service background threads, delaying the shutdown is not
a feature, it's a bug. For example if you run,

        run.py -e "libhttpserver.so & /tests/tst-chdir.so"

the guest will never exit, despite tst-chdir.so finishing in less than a
second, because libhttserver never completes.

It's even more annoying now that we automatically add "libhttpserver.so &"
to every command line - now even a 'run.py -e /tests/tst-chdir.so' will
never complete.

This patch adds a new alternative to "&": "&!". This syntax is inspired
by zsh, where &! means creating a *disowned* background process - one which
the shell doesn't track, and doesn't worry about when the shell exits.

With this patch,

        run.py -e "libhttpserver.so &! /tests/tst-chdir.so"

Will shutdown as soon as chdir.so finishes - no matter if libhttpserver.so
finished (it never will...).

Signed-off-by: Nadav Har'El <nyh@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
osvinit: fix linking of osvinit.so

The placement of -l is significant. We should put dynamic libraries
last otherise they will not be recorded as dependencies which leads to
symbol resolution errors like this one:

Failed looking up symbol _ZN4YAML6detail9node_data12empty_scalarE (YAML::detail::node_data::empty_scalar)

Signed-off-by: Tomasz Grabiec <tgrabiec@cloudius-systems.com>
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
mgmt: update to latest

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>