WPS benchmark 2014

== WPS Benchmark 2014 ==
This page contains informations about the (possible) WPS Benchmarking session for the FOSS4G@PDX in 2014.
=== Plan (Draft) ===
* Call for project, call for testing proposition, scénarios and designation of one contact user (for providing private informations, mainly ip, logins and passwords)
* Setup a host that we will call the "test server" and give access to one user per project involved (server specification to come, if there is any specific requirement for your solution to be setup please let us know)
* Call project for installing their solutions on the test server
* Vote then define testing procedures / method / scenarios
* Run the tests on each instances setup on the test server and publish results (at any time a team may modify the setup they made initialy and then ask that a test shlould be run against their setup again)
* Have a WPS Benchmarking web site providing detailed informations about the tests, displaying results in fancy ways ...
=== Projects and people ===
* ZOO-Project, Gerald Fenoy, Nicolas Bozon, Venkatesh Raghavan
* 52°North, Benjamin Pross
* GeoServer, Jody Garnett
* PyWPS, Jachym Cepicky, Jorge de Jesus
=== Available infrastructure ===
A dedicated server was started on april 15th and contain hosts configured for different projects, it have the following specs:
 * Processor: Intel Xeon E3 1245v2 (4 cores/ 8 threads) 3.4 GHz+
 * RAM: 32 GB DDR3
 * Disks: 2 x 2 TB SATA (raid hard)
 * Network connection: 1Gbps
 * Bandwidth: 200 Mbps
The server ip address is the following : 37.187.89.64.
By now, there is no failover IP available (this can be modified if required) so we need to share ports between each environments. Here are the port definitions for each environment:
Team 	User Names 	SSH Port	HTTP port	WPS Endpoint 	Echo Service Name
All 	gerald.fenoy,nicolas.bozon,benjamin.prosss,jody.garnett,jachym.cepicky,jorge.jesus	1046 	80 	 	
ZOO-Project 	gerald.fenoy,nicolas.bozon 	1047 	2007 	ZOO-Kernel 	
52° North WPS	benjamin.prosss 	1048 	2008 	52°North WPS GetCapabilities 	
GeoServer 	jody,garnett 	1049 	8082 	GeoServer WPS GetCapabilities 	
PyWPS-WSGI 	jachym.cepicky, jorge.jesus 	1050 	2010 	PyWPS-WSGI WPS GetCapabilities	
PyWPS-CGI 	jachym.cepicky, jorge.jesus 	1050 	2010 	PyWPS-CGI WPS GetCapabilities 	
Constellation	olivier.nouguier 	1051 	2011 	 	
=== Testing procedures ===
There is a first draft description of tests available for the WPS Benchmarking here : http://wiki.osgeo.org/wiki/WPS_benchmark_2014/Test.
=== Results ===
Results from september 11th: http://37.187.89.64:2007/testing/OSGeoLive-presentation-master/WPS_BenchmarkAF.html
=== Mailing list ===
* http://lists.osgeo.org/mailman/listinfo/wps-discuss
=== Deadlines (Draft) ===
* 2014.04.04 - Call for projects / testing proposals start
* 2014.04.15 - FOSS4G call for abstract close
* 2014.04.15 - Server available for installing solutions
* 2014.06.03 - First test can start
* 2014.06.15 - Call for projects closed
* 2014.06.23 - Call for testing closed
* 2014.06.30 - Definition of testing procedures for FOSS4G-Europe
* 2014.07.04 - Extract final results and inclusions in presentation for FOSS4G-Europe
* 2014.07.07 - Discuss final results and define what should be included in presentation at FOSS4G
* 2014.07.15 - Procedure and Results presentation at FOSS4G-Europe
* 2014.08.01 - Definition of testing procedures for FOSS4G
* 2014.08.15 - Installation and verification of testing procedures on the dedicated server end
* 2014.08.22 - Extract final results and inclusions in presentation
* 2014.08.22 - Discuss final results and define what should be included in presentation at FOSS4G
* 2014.09.08 - FOSS4G start
* 2015.04.15 - End of test server availability