DataTorrent/Malhar — pull request #336 by ashwinchandrap (2013-11-28 02:01:31+00:00)
Title: logstream integration with siteops ui

fixed the following issues

#291 LogStream - siteops conversion - top 10 URL's (req/sec)
#292 LogStream - siteops conversion - server load (req/sec/server)
#293 LogStream - siteops conversion - top 10 client IP's (req/sec)
#295 LogStream - siteops conversion - top 10 URL's with 404 response (req/sec)
#296 LogStream - siteops conversion - top 10 servers with 404 response (req/sec)
#298 LogStream - siteops conversion - totals per second ( pages / bytes)

Squashed commit of the following:

commit bbcc758e996e0dd485406c387623b1fc8ec71786
Author: Ashwin Chandra Putta
Date: Wed Nov 27 17:03:40 2013 -0800

cleaned up code and added comments

commit 73a667bc66bef3462e88d2ee019eaaa9db3564e0
Author: Ashwin Chandra Putta
Date: Wed Nov 27 17:02:36 2013 -0800

reorganized dag for better readability

commit 8a60da1487f0b439525f6ea2fb832d331ee1dad7
Author: Ashwin Chandra Putta
Date: Tue Nov 26 21:06:42 2013 -0800

added operator to do sum on a specific value in given map

commit 18b4ac69a7d2092d6ffcf8e5bc41119937cb2e43
Author: Ashwin Chandra Putta
Date: Tue Nov 26 21:02:48 2013 -0800

added no arg constructor in ColumnIndex as kryo needs it

commit e1f3a7fa3d121ce6f190637cbfb49aa7328e9e92
Author: Ashwin Chandra Putta
Date: Tue Nov 26 20:49:13 2013 -0800

added operator to convert aggregations to redit output

commit fa0763e76f83cf8838fce9efb368f39ac9caee40
Author: Ashwin Chandra Putta
Date: Tue Nov 26 20:47:20 2013 -0800

added many use cases for siteops

commit 28f581554003c2b18a71220b889d281aadfe7495
Author: Ashwin Chandra Putta
Date: Sat Nov 23 20:34:43 2013 -0800

use single redis db for all dimension instead of one db per dimension, makes it scalable

commit 428c8e12f7cfe26878b1053a2712db709aa42f48
Author: Ashwin Chandra Putta
Date: Sat Nov 23 19:53:18 2013 -0800

fixed null pointer in RedisOutputOperator

commit 0b3d06c9ed061b7801586221e531e08fccc97a67
Author: Ashwin Chandra Putta
Date: Sat Nov 23 19:52:24 2013 -0800

added redis output to logstream app for siteops integration

commit d17bbd698b7ecb63c5e3c19b656e94d4b84c7048
Author: Ashwin Chandra Putta
Date: Sat Nov 23 19:50:17 2013 -0800

added new operator to convert topn output format for redis output operator

commit 03ae1aaa8090d1861efa7a726b0bffab0e0935db
Merge: 860b56c 73847c6
Author: Ashwin Chandra Putta
Date: Thu Nov 21 22:25:31 2013 -0800

Merge branch 'logstream' of https://github.com/DataTorrent/Malhar into siteops_topurl

commit 860b56c7156eedd57b4ecf7db3187900f536566f
Author: Ashwin Chandra Putta
Date: Thu Nov 21 22:25:03 2013 -0800

moved to flat map output from json byte array operator