Hive-HDFS Operator

commit 250d7277f777d41fcf3f71d30be9ac1f8748bcbf
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Thu Oct 30 14:47:05 2014 -0700

    modifications done to get rid of errors with java 1.6

commit b15a4db3d56748d987ffa59034f280950241c1df
Merge: f34dabc bbe2741
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Thu Oct 30 14:38:16 2014 -0700

    Merge remote-tracking branch 'upstream/dt-dev' into Hive

    Conflicts:
    	contrib/pom.xml

commit f34dabc76eac8cb857b224222a6d301a02f00a8a
Merge: 3db2bc7 fa35b92
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Mon Oct 27 00:24:35 2014 -0700

    Merge branch 'Hive' of github.com:pm48/Malhar into Hive

    Conflicts:
    	benchmark/src/main/java/com/datatorrent/benchmark/HiveInsertBenchmarkingApp.java
    	benchmark/src/main/java/com/datatorrent/benchmark/HiveMapInsertBenchmarkApp.java
    	benchmark/src/test/java/com/datatorrent/benchmark/hive/HiveInsertBenchmarkTest.java
    	benchmark/src/test/resources/dt-site-hive.xml
    	contrib/src/main/java/com/datatorrent/contrib/hive/AbstractHiveHDFS.java

commit 3db2bc7abc195b74ebd4de67b1d8e2316a79a535
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Mon Oct 27 00:12:06 2014 -0700

    changes for renaming hive map and string operator to insert operators.

commit 28c9056976ed27cb893aca2cb35ce378e2f580ce
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Wed Oct 22 16:18:33 2014 -0700

    changes for hive

commit b1dcf7f0cf251a8e0f642ad07364074c24217f93
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Tue Oct 21 14:18:29 2014 -0700

    commit for map implementation in hive

commit fa35b921c9a7c05712719d9392cde3368325de4c
Author: Prerna Manaktala <prerna@node0.morado.com>
Date:   Tue Oct 21 11:10:47 2014 -0700

    need to add input for map operator

commit 77c641596928fc76454191fa894d63c2981c6206
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Mon Oct 20 22:45:15 2014 -0700

    commit to test on cluster

commit 1d6f868d3fff218c1a15b8a6bfefe867b05328d8
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Mon Oct 20 13:45:08 2014 -0700

    changed map implementation

commit 61b37b383c30dcbc96d60153705a4cbf681bdadd
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Mon Oct 20 10:19:29 2014 -0700

    changes for map implementation in hive

commit 8897e78410f9a9039ff1290f4c76eee740a844cb
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Sat Oct 18 12:21:03 2014 -0700

    checkin for int windowID support since hiveserver2 doesnt support long data type

commit e80cce0cf648e8ba679905627c5c685249434c84
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Fri Oct 17 01:25:49 2014 -0700

    commit for hiveserver2

commit 2c4a85c30163c01d4b4507e8f16ffc18e66f8cf9
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Thu Oct 16 10:31:06 2014 -0700

    Changes for hive operator to test on cluster

commit 5e02867373c255f83427a3341b9a4d943b2f3a9d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Wed Oct 15 12:49:33 2014 -0700

    modifications for hive meta store

commit 7e62eebe98ac8fe9303c8cc3db090ca6371b38fd
Merge: 4039b01 2d75230
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Wed Oct 15 12:46:16 2014 -0700

    Merge branch 'dt-dev' of github.com:pm48/Malhar into Hive

commit 4039b01621f902116bd66c4ec36fe0ff692d5bef
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Tue Oct 14 11:12:27 2014 -0700

    changes for hive

commit ef97b8f02a0f461377797f3f268fa375009d2b0e
Author: Prerna Manaktala <prerna@datatorrent.com>
Date:   Fri Oct 10 10:55:57 2014 -0700

    commit for Hive operator
Done.

From:  chandnisingh <notifications@github.com>
Reply-To:  DataTorrent/Malhar
<reply+00538c5431572c9e899a0685b13b5b2db94a6d1bf2d69f7992cf00000001108de3969
2a170ce013fc184@reply.github.com>
Date:  Wednesday, November 26, 2014 at 11:53 AM
To:  DataTorrent/Malhar <Malhar@noreply.github.com>
Cc:  pm48 <prerna.manaktala@gmail.com>
Subject:  Re: [Malhar] Hive-HDFS Operator (#1159)


In library/src/main/java/com/datatorrent/lib/io/fs/AbstractFSWriter.java:
> @@ -222,7 +244,7 @@ public AbstractFSWriter()
>    protected FileSystem getFSInstance() throws IOException
>    {
>      FileSystem tempFS = FileSystem.newInstance(new Path(filePath).toUri(),
new Configuration());
> -
> +    LOG.info("temp fs is" + tempFS.getClass());
Why aren't we using slf4j Logger capabilities? Should be using braces
instead of forming the statement for concatenation

‹
Reply to this email directly or view it on GitHub
<https://github.com/DataTorrent/Malhar/pull/1159/files#r20955524> .