GitHub PushEvent at 2014-04-02 08:04:30
Repository: spark
Actor: mengxr
Payload: {"shas":[["5731af5be65ccac831445f351baf040a0d007687","17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","[SQL] Rewrite join implementation to allow streaming of one relation.\n\nBefore we were materializing everything in memory.  This also uses the projection interface so will be easier to plug in code gen (its ported from that branch).\n\n@rxin @liancheng\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #250 from marmbrus/hashJoin and squashes the following commits:\n\n1ad873e [Michael Armbrust] Change hasNext logic back to the correct version.\n8e6f2a2 [Michael Armbrust] Review comments.\n1e9fb63 [Michael Armbrust] style\nbc0cb84 [Michael Armbrust] Rewrite join implementation to allow streaming of one relation.","Michael Armbrust",false],["33b3c2a8c6c71b89744834017a183ea855e1697c","8bcd50e7b1eea79f965dde19d326001805380997@gmail.com","SPARK-1365 [HOTFIX] Fix RateLimitedOutputStream test\n\nThis test needs to be fixed. It currently depends on Thread.sleep() having exact-timing\nsemantics, which is not a valid assumption.\n\nAuthor: Patrick Wendell <pwendell@gmail.com>\n\nCloses #277 from pwendell/rate-limited-stream and squashes the following commits:\n\n6c0ff81 [Patrick Wendell] SPARK-1365: Fix RateLimitedOutputStream test","Patrick Wendell",false],["564f1c137caf07bd1f073ec6c93551dcad935ee5","5673041ad99da73cfefa170a7081c0daed5d97b6@cloudera.com","SPARK-1376. In the yarn-cluster submitter, rename \"args\" option to \"arg\"\n\nAuthor: Sandy Ryza <sandy@cloudera.com>\n\nCloses #279 from sryza/sandy-spark-1376 and squashes the following commits:\n\nd8aebfa [Sandy Ryza] SPARK-1376. In the yarn-cluster submitter, rename \"args\" option to \"arg\"","Sandy Ryza",false],["94fe7fd4fa9749cb13e540e4f9caf28de47eaf32","a5c478d606458f6c868a5126471748acd4730a6f@gmail.com","[SPARK-1377] Upgrade Jetty to 8.1.14v20131031\n\nPrevious version was 7.6.8v20121106. The only difference between Jetty 7 and Jetty 8 is that the former uses Servlet API 2.5, while the latter uses Servlet API 3.0.\n\nAuthor: Andrew Or <andrewor14@gmail.com>\n\nCloses #280 from andrewor14/jetty-upgrade and squashes the following commits:\n\ndd57104 [Andrew Or] Merge github.com:apache/spark into jetty-upgrade\ne75fa85 [Andrew Or] Upgrade Jetty to 8.1.14v20131031","Andrew Or",false],["ada310a9d3d5419e101b24d9b41398f609da1ad3","a5c478d606458f6c868a5126471748acd4730a6f@gmail.com","[Hot Fix #42] Persisted RDD disappears on storage page if re-used\n\nIf a previously persisted RDD is re-used, its information disappears from the Storage page.\n\nThis is because the tasks associated with re-using the RDD do not report the RDD's blocks as updated (which is correct). On stage submit, however, we overwrite any existing information regarding that RDD with a fresh one, whether or not the information for the RDD already exists.\n\nAuthor: Andrew Or <andrewor14@gmail.com>\n\nCloses #281 from andrewor14/ui-storage-fix and squashes the following commits:\n\n408585a [Andrew Or] Fix storage UI bug","Andrew Or",false],["f5c418da044ef7f3d7185cc5bb1bef79d7f4e25c","17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","[SQL] SPARK-1372 Support for caching and uncaching tables in a SQLContext.\n\nThis doesn't yet support different databases in Hive (though you can probably workaround this by calling `USE <dbname>`).  However, given the time constraints for 1.0 I think its probably worth including this now and extending the functionality in the next release.\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #282 from marmbrus/cacheTables and squashes the following commits:\n\n83785db [Michael Armbrust] Support for caching and uncaching tables in a SQLContext.","Michael Armbrust",false],["764353d2c5162352781c273dd3d4af6a309190c7","47f947204c0a430d1f3d77ee35599c230fda5709@gmail.com","[SPARK-1342] Scala 2.10.4\n\nJust a Scala version increment\n\nAuthor: Mark Hamstra <markhamstra@gmail.com>\n\nCloses #259 from markhamstra/scala-2.10.4 and squashes the following commits:\n\nfbec547 [Mark Hamstra] [SPARK-1342] Bumped Scala version to 2.10.4","Mark Hamstra",false],["afb5ea62786e3ca055e247176def3e7ecf0d2c9d","9e5fb37886959f2d43529d2ae616012951fc2577@cloudera.com","[Spark-1134] only call ipython if no arguments are given; remove IPYTHONOPTS from call\n\nsee comments on Pull Request https://github.com/apache/spark/pull/38\n(i couldn't figure out how to modify an existing pull request, so I'm hoping I can withdraw that one and replace it with this one.)\n\nAuthor: Diana Carroll <dcarroll@cloudera.com>\n\nCloses #227 from dianacarroll/spark-1134 and squashes the following commits:\n\nffe47f2 [Diana Carroll] [spark-1134] remove ipythonopts from ipython command\nb673bf7 [Diana Carroll] Merge branch 'master' of github.com:apache/spark\n0309cf9 [Diana Carroll] SPARK-1134 bug with ipython prevents non-interactive use with spark; only call ipython if no command line arguments were supplied","Diana Carroll",false],["45df9127365f8942794273b8ada004bf6ea3ef10","c481c5e387de8107aa9fe99c851e11e1ff44d0c3@databricks.com","Revert \"[Spark-1134] only call ipython if no arguments are given; remove IPYTHONOPTS from call\"\n\nThis reverts commit afb5ea62786e3ca055e247176def3e7ecf0d2c9d.","Matei Zaharia",false],["8b3045ceab591a3f3ca18823c7e2c5faca38a06e","e7094add069bd1fdbe6f5391b2cf9764f1037041@gmail.com","MLI-1 Decision Trees\n\nJoint work with @hirakendu, @etrain, @atalwalkar and @harsha2010.\n\nKey features:\n+ Supports binary classification and regression\n+ Supports gini, entropy and variance for information gain calculation\n+ Supports both continuous and categorical features\n\nThe algorithm has gone through several development iterations over the last few months leading to a highly optimized implementation. Optimizations include:\n\n1. Level-wise training to reduce passes over the entire dataset.\n2. Bin-wise split calculation to reduce computation overhead.\n3. Aggregation over partitions before combining to reduce communication overhead.\n\nAuthor: Manish Amde <manish9ue@gmail.com>\nAuthor: manishamde <manish9ue@gmail.com>\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #79 from manishamde/tree and squashes the following commits:\n\n1e8c704 [Manish Amde] remove numBins field in the Strategy class\n7d54b4f [manishamde] Merge pull request #4 from mengxr/dtree\nf536ae9 [Xiangrui Meng] another pass on code style\ne1dd86f [Manish Amde] implementing code style suggestions\n62dc723 [Manish Amde] updating javadoc and converting helper methods to package private to allow unit testing\n201702f [Manish Amde] making some more methods private\nf963ef5 [Manish Amde] making methods private\nc487e6a [manishamde] Merge pull request #1 from mengxr/dtree\n24500c5 [Xiangrui Meng] minor style updates\n4576b64 [Manish Amde] documentation and for to while loop conversion\nff363a7 [Manish Amde] binary search for bins and while loop for categorical feature bins\n632818f [Manish Amde] removing threshold for classification predict method\n2116360 [Manish Amde] removing dummy bin calculation for categorical variables\n6068356 [Manish Amde] ensuring num bins is always greater than max number of categories\n62c2562 [Manish Amde] fixing comment indentation\nad1fc21 [Manish Amde] incorporated mengxr's code style suggestions\nd1ef4f6 [Manish Amde] more documentation\n794ff4d [Manish Amde] minor improvements to docs and style\neb8fcbe [Manish Amde] minor code style updates\ncd2c2b4 [Manish Amde] fixing code style based on feedback\n63e786b [Manish Amde] added multiple train methods for java compatability\nd3023b3 [Manish Amde] adding more docs for nested methods\n84f85d6 [Manish Amde] code documentation\n9372779 [Manish Amde] code style: max line lenght <= 100\ndd0c0d7 [Manish Amde] minor: some docs\n0dd7659 [manishamde] basic doc\n5841c28 [Manish Amde] unit tests for categorical features\nf067d68 [Manish Amde] minor cleanup\nc0e522b [Manish Amde] updated predict and split threshold logic\nb09dc98 [Manish Amde] minor refactoring\n6b7de78 [Manish Amde] minor refactoring and tests\nd504eb1 [Manish Amde] more tests for categorical features\ndbb7ac1 [Manish Amde] categorical feature support\n6df35b9 [Manish Amde] regression predict logic\n53108ed [Manish Amde] fixing index for highest bin\ne23c2e5 [Manish Amde] added regression support\nc8f6d60 [Manish Amde] adding enum for feature type\nb0e3e76 [Manish Amde] adding enum for feature type\n154aa77 [Manish Amde] enums for configurations\n733d6dd [Manish Amde] fixed tests\n02c595c [Manish Amde] added command line parsing\n98ec8d5 [Manish Amde] tree building and prediction logic\nb0eb866 [Manish Amde] added logic to handle leaf nodes\n80e8c66 [Manish Amde] working version of multi-level split calculation\n4798aae [Manish Amde] added gain stats class\ndad0afc [Manish Amde] decison stump functionality working\n03f534c [Manish Amde] some more tests\n0012a77 [Manish Amde] basic stump working\n8bca1e2 [Manish Amde] additional code for creating intermediate RDD\n92cedce [Manish Amde] basic building blocks for intermediate RDD calculation. untested.\ncd53eae [Manish Amde] skeletal framework","Manish Amde",false],["11999c717bd02999728180c805fdf8d198600f5a","9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","Merge branch 'master' into vector","Xiangrui Meng",true],["c26c4fcc300cf48f5fdbae125ec1c7a0e2959202","9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","update DecisionTree to use RDD[Vector]","Xiangrui Meng",true],["eb6e79321548fc6e806105d731b12d87ac01e3de","9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","move libSVMFile to MLUtils and rename to loadLibSVMData","Xiangrui Meng",true]],"size":13,"ref":"refs/heads/vector","head":"eb6e79321548fc6e806105d731b12d87ac01e3de"}