GitHub PushEvent at 2014-09-02 16:25:48
Repository: spark
Actor: andrewor14
Payload: {"shas":[["1f98add92675eb34c80be9bd7d10ea4608a9a6c2","8bcd50e7b1eea79f965dde19d326001805380997@gmail.com","MAINTENANCE: Automated closing of pull requests.\n\nThis commit exists to close the following pull requests on Github:\n\nCloses #1696 (close requested by 'pwendell')\nCloses #1384 (close requested by 'pwendell')\nCloses #845 (close requested by 'pwendell')\nCloses #81 (close requested by 'pwendell')\nCloses #1528 (close requested by 'pwendell')\nCloses #1018 (close requested by 'pwendell')","Patrick Wendell",true],["db160676c56de54efc4d42c6466847c2c3b6a963","c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@apache.org","[SPARK-3135] Avoid extra mem copy in TorrentBroadcast via ByteArrayChunkOutputStream\n\nThis also enables supporting broadcast variables larger than 2G.\n\nAuthor: Reynold Xin <rxin@apache.org>\n\nCloses #2054 from rxin/ByteArrayChunkOutputStream and squashes the following commits:\n\n618d9c8 [Reynold Xin] Code review.\n93f5a51 [Reynold Xin] Added comments.\nee88e73 [Reynold Xin] to -> until\nbbd1cb1 [Reynold Xin] Renamed a variable.\n36f4d01 [Reynold Xin] Sort imports.\n8f1a8eb [Reynold Xin] [SPARK-3135] Created ByteArrayChunkOutputStream and used it to avoid memory copy in TorrentBroadcast.","Reynold Xin",true],["44d3a6a75209370b1648e2dfedaa4c895923dae5","9d468ac3e51a0dd55cd858437e2237db1fbaae1b@gmail.com","[SPARK-3342] Add SSDs to block device mapping\n\nOn `m3.2xlarge` instances the 2x80GB SSDs are inaccessible if not added to the block device mapping when the instance is created. They work when added with this patch. I have not tested this with other instance types, and I do not know much about this script and EC2 deployment in general. Maybe this code needs to depend on the instance type.\n\nThe requirement for this mapping is described in the AWS docs at:\nhttp://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html#InstanceStore_UsageScenarios\n\n\"For M3 instances, you must specify instance store volumes in the block\ndevice mapping for the instance. When you launch an M3 instance, we\nignore any instance store volumes specified in the block device mapping\nfor the AMI.\"\n\nAuthor: Daniel Darabos <darabos.daniel@gmail.com>\n\nCloses #2081 from darabos/patch-1 and squashes the following commits:\n\n1ceb2c8 [Daniel Darabos] Use %d string interpolation instead of {}.\na1854d7 [Daniel Darabos] Only specify ephemeral device mapping for M3.\ne0d9e37 [Daniel Darabos] Create ephemeral device mapping based on get_num_disks().\n6b116a6 [Daniel Darabos] Add SSDs to block device mapping","Daniel Darabos",true],["fbf2678c16acc0071ebd1cbdd165702635be5f0c","bdff7f849ddaeb48cc60ea6d20d05a7336797665@intel.com","SPARK-2636: Expose job ID in JobWaiter API\n\nThis PR adds the async actions to the Java API. User can call these async actions to get the FutureAction and use JobWaiter (for SimpleFutureAction) to retrieve job Id.\n\nAuthor: lirui <rui.li@intel.com>\n\nCloses #2176 from lirui-intel/SPARK-2636 and squashes the following commits:\n\nccaafb7 [lirui] SPARK-2636: fix java doc\n5536d55 [lirui] SPARK-2636: mark the async API as experimental\ne2e01d5 [lirui] SPARK-2636: add mima exclude\n0ca320d [lirui] SPARK-2636: fix method name & javadoc\n3fa39f7 [lirui] SPARK-2636: refine the patch\naf4f5d9 [lirui] SPARK-2636: remove unused imports\n843276c [lirui] SPARK-2636: only keep foreachAsync in the java API\nfbf5744 [lirui] SPARK-2636: add more async actions for java api\n1b25abc [lirui] SPARK-2636: expose some fields in JobWaiter\nd09f732 [lirui] SPARK-2636: fix build\neb1ee79 [lirui] SPARK-2636: change some parameters in SimpleFutureAction to member field\n6e2b87b [lirui] SPARK-2636: add java API for async actions","lirui",true]],"size":4,"ref":"refs/heads/master","head":"fbf2678c16acc0071ebd1cbdd165702635be5f0c"}