e6c4e09 | Shivaram Venkataraman | 21 June 2017, 18:49:19 UTC | Merge pull request #104 from lagerspetz/add-210 Added Spark 2.1.1. | 21 June 2017, 18:49:19 UTC |
697e802 | Eemil Lagerspetz | 21 June 2017, 07:50:23 UTC | Added Spark 2.1.1. | 21 June 2017, 07:50:23 UTC |
7af4f6d | Shivaram Venkataraman | 22 February 2017, 20:16:20 UTC | Merge pull request #87 from shiyuangu/branch-2.0 add missing spark_version 2.1.0 | 22 February 2017, 20:16:20 UTC |
045507a | S.Gu | 20 February 2017, 02:44:56 UTC | add missing spark_version 2.1.0 | 20 February 2017, 02:44:56 UTC |
9314296 | Shivaram Venkataraman | 11 January 2017, 00:06:05 UTC | Merge pull request #79 from dud225/branch-2.0 Get rid of useless mount flag | 11 January 2017, 00:06:05 UTC |
fcbe85f | Hervé Werner | 10 January 2017, 16:33:29 UTC | Get rid of useless mount flag See function __atime_needs_update in fs/inode.c of Linux | 10 January 2017, 16:37:17 UTC |
5188c78 | Shivaram Venkataraman | 16 November 2016, 22:18:08 UTC | Fix missing close quote | 16 November 2016, 22:18:08 UTC |
a3e1d7b | Shivaram Venkataraman | 15 November 2016, 17:17:34 UTC | Merge pull request #73 from lagerspetz/202 Add missing 1.6.1 and new 1.6.3 and 2.0.2 | 15 November 2016, 17:17:34 UTC |
bafa07c | Eemil Lagerspetz | 15 November 2016, 08:02:15 UTC | Add missing 1.6.1 and new 1.6.3 and 2.0.2 | 15 November 2016, 08:02:15 UTC |
81a5aeb | Shivaram Venkataraman | 10 October 2016, 16:05:39 UTC | Merge pull request #62 from lagerspetz/branch-2.0 Add Spark 2.0.1 to valid spark versions. | 10 October 2016, 16:05:39 UTC |
78280cb | Eemil Lagerspetz | 10 October 2016, 06:24:25 UTC | Added also Spark 1.6.2 | 10 October 2016, 06:24:25 UTC |
bd25efa | Eemil Lagerspetz | 09 October 2016, 05:50:27 UTC | Add Spark 2.0.1 to valid spark versions. | 09 October 2016, 05:50:27 UTC |
06f5d2b | Shivaram Venkataraman | 07 September 2016, 20:38:27 UTC | Merge pull request #48 from aaronj1331/tag-volumes Apply --additional-tags to EBS volumes | 07 September 2016, 20:38:27 UTC |
783a075 | Aaron Johnson | 07 September 2016, 04:41:27 UTC | Apply --additional-tags to EBS volumes - Add --tag-volumes option - Apply --additional-tags to any EBS volumes that are attached to any master or slave instances. | 07 September 2016, 05:01:51 UTC |
472d067 | Shivaram Venkataraman | 29 August 2016, 19:18:39 UTC | Merge pull request #46 from tomerk/branch-2.0 Enable launching with spark 2.0.0 | 29 August 2016, 19:18:39 UTC |
59045a1 | Tomer Kaftan | 29 August 2016, 18:44:12 UTC | Updated default spark version and hadoop version to 2.0.0 and yarn | 29 August 2016, 18:44:12 UTC |
8aff6d1 | Tomer Kaftan | 29 August 2016, 17:41:57 UTC | Now that it's been released, enable launching with spark 2.0.0 | 29 August 2016, 17:41:57 UTC |
d89a22e | Shivaram Venkataraman | 15 June 2016, 17:58:18 UTC | Merge pull request #35 from shivaram/2.0-preview Add support for 2.0.0-preview | 15 June 2016, 17:58:18 UTC |
79736f2 | Shivaram Venkataraman | 15 June 2016, 16:39:47 UTC | Remove debug print statement | 15 June 2016, 16:39:47 UTC |
11a2975 | Shivaram Venkataraman | 15 June 2016, 16:31:27 UTC | Address code review comments | 15 June 2016, 16:31:27 UTC |
38b0095 | Shivaram Venkataraman | 15 June 2016, 00:36:55 UTC | Check if hadoop version is YARN for Spark 2.0 | 15 June 2016, 00:36:55 UTC |
0020b7a | Shivaram Venkataraman | 14 June 2016, 23:09:52 UTC | Add support for 2.0.0-preview | 14 June 2016, 23:09:52 UTC |
31f7927 | Shivaram Venkataraman | 13 June 2016, 19:37:52 UTC | Merge pull request #32 from hyviquel/patch-1 Update c3 instances to hvm type | 13 June 2016, 19:37:52 UTC |
389a6b7 | Hervé Yviquel | 13 June 2016, 18:48:28 UTC | Update spark_ec2.py Move c3 instances to hvm type since they support it according to AWS documentation https://aws.amazon.com/fr/amazon-linux-ami/instance-type-matrix/ Indeed, Amazon currently recommends users choose HVM instead of PV because of the progress of the technology. | 13 June 2016, 18:48:28 UTC |
550e2c9 | Shivaram Venkataraman | 03 June 2016, 00:31:12 UTC | Cherry-pick README update from @kayousterhout | 03 June 2016, 00:31:12 UTC |
00461e8 | Shivaram Venkataraman | 19 April 2016, 17:36:35 UTC | Merge pull request #24 from nchammas/migrate-readme Migrate README from main Spark repo | 19 April 2016, 17:36:35 UTC |
3fd884b | Nicholas Chammas | 15 April 2016, 01:58:46 UTC | remove incorrect link | 15 April 2016, 01:58:46 UTC |
84e279d | Nicholas Chammas | 15 April 2016, 01:34:40 UTC | migrate README from main Spark repo | 15 April 2016, 01:34:40 UTC |
78c4a24 | Shivaram Venkataraman | 24 March 2016, 01:13:09 UTC | Merge pull request #23 from etrain/permissions-fix Making 'spark-ec2' executable. | 24 March 2016, 01:13:09 UTC |
78d8543 | Evan Sparks | 24 March 2016, 01:11:40 UTC | Making 'spark-ec2' executable. | 24 March 2016, 01:11:40 UTC |
998358d | Shivaram Venkataraman | 22 February 2016, 23:36:09 UTC | Merge pull request #21 from amplab/rxin-move-from-spark Move spark-ec2 script from Spark. | 22 February 2016, 23:36:09 UTC |
c602058 | Reynold Xin | 09 January 2016, 06:37:07 UTC | Add deploy.generic. | 09 January 2016, 06:37:07 UTC |
5b3c932 | Reynold Xin | 09 January 2016, 06:34:01 UTC | Move spark-ec2 script from Spark. | 09 January 2016, 06:34:01 UTC |
a990752 | Shivaram Venkataraman | 16 September 2015, 04:13:17 UTC | Merge pull request #11 from serialx/hadoop-native-fix Fix hadoop native library collision in YARN | 16 September 2015, 04:13:17 UTC |
3ecafa0 | Brian Hong | 15 September 2015, 05:05:29 UTC | Fix hadoop native library collision in YARN Signed-off-by: Brian Hong <sungjinhong@devsisters.com> | 15 September 2015, 07:18:28 UTC |
b778025 | Shivaram Venkataraman | 15 September 2015, 05:04:03 UTC | Merge pull request #10 from saurfang/yarn-ec2 [SPARK-8939] [EC2] YARN EC2 default setting fails with IllegalArgumentException | 15 September 2015, 05:04:03 UTC |
c4bcbd6 | Forest Fang | 15 September 2015, 03:55:06 UTC | Surround {{spark_worker_instances}} with quotes | 15 September 2015, 03:55:06 UTC |
03430c6 | Shivaram Venkataraman | 13 September 2015, 05:38:13 UTC | Merge pull request #9 from jeffusan/branch-1.5 updating phplib to 5.6 fixes ganglia setup | 13 September 2015, 05:38:13 UTC |
1e10565 | Jeff Hemminger | 13 September 2015, 05:21:24 UTC | updating phplib to 5.6 fixes ganglia setup | 13 September 2015, 05:21:24 UTC |
07566b7 | Shivaram Venkataraman | 20 August 2015, 21:34:57 UTC | Merge pull request #3 from mdagost/fix_private_submission BUG: Add explicit exports to fix private IP submission. | 20 August 2015, 21:34:57 UTC |
5eed2ed | Michelangelo D'Agostino | 20 August 2015, 21:14:13 UTC | Combine SPARK_PUBLIC_DNS export options. | 20 August 2015, 21:14:13 UTC |
3e7d2b6 | Michelangelo D'Agostino | 12 August 2015, 18:01:25 UTC | BUG: Add explicit exports to fix private IP submission. | 12 August 2015, 18:01:25 UTC |
3c81699 | Shivaram Venkataraman | 15 July 2015, 16:01:26 UTC | Merge pull request #130 from darabos/patch-1 Return positive value on error | 15 July 2015, 16:01:26 UTC |
cb285a4 | Shivaram Venkataraman | 15 July 2015, 14:19:37 UTC | Merge pull request #131 from shivaram/rstudio-fix [HOTFIX] Fix check in create_temp_dirs | 15 July 2015, 14:19:37 UTC |
c8d91fe | Shivaram Venkataraman | 15 July 2015, 14:13:58 UTC | Fix create_temp_dirs in rstudio/init.sh | 15 July 2015, 14:13:58 UTC |
18047a5 | Daniel Darabos | 15 July 2015, 13:00:29 UTC | Return positive value on error in persistent-hdfs/init.sh | 15 July 2015, 13:00:29 UTC |
fec2b2b | Daniel Darabos | 15 July 2015, 12:59:48 UTC | Return positive value on error in ephemeral-hdfs/init.sh | 15 July 2015, 12:59:48 UTC |
8bdbf71 | Shivaram Venkataraman | 11 July 2015, 18:04:35 UTC | Merge pull request #129 from koaning/rstudio-install [SPARK-8596] Rstudio install | 11 July 2015, 18:04:35 UTC |
e7d64e7 | Vincent D. Warmerdam | 11 July 2015, 11:56:37 UTC | ! -e catch, removed unneeded sudo | 11 July 2015, 11:56:37 UTC |
bbdac09 | Vincent D. Warmerdam | 09 July 2015, 12:32:07 UTC | added shivaram comments | 09 July 2015, 12:32:07 UTC |
a64a40a | Vincent D. Warmerdam | 07 July 2015, 20:20:48 UTC | force user to supply password | 07 July 2015, 20:20:48 UTC |
0d617d4 | Vincent D. Warmerdam | 07 July 2015, 12:34:47 UTC | placed code in more appropriate places | 07 July 2015, 12:34:47 UTC |
f9af12c | Vincent D. Warmerdam | 06 July 2015, 19:38:46 UTC | ulimit set via rstudio/init.sh | 06 July 2015, 19:38:46 UTC |
fe6e4d6 | Shivaram Venkataraman | 06 July 2015, 17:59:52 UTC | Merge pull request #128 from armisael/patch-1 [MESOS-2985] [SPARK-8726] Give to spark workers the correct amount of memory | 06 July 2015, 17:59:52 UTC |
447ff9c | Vincent D. Warmerdam | 06 July 2015, 12:29:36 UTC | ulimit now in init.sh | 06 July 2015, 12:29:36 UTC |
c4a8ab2 | Vincent D. Warmerdam | 06 July 2015, 11:36:18 UTC | sparklink now via file instead of curl | 06 July 2015, 11:36:18 UTC |
26b8767 | Vincent D. Warmerdam | 06 July 2015, 11:14:23 UTC | turned rprofile into a starter script | 06 July 2015, 11:14:23 UTC |
557325a | Vincent D. Warmerdam | 03 July 2015, 13:23:23 UTC | removed init script for R. better if done manual | 03 July 2015, 13:23:23 UTC |
ea48166 | Vincent D. Warmerdam | 03 July 2015, 09:29:19 UTC | added .Rprofile | 03 July 2015, 09:29:19 UTC |
19ae4a5 | Stefano Parmesan | 02 July 2015, 18:03:49 UTC | rename default_spark_mem template variable to spark_worker_mem | 02 July 2015, 18:03:49 UTC |
b5ccd30 | Vincent D. Warmerdam | 02 July 2015, 09:15:31 UTC | naive rstudio install, old r version | 02 July 2015, 09:15:31 UTC |
7877268 | Stefano Parmesan | 02 July 2015, 07:02:48 UTC | Give to spark workers the correct amount of memory As described in SPARK-8726, spark workers were given `min(slave_ram_kb, master_ram_kb)` memory by default, which could lead to unused memory when master and slaves instance types are different. This commit also introduces a better naming for the variable `spark_mb`. | 02 July 2015, 07:02:48 UTC |
262fe32 | Shivaram Venkataraman | 01 July 2015, 16:22:33 UTC | Merge pull request #127 from uronce-cc/branch-1.4-tachyon-conf add missing tachyon conf in template | 01 July 2015, 16:22:33 UTC |
3bd7f6a | cc | 01 July 2015, 06:22:15 UTC | add missing tachyon conf in template | 01 July 2015, 06:22:15 UTC |
9d3326e | Vincent D. Warmerdam | 30 June 2015, 21:02:49 UTC | first steps for getting right r version installed | 30 June 2015, 21:02:49 UTC |
75b7656 | Vincent D. Warmerdam | 28 June 2015, 10:14:48 UTC | added epel upgrade to install script, should allow R-3.2 | 28 June 2015, 10:14:48 UTC |
8b13ca0 | Shivaram Venkataraman | 27 June 2015, 18:50:20 UTC | Merge pull request #125 from uronce-cc/branch-1.4-tachyon-0.6.4 Add configurations for Tachyon | 27 June 2015, 18:50:20 UTC |
cf51184 | cc | 27 June 2015, 13:40:15 UTC | without these configurations, OFF_HEAP persistence will not work out of box | 27 June 2015, 13:40:15 UTC |
cea0509 | cc | 27 June 2015, 13:39:38 UTC | new configuration for tachyon0.6.4 | 27 June 2015, 13:39:38 UTC |
e642aa3 | Shivaram Venkataraman | 18 June 2015, 21:29:29 UTC | Merge pull request #123 from shivaram/worker-instances-fix Handle empty worker instances | 18 June 2015, 21:29:29 UTC |
d788ed9 | Shivaram Venkataraman | 18 June 2015, 21:26:22 UTC | Merge pull request #124 from uronce-cc/branch-1.4-tachyon-0.6.4 Add tachyon releases 0.6.4 | 18 June 2015, 21:26:22 UTC |
d331a7e | cc | 18 June 2015, 16:33:24 UTC | add hadoop2.4 to any tachyon version | 18 June 2015, 16:33:24 UTC |
a8d38ee | cc | 18 June 2015, 05:11:12 UTC | add tachyon releases 0.6.4 | 18 June 2015, 05:11:12 UTC |
56d961c | Shivaram Venkataraman | 14 June 2015, 21:49:34 UTC | Move cores calc inside if | 14 June 2015, 21:49:34 UTC |
c30141a | Shivaram Venkataraman | 14 June 2015, 21:42:01 UTC | Handle empty string for worker instances in YARN | 14 June 2015, 21:42:01 UTC |
48a01d1 | Shivaram Venkataraman | 11 June 2015, 18:15:55 UTC | Merge pull request #119 from brdw/branch-1.4 prebuilt urls are not valid since 0.7. Should default to new scheme | 11 June 2015, 18:15:55 UTC |
d30ca59 | Brad Willard | 11 June 2015, 18:00:23 UTC | prebuilt urls are not valid since 0.7. Should default to new scheme | 11 June 2015, 18:00:23 UTC |
f38eace | Shivaram Venkataraman | 03 June 2015, 23:11:31 UTC | Merge pull request #116 from shivaram/yarn-1.4 [branch-1.4] Support for launching YARN clusters | 03 June 2015, 23:11:31 UTC |
c525694 | Shivaram Venkataraman | 27 May 2015, 18:08:26 UTC | Merge pull request #117 from meawoppl/patch-1 Tweak to make script work in py3 | 27 May 2015, 18:08:26 UTC |
68c4b28 | Shivaram Venkataraman | 27 May 2015, 01:24:12 UTC | Set WORKERS_INSTANCES inside if | 27 May 2015, 01:50:41 UTC |
0ecf087 | Matty G | 26 May 2015, 19:01:52 UTC | Tweak to make script work in py3 | 26 May 2015, 19:01:52 UTC |
b707521 | Shivaram Venkataraman | 23 May 2015, 05:33:20 UTC | Handle newer Spark versions Also update persistent hdfs core-site.xml | 23 May 2015, 05:33:20 UTC |
decdb5a | Shivaram Venkataraman | 23 May 2015, 04:38:45 UTC | Port YARN to branch-1.4 | 23 May 2015, 04:38:45 UTC |
74e884c | Shivaram Venkataraman | 22 April 2015, 23:32:57 UTC | Merge pull request #115 from tkunicki/spark_ui_without_public_dns Spark UI: Fallback to private IP if public DNS not available | 22 April 2015, 23:32:57 UTC |
b21512e | Tom Kunicki | 22 April 2015, 19:53:02 UTC | Update spark-env.sh to use private IP if public DNS not available | 22 April 2015, 19:53:02 UTC |
f0a48be | Shivaram Venkataraman | 12 March 2015, 17:33:22 UTC | Merge pull request #106 from uronce-cc/NewBranch-1.4 make tachyon version configurable | 12 March 2015, 17:33:22 UTC |
29a3d54 | cheng chang | 12 March 2015, 05:25:41 UTC | make tachyon version configurable add git hash not implemented info | 12 March 2015, 06:21:25 UTC |
d9180c1 | Shivaram Venkataraman | 06 March 2015, 02:48:44 UTC | Merge pull request #102 from uronce-cc/AddNewTachyonVersion update tachyon version | 06 March 2015, 02:48:44 UTC |
13efaac | cheng chang | 06 March 2015, 01:49:39 UTC | update tachyon version add hadoop version support | 06 March 2015, 01:53:16 UTC |
626531e | Shivaram Venkataraman | 11 February 2015, 02:11:39 UTC | Merge pull request #100 from nchammas/patch-1 Minor rewording + typo fix | 11 February 2015, 02:11:39 UTC |
fbfe66b | Nicholas Chammas | 11 February 2015, 02:07:07 UTC | Minor rewording + typo fix | 11 February 2015, 02:07:07 UTC |
b152a11 | Shivaram Venkataraman | 11 February 2015, 01:54:48 UTC | Merge pull request #99 from nchammas/contrib Move contributing guide to separate file | 11 February 2015, 01:54:48 UTC |
ca2d0f0 | Nicholas Chammas | 11 February 2015, 01:37:04 UTC | add branch and testing info | 11 February 2015, 01:37:04 UTC |
b888789 | Nicholas Chammas | 10 February 2015, 23:10:58 UTC | move contributing to separate file | 10 February 2015, 23:24:00 UTC |
d4800c1 | Shivaram Venkataraman | 10 February 2015, 22:35:06 UTC | Merge pull request #97 from laserson/fix-spark-1.2.1 Add Spark 1.2.1 to init.sh | 10 February 2015, 22:35:06 UTC |
626ebee | Uri Laserson | 10 February 2015, 22:26:06 UTC | Add Spark 1.2.1 to init.sh | 10 February 2015, 22:26:06 UTC |
0d70863 | Shivaram Venkataraman | 10 February 2015, 16:55:52 UTC | Merge pull request #96 from shivaram/mesos-spark-ec2-branch-1.3 Add Apache license and update README | 10 February 2015, 16:55:52 UTC |
5d350eb | Shivaram Venkataraman | 10 February 2015, 00:51:14 UTC | Add Apache license and update README | 10 February 2015, 00:51:14 UTC |
c617a70 | Shivaram Venkataraman | 06 February 2015, 20:11:38 UTC | Merge pull request #92 from voukka/SPARK-5246_resolve_hostname_2 fixed another bug in the bug fix for SPARK-5246 | 06 February 2015, 20:11:38 UTC |
a7e6839 | Shivaram Venkataraman | 06 February 2015, 20:05:44 UTC | Merge pull request #95 from fredcons/branch-1.3 SPARK-1302 : Fixing ganglia httpd configuration file | 06 February 2015, 20:05:44 UTC |