https://github.com/amplab/spark-ec2

sort by:
Revision Author Date Message Commit Date
4b04db3 Update readme to say project is archived. 22 November 2017, 21:44:35 UTC
f4bc534 Merge pull request #117 from nchammas/flintrock-pointer Add README note about project status and recommended alternative 04 November 2017, 17:32:43 UTC
9c3fa5b add GitHub issue and PR templates to redirect people appropriately 03 November 2017, 21:00:06 UTC
c3d7eed add README note about project status and recommended alternative 31 October 2017, 02:56:05 UTC
9eaa036 Merge pull request #108 from robhudson/patch-1 Fix spacing of code examples in README 29 June 2017, 17:10:02 UTC
a804c94 Fix spacing of code examples in README 29 June 2017, 16:27:21 UTC
4b57900 Merge pull request #54 from ndtreviv/branch-1.6 Update README.md 26 September 2016, 16:15:35 UTC
e995cc6 Update README.md Fixed link to configuration page 23 September 2016, 11:27:37 UTC
dcdc566 Merge pull request #37 from cjosephson/branch-1.6 Update Spark versions and branches 19 July 2016, 01:27:28 UTC
a284fdf Merge branch 'branch-1.6' of https://github.com/cjosephson/spark-ec2 into branch-1.6 11 July 2016, 21:06:46 UTC
8d2d1d3 Changed DEFAULT_SPARK_EC2_BRANCH from 1.5 to 1.6, added Spark 1.6.1 and 1.6.2 to VALID_SPARK_VERSIONS list, and changed SPARK_EC2_VERSION to latest stable 1.6.2 11 July 2016, 21:06:16 UTC
6beaf9e changed SPARK_EC2_VERSION to latest stable 1.6.2 11 July 2016, 21:05:55 UTC
232e84b Changed DEFAULT_SPARK_EC2_BRANCH from 1.5 to 1.6 and added Spark 1.6.1 and 1.6.2 to VALID_SPARK_VERSIONS list. 11 July 2016, 20:52:05 UTC
f8a8bd5 Merge pull request #36 from EdGENetworks/feature/change-default-ec2-instance change default instance from m1.large to m3.large 05 July 2016, 22:10:56 UTC
bbaff24 change default instance from m1.large to m3.large 05 July 2016, 05:11:35 UTC
31f7927 Merge pull request #32 from hyviquel/patch-1 Update c3 instances to hvm type 13 June 2016, 19:37:52 UTC
389a6b7 Update spark_ec2.py Move c3 instances to hvm type since they support it according to AWS documentation https://aws.amazon.com/fr/amazon-linux-ami/instance-type-matrix/ Indeed, Amazon currently recommends users choose HVM instead of PV because of the progress of the technology. 13 June 2016, 18:48:28 UTC
550e2c9 Cherry-pick README update from @kayousterhout 03 June 2016, 00:31:12 UTC
00461e8 Merge pull request #24 from nchammas/migrate-readme Migrate README from main Spark repo 19 April 2016, 17:36:35 UTC
3fd884b remove incorrect link 15 April 2016, 01:58:46 UTC
84e279d migrate README from main Spark repo 15 April 2016, 01:34:40 UTC
78c4a24 Merge pull request #23 from etrain/permissions-fix Making 'spark-ec2' executable. 24 March 2016, 01:13:09 UTC
78d8543 Making 'spark-ec2' executable. 24 March 2016, 01:11:40 UTC
998358d Merge pull request #21 from amplab/rxin-move-from-spark Move spark-ec2 script from Spark. 22 February 2016, 23:36:09 UTC
c602058 Add deploy.generic. 09 January 2016, 06:37:07 UTC
5b3c932 Move spark-ec2 script from Spark. 09 January 2016, 06:34:01 UTC
a990752 Merge pull request #11 from serialx/hadoop-native-fix Fix hadoop native library collision in YARN 16 September 2015, 04:13:17 UTC
3ecafa0 Fix hadoop native library collision in YARN Signed-off-by: Brian Hong <sungjinhong@devsisters.com> 15 September 2015, 07:18:28 UTC
b778025 Merge pull request #10 from saurfang/yarn-ec2 [SPARK-8939] [EC2] YARN EC2 default setting fails with IllegalArgumentException 15 September 2015, 05:04:03 UTC
c4bcbd6 Surround {{spark_worker_instances}} with quotes 15 September 2015, 03:55:06 UTC
03430c6 Merge pull request #9 from jeffusan/branch-1.5 updating phplib to 5.6 fixes ganglia setup 13 September 2015, 05:38:13 UTC
1e10565 updating phplib to 5.6 fixes ganglia setup 13 September 2015, 05:21:24 UTC
07566b7 Merge pull request #3 from mdagost/fix_private_submission BUG: Add explicit exports to fix private IP submission. 20 August 2015, 21:34:57 UTC
5eed2ed Combine SPARK_PUBLIC_DNS export options. 20 August 2015, 21:14:13 UTC
3e7d2b6 BUG: Add explicit exports to fix private IP submission. 12 August 2015, 18:01:25 UTC
3c81699 Merge pull request #130 from darabos/patch-1 Return positive value on error 15 July 2015, 16:01:26 UTC
cb285a4 Merge pull request #131 from shivaram/rstudio-fix [HOTFIX] Fix check in create_temp_dirs 15 July 2015, 14:19:37 UTC
c8d91fe Fix create_temp_dirs in rstudio/init.sh 15 July 2015, 14:13:58 UTC
18047a5 Return positive value on error in persistent-hdfs/init.sh 15 July 2015, 13:00:29 UTC
fec2b2b Return positive value on error in ephemeral-hdfs/init.sh 15 July 2015, 12:59:48 UTC
8bdbf71 Merge pull request #129 from koaning/rstudio-install [SPARK-8596] Rstudio install 11 July 2015, 18:04:35 UTC
e7d64e7 ! -e catch, removed unneeded sudo 11 July 2015, 11:56:37 UTC
bbdac09 added shivaram comments 09 July 2015, 12:32:07 UTC
a64a40a force user to supply password 07 July 2015, 20:20:48 UTC
0d617d4 placed code in more appropriate places 07 July 2015, 12:34:47 UTC
f9af12c ulimit set via rstudio/init.sh 06 July 2015, 19:38:46 UTC
fe6e4d6 Merge pull request #128 from armisael/patch-1 [MESOS-2985] [SPARK-8726] Give to spark workers the correct amount of memory 06 July 2015, 17:59:52 UTC
447ff9c ulimit now in init.sh 06 July 2015, 12:29:36 UTC
c4a8ab2 sparklink now via file instead of curl 06 July 2015, 11:36:18 UTC
26b8767 turned rprofile into a starter script 06 July 2015, 11:14:23 UTC
557325a removed init script for R. better if done manual 03 July 2015, 13:23:23 UTC
ea48166 added .Rprofile 03 July 2015, 09:29:19 UTC
19ae4a5 rename default_spark_mem template variable to spark_worker_mem 02 July 2015, 18:03:49 UTC
b5ccd30 naive rstudio install, old r version 02 July 2015, 09:15:31 UTC
7877268 Give to spark workers the correct amount of memory As described in SPARK-8726, spark workers were given `min(slave_ram_kb, master_ram_kb)` memory by default, which could lead to unused memory when master and slaves instance types are different. This commit also introduces a better naming for the variable `spark_mb`. 02 July 2015, 07:02:48 UTC
262fe32 Merge pull request #127 from uronce-cc/branch-1.4-tachyon-conf add missing tachyon conf in template 01 July 2015, 16:22:33 UTC
3bd7f6a add missing tachyon conf in template 01 July 2015, 06:22:15 UTC
9d3326e first steps for getting right r version installed 30 June 2015, 21:02:49 UTC
75b7656 added epel upgrade to install script, should allow R-3.2 28 June 2015, 10:14:48 UTC
8b13ca0 Merge pull request #125 from uronce-cc/branch-1.4-tachyon-0.6.4 Add configurations for Tachyon 27 June 2015, 18:50:20 UTC
cf51184 without these configurations, OFF_HEAP persistence will not work out of box 27 June 2015, 13:40:15 UTC
cea0509 new configuration for tachyon0.6.4 27 June 2015, 13:39:38 UTC
e642aa3 Merge pull request #123 from shivaram/worker-instances-fix Handle empty worker instances 18 June 2015, 21:29:29 UTC
d788ed9 Merge pull request #124 from uronce-cc/branch-1.4-tachyon-0.6.4 Add tachyon releases 0.6.4 18 June 2015, 21:26:22 UTC
d331a7e add hadoop2.4 to any tachyon version 18 June 2015, 16:33:24 UTC
a8d38ee add tachyon releases 0.6.4 18 June 2015, 05:11:12 UTC
56d961c Move cores calc inside if 14 June 2015, 21:49:34 UTC
c30141a Handle empty string for worker instances in YARN 14 June 2015, 21:42:01 UTC
48a01d1 Merge pull request #119 from brdw/branch-1.4 prebuilt urls are not valid since 0.7. Should default to new scheme 11 June 2015, 18:15:55 UTC
d30ca59 prebuilt urls are not valid since 0.7. Should default to new scheme 11 June 2015, 18:00:23 UTC
f38eace Merge pull request #116 from shivaram/yarn-1.4 [branch-1.4] Support for launching YARN clusters 03 June 2015, 23:11:31 UTC
c525694 Merge pull request #117 from meawoppl/patch-1 Tweak to make script work in py3 27 May 2015, 18:08:26 UTC
68c4b28 Set WORKERS_INSTANCES inside if 27 May 2015, 01:50:41 UTC
0ecf087 Tweak to make script work in py3 26 May 2015, 19:01:52 UTC
b707521 Handle newer Spark versions Also update persistent hdfs core-site.xml 23 May 2015, 05:33:20 UTC
decdb5a Port YARN to branch-1.4 23 May 2015, 04:38:45 UTC
74e884c Merge pull request #115 from tkunicki/spark_ui_without_public_dns Spark UI: Fallback to private IP if public DNS not available 22 April 2015, 23:32:57 UTC
b21512e Update spark-env.sh to use private IP if public DNS not available 22 April 2015, 19:53:02 UTC
f0a48be Merge pull request #106 from uronce-cc/NewBranch-1.4 make tachyon version configurable 12 March 2015, 17:33:22 UTC
29a3d54 make tachyon version configurable add git hash not implemented info 12 March 2015, 06:21:25 UTC
d9180c1 Merge pull request #102 from uronce-cc/AddNewTachyonVersion update tachyon version 06 March 2015, 02:48:44 UTC
13efaac update tachyon version add hadoop version support 06 March 2015, 01:53:16 UTC
626531e Merge pull request #100 from nchammas/patch-1 Minor rewording + typo fix 11 February 2015, 02:11:39 UTC
fbfe66b Minor rewording + typo fix 11 February 2015, 02:07:07 UTC
b152a11 Merge pull request #99 from nchammas/contrib Move contributing guide to separate file 11 February 2015, 01:54:48 UTC
ca2d0f0 add branch and testing info 11 February 2015, 01:37:04 UTC
b888789 move contributing to separate file 10 February 2015, 23:24:00 UTC
d4800c1 Merge pull request #97 from laserson/fix-spark-1.2.1 Add Spark 1.2.1 to init.sh 10 February 2015, 22:35:06 UTC
626ebee Add Spark 1.2.1 to init.sh 10 February 2015, 22:26:06 UTC
0d70863 Merge pull request #96 from shivaram/mesos-spark-ec2-branch-1.3 Add Apache license and update README 10 February 2015, 16:55:52 UTC
5d350eb Add Apache license and update README 10 February 2015, 00:51:14 UTC
c617a70 Merge pull request #92 from voukka/SPARK-5246_resolve_hostname_2 fixed another bug in the bug fix for SPARK-5246 06 February 2015, 20:11:38 UTC
a7e6839 Merge pull request #95 from fredcons/branch-1.3 SPARK-1302 : Fixing ganglia httpd configuration file 06 February 2015, 20:05:44 UTC
ab75773 Merge pull request #93 from dselivanov/branch-1.3 workaround for hi1.4xlarge instances (similar to r3) 03 February 2015, 18:30:30 UTC
56de800 fix for hi1 03 February 2015, 14:55:13 UTC
770941e Merge pull request #94 from tomerk/i2-ssd Added support for I2.xlarge ssd 27 January 2015, 19:00:46 UTC
d64fc76 Response to pull request comments 27 January 2015, 18:26:10 UTC
cb29b37 Added support for I2.xlarge ssd 26 January 2015, 21:58:43 UTC
8ddea42 fixed according to coding style 19 January 2015, 19:34:44 UTC
95c693c fixed another bug in the bug fix for https://issues.apache.org/jira/browse/SPARK-5246. Doh. 19 January 2015, 16:54:43 UTC
back to top