| edb91a3 | mbautin | 19 November 2012, 19:52:10 UTC | Addressing Matei's comment: SPARK_LOCAL_IP environment variable | 19 November 2012, 21:44:51 UTC |
| eeb093b | mbautin | 15 November 2012, 21:44:13 UTC | SPARK-624: make the default local IP customizable | 19 November 2012, 21:44:42 UTC |
| 5c0835f | Matei Zaharia | 17 November 2012, 04:48:35 UTC | Doc fix | 17 November 2012, 04:48:42 UTC |
| 7c1be97 | Matei Zaharia | 15 November 2012, 20:55:34 UTC | Change version to 0.6.1 | 15 November 2012, 20:55:34 UTC |
| 8892603 | Matei Zaharia | 15 November 2012, 08:10:52 UTC | Use DNS names instead of IP addresses in standalone mode, to allow matching with data locality hints from storage systems. | 15 November 2012, 08:11:40 UTC |
| 9d8e17d | Matei Zaharia | 15 November 2012, 06:37:05 UTC | Fix Java/Scala home having spaces on Windows | 15 November 2012, 08:11:31 UTC |
| 9b80225 | Matei Zaharia | 12 November 2012, 05:06:57 UTC | Detect correctly when one has disconnected from a standalone cluster. SPARK-617 #resolve | 12 November 2012, 05:22:17 UTC |
| dc84ce7 | root | 11 November 2012, 07:05:22 UTC | Fix K-means example a little | 11 November 2012, 07:05:22 UTC |
| 9d5740f | Tathagata Das | 09 November 2012, 23:46:15 UTC | Incorporated Matei's suggestions. Tested with 5 producer(consumer) threads each doing 50k puts (gets), took 15 minutes to run, no errors or deadlocks. | 10 November 2012, 04:28:04 UTC |
| e870ca5 | Tathagata Das | 09 November 2012, 22:09:37 UTC | Fixed deadlock in BlockManager. 1. Changed the lock structure of BlockManager by replacing the 337 coarse-grained locks to use BlockInfo objects as per-block fine-grained locks. 2. Changed the MemoryStore lock structure by making the block putting threads lock on a different object (not the memory store) thus making sure putting threads minimally blocks to the getting treads. 3. Added spark.storage.ThreadingTest to stress test the BlockManager using 5 block producer and 5 block consumer threads. | 10 November 2012, 04:27:56 UTC |
| bb2b9ff | Matei Zaharia | 09 November 2012, 07:13:12 UTC | Added an option to spread out jobs in the standalone mode. | 09 November 2012, 07:13:50 UTC |
| b3b52c9 | Matei Zaharia | 08 November 2012, 17:53:40 UTC | Fix for connections not being reused (from Josh Rosen) | 08 November 2012, 17:54:17 UTC |
| a245408 | Matei Zaharia | 08 November 2012, 08:10:13 UTC | Merge pull request #300 from enachb/mesos_slavelost fix bug in getting slave id out of mesos | 08 November 2012, 08:10:13 UTC |
| 4fe0d80 | Imran Rashid | 07 November 2012, 23:35:51 UTC | fix bug in getting slave id out of mesos | 08 November 2012, 05:45:54 UTC |
| 5acd753 | Matei Zaharia | 21 October 2012, 06:33:37 UTC | Various fixes to standalone mode and web UI: - Don't report a job as finishing multiple times - Don't show state of workers as LOADING when they're running - Show start and finish times in web UI - Sort web UI tables by ID and time by default | 08 November 2012, 00:51:16 UTC |
| 171e97a | Josh Rosen | 31 October 2012, 06:32:38 UTC | Cancel spot instance requests when exiting spark-ec2. | 07 November 2012, 23:14:32 UTC |
| d20142b | Shivaram Venkataraman | 01 November 2012, 17:46:38 UTC | Remove unnecessary hash-map put in MemoryStore | 07 November 2012, 23:13:59 UTC |
| 43465e9 | Josh Rosen | 04 November 2012, 00:02:47 UTC | Fix check for existing instances during EC2 launch. | 07 November 2012, 23:08:40 UTC |
| cf0bf73 | Josh Rosen | 18 October 2012, 17:01:38 UTC | Allow EC2 script to stop/destroy cluster after master/slave failures. | 07 November 2012, 23:06:00 UTC |
| ef683d4 | Josh Rosen | 23 October 2012, 20:49:52 UTC | Fix minor typos in quick start guide. | 07 November 2012, 23:03:50 UTC |
| 222355e | Thomas Dudziak | 22 October 2012, 20:10:47 UTC | Tweaked run file to live more happily with typesafe's debian package | 07 November 2012, 23:02:46 UTC |
| d2b2fc2 | Matei Zaharia | 06 November 2012, 23:57:38 UTC | Made Akka timeout and message frame size configurable, and upped the defaults | 06 November 2012, 23:57:38 UTC |
| d338742 | root | 26 October 2012, 07:31:08 UTC | Don't throw an error in the block manager when a block is cached on the master due to a locally computed operation | 26 October 2012, 07:31:08 UTC |
| ce143d6 | Matei Zaharia | 25 October 2012, 04:52:13 UTC | Strip leading mesos:// in URLs passed to Mesos | 25 October 2012, 04:52:40 UTC |
| 902a608 | Matei Zaharia | 22 October 2012, 18:43:57 UTC | Update version to 0.6.1-SNAPSHOT to show this is in development | 22 October 2012, 18:43:57 UTC |
| 1be335e | Matei Zaharia | 21 October 2012, 07:05:02 UTC | Merge branch 'master' into dev | 21 October 2012, 07:05:02 UTC |
| 15e95be | Matei Zaharia | 21 October 2012, 06:35:01 UTC | Merge pull request #285 from tomdz/cdh4-dev Support for Hadoop 2 distributions such as cdh4 | 21 October 2012, 06:35:01 UTC |
| 6999724 | Matei Zaharia | 21 October 2012, 06:33:37 UTC | Fix a path in the web UI | 21 October 2012, 06:33:37 UTC |
| 45430f2 | Patrick Wendell | 20 October 2012, 06:18:44 UTC | Merge pull request #290 from pwendell/dev Two trivial commits to test JIRA integration | 20 October 2012, 06:18:44 UTC |
| cd09365 | Patrick Wendell | 20 October 2012, 06:14:37 UTC | SPARK-581 #resolve Removing whitespace to test JIRA | 20 October 2012, 06:17:44 UTC |
| d50028b | Patrick Wendell | 20 October 2012, 06:14:25 UTC | Adding whitespace to test JIRA integration | 20 October 2012, 06:17:44 UTC |
| bff5cef | Matei Zaharia | 19 October 2012, 08:12:05 UTC | Merge pull request #287 from rxin/startslave Use SPARK_MASTER_IP if it is set in start-slaves.sh. | 19 October 2012, 08:12:05 UTC |
| f67bcbe | Reynold Xin | 19 October 2012, 08:08:23 UTC | Use SPARK_MASTER_IP if it is set in start-slaves.sh. | 19 October 2012, 08:08:23 UTC |
| d9c2a89 | Thomas Dudziak | 09 October 2012, 22:21:38 UTC | Support for Hadoop 2 distributions such as cdh4 | 18 October 2012, 23:08:54 UTC |
| 388a111 | Matei Zaharia | 15 October 2012, 17:21:16 UTC | Fix sbt assembly's merge rules | 15 October 2012, 17:21:16 UTC |
| 63fe4e9 | Matei Zaharia | 15 October 2012, 02:36:41 UTC | Merge pull request #279 from pwendell/dev Removing credentials line in build. | 15 October 2012, 02:36:41 UTC |
| 629dd26 | Patrick Wendell | 15 October 2012, 02:33:39 UTC | Removing credentials line in build. | 15 October 2012, 02:33:39 UTC |
| f8768da | Matei Zaharia | 15 October 2012, 00:36:20 UTC | Comment out PGP stuff for publish-local to work | 15 October 2012, 00:37:21 UTC |
| 1f06445 | Matei Zaharia | 14 October 2012, 19:04:58 UTC | tweak | 14 October 2012, 19:04:58 UTC |
| 4947bd0 | Matei Zaharia | 14 October 2012, 19:02:58 UTC | tweak | 14 October 2012, 19:02:58 UTC |
| 6c766a9 | Matei Zaharia | 14 October 2012, 19:02:32 UTC | tweak | 14 October 2012, 19:02:32 UTC |
| 8192fe0 | Matei Zaharia | 14 October 2012, 19:01:38 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 14 October 2012, 19:01:38 UTC |
| 1c73d89 | Matei Zaharia | 14 October 2012, 19:00:25 UTC | Update README | 14 October 2012, 19:00:25 UTC |
| 7855bac | Matei Zaharia | 14 October 2012, 18:52:24 UTC | Merge pull request #278 from pwendell/quickstart-fix Adding dependency repos in quickstart example | 14 October 2012, 18:52:24 UTC |
| 7a03a0e | Patrick Wendell | 14 October 2012, 18:48:24 UTC | Adding dependency repos in quickstart example | 14 October 2012, 18:48:24 UTC |
| 64dbf8d | Matei Zaharia | 14 October 2012, 17:00:22 UTC | Made ShuffleDependency automatically find a shuffle ID for itself | 14 October 2012, 17:00:22 UTC |
| 64b5216 | Matei Zaharia | 14 October 2012, 16:51:34 UTC | Changed default Hadoop version back to 0.20.205 | 14 October 2012, 16:51:34 UTC |
| 4be12d9 | Matei Zaharia | 14 October 2012, 02:05:11 UTC | Some doc fixes, including showing version number in nav bar again | 14 October 2012, 02:05:11 UTC |
| 19910c0 | Matei Zaharia | 13 October 2012, 23:22:39 UTC | tweaks | 13 October 2012, 23:22:39 UTC |
| 4a3e9cf | Matei Zaharia | 13 October 2012, 23:20:25 UTC | Document how to configure SPARK_MEM & co on a per-job basis | 13 October 2012, 23:20:25 UTC |
| ce6b5a3 | Matei Zaharia | 13 October 2012, 22:55:39 UTC | Uncomment Maven publishing stuff and set version to 0.6.0 | 13 October 2012, 22:55:39 UTC |
| 8815aeb | Matei Zaharia | 13 October 2012, 22:31:11 UTC | Take executor environment vars as an arguemnt to SparkContext | 13 October 2012, 22:31:11 UTC |
| 8497949 | Matei Zaharia | 13 October 2012, 21:52:14 UTC | Merge pull request #273 from dennybritz/executorVars Let the user specify environment variables to be passed to the Executors | 13 October 2012, 21:52:14 UTC |
| 0700d19 | Denny | 13 October 2012, 20:57:59 UTC | Protect from null env variables in mesos. | 13 October 2012, 20:57:59 UTC |
| 21047d9 | Denny | 13 October 2012, 20:44:24 UTC | Protect from setting null environment variables. | 13 October 2012, 20:44:24 UTC |
| fa41d50 | Denny | 13 October 2012, 20:15:50 UTC | Don't use system envs for Mesos. | 13 October 2012, 20:15:50 UTC |
| 67c42a4 | Denny | 13 October 2012, 20:08:44 UTC | Let the user specify environment variables to be passed to the Executors. Also removed unused variables in the ExecutorRunner. | 13 October 2012, 20:08:44 UTC |
| 5b7ee17 | Matei Zaharia | 13 October 2012, 02:53:03 UTC | Update EC2 scripts for Spark 0.6 | 13 October 2012, 02:53:03 UTC |
| b4067cb | Matei Zaharia | 13 October 2012, 01:19:21 UTC | More doc updates, and moved Serializer to a subpackage. | 13 October 2012, 01:19:21 UTC |
| 8d7b77b | Matei Zaharia | 13 October 2012, 00:53:20 UTC | Some doc and usability improvements: - Added a StorageLevels class for easy access to StorageLevel constants in Java - Added doc comments on Function classes in Java - Updated Accumulator and HadoopWriter docs slightly | 13 October 2012, 00:53:20 UTC |
| 682b2d9 | Matei Zaharia | 12 October 2012, 21:58:26 UTC | Added a test for when an RDD only partially fits in memory | 12 October 2012, 21:58:26 UTC |
| dca496b | Matei Zaharia | 12 October 2012, 21:46:41 UTC | Document cartesian() operation | 12 October 2012, 21:46:41 UTC |
| 1183b30 | Matei Zaharia | 12 October 2012, 21:40:07 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 12 October 2012, 21:40:07 UTC |
| 603b419 | Matei Zaharia | 12 October 2012, 21:40:00 UTC | Tweak | 12 October 2012, 21:40:00 UTC |
| 23015cc | Matei Zaharia | 12 October 2012, 21:36:28 UTC | Merge pull request #271 from shivaram/block-manager-npe-fix Change block manager to accept a ArrayBuffer | 12 October 2012, 21:36:28 UTC |
| 8577523 | Shivaram Venkataraman | 12 October 2012, 21:14:57 UTC | Add test to verify if RDD is computed even if block manager has insufficient memory | 12 October 2012, 21:14:57 UTC |
| bd78bbb | Matei Zaharia | 11 October 2012, 19:21:47 UTC | Merge pull request #270 from pwendell/java-javadoc Adding Java documentation | 11 October 2012, 19:21:47 UTC |
| dc8adbd | Patrick Wendell | 11 October 2012, 07:49:03 UTC | Adding Java documentation | 11 October 2012, 07:49:03 UTC |
| 2cf40c5 | Shivaram Venkataraman | 11 October 2012, 07:42:46 UTC | Change block manager to accept a ArrayBuffer instead of an iterator to ensure that the computation can proceed even if we run out of memory to cache the block. Update CacheTracker to use this new interface | 11 October 2012, 07:42:46 UTC |
| cce5683 | Matei Zaharia | 11 October 2012, 05:11:31 UTC | Comment out Sonatype publishing stuff so publish-local works | 11 October 2012, 05:11:31 UTC |
| 4001cbd | Matei Zaharia | 11 October 2012, 01:57:32 UTC | Merge pull request #268 from pwendell/sonatype Adding code for publishing to Sonatype. | 11 October 2012, 01:57:32 UTC |
| 6d328f5 | Patrick Wendell | 11 October 2012, 01:54:22 UTC | Changing tabs to spaces | 11 October 2012, 01:54:22 UTC |
| 066e979 | Matei Zaharia | 11 October 2012, 01:32:23 UTC | Merge pull request #267 from dennybritz/dev Fixed bug when fetching Jar dependencies. | 11 October 2012, 01:32:23 UTC |
| 3ed172e | Patrick Wendell | 06 October 2012, 03:59:31 UTC | Adding code for publishing to Sonatype. By default - I'm leaving this commented out. This is because there is a bug in the PGP signing plugin which causes it to active even duing a publish-local. So we'll just uncomment when we decide to publish. | 11 October 2012, 00:25:29 UTC |
| d3f095f | Denny | 10 October 2012, 23:09:53 UTC | Fixed bug when fetching Jar dependencies. Instead of checking currentFiles check currentJars. | 10 October 2012, 23:09:53 UTC |
| 1ac7bf8 | Matei Zaharia | 10 October 2012, 18:02:29 UTC | Merge pull request #265 from pwendell/docs-version-config Making Spark version configurable in docs and updating Bagel doc | 10 October 2012, 18:02:29 UTC |
| 5788a92 | Patrick Wendell | 10 October 2012, 05:38:36 UTC | Updating Bagel build instructions | 10 October 2012, 05:39:29 UTC |
| 0f760a0 | Patrick Wendell | 10 October 2012, 05:37:58 UTC | Updating programming guide with new link instructions | 10 October 2012, 05:39:29 UTC |
| 4de5cc1 | Patrick Wendell | 10 October 2012, 04:52:49 UTC | Removing reference to publish-local in the quickstart | 10 October 2012, 05:39:29 UTC |
| 8321e7f | Patrick Wendell | 10 October 2012, 05:38:19 UTC | Fixing YARN instructions | 10 October 2012, 05:39:28 UTC |
| 5013c78 | Patrick Wendell | 10 October 2012, 04:52:46 UTC | Adding SNAPSHOT to Spark version in doc config | 10 October 2012, 05:39:28 UTC |
| ee2fcb2 | Matei Zaharia | 10 October 2012, 01:38:36 UTC | Added documentation to all the *RDDFunction classes, and moved them into the spark package to make them more visible. Also documented various other miscellaneous things in the API. | 10 October 2012, 01:38:36 UTC |
| 95a435c | Matei Zaharia | 10 October 2012, 01:17:51 UTC | Increase version on 0.5 branch to 0.5.2-SNAPSHOT | 10 October 2012, 01:17:51 UTC |
| bc0bc67 | Matei Zaharia | 09 October 2012, 21:30:23 UTC | Updates to documentation: - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes | 09 October 2012, 21:30:23 UTC |
| ad28aeb | Matei Zaharia | 09 October 2012, 16:47:58 UTC | Merge pull request #262 from andyk/document-public-apis Document RDD api (i.e. RDD.scala) | 09 October 2012, 16:47:58 UTC |
| 4780fee | Matei Zaharia | 09 October 2012, 16:46:20 UTC | Merge pull request #260 from andyk/update-docs-to-use-version-vars Updates docs to use the new version num vars and adds Spark version in nav bar | 09 October 2012, 16:46:20 UTC |
| d3b8252 | Matei Zaharia | 09 October 2012, 16:44:58 UTC | Merge pull request #263 from RayRacine/m1.medium Add m1.medium node option to cluster management script. | 09 October 2012, 16:44:58 UTC |
| c52bd1b | Ray Racine | 09 October 2012, 14:57:34 UTC | Add m1.medium node option to cluster management script. | 09 October 2012, 15:05:13 UTC |
| 8aec63b | Andy Konwinski | 09 October 2012, 05:50:58 UTC | Merge remote-tracking branch 'public-spark/dev' into document-public-apis | 09 October 2012, 05:50:58 UTC |
| 1d79ff6 | Andy Konwinski | 09 October 2012, 05:49:17 UTC | Fixes a typo, adds scaladoc comments to SparkContext constructors. | 09 October 2012, 05:49:17 UTC |
| ac31009 | Patrick Wendell | 09 October 2012, 05:25:03 UTC | More docs in RDD class | 09 October 2012, 05:25:11 UTC |
| bd68894 | Andy Konwinski | 09 October 2012, 04:13:29 UTC | A start on scaladoc for the public APIs. | 09 October 2012, 04:13:29 UTC |
| a91ed6a | Matei Zaharia | 09 October 2012, 00:25:25 UTC | Merge pull request #256 from pwendell/new-download-instr Adding new download instructions | 09 October 2012, 00:25:25 UTC |
| e1a724f | Andy Konwinski | 09 October 2012, 00:14:53 UTC | Updating lots of docs to use the new special version number variables, also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for. | 09 October 2012, 00:17:17 UTC |
| 7887e17 | Patrick Wendell | 08 October 2012, 16:43:24 UTC | Adding new download instructions | 09 October 2012, 00:05:13 UTC |
| 1231eb1 | Matei Zaharia | 08 October 2012, 23:54:28 UTC | Merge pull request #259 from mosharaf/bc-fix-dev Synchronization bug fix in broadcast implementations | 08 October 2012, 23:54:28 UTC |
| edc67bf | Mosharaf Chowdhury | 08 October 2012, 23:19:13 UTC | Merge branch 'dev' into bc-fix-dev | 08 October 2012, 23:19:13 UTC |
| 4f1e032 | Matei Zaharia | 08 October 2012, 19:29:08 UTC | Merge pull request #257 from andyk/add-version-vars-to-docs Adds special version variables to docs templating system | 08 October 2012, 19:29:08 UTC |
| 56b91ab | Andy Konwinski | 08 October 2012, 19:15:44 UTC | Updates README.md with instructions for running jekyll without building scaladoc (i.e. run `SKIP_SCALADOC=1 jekyll`). | 08 October 2012, 19:15:44 UTC |
| 89f8e1c | Andy Konwinski | 08 October 2012, 19:15:38 UTC | Merge remote-tracking branch 'public-spark/dev' into add-version-vars-to-docs Conflicts: docs/quick-start.md | 08 October 2012, 19:15:38 UTC |
