| 63fe4e9 | Matei Zaharia | 15 October 2012, 02:36:41 UTC | Merge pull request #279 from pwendell/dev Removing credentials line in build. | 15 October 2012, 02:36:41 UTC |
| 629dd26 | Patrick Wendell | 15 October 2012, 02:33:39 UTC | Removing credentials line in build. | 15 October 2012, 02:33:39 UTC |
| f8768da | Matei Zaharia | 15 October 2012, 00:36:20 UTC | Comment out PGP stuff for publish-local to work | 15 October 2012, 00:37:21 UTC |
| 1f06445 | Matei Zaharia | 14 October 2012, 19:04:58 UTC | tweak | 14 October 2012, 19:04:58 UTC |
| 4947bd0 | Matei Zaharia | 14 October 2012, 19:02:58 UTC | tweak | 14 October 2012, 19:02:58 UTC |
| 6c766a9 | Matei Zaharia | 14 October 2012, 19:02:32 UTC | tweak | 14 October 2012, 19:02:32 UTC |
| 8192fe0 | Matei Zaharia | 14 October 2012, 19:01:38 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 14 October 2012, 19:01:38 UTC |
| 1c73d89 | Matei Zaharia | 14 October 2012, 19:00:25 UTC | Update README | 14 October 2012, 19:00:25 UTC |
| 7855bac | Matei Zaharia | 14 October 2012, 18:52:24 UTC | Merge pull request #278 from pwendell/quickstart-fix Adding dependency repos in quickstart example | 14 October 2012, 18:52:24 UTC |
| 7a03a0e | Patrick Wendell | 14 October 2012, 18:48:24 UTC | Adding dependency repos in quickstart example | 14 October 2012, 18:48:24 UTC |
| 64dbf8d | Matei Zaharia | 14 October 2012, 17:00:22 UTC | Made ShuffleDependency automatically find a shuffle ID for itself | 14 October 2012, 17:00:22 UTC |
| 64b5216 | Matei Zaharia | 14 October 2012, 16:51:34 UTC | Changed default Hadoop version back to 0.20.205 | 14 October 2012, 16:51:34 UTC |
| 4be12d9 | Matei Zaharia | 14 October 2012, 02:05:11 UTC | Some doc fixes, including showing version number in nav bar again | 14 October 2012, 02:05:11 UTC |
| 19910c0 | Matei Zaharia | 13 October 2012, 23:22:39 UTC | tweaks | 13 October 2012, 23:22:39 UTC |
| 4a3e9cf | Matei Zaharia | 13 October 2012, 23:20:25 UTC | Document how to configure SPARK_MEM & co on a per-job basis | 13 October 2012, 23:20:25 UTC |
| ce6b5a3 | Matei Zaharia | 13 October 2012, 22:55:39 UTC | Uncomment Maven publishing stuff and set version to 0.6.0 | 13 October 2012, 22:55:39 UTC |
| 8815aeb | Matei Zaharia | 13 October 2012, 22:31:11 UTC | Take executor environment vars as an arguemnt to SparkContext | 13 October 2012, 22:31:11 UTC |
| 8497949 | Matei Zaharia | 13 October 2012, 21:52:14 UTC | Merge pull request #273 from dennybritz/executorVars Let the user specify environment variables to be passed to the Executors | 13 October 2012, 21:52:14 UTC |
| 0700d19 | Denny | 13 October 2012, 20:57:59 UTC | Protect from null env variables in mesos. | 13 October 2012, 20:57:59 UTC |
| 21047d9 | Denny | 13 October 2012, 20:44:24 UTC | Protect from setting null environment variables. | 13 October 2012, 20:44:24 UTC |
| fa41d50 | Denny | 13 October 2012, 20:15:50 UTC | Don't use system envs for Mesos. | 13 October 2012, 20:15:50 UTC |
| 67c42a4 | Denny | 13 October 2012, 20:08:44 UTC | Let the user specify environment variables to be passed to the Executors. Also removed unused variables in the ExecutorRunner. | 13 October 2012, 20:08:44 UTC |
| 5b7ee17 | Matei Zaharia | 13 October 2012, 02:53:03 UTC | Update EC2 scripts for Spark 0.6 | 13 October 2012, 02:53:03 UTC |
| b4067cb | Matei Zaharia | 13 October 2012, 01:19:21 UTC | More doc updates, and moved Serializer to a subpackage. | 13 October 2012, 01:19:21 UTC |
| 8d7b77b | Matei Zaharia | 13 October 2012, 00:53:20 UTC | Some doc and usability improvements: - Added a StorageLevels class for easy access to StorageLevel constants in Java - Added doc comments on Function classes in Java - Updated Accumulator and HadoopWriter docs slightly | 13 October 2012, 00:53:20 UTC |
| 682b2d9 | Matei Zaharia | 12 October 2012, 21:58:26 UTC | Added a test for when an RDD only partially fits in memory | 12 October 2012, 21:58:26 UTC |
| dca496b | Matei Zaharia | 12 October 2012, 21:46:41 UTC | Document cartesian() operation | 12 October 2012, 21:46:41 UTC |
| 1183b30 | Matei Zaharia | 12 October 2012, 21:40:07 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 12 October 2012, 21:40:07 UTC |
| 603b419 | Matei Zaharia | 12 October 2012, 21:40:00 UTC | Tweak | 12 October 2012, 21:40:00 UTC |
| 23015cc | Matei Zaharia | 12 October 2012, 21:36:28 UTC | Merge pull request #271 from shivaram/block-manager-npe-fix Change block manager to accept a ArrayBuffer | 12 October 2012, 21:36:28 UTC |
| 8577523 | Shivaram Venkataraman | 12 October 2012, 21:14:57 UTC | Add test to verify if RDD is computed even if block manager has insufficient memory | 12 October 2012, 21:14:57 UTC |
| bd78bbb | Matei Zaharia | 11 October 2012, 19:21:47 UTC | Merge pull request #270 from pwendell/java-javadoc Adding Java documentation | 11 October 2012, 19:21:47 UTC |
| dc8adbd | Patrick Wendell | 11 October 2012, 07:49:03 UTC | Adding Java documentation | 11 October 2012, 07:49:03 UTC |
| 2cf40c5 | Shivaram Venkataraman | 11 October 2012, 07:42:46 UTC | Change block manager to accept a ArrayBuffer instead of an iterator to ensure that the computation can proceed even if we run out of memory to cache the block. Update CacheTracker to use this new interface | 11 October 2012, 07:42:46 UTC |
| 4001cbd | Matei Zaharia | 11 October 2012, 01:57:32 UTC | Merge pull request #268 from pwendell/sonatype Adding code for publishing to Sonatype. | 11 October 2012, 01:57:32 UTC |
| 6d328f5 | Patrick Wendell | 11 October 2012, 01:54:22 UTC | Changing tabs to spaces | 11 October 2012, 01:54:22 UTC |
| 066e979 | Matei Zaharia | 11 October 2012, 01:32:23 UTC | Merge pull request #267 from dennybritz/dev Fixed bug when fetching Jar dependencies. | 11 October 2012, 01:32:23 UTC |
| 3ed172e | Patrick Wendell | 06 October 2012, 03:59:31 UTC | Adding code for publishing to Sonatype. By default - I'm leaving this commented out. This is because there is a bug in the PGP signing plugin which causes it to active even duing a publish-local. So we'll just uncomment when we decide to publish. | 11 October 2012, 00:25:29 UTC |
| d3f095f | Denny | 10 October 2012, 23:09:53 UTC | Fixed bug when fetching Jar dependencies. Instead of checking currentFiles check currentJars. | 10 October 2012, 23:09:53 UTC |
| 1ac7bf8 | Matei Zaharia | 10 October 2012, 18:02:29 UTC | Merge pull request #265 from pwendell/docs-version-config Making Spark version configurable in docs and updating Bagel doc | 10 October 2012, 18:02:29 UTC |
| 5788a92 | Patrick Wendell | 10 October 2012, 05:38:36 UTC | Updating Bagel build instructions | 10 October 2012, 05:39:29 UTC |
| 0f760a0 | Patrick Wendell | 10 October 2012, 05:37:58 UTC | Updating programming guide with new link instructions | 10 October 2012, 05:39:29 UTC |
| 4de5cc1 | Patrick Wendell | 10 October 2012, 04:52:49 UTC | Removing reference to publish-local in the quickstart | 10 October 2012, 05:39:29 UTC |
| 8321e7f | Patrick Wendell | 10 October 2012, 05:38:19 UTC | Fixing YARN instructions | 10 October 2012, 05:39:28 UTC |
| 5013c78 | Patrick Wendell | 10 October 2012, 04:52:46 UTC | Adding SNAPSHOT to Spark version in doc config | 10 October 2012, 05:39:28 UTC |
| ee2fcb2 | Matei Zaharia | 10 October 2012, 01:38:36 UTC | Added documentation to all the *RDDFunction classes, and moved them into the spark package to make them more visible. Also documented various other miscellaneous things in the API. | 10 October 2012, 01:38:36 UTC |
| bc0bc67 | Matei Zaharia | 09 October 2012, 21:30:23 UTC | Updates to documentation: - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes | 09 October 2012, 21:30:23 UTC |
| ad28aeb | Matei Zaharia | 09 October 2012, 16:47:58 UTC | Merge pull request #262 from andyk/document-public-apis Document RDD api (i.e. RDD.scala) | 09 October 2012, 16:47:58 UTC |
| 4780fee | Matei Zaharia | 09 October 2012, 16:46:20 UTC | Merge pull request #260 from andyk/update-docs-to-use-version-vars Updates docs to use the new version num vars and adds Spark version in nav bar | 09 October 2012, 16:46:20 UTC |
| d3b8252 | Matei Zaharia | 09 October 2012, 16:44:58 UTC | Merge pull request #263 from RayRacine/m1.medium Add m1.medium node option to cluster management script. | 09 October 2012, 16:44:58 UTC |
| c52bd1b | Ray Racine | 09 October 2012, 14:57:34 UTC | Add m1.medium node option to cluster management script. | 09 October 2012, 15:05:13 UTC |
| 8aec63b | Andy Konwinski | 09 October 2012, 05:50:58 UTC | Merge remote-tracking branch 'public-spark/dev' into document-public-apis | 09 October 2012, 05:50:58 UTC |
| 1d79ff6 | Andy Konwinski | 09 October 2012, 05:49:17 UTC | Fixes a typo, adds scaladoc comments to SparkContext constructors. | 09 October 2012, 05:49:17 UTC |
| ac31009 | Patrick Wendell | 09 October 2012, 05:25:03 UTC | More docs in RDD class | 09 October 2012, 05:25:11 UTC |
| bd68894 | Andy Konwinski | 09 October 2012, 04:13:29 UTC | A start on scaladoc for the public APIs. | 09 October 2012, 04:13:29 UTC |
| a91ed6a | Matei Zaharia | 09 October 2012, 00:25:25 UTC | Merge pull request #256 from pwendell/new-download-instr Adding new download instructions | 09 October 2012, 00:25:25 UTC |
| e1a724f | Andy Konwinski | 09 October 2012, 00:14:53 UTC | Updating lots of docs to use the new special version number variables, also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for. | 09 October 2012, 00:17:17 UTC |
| 7887e17 | Patrick Wendell | 08 October 2012, 16:43:24 UTC | Adding new download instructions | 09 October 2012, 00:05:13 UTC |
| 1231eb1 | Matei Zaharia | 08 October 2012, 23:54:28 UTC | Merge pull request #259 from mosharaf/bc-fix-dev Synchronization bug fix in broadcast implementations | 08 October 2012, 23:54:28 UTC |
| edc67bf | Mosharaf Chowdhury | 08 October 2012, 23:19:13 UTC | Merge branch 'dev' into bc-fix-dev | 08 October 2012, 23:19:13 UTC |
| 4f1e032 | Matei Zaharia | 08 October 2012, 19:29:08 UTC | Merge pull request #257 from andyk/add-version-vars-to-docs Adds special version variables to docs templating system | 08 October 2012, 19:29:08 UTC |
| 56b91ab | Andy Konwinski | 08 October 2012, 19:15:44 UTC | Updates README.md with instructions for running jekyll without building scaladoc (i.e. run `SKIP_SCALADOC=1 jekyll`). | 08 October 2012, 19:15:44 UTC |
| 89f8e1c | Andy Konwinski | 08 October 2012, 19:15:38 UTC | Merge remote-tracking branch 'public-spark/dev' into add-version-vars-to-docs Conflicts: docs/quick-start.md | 08 October 2012, 19:15:38 UTC |
| 88152e2 | Matei Zaharia | 08 October 2012, 18:08:29 UTC | Merge pull request #254 from pwendell/quickstart-fix Removing one link in quickstart | 08 October 2012, 18:08:29 UTC |
| 45d0323 | Andy Konwinski | 08 October 2012, 17:13:26 UTC | Adds liquid variables to docs templating system so that they can be used throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway. | 08 October 2012, 17:30:38 UTC |
| 46c3899 | Mosharaf Chowdhury | 08 October 2012, 16:47:46 UTC | Merge remote-tracking branch 'upstream/dev' into dev | 08 October 2012, 16:47:46 UTC |
| 280286b | Matei Zaharia | 08 October 2012, 16:45:03 UTC | Merge pull request #255 from andyk/fix-nav-gap Removes the annoying small gap above the nav menu dropdown boxes | 08 October 2012, 16:45:03 UTC |
| cd710a7 | Andy Konwinski | 08 October 2012, 16:30:32 UTC | Fixes the small gap above the nav menu dropdown boxes and the hoverable menu items that was causing the dropdowns to go away when the user moved their mouse down towards them. | 08 October 2012, 16:33:40 UTC |
| 99aac2f | Patrick Wendell | 08 October 2012, 15:53:27 UTC | Removing one link in quickstart | 08 October 2012, 15:53:27 UTC |
| efc5423 | Matei Zaharia | 07 October 2012, 18:30:53 UTC | Made compression configurable separately for shuffle, broadcast and RDDs | 07 October 2012, 18:30:53 UTC |
| 039cc62 | Matei Zaharia | 07 October 2012, 16:56:53 UTC | Merge pull request #251 from JoshRosen/docs/internals Document Dependency classes and make minor interface improvements | 07 October 2012, 16:56:53 UTC |
| 933e4f5 | Reynold Xin | 07 October 2012, 08:54:18 UTC | Merge pull request #253 from rxin/dev Changed the println to logInfo in Utils.fetchFile. | 07 October 2012, 08:54:18 UTC |
| f66c0e9 | Reynold Xin | 07 October 2012, 08:53:24 UTC | Changed the println to logInfo in Utils.fetchFile. | 07 October 2012, 08:53:24 UTC |
| d72db3d | Matei Zaharia | 07 October 2012, 07:56:53 UTC | Merge pull request #250 from rxin/dev Fixed a bug in addFile that if the file is specified as "file:///", the symlink is created incorrectly for local mode. | 07 October 2012, 07:56:53 UTC |
| 80f59e1 | Reynold Xin | 07 October 2012, 07:54:38 UTC | Fixed a bug in addFile that if the file is specified as "file:///", the symlink is created wrong for local mode. | 07 October 2012, 07:54:38 UTC |
| e10308f | Josh Rosen | 07 October 2012, 07:36:04 UTC | Make ShuffleDependency.aggregator explicitly optional. It was confusing to be using new Aggregator[K, V, V](null, null, null, false) to represent the absence of an aggregator. | 07 October 2012, 07:36:04 UTC |
| f930fe5 | Matei Zaharia | 07 October 2012, 07:34:36 UTC | Improve error message | 07 October 2012, 07:34:36 UTC |
| a3bf0ce | Matei Zaharia | 07 October 2012, 07:25:41 UTC | Don't crash on ask timeout exceptions in deploy.Client.stop() (fixes a crash in tests) | 07 October 2012, 07:25:41 UTC |
| eca570f | Matei Zaharia | 07 October 2012, 07:17:59 UTC | Removed the need to sleep in tests due to waiting for Akka to shut down | 07 October 2012, 07:17:59 UTC |
| 4f72066 | Josh Rosen | 07 October 2012, 06:59:55 UTC | Document the Dependency classes. | 07 October 2012, 07:05:37 UTC |
| 3f2571f | Josh Rosen | 04 October 2012, 18:12:57 UTC | Remove unused isShuffle field from Dependency. | 07 October 2012, 07:03:55 UTC |
| b2fc3dd | Matei Zaharia | 07 October 2012, 06:43:52 UTC | Log message | 07 October 2012, 06:43:52 UTC |
| ea096f7 | Matei Zaharia | 07 October 2012, 06:35:48 UTC | More logging | 07 October 2012, 06:35:48 UTC |
| 554b42c | root | 07 October 2012, 05:02:18 UTC | Log more info in MapOutputTracker | 07 October 2012, 05:02:18 UTC |
| a73b258 | root | 07 October 2012, 04:19:54 UTC | Made Akka thread pool and message batch sizes configurable | 07 October 2012, 04:19:54 UTC |
| ce915ca | root | 07 October 2012, 04:19:16 UTC | Made run script add test-classes onto the classpath only if SPARK_TESTING is set; fixes #216 | 07 October 2012, 04:19:16 UTC |
| 975009d | root | 07 October 2012, 04:02:10 UTC | Avoid acquiring locks in BlockManager when fetching shuffle outputs | 07 October 2012, 04:02:10 UTC |
| 0bc63f7 | root | 07 October 2012, 03:51:04 UTC | Log initial number of fetches in reducer | 07 October 2012, 03:51:04 UTC |
| dc28a3a | Matei Zaharia | 07 October 2012, 03:07:10 UTC | Modified shuffle to limit the maximum outstanding data size in bytes, instead of the maximum number of outstanding fetches. This should make it faster when there are many small map output files, as well as more robust to overallocating memory on large map outputs. | 07 October 2012, 03:07:10 UTC |
| 9a3b3f3 | Matei Zaharia | 07 October 2012, 01:46:04 UTC | Pass sizes of map outputs back to MapOutputTracker | 07 October 2012, 01:46:04 UTC |
| 0e42832 | Matei Zaharia | 07 October 2012, 01:00:53 UTC | Made block store return the size of each block put in | 07 October 2012, 01:00:53 UTC |
| b0110de | Matei Zaharia | 07 October 2012, 00:27:14 UTC | Warn about user programs that try to set spark.cache.class | 07 October 2012, 00:27:14 UTC |
| 65113b7 | Matei Zaharia | 04 October 2012, 23:49:30 UTC | Only group elements ten at a time into SequenceFile records in saveAsObjectFile | 07 October 2012, 00:14:41 UTC |
| 716e10c | Matei Zaharia | 06 October 2012, 05:03:06 UTC | Minor formatting fixes | 06 October 2012, 05:03:06 UTC |
| 70f02fa | Matei Zaharia | 06 October 2012, 05:00:22 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 06 October 2012, 05:00:22 UTC |
| 95ef307 | Matei Zaharia | 06 October 2012, 04:59:57 UTC | Merge pull request #249 from andyk/move-rdds-to-their-own-package Move RDD classes/files to their own package/directory | 06 October 2012, 04:59:57 UTC |
| a242cdd | Andy Konwinski | 06 October 2012, 02:53:54 UTC | Factor subclasses of RDD out of RDD.scala into their own classes in the rdd package. | 06 October 2012, 02:53:54 UTC |
| d7363a6 | Andy Konwinski | 06 October 2012, 01:54:49 UTC | Moves all files in core/src/main/scala/ that have RDD in their name from that directory to a new core/src/main/scala/rdd directory. | 06 October 2012, 02:23:45 UTC |
| e0067da | Andy Konwinski | 06 October 2012, 01:50:56 UTC | Moves all files in core/src/main/scala/ that have RDD in them from package spark to package spark.rdd and updates all references to them. | 06 October 2012, 02:23:45 UTC |
| 69588ba | Matei Zaharia | 06 October 2012, 02:16:09 UTC | Cleaning up code slightly | 06 October 2012, 02:16:09 UTC |
