| d1538eb | Matei Zaharia | 07 October 2012, 17:40:29 UTC | Change version in REPL | 07 October 2012, 17:40:29 UTC |
| f31b6f9 | Matei Zaharia | 07 October 2012, 17:00:48 UTC | Changes to run script and README to deal with updated Scala version and with Mesos being in Maven | 07 October 2012, 17:00:48 UTC |
| b97bde2 | Matei Zaharia | 07 October 2012, 16:47:46 UTC | Merge pull request #252 from pwendell/0.5-with-sonatype Adding Sonatype releases to SBT. | 07 October 2012, 16:47:46 UTC |
| 14719b9 | Patrick Wendell | 07 October 2012, 06:02:36 UTC | Adding Sonatype releases to SBT. This does a few things to get this branch ready for release: 1. Upgrades the sbt and Scala version 2. Sets the release number to 0.5.1 3. Adds the Sonatype publishing target 4. Installs the PGP signing plugin 5. Removes the Mesos jar dependency | 07 October 2012, 08:20:39 UTC |
| dbf1f3d | Matei Zaharia | 07 October 2012, 00:10:09 UTC | Make reduce logging less verbose | 07 October 2012, 00:10:09 UTC |
| 7eae2d1 | Matei Zaharia | 05 October 2012, 23:36:16 UTC | Merge branch 'master' into reduce-logging | 05 October 2012, 23:36:16 UTC |
| d9bcc2a | Matei Zaharia | 05 October 2012, 23:35:48 UTC | Merge branch 'master' of github.com:mesos/spark | 05 October 2012, 23:35:48 UTC |
| 1620d59 | Matei Zaharia | 05 October 2012, 17:28:30 UTC | Merge pull request #246 from shivaram/size-estimator-fix-master Fix SizeEstimator tests to work with String classes in JDK 6 and 7 | 05 October 2012, 17:28:30 UTC |
| 5975d2e | Shivaram Venkataraman | 05 October 2012, 02:42:57 UTC | Fix SizeEstimator tests to work with String classes in JDK 6 and 7 | 05 October 2012, 02:42:57 UTC |
| 5a7b370 | Matei Zaharia | 04 October 2012, 23:49:30 UTC | Only group elements ten at a time into SequenceFile records in saveAsObjectFile | 04 October 2012, 23:49:30 UTC |
| 66d7066 | Matei Zaharia | 04 October 2012, 23:41:17 UTC | Let the reducer retry if a fetch fails before reading all records | 04 October 2012, 23:41:17 UTC |
| 588120c | Matei Zaharia | 04 October 2012, 18:54:47 UTC | Add more logging for number of records fetched by each reduce | 04 October 2012, 18:54:47 UTC |
| 3d24281 | Matei Zaharia | 30 September 2012, 04:55:22 UTC | Backport sampling fixes from dev (suggested by Henry Milner) | 30 September 2012, 04:55:52 UTC |
| 915ab97 | Matei Zaharia | 28 September 2012, 21:52:37 UTC | Make error reporting less scary if we can't look up UseCompressedOops | 28 September 2012, 21:52:37 UTC |
| a417cd4 | Matei Zaharia | 26 September 2012, 21:14:17 UTC | Look for Kryo registrator using context class loader | 26 September 2012, 21:14:17 UTC |
| 2498f95 | Matei Zaharia | 11 September 2012, 22:17:44 UTC | Fixed GrowableAccumulatorParam.zero() to do a copy and to make sure it's empty instead of using the old initialValue | 11 September 2012, 22:17:44 UTC |
| 66e5362 | Matei Zaharia | 11 September 2012, 21:29:10 UTC | Merge pull request #175 from squito/collection_accumulators add accumulators for mutable collections, with correct typing! | 11 September 2012, 21:29:10 UTC |
| 1490d09 | Imran Rashid | 11 September 2012, 18:20:56 UTC | Merge branch 'master' into collection_accumulators Conflicts: core/src/test/scala/spark/AccumulatorSuite.scala | 11 September 2012, 18:20:56 UTC |
| f8f125e | Imran Rashid | 07 September 2012, 20:58:46 UTC | fix stupid typo and add documentation | 07 September 2012, 20:58:46 UTC |
| 607b8ff | Matei Zaharia | 31 August 2012, 18:40:12 UTC | End runJob with a SparkException when a Mesos task fails too many times | 31 August 2012, 18:40:12 UTC |
| 62e5326 | Matei Zaharia | 30 August 2012, 15:37:43 UTC | Wording | 30 August 2012, 15:37:43 UTC |
| e8ac922 | Matei Zaharia | 30 August 2012, 15:36:39 UTC | Update sbt build command to create JARs | 30 August 2012, 15:36:39 UTC |
| 84bf792 | Matei Zaharia | 29 August 2012, 05:40:00 UTC | Made region used by spark-ec2 configurable. | 29 August 2012, 05:40:48 UTC |
| 79c82b6 | Matei Zaharia | 22 August 2012, 07:11:21 UTC | Merge pull request #173 from squito/accum_localValue make accumulator.localValue public, add tests | 22 August 2012, 07:11:21 UTC |
| 4d2efe9 | Imran Rashid | 20 August 2012, 22:17:31 UTC | change tests to show utility of localValue | 20 August 2012, 22:17:31 UTC |
| 823878c | Imran Rashid | 17 August 2012, 22:52:42 UTC | add accumulators for mutable collections, with correct typing! | 17 August 2012, 22:52:42 UTC |
| 206a383 | Imran Rashid | 14 August 2012, 21:08:22 UTC | make accumulator.localValue public, add tests | 14 August 2012, 21:08:22 UTC |
| 680df96 | Matei Zaharia | 13 August 2012, 05:29:11 UTC | Merge pull request #169 from shivaram/master Changes to SizeEstimator more accurate | 13 August 2012, 05:29:11 UTC |
| 2ee7312 | Shivaram Venkataraman | 13 August 2012, 00:18:01 UTC | Add test-cases for 32-bit and no-compressed oops scenarios. | 13 August 2012, 00:18:01 UTC |
| 5450223 | Shivaram Venkataraman | 13 August 2012, 00:16:27 UTC | Move object size and pointer size initialization into a function to enable unit-testing | 13 August 2012, 00:16:27 UTC |
| 73452cc | Shivaram Venkataraman | 11 August 2012, 23:42:35 UTC | Update test cases to match the new size estimates. Uses 64-bit and compressed oops setting to get deterministic results | 11 August 2012, 23:42:35 UTC |
| 64b8fd6 | Shivaram Venkataraman | 11 August 2012, 23:40:33 UTC | If spark.test.useCompressedOops is set, use that to infer compressed oops setting. This is useful to get a deterministic test case | 11 August 2012, 23:40:33 UTC |
| c0e773a | Shivaram Venkataraman | 11 August 2012, 21:38:05 UTC | Use HotSpotDiagnosticMXBean to get if CompressedOops are in use or not | 11 August 2012, 21:38:05 UTC |
| f2475ca | Shivaram Venkataraman | 11 August 2012, 09:34:20 UTC | Add link to Java wiki which specifies what changes with compressed oops | 11 August 2012, 09:34:20 UTC |
| 980585b | Shivaram Venkataraman | 11 August 2012, 09:16:15 UTC | Changes to make size estimator more accurate. Fixes object size, pointer size according to architecture and also aligns objects and arrays when computing instance sizes. Verified using Eclipse Memory Analysis Tool (MAT) | 11 August 2012, 09:18:39 UTC |
| 1c5ae3e | Matei Zaharia | 05 August 2012, 00:39:41 UTC | Merge pull request #151 from dennybritz/fix/examples_jar Examples ship to to cluster | 05 August 2012, 00:39:41 UTC |
| 38d86d2 | Denny | 04 August 2012, 23:58:47 UTC | updated readme | 04 August 2012, 23:58:47 UTC |
| 48cac41 | Denny | 04 August 2012, 23:56:32 UTC | Renamed EXAMPLES_JAR to SPARK_EXAMPLES_JAR | 04 August 2012, 23:56:32 UTC |
| 63c2020 | Denny | 04 August 2012, 23:55:18 UTC | Merge branch 'master' into fix/examples_jar | 04 August 2012, 23:55:18 UTC |
| abca699 | Matei Zaharia | 03 August 2012, 20:44:17 UTC | Made range partition balance tests more aggressive. This is because we pull out such a large sample (10x the number of partitions) that we should expect pretty good balance. The tests are also deterministic so there's no worry about them failing irreproducibly. | 03 August 2012, 20:44:17 UTC |
| 6da2bcd | Matei Zaharia | 03 August 2012, 20:37:35 UTC | Added a unit test for cross-partition balancing in sort, and changes to RangePartitioner to make it pass. It turns out that the first partition was always kind of small due to how we picked partition boundaries. | 03 August 2012, 20:37:35 UTC |
| 508221b | Matei Zaharia | 03 August 2012, 19:57:43 UTC | Fix to #154 (CacheTracker trying to cast a broadcast variable's ID to int) | 03 August 2012, 19:57:43 UTC |
| c0d5bd6 | Matei Zaharia | 03 August 2012, 19:27:17 UTC | Merge pull request #164 from HarveyFeng/master Bug fix in RangePartitioner for partitioning when sorting in descending order. | 03 August 2012, 19:27:17 UTC |
| 5ec1332 | Harvey | 03 August 2012, 19:22:07 UTC | Fix for partitioning when sorting in descending order | 03 August 2012, 19:22:07 UTC |
| 4a9c589 | Matei Zaharia | 02 August 2012, 13:26:06 UTC | Merge pull request #157 from paulcavallaro/log-throwables Logging Throwables in Info and Debug | 02 August 2012, 13:26:06 UTC |
| e3952f3 | Paul Cavallaro | 30 July 2012, 17:41:09 UTC | Logging Throwables in Info and Debug Logging Throwables in logInfo and logDebug instead of swallowing them. | 30 July 2012, 17:41:09 UTC |
| 1e2df26 | Matei Zaharia | 27 July 2012, 00:25:45 UTC | Merge pull request #145 from squito/exp_accum add Accumulatable, add corresponding docs & tests for accumulators | 27 July 2012, 00:25:45 UTC |
| 0384be3 | Imran Rashid | 26 July 2012, 19:38:51 UTC | tasks cannot access value of accumulator | 26 July 2012, 19:38:51 UTC |
| da42981 | Matei Zaharia | 23 July 2012, 23:13:24 UTC | Merge pull request #152 from dennybritz/fix/testbeforeafter Always destroy SparkContext in after block for the unit tests. | 23 July 2012, 23:13:24 UTC |
| 5656dcd | Denny | 23 July 2012, 17:36:30 UTC | Stlystic changes | 23 July 2012, 17:36:52 UTC |
| 840e1b2 | Matei Zaharia | 22 July 2012, 04:58:40 UTC | Merge branch 'master' of github.com:mesos/spark | 22 July 2012, 04:58:40 UTC |
| 6f44c0d | Matei Zaharia | 22 July 2012, 04:58:28 UTC | Fix a bug where an input path was added to a Hadoop job configuration twice | 22 July 2012, 04:58:28 UTC |
| d1759c0 | Matei Zaharia | 22 July 2012, 04:54:50 UTC | Merge pull request #149 from dennybritz/serfix Instantiating custom serializer using user's classpath | 22 July 2012, 04:54:50 UTC |
| 5122f11 | Matei Zaharia | 22 July 2012, 04:53:38 UTC | Use full package name in import | 22 July 2012, 04:53:38 UTC |
| 5559608 | Denny | 18 July 2012, 20:09:50 UTC | Always destroy SparkContext in after block for the unit tests. | 18 July 2012, 20:09:50 UTC |
| e4dbaf6 | Denny | 18 July 2012, 19:18:00 UTC | syntax errors | 18 July 2012, 19:18:00 UTC |
| 1d98884 | Denny | 18 July 2012, 18:46:03 UTC | Use extended constructor in the examples. | 18 July 2012, 18:46:03 UTC |
| 2132c54 | Denny | 17 July 2012, 21:05:26 UTC | Create the ClassLoader before creating a SparkEnv - SparkEnv must use the loader. | 17 July 2012, 21:05:26 UTC |
| 2b84b50 | Denny | 17 July 2012, 20:55:23 UTC | Use Context classloader for Serializer class | 17 July 2012, 20:55:23 UTC |
| 7f43ba7 | Imran Rashid | 17 July 2012, 01:26:48 UTC | one more minor cleanup to scaladoc | 17 July 2012, 01:26:48 UTC |
| 913d42c | Imran Rashid | 17 July 2012, 01:25:15 UTC | fix up scaladoc, naming of type parameters | 17 July 2012, 01:25:15 UTC |
| 85940a7 | Imran Rashid | 17 July 2012, 01:17:13 UTC | rename addToAccum to addAccumulator | 17 July 2012, 01:17:13 UTC |
| a33ca69 | Matei Zaharia | 13 July 2012, 01:38:20 UTC | Merge branch 'master' of github.com:mesos/spark | 13 July 2012, 01:38:20 UTC |
| 452330e | Matei Zaharia | 13 July 2012, 01:36:02 UTC | Allow null keys in Spark's reduce and group by | 13 July 2012, 01:37:37 UTC |
| 86024ca | Imran Rashid | 12 July 2012, 19:52:12 UTC | add some functionality to Vector, delete copy in AccumulatorSuite | 12 July 2012, 20:08:03 UTC |
| 42ce879 | Imran Rashid | 12 July 2012, 19:42:10 UTC | move Vector class into core and spark.util package | 12 July 2012, 20:08:03 UTC |
| 13cc72c | Imran Rashid | 12 July 2012, 19:40:10 UTC | Accumulator now inherits from Accumulable, whcih simplifies a bunch of other things (eg., no +:=) | 12 July 2012, 19:40:10 UTC |
| 7393562 | Imran Rashid | 12 July 2012, 16:58:06 UTC | improve scaladoc | 12 July 2012, 16:58:06 UTC |
| 30480e6 | Imran Rashid | 12 July 2012, 16:37:42 UTC | add Accumulatable, add corresponding docs & tests for accumulators | 12 July 2012, 16:37:42 UTC |
| 4259d37 | Matei Zaharia | 10 July 2012, 18:16:34 UTC | Formatting | 10 July 2012, 18:16:34 UTC |
| 6980b67 | Matei Zaharia | 10 July 2012, 18:11:35 UTC | Added more methods for loading/saving with new Hadoop API | 10 July 2012, 18:11:35 UTC |
| cbe8846 | Matei Zaharia | 29 June 2012, 23:40:57 UTC | Merge pull request #142 from rrmckinley/patch-1 Scalacheck groupId has changed https://github.com/rickynils/scalacheck/i... | 29 June 2012, 23:40:57 UTC |
| 3a326c0 | Matei Zaharia | 29 June 2012, 23:25:06 UTC | Increase the default wait time for EC2 clusters to 2 minutes. | 29 June 2012, 23:25:06 UTC |
| 25972b5 | rrmckinley | 29 June 2012, 19:00:23 UTC | Scalacheck groupId has changed https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too. | 29 June 2012, 19:00:23 UTC |
| 800fcbf | Matei Zaharia | 17 June 2012, 21:29:39 UTC | Revert "Fixed HttpBroadcast to work with this branch's Serializer." This reverts commit b3eeac55b8f3c8c7b5ea18281d9d39dab63d5164. | 17 June 2012, 21:29:39 UTC |
| 94d77f8 | Matei Zaharia | 17 June 2012, 21:27:45 UTC | Revert "Merge branch 'master' into dev" This reverts commit f58da6164eaf13dd986a39a40535975096b71b44, reversing changes made to 4449eb97834ed6191dc0937d255c475191895980. | 17 June 2012, 21:27:45 UTC |
| f46e867 | Matei Zaharia | 17 June 2012, 21:27:32 UTC | Revert "Update version number for dev branch" This reverts commit 08579ffa11574f3d53ef62ae1b41847b4dce16d5. | 17 June 2012, 21:27:32 UTC |
| 0e84d62 | Matei Zaharia | 17 June 2012, 21:27:30 UTC | Revert "Various fixes to get unit tests running. In particular, shut down" This reverts commit 2893b305501a0e04cabdaa2fbad06ef86076cdf8. | 17 June 2012, 21:27:30 UTC |
| 4749ec0 | Matei Zaharia | 17 June 2012, 21:27:18 UTC | Revert "Fixed nasty corner case bug in ByteBufferInputStream. Could not add a test case for this as I could not figure out how to deterministically reproduce the bug in a short testcase." This reverts commit 40536e3668c3f8077c91170318f3bbd8f3060517. | 17 June 2012, 21:27:18 UTC |
| 40536e3 | Tathagata Das | 17 June 2012, 20:28:41 UTC | Fixed nasty corner case bug in ByteBufferInputStream. Could not add a test case for this as I could not figure out how to deterministically reproduce the bug in a short testcase. | 17 June 2012, 20:28:41 UTC |
| 2893b30 | Matei Zaharia | 17 June 2012, 07:28:45 UTC | Various fixes to get unit tests running. In particular, shut down ConnectionManager and DAGScheduler properly, plus a fix to LocalScheduler that was not merged in from 0.5 and was actually caught by one of the tests. | 17 June 2012, 07:28:45 UTC |
| 08579ff | Matei Zaharia | 16 June 2012, 06:55:43 UTC | Update version number for dev branch | 16 June 2012, 06:55:43 UTC |
| b3eeac5 | Matei Zaharia | 16 June 2012, 06:54:38 UTC | Fixed HttpBroadcast to work with this branch's Serializer. | 16 June 2012, 06:54:38 UTC |
| f58da61 | Matei Zaharia | 16 June 2012, 06:47:11 UTC | Merge branch 'master' into dev | 16 June 2012, 06:47:11 UTC |
| b5cf47c | Matei Zaharia | 16 June 2012, 06:36:30 UTC | Merge branch 'dev' of github.com:mesos/spark into dev | 16 June 2012, 06:36:30 UTC |
| 4449eb9 | Matei Zaharia | 14 June 2012, 02:26:14 UTC | Changed version in master branch to 0.5.1-SNAPSHOT for further development. | 14 June 2012, 02:26:14 UTC |
| 5f54bdf | Tathagata Das | 14 June 2012, 00:49:00 UTC | Added shutdown for akka to SparkContext.stop(). Helps a little, but many testsuites still fail. | 14 June 2012, 00:49:00 UTC |
| c6156da | Tathagata Das | 13 June 2012, 20:01:31 UTC | Multiple bug fixes to pass the testsuites ShuffleSuite and BlockManagerSuite. | 13 June 2012, 20:26:49 UTC |
| 0472cf8 | Matei Zaharia | 12 June 2012, 18:30:49 UTC | Update version in SBT | 12 June 2012, 18:30:49 UTC |
| 4971e0f | Matei Zaharia | 12 June 2012, 17:41:57 UTC | Updated version number to 0.5.0 | 12 June 2012, 17:41:57 UTC |
| 08c50ad | Matei Zaharia | 11 June 2012, 06:06:15 UTC | Added script for launching Spark on EC2 from Mesos, to make it easier for new users to get up and running on EC2. | 11 June 2012, 06:06:15 UTC |
| 879bc0b | Matei Zaharia | 09 June 2012, 23:24:16 UTC | Merge branch 'master' into mesos-0.9 | 09 June 2012, 23:24:16 UTC |
| 4b05798 | Matei Zaharia | 09 June 2012, 23:24:03 UTC | Further bug fix to HttpBroadcast | 09 June 2012, 23:24:03 UTC |
| 587a16a | Matei Zaharia | 09 June 2012, 23:17:07 UTC | Merge branch 'master' into mesos-0.9 | 09 June 2012, 23:17:07 UTC |
| 8ed6628 | Matei Zaharia | 09 June 2012, 23:16:48 UTC | Bug fix to HttpBroadcast | 09 June 2012, 23:16:55 UTC |
| 2fd9f99 | Matei Zaharia | 09 June 2012, 22:58:35 UTC | Merge branch 'master' into mesos-0.9 | 09 June 2012, 22:58:35 UTC |
| e75b1b5 | Matei Zaharia | 09 June 2012, 22:58:07 UTC | Change the default broadcast implementation to a simple HTTP-based broadcast. Fixes #139. | 09 June 2012, 22:58:07 UTC |
| a96558c | Matei Zaharia | 09 June 2012, 21:44:18 UTC | Performance improvements to shuffle operations: in particular, preserve RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins. | 09 June 2012, 21:44:18 UTC |
| 8b0bd5d | Matei Zaharia | 08 June 2012, 06:05:58 UTC | Update SBT to version 0.11.3-2. | 08 June 2012, 06:05:58 UTC |
| c2c7299 | Matei Zaharia | 07 June 2012, 20:47:10 UTC | Added BlockManagerSuite, which I'd forgotten to merge. | 07 June 2012, 20:47:10 UTC |
