Skip to main content

Browse the archive

https://github.com/apache/spark
17 June 2024, 00:28:55 UTC
sort by:
Revision Author Date Message Commit Date
00e78b6 Jey Kottalam 26 April 2013, 17:58:40 UTC Release v0.7.1 26 April 2013, 17:58:40 UTC
9d06bc9 Jey Kottalam 26 April 2013, 05:54:47 UTC Mark kafka:0.7.2-spark as an externally provided dependency 26 April 2013, 17:58:18 UTC
20b0eb1 Jey Kottalam 25 April 2013, 21:01:15 UTC Include scala version in artifactId 25 April 2013, 22:53:15 UTC
95a9924 Jey Kottalam 24 April 2013, 00:44:14 UTC Conform to Sonatype's "Central Sync Requirements" 25 April 2013, 09:04:01 UTC
ee93c18 Jey Kottalam 23 April 2013, 03:04:10 UTC Configure Maven to perform releases 25 April 2013, 09:03:57 UTC
2e97618 Matei Zaharia 25 April 2013, 01:53:12 UTC Create an empty directory when checkpointing a 0-partition RDD (fixes a test failure on Hadoop 2.0) 25 April 2013, 01:53:12 UTC
f216ea0 Matei Zaharia 24 April 2013, 22:51:59 UTC Call commitJob on Hadoop OutputFormats to fix issues with saving on Hadoop 2 24 April 2013, 22:51:59 UTC
a9b3856 Matei Zaharia 24 April 2013, 22:08:20 UTC Update unit test memory to 2 GB 24 April 2013, 22:08:20 UTC
80efd7c Matei Zaharia 20 April 2013, 00:14:36 UTC Merge pull request #574 from jey/make-repl-not-require-streaming Remove spark-repl's extraneous dependency on spark-streaming 20 April 2013, 00:14:36 UTC
b9810ea Matei Zaharia 19 April 2013, 06:41:32 UTC Merge pull request #576 from jey/update-maven-to-scala-2.9.3 Update Maven build to Scala 2.9.3 19 April 2013, 06:41:32 UTC
f5756cd Matei Zaharia 19 April 2013, 05:25:21 UTC Turn on forking in test JVMs to reduce the pressure on perm gen and code cache sizes due to having 2 instances of the Scala compiler and a bunch of classloaders. 19 April 2013, 05:25:21 UTC
c9b1811 Jey Kottalam 18 April 2013, 21:58:38 UTC Update Maven build to Scala 2.9.3 18 April 2013, 21:58:38 UTC
b9aef50 Jey Kottalam 18 April 2013, 19:08:11 UTC Remove spark-repl's extraneous dependency on spark-streaming 18 April 2013, 19:08:11 UTC
7e1ec8c Jey Kottalam 16 April 2013, 06:32:25 UTC Increase ReservedCodeCacheSize for sbt 17 April 2013, 02:48:41 UTC
56e3ca0 Matei Zaharia 15 April 2013, 20:41:51 UTC Make ShuffledRDD.prev transient 15 April 2013, 20:42:16 UTC
1c2bb35 Andrew Ash 09 April 2013, 18:35:29 UTC Don't pull in old versions of Jackson via hadoop-core 14 April 2013, 15:26:07 UTC
c3769c7 Mike 12 April 2013, 03:52:06 UTC Reversed the order of tests to find a scala executable (in the case when SPARK_LAUNCH_WITH_SCALA is defined): instead of checking in the PATH first, and only then (if not found) for SCALA_HOME, now we check for SCALA_HOME first, and only then (if not defined) do we look in the PATH. The advantage is that now if the user has a more recent (non-compatible) version of scala in her PATH, she can use SCALA_HOME to point to the older (compatible) version for use with spark. Suggested by Josh Rosen in this thread: https://groups.google.com/forum/?fromgroups=#!topic/spark-users/NC9JKvP8808 14 April 2013, 15:13:28 UTC
ceb3c4c Matei Zaharia 12 April 2013, 02:29:37 UTC Fix tests from different projects running in parallel in SBT 0.12 12 April 2013, 02:30:24 UTC
f8ca144 Andrew Ash 10 April 2013, 03:35:13 UTC Uniform whitespace across scala examples 10 April 2013, 05:07:53 UTC
c2f537b Holden Karau 10 April 2013, 04:37:02 UTC Just use a loop for retries 10 April 2013, 05:05:37 UTC
c9baafc Holden Karau 06 April 2013, 07:35:50 UTC Retry failed ssh commands. This is especially useful during system startup when the hosts may not have yet come on-line but can be useful at other points for people with flakey connections 10 April 2013, 05:05:37 UTC
ef42c30 Matei Zaharia 08 April 2013, 21:34:38 UTC Fix passing of superstep in Bagel to avoid seeing new values of the superstep value upon recomputation, and set the default storage level in Bagel to MEMORY_AND_DISK 08 April 2013, 21:35:21 UTC
c01958f Patrick Wendell 08 April 2013, 00:44:48 UTC Updating based on code review 08 April 2013, 16:45:24 UTC
f232223 Patrick Wendell 03 April 2013, 21:29:46 UTC SPARK-724 - Have Akka logging enabled by default for standalone daemons See the JIRA for more details. I was only able to test the bash version (don't have Windows) so maybe check over that the syntax is correct there. 08 April 2013, 16:45:24 UTC
054feb6 Matei Zaharia 08 April 2013, 01:15:21 UTC Fixed a bug with zip 08 April 2013, 01:15:21 UTC
b5900d4 Matei Zaharia 08 April 2013, 00:55:42 UTC Fix compile warning 08 April 2013, 00:55:42 UTC
1cb3eb9 Matei Zaharia 08 April 2013, 00:54:18 UTC Merge remote-tracking branch 'kalpit/master' Conflicts: project/SparkBuild.scala 08 April 2013, 00:54:18 UTC
a158641 Matei Zaharia 08 April 2013, 00:31:19 UTC Updated link to SBT 08 April 2013, 00:31:19 UTC
6962d40 Matei Zaharia 08 April 2013, 00:27:33 UTC Fix deprecated warning 08 April 2013, 00:27:33 UTC
34a47b8 Matei Zaharia 08 April 2013, 00:27:03 UTC Update Scala version in docs 08 April 2013, 00:27:03 UTC
b362df3 Matei Zaharia 08 April 2013, 00:17:52 UTC Merge pull request #552 from MLnick/master Bumping version for Twitter Algebird to latest 08 April 2013, 00:17:52 UTC
4b30190 Matei Zaharia 08 April 2013, 00:15:10 UTC Merge pull request #554 from andyk/scala2.9.3 Fixes SPARK-723 - Update build to Scala 2.9.3 08 April 2013, 00:15:10 UTC
5555811 Andy Konwinski 04 April 2013, 20:26:45 UTC Update build to Scala 2.9.3 04 April 2013, 20:26:45 UTC
0f54344 Nick Pentreath 03 April 2013, 11:15:34 UTC Bumping Algebird version in examples now that it supports JDK 1.6 03 April 2013, 11:15:34 UTC
dfe98ca Matei Zaharia 03 April 2013, 02:24:12 UTC Merge pull request #550 from erikvanoosten/master corrected Algebird example 03 April 2013, 02:24:12 UTC
b5d7830 Matei Zaharia 03 April 2013, 02:23:45 UTC Merge pull request #551 from jey/python-bugfixes Python bugfixes 03 April 2013, 02:23:45 UTC
9a731f5 Jey Kottalam 02 April 2013, 18:58:40 UTC Fix Python saveAsTextFile doctest to not expect order to be preserved 02 April 2013, 18:59:20 UTC
2060400 Jey Kottalam 10 March 2013, 06:16:19 UTC Fix argv handling in Python transitive closure example 02 April 2013, 18:59:07 UTC
b5e60c3 Erik van oosten 02 April 2013, 12:25:22 UTC Corrected order of CountMinSketchMonoid arguments 02 April 2013, 12:25:22 UTC
2be2295 Matei Zaharia 01 April 2013, 01:09:14 UTC Merge pull request #548 from markhamstra/getWritableClass_filter Fixed broken filter in getWritableClass[T] 01 April 2013, 01:09:14 UTC
e215f67 Mark Hamstra 31 March 2013, 15:00:13 UTC Correct sense of 'filter out' in comment. 31 March 2013, 15:00:13 UTC
8bcdc64 Mark Hamstra 31 March 2013, 05:09:52 UTC Fixed broken filter in getWritableClass[T] 31 March 2013, 05:09:52 UTC
9831bc1 Matei Zaharia 30 March 2013, 05:16:22 UTC Merge pull request #539 from cgrothaus/fix-webui-workdirpath Bugfix: WorkerWebUI must respect workDirPath from Worker 30 March 2013, 05:16:22 UTC
3cc8ab6 Matei Zaharia 30 March 2013, 05:14:07 UTC Merge pull request #541 from stephenh/shufflecoalesce Add a shuffle parameter to coalesce. 30 March 2013, 05:14:07 UTC
cad507a Matei Zaharia 30 March 2013, 05:13:12 UTC Merge pull request #547 from jey/maven-streaming-tests-initialization-fix Move streaming test initialization into 'before' blocks 30 March 2013, 05:13:12 UTC
a98996d Matei Zaharia 30 March 2013, 05:12:15 UTC Merge pull request #545 from ash211/patch-1 Don't use deprecated Application in example 30 March 2013, 05:12:15 UTC
104c694 Matei Zaharia 30 March 2013, 05:11:50 UTC Merge pull request #546 from ash211/patch-2 Update tuning.md 30 March 2013, 05:11:50 UTC
e8f3669 Andrew Ash 28 March 2013, 22:17:39 UTC Update tuning.md Make the example more compilable 28 March 2013, 22:17:39 UTC
b569b3f Jey Kottalam 27 March 2013, 01:14:04 UTC Move streaming test initialization into 'before' blocks 28 March 2013, 22:08:41 UTC
4e2c965 Andrew Ash 28 March 2013, 20:47:37 UTC Don't use deprecated Application in example As of 2.9.0 extending from Application is not recommended http://www.scala-lang.org/api/2.9.3/index.html#scala.Application 28 March 2013, 20:47:37 UTC
aa9134f kalpit 09 March 2013, 02:28:43 UTC spark instance number must be present in log filename to prevent multiple workers from overriding each other's logs 27 March 2013, 00:49:30 UTC
f08db01 kalpit 07 March 2013, 02:06:32 UTC added SPARK_WORKER_INSTANCES : allows spawning multiple worker instances/processes on every slave machine 27 March 2013, 00:49:30 UTC
f0164e5 kalpit 07 March 2013, 01:03:15 UTC upgraded sbt version, sbt plugins and some library dependencies to latest stable version 27 March 2013, 00:49:29 UTC
bc36ee4 Matei Zaharia 26 March 2013, 22:05:13 UTC Merge pull request #543 from holdenk/master Re-enable deprecation warnings and fix deprecated warning. 26 March 2013, 22:05:13 UTC
6c18131 Andy Konwinski 26 March 2013, 21:28:08 UTC Add comment to README that 2.10 not yet supported 26 March 2013, 21:28:08 UTC
1f53811 Holden Karau 24 March 2013, 23:21:51 UTC method first in trait IterableLike is deprecated: use `head' instead 25 March 2013, 02:19:40 UTC
8456d67 Holden Karau 24 March 2013, 23:20:34 UTC Re-enable deprecation warnings since there are only two 25 March 2013, 00:30:23 UTC
e104a76 Holden Karau 24 March 2013, 23:16:05 UTC Makes the syntax highlighting on the build file not broken in emacs. 24 March 2013, 23:16:05 UTC
f5df729 Holden Karau 24 March 2013, 23:15:32 UTC Explicitly catch all throwables (warning in 2.10) 24 March 2013, 23:15:32 UTC
dd854d5 Stephen Haberman 23 March 2013, 16:49:45 UTC Use Boolean in the Java API, and != for assert. 23 March 2013, 16:49:45 UTC
4ca273e Stephen Haberman 23 March 2013, 16:45:45 UTC Merge branch 'master' into shufflecoalesce Conflicts: core/src/test/scala/spark/RDDSuite.scala 23 March 2013, 16:45:45 UTC
b8949ca Matei Zaharia 23 March 2013, 14:19:34 UTC Merge pull request #505 from stephenh/volatile Make Executor fields volatile since they're read from the thread pool. 23 March 2013, 14:19:34 UTC
fd53f2f Matei Zaharia 23 March 2013, 14:13:21 UTC Merge pull request #510 from markhamstra/WithThing mapWith, flatMapWith and filterWith 23 March 2013, 14:13:21 UTC
00170eb Stephen Haberman 22 March 2013, 17:59:08 UTC Fix are/our typo. 22 March 2013, 17:59:08 UTC
1c67c7d Stephen Haberman 22 March 2013, 13:54:44 UTC Add a shuffle parameter to coalesce. This is useful for when you want just 1 output file (part-00000) but still up the upstream RDD to be computed in parallel. 22 March 2013, 13:54:44 UTC
445f387 Christoph Grothaus 18 February 2013, 12:54:01 UTC Bugfix: WorkerWebUI must respect workDirPath from Worker 22 March 2013, 10:08:40 UTC
4c5efcf Matei Zaharia 21 March 2013, 02:29:23 UTC Merge pull request #532 from andyk/master SPARK-715: Adds instructions for building with Maven to documentation 21 March 2013, 02:29:23 UTC
3558849 Matei Zaharia 21 March 2013, 02:27:47 UTC Merge pull request #538 from rxin/cogroup Added mapSideCombine flag to CoGroupedRDD. Added unit test for CoGroupedRDD. 21 March 2013, 02:27:47 UTC
446b801 Andy Konwinski 21 March 2013, 00:30:31 UTC Fixing typos pointed out by Matei 21 March 2013, 00:30:31 UTC
4f42153 Stephen Haberman 20 March 2013, 20:37:10 UTC Merge branch 'master' into volatile 20 March 2013, 20:37:10 UTC
ca4d083 Matei Zaharia 20 March 2013, 18:22:36 UTC Merge pull request #528 from MLnick/java-examples [SPARK-707] Adding Java versions of Pi, LogQuery and K-Means examples 20 March 2013, 18:22:36 UTC
b812e6b Matei Zaharia 20 March 2013, 18:21:02 UTC Merge pull request #526 from markhamstra/foldByKey Add foldByKey 20 March 2013, 18:21:02 UTC
5a378a1 Nick Pentreath 20 March 2013, 07:57:00 UTC Merge branch 'java-examples' of https://github.com/MLnick/spark into java-examples 20 March 2013, 07:57:00 UTC
52398cc Nick Pentreath 20 March 2013, 07:49:57 UTC Java indentation 4 --> 2 spaces 20 March 2013, 07:55:42 UTC
7a443bb Nick Pentreath 20 March 2013, 07:49:57 UTC Java indentation 2 --> 4 spaces 20 March 2013, 07:49:57 UTC
d48ee7e Reynold Xin 20 March 2013, 06:00:28 UTC Merge branch 'master' of github.com:mesos/spark into cogroup 20 March 2013, 06:00:28 UTC
00a1130 Reynold Xin 20 March 2013, 05:49:51 UTC Added mapSideCombine flag to CoGroupedRDD. Added unit test for CoGroupedRDD. 20 March 2013, 05:49:51 UTC
945d1e7 Matei Zaharia 20 March 2013, 04:59:06 UTC Merge pull request #536 from sasurfer/master CoalescedRDD for many partitions 20 March 2013, 04:59:06 UTC
1cbbe94 Matei Zaharia 20 March 2013, 04:34:34 UTC Merge pull request #534 from stephenh/removetrycatch Remove try/catch block that can't be hit. 20 March 2013, 04:34:34 UTC
71e53f8 Matei Zaharia 20 March 2013, 04:31:41 UTC Merge pull request #537 from wishbear/configurableInputFormat call setConf from input format if it is Configurable 20 March 2013, 04:31:41 UTC
9fa47a2 Nick Pentreath 19 March 2013, 13:31:03 UTC A few cosmetic changes for JavaKMeans 19 March 2013, 13:31:03 UTC
568ddf7 Nick Pentreath 19 March 2013, 13:29:22 UTC Adding Java K-Means example 19 March 2013, 13:29:22 UTC
bd167f8 Andrey Kouznetsov 19 March 2013, 13:15:15 UTC call setConf from input format if it is Configurable 19 March 2013, 13:15:15 UTC
aceae02 Giovanni Delussu 19 March 2013, 10:25:45 UTC CoalescedRDD changed to work with a big number of partitions both in the original and the new coalesced RDD. The limitation was in the range that Scala.Int can represent. 19 March 2013, 10:25:45 UTC
fb34967 Stephen Haberman 18 March 2013, 06:55:50 UTC Remove try/catch block that can't be hit. 18 March 2013, 06:55:50 UTC
ad7f045 Andy Konwinski 17 March 2013, 21:47:44 UTC Adds page to docs about building using Maven. Adds links to new instructions in: * The main Spark project README.md * The docs nav menu called "More" * The docs Overview page under the "Building" and "Where to Go from Here" sections 17 March 2013, 22:02:40 UTC
b990cae Nick Pentreath 17 March 2013, 18:03:27 UTC Changes to more closely match line length limit style 17 March 2013, 18:03:27 UTC
ab33e27 Mark Hamstra 16 March 2013, 22:29:15 UTC constructorOfA -> constructA in doc comments 16 March 2013, 22:29:15 UTC
9784fc1 Mark Hamstra 16 March 2013, 22:25:02 UTC fix wayward comma in doc comment 16 March 2013, 22:25:02 UTC
32979b5 Mark Hamstra 16 March 2013, 20:36:46 UTC whitespace 16 March 2013, 20:36:46 UTC
ca9f81e Mark Hamstra 16 March 2013, 20:31:01 UTC refactor foldByKey to use combineByKey 16 March 2013, 20:31:01 UTC
1fb192e Mark Hamstra 16 March 2013, 19:17:13 UTC Merge branch 'master' of https://github.com/mesos/spark into foldByKey 16 March 2013, 19:17:13 UTC
80fc8c8 Mark Hamstra 16 March 2013, 19:16:29 UTC _With[Matei] 16 March 2013, 19:16:29 UTC
38454c4 Mark Hamstra 16 March 2013, 18:54:44 UTC Merge branch 'master' of https://github.com/mesos/spark into WithThing 16 March 2013, 18:54:44 UTC
c1e9cdc Matei Zaharia 16 March 2013, 18:47:45 UTC Merge pull request #525 from stephenh/subtractByKey Add PairRDDFunctions.subtractByKey. 16 March 2013, 18:47:45 UTC
ef75be3 Mark Hamstra 16 March 2013, 04:41:24 UTC Merge branch 'master' of https://github.com/mesos/spark into foldByKey 16 March 2013, 04:41:24 UTC
cdbfd1e Matei Zaharia 15 March 2013, 22:13:28 UTC Merge pull request #516 from squito/fix_local_metrics Fix local metrics 15 March 2013, 22:13:28 UTC
f9fa2ad Matei Zaharia 15 March 2013, 22:12:43 UTC Merge pull request #530 from mbautin/master-update-log4j-and-make-compile-in-IntelliJ Add a log4j compile dependency to fix build in IntelliJ 15 March 2013, 22:12:43 UTC
7fd2708 Mikhail Bautin 15 March 2013, 18:41:51 UTC Add a log4j compile dependency to fix build in IntelliJ Also rename parent project to spark-parent (otherwise it shows up as "parent" in IntelliJ, which is very confusing). 15 March 2013, 18:41:51 UTC
1a40704 Mark Hamstra 15 March 2013, 18:28:28 UTC whitespace cleanup 15 March 2013, 18:28:28 UTC
back to top