Skip to main content

Browse the archive

https://github.com/apache/spark
17 June 2024, 00:28:55 UTC
sort by:
Revision Author Date Message Commit Date
baa30fc Matei Zaharia 27 February 2013, 07:38:50 UTC Use new Spark EC2 scripts by default 27 February 2013, 07:38:50 UTC
fadeb1d Matei Zaharia 27 February 2013, 07:20:49 UTC More doc tweaks 27 February 2013, 07:20:49 UTC
22334ea Matei Zaharia 27 February 2013, 06:52:38 UTC Some tweaks to docs 27 February 2013, 06:52:38 UTC
434a1ce Matei Zaharia 26 February 2013, 20:24:18 UTC Small hack to work around multiple JARs being built by sbt package 26 February 2013, 20:24:18 UTC
ece3edf Matei Zaharia 26 February 2013, 20:11:03 UTC Fix a problem with no hosts being counted as alive in the first job 26 February 2013, 20:11:03 UTC
73697e2 Matei Zaharia 26 February 2013, 20:07:59 UTC Fix overly large thread names in PySpark 26 February 2013, 20:07:59 UTC
9a046e3 Matei Zaharia 26 February 2013, 06:18:47 UTC Switch docs to use Akka repo instead of Typesafe 26 February 2013, 06:18:47 UTC
7e67c62 Matei Zaharia 26 February 2013, 04:30:47 UTC Change version number to 0.7.0 26 February 2013, 04:30:47 UTC
c6380b1 Matei Zaharia 26 February 2013, 04:23:41 UTC Merge branch 'master' of https://github.com/mesos/spark 26 February 2013, 04:23:41 UTC
108cfaa Matei Zaharia 26 February 2013, 04:23:36 UTC Fix Windows script for finding examples JAR 26 February 2013, 04:23:36 UTC
4223be3 Matei Zaharia 26 February 2013, 03:43:05 UTC Merge pull request #503 from pwendell/bug-fix createNewSparkContext should use sparkHome/jars/environment. 26 February 2013, 03:43:05 UTC
284ba90 Patrick Wendell 26 February 2013, 03:40:52 UTC createNewSparkContext should use sparkHome/jars/environment. This fixes a bug introduced by Matei's recent change. 26 February 2013, 03:40:52 UTC
5d7b591 Matei Zaharia 26 February 2013, 03:34:32 UTC Pass a code JAR to SparkContext in our examples. Fixes SPARK-594. 26 February 2013, 03:34:32 UTC
7b88534 Matei Zaharia 26 February 2013, 02:11:00 UTC Merge pull request #502 from tdas/master Very minor change in a testcase 26 February 2013, 02:11:00 UTC
bc4a6eb Tathagata Das 26 February 2013, 02:04:21 UTC Changed Flume test to use the same port as other tests, so that can be controlled centrally. 26 February 2013, 02:04:21 UTC
c45d6f1 Matei Zaharia 26 February 2013, 01:35:31 UTC Merge pull request #501 from tdas/master Fixed bug in BlockManager and added a testcase 26 February 2013, 01:35:31 UTC
c02e064 Tathagata Das 26 February 2013, 01:27:46 UTC Fixed replication bug in BlockManager 26 February 2013, 01:27:46 UTC
4d480ec Matei Zaharia 25 February 2013, 23:53:43 UTC Fixed something that was reported as a compile error in ScalaDoc. For some reason, ScalaDoc complained about no such constructor for StreamingContext; it doesn't seem like an actual Scala error but it prevented sbt publish and from working because docs weren't built. 25 February 2013, 23:53:43 UTC
6494cab Matei Zaharia 25 February 2013, 23:38:21 UTC Update Hadoop dependency to 1.0.4 25 February 2013, 23:38:21 UTC
6a78ef0 Tathagata Das 25 February 2013, 23:28:45 UTC Merge pull request #500 from pwendell/streaming-docs Minor changes based on feedback 25 February 2013, 23:28:45 UTC
8316534 Patrick Wendell 25 February 2013, 23:27:04 UTC meta-data 25 February 2013, 23:27:04 UTC
918ee25 Patrick Wendell 25 February 2013, 23:24:17 UTC One more change done with TD 25 February 2013, 23:24:17 UTC
351ac52 Matei Zaharia 25 February 2013, 23:19:05 UTC Some tweaks to docs 25 February 2013, 23:19:05 UTC
2ae1535 Matei Zaharia 25 February 2013, 23:14:16 UTC Merge branch 'master' of github.com:mesos/spark 25 February 2013, 23:14:16 UTC
490f056 Matei Zaharia 25 February 2013, 23:13:30 UTC Allow passing sparkHome and JARs to StreamingContext constructor Also warns if spark.cleaner.ttl is not set in the version where you pass your own SparkContext. 25 February 2013, 23:13:30 UTC
07f2618 Patrick Wendell 25 February 2013, 23:09:46 UTC Minor changes based on feedback 25 February 2013, 23:09:59 UTC
271a40f Matei Zaharia 25 February 2013, 22:47:32 UTC Merge pull request #499 from pwendell/streaming-docs Some changes to streaming failure docs. 25 February 2013, 22:47:32 UTC
50ce051 Patrick Wendell 25 February 2013, 22:28:23 UTC Some changes to streaming failure docs. TD gave me the go-ahead to just make these changes: - Define stateful dstream - Some minor wording fixes 25 February 2013, 22:38:39 UTC
568bdaf Matei Zaharia 25 February 2013, 22:34:55 UTC Set spark.deploy.spreadOut to true by default in 0.7 (improves locality) 25 February 2013, 22:34:55 UTC
5d4a0ac Matei Zaharia 25 February 2013, 22:23:03 UTC Some tweaks to docs 25 February 2013, 22:23:03 UTC
1ef58da Matei Zaharia 25 February 2013, 22:01:24 UTC Add a config property for Akka lifecycle event logging 25 February 2013, 22:01:24 UTC
6b87ef7 Matei Zaharia 25 February 2013, 22:01:16 UTC Fix compile error 25 February 2013, 22:01:16 UTC
01bd136 Matei Zaharia 25 February 2013, 21:27:11 UTC Use public method sparkContext instead of protected sc in streaming examples 25 February 2013, 21:27:11 UTC
848321f Matei Zaharia 25 February 2013, 21:15:30 UTC Change doc color scheme slightly for Spark 0.7 (to differ from 0.6) 25 February 2013, 21:15:30 UTC
3c7dcb6 Matei Zaharia 25 February 2013, 21:15:12 UTC Use a single setting for disabling API doc build 25 February 2013, 21:15:12 UTC
0cb8ee9 Matei Zaharia 25 February 2013, 21:10:35 UTC Merge branch 'master' of github.com:mesos/spark 25 February 2013, 21:10:35 UTC
ceaec4a Matei Zaharia 25 February 2013, 20:31:24 UTC Merge pull request #498 from pwendell/shutup-akka Disable remote lifecycle logging from Akka. 25 February 2013, 20:31:24 UTC
85a8564 Patrick Wendell 25 February 2013, 20:25:43 UTC Disable remote lifecycle logging from Akka. This changes the default setting to `off` for remote lifecycle events. When this is on, it is very chatty at the INFO level. It also prints out several ERROR messages sometimes when sc.stop() is called. 25 February 2013, 20:25:43 UTC
25f7378 Matei Zaharia 25 February 2013, 19:53:55 UTC Change tabs to spaces 25 February 2013, 19:53:55 UTC
6ae9a22 Matei Zaharia 25 February 2013, 18:28:08 UTC Get spark.default.paralellism on each call to defaultPartitioner, instead of only once, in case the user changes it across Spark uses 25 February 2013, 18:28:08 UTC
d6e6abe Matei Zaharia 25 February 2013, 17:22:04 UTC Merge pull request #459 from stephenh/bettersplits Change defaultPartitioner to use upstream split size. 25 February 2013, 17:22:04 UTC
fb76250 Matei Zaharia 25 February 2013, 08:16:52 UTC Merge pull request #497 from ScrapCodes/dep-resolution-fix Moving akka dependency resolver to shared. 25 February 2013, 08:16:52 UTC
254acb1 Prashant Sharma 25 February 2013, 08:07:07 UTC Moving akka dependency resolver to shared. 25 February 2013, 08:07:07 UTC
c44ccf2 Stephen Haberman 25 February 2013, 05:54:03 UTC Use default parallelism if its set. 25 February 2013, 05:54:03 UTC
44032bc Stephen Haberman 25 February 2013, 04:08:14 UTC Merge branch 'master' into bettersplits Conflicts: core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/test/scala/spark/ShuffleSuite.scala 25 February 2013, 04:08:14 UTC
22f68b7 Matei Zaharia 25 February 2013, 01:48:17 UTC Merge pull request #494 from mesos/streaming Final set of Spark Streaming changes 25 February 2013, 01:48:17 UTC
f9881b1 Tathagata Das 25 February 2013, 00:39:04 UTC Merge pull request #495 from tdas/streaming Changed class paths and dependencies based on Matei's comments 25 February 2013, 00:39:04 UTC
abb5471 Tathagata Das 25 February 2013, 00:32:44 UTC Removing duplicate doc. 25 February 2013, 00:32:44 UTC
5ab37be Tathagata Das 25 February 2013, 00:24:52 UTC Fixed class paths and dependencies based on Matei's comments. 25 February 2013, 00:24:52 UTC
32f1a2d Tathagata Das 24 February 2013, 22:46:19 UTC Merge pull request #493 from tdas/streaming Streaming bug fixes 24 February 2013, 22:46:19 UTC
066ce0f Matei Zaharia 24 February 2013, 22:11:07 UTC Merge pull request #492 from JoshRosen/pyspark-split-rename Change numSplits to numPartitions in PySpark 24 February 2013, 22:11:07 UTC
2c966c9 Josh Rosen 24 February 2013, 21:25:09 UTC Change numSplits to numPartitions in PySpark. 24 February 2013, 21:25:09 UTC
28f8b72 Tathagata Das 24 February 2013, 21:01:54 UTC Added back the initial spark job before starting streaming receivers 24 February 2013, 21:01:54 UTC
f282bc4 Tathagata Das 24 February 2013, 20:44:12 UTC Changed Algebird from 0.1.9 to 0.1.8 24 February 2013, 20:44:12 UTC
dff53d1 Tathagata Das 24 February 2013, 20:17:22 UTC Merge branch 'mesos-master' into streaming 24 February 2013, 20:17:22 UTC
68c7934 Tathagata Das 24 February 2013, 19:51:45 UTC Fixed missing dependencies in streaming/pom.xml 24 February 2013, 19:51:45 UTC
c1a040d Tathagata Das 24 February 2013, 19:00:30 UTC Fixed bugs in examples. 24 February 2013, 19:00:30 UTC
b4eb24d Tathagata Das 24 February 2013, 07:59:45 UTC Updated streaming programming guide with Java API info, and comments from Patrick. 24 February 2013, 07:59:45 UTC
3b9f929 Matei Zaharia 24 February 2013, 07:38:15 UTC Merge pull request #468 from haitaoyao/master support customized java options for Master, Worker, Executor, and Repl 24 February 2013, 07:38:15 UTC
beb79db Matei Zaharia 24 February 2013, 07:25:27 UTC Merge pull request #473 from stephenh/subtract Add RDD.subtract. 24 February 2013, 07:25:27 UTC
37c7a71 Stephen Haberman 24 February 2013, 06:27:53 UTC Add subtract to JavaRDD, JavaDoubleRDD, and JavaPairRDD. 24 February 2013, 06:27:53 UTC
f442e7d Stephen Haberman 24 February 2013, 06:27:14 UTC Update for split->partition rename. 24 February 2013, 06:27:14 UTC
cec87a0 Stephen Haberman 24 February 2013, 05:27:55 UTC Merge branch 'master' into subtract 24 February 2013, 05:27:55 UTC
d853aa9 Tathagata Das 24 February 2013, 01:42:26 UTC Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs. 24 February 2013, 01:42:26 UTC
41285ea Tathagata Das 24 February 2013, 00:25:07 UTC Fixed differences in APIs of StreamingContext and JavaStreamingContext. Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite. 24 February 2013, 00:25:07 UTC
8a0ca6f Matei Zaharia 23 February 2013, 23:55:06 UTC Merge pull request #491 from pwendell/java-vector Adding Java-accessible methods to Vector.scala 23 February 2013, 23:55:06 UTC
931f439 Patrick Wendell 23 February 2013, 23:40:41 UTC Responding to code review 23 February 2013, 23:40:41 UTC
f51b0f9 Patrick Wendell 23 February 2013, 21:26:59 UTC Adding Java-accessible methods to Vector.scala This is needed for the Strata machine learning tutorial (and also is generally helpful). 23 February 2013, 21:26:59 UTC
d942d39 Matei Zaharia 23 February 2013, 19:19:07 UTC Handle exceptions in RecordReader.close() better (suggested by Jim Donahue) 23 February 2013, 19:19:07 UTC
c898240 Matei Zaharia 23 February 2013, 06:58:19 UTC Merge pull request #490 from woggling/conn-death Detect when SendingConnections disconnect even if we aren't sending to them 23 February 2013, 06:58:19 UTC
d8cee52 Tathagata Das 23 February 2013, 02:25:34 UTC Merge branch 'mesos-streaming' into streaming 23 February 2013, 02:25:34 UTC
24c0cd6 Tathagata Das 23 February 2013, 02:23:29 UTC Fixed resolver for akka-zeromq 23 February 2013, 02:23:29 UTC
50cf8c8 Charles Reiss 22 February 2013, 23:23:58 UTC Add fault tolerance test that uses replicated RDDs. 23 February 2013, 00:11:53 UTC
c8a7886 Charles Reiss 22 February 2013, 23:16:03 UTC Detect when SendingConnections drop by trying to read them. Comment fix 23 February 2013, 00:11:52 UTC
d4d7993 Matei Zaharia 22 February 2013, 23:51:37 UTC Several fixes to the work to log when no resources can be used by a job. Fixed some of the messages as well as code style. 22 February 2013, 23:51:37 UTC
f33662c Matei Zaharia 22 February 2013, 23:26:55 UTC Merge remote-tracking branch 'pwendell/starvation-check' Also fixed a bug where master was offering executors on dead workers Conflicts: core/src/main/scala/spark/deploy/master/Master.scala 22 February 2013, 23:27:41 UTC
7341de0 Matei Zaharia 22 February 2013, 22:56:18 UTC Merge pull request #475 from JoshRosen/spark-668 Remove hack workaround for SPARK-668 22 February 2013, 22:56:18 UTC
fcf7fa8 Matei Zaharia 22 February 2013, 22:55:46 UTC Merge pull request #489 from pwendell/SPARK-702 SPARK-702: Replace Function --> JFunction in JavaAPI Suite. 22 February 2013, 22:55:46 UTC
f8c3a03 Patrick Wendell 22 February 2013, 20:54:15 UTC SPARK-702: Replace Function --> JFunction in JavaAPI Suite. In a few places the Scala (rather than Java) function class is used. 22 February 2013, 20:54:15 UTC
cfa65eb Tathagata Das 22 February 2013, 20:29:04 UTC Merge pull request #480 from MLnick/streaming-eg-algebird [Streaming] Examples using Twitter's Algebird library 22 February 2013, 20:29:04 UTC
688e627 Tathagata Das 22 February 2013, 20:17:17 UTC Merge pull request #479 from ScrapCodes/zeromq-streaming Zeromq streaming 22 February 2013, 20:17:17 UTC
208edaa Tathagata Das 21 February 2013, 23:22:26 UTC Fixed condition in InputDStream isTimeValid. 21 February 2013, 23:22:26 UTC
d9bdae8 Nick Pentreath 21 February 2013, 10:31:31 UTC Adding documentation for HLL and CMS examples. More efficient and clear use of the monoids. 21 February 2013, 10:31:31 UTC
718474b Nick Pentreath 21 February 2013, 10:11:31 UTC Bumping Algebird to 0.1.9 21 February 2013, 10:11:31 UTC
16d4567 Nick Pentreath 21 February 2013, 07:33:08 UTC Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird 21 February 2013, 07:33:08 UTC
8215b95 haitao.yao 21 February 2013, 02:07:24 UTC Merge branch 'mesos' 21 February 2013, 02:07:24 UTC
2921fa7 Tathagata Das 20 February 2013, 19:06:57 UTC Merge pull request #487 from tdas/streaming Merged latest master changes to streaming 20 February 2013, 19:06:57 UTC
972fe77 Tathagata Das 20 February 2013, 19:06:01 UTC Merge branch 'mesos-streaming' into streaming Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java 20 February 2013, 19:06:01 UTC
334ab92 Tathagata Das 20 February 2013, 18:26:36 UTC Fixed bug in CheckpointSuite 20 February 2013, 18:26:36 UTC
1cb725e Tathagata Das 20 February 2013, 17:55:35 UTC Merge branch 'mesos-master' into streaming 20 February 2013, 17:55:35 UTC
fb99562 Tathagata Das 20 February 2013, 17:01:29 UTC Merge branch 'mesos-master' into streaming Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala 20 February 2013, 17:01:29 UTC
ee88561 Prashant Sharma 20 February 2013, 13:48:24 UTC removed document on zeromq 20 February 2013, 13:48:24 UTC
4e5b096 Prashant Sharma 20 February 2013, 07:03:37 UTC fixes corresponding to review feedback at pull request #479 20 February 2013, 13:44:52 UTC
991d334 Tathagata Das 20 February 2013, 10:06:36 UTC Merge pull request #486 from ScrapCodes/akka-example-bug-fix A bug fix to AkkaWordCount example. 20 February 2013, 10:06:36 UTC
05dc385 Prashant Sharma 20 February 2013, 09:58:12 UTC A bug fix post merge, following changes to AkkaUtils 20 February 2013, 09:58:12 UTC
05bc02e Matei Zaharia 20 February 2013, 04:56:15 UTC Merge pull request #482 from woggling/shutdown-exceptions Don't call System.exit over uncaught exceptions from shutdown hooks 20 February 2013, 04:56:15 UTC
6a3d44c haitao.yao 20 February 2013, 02:23:58 UTC Merge branch 'mesos' 20 February 2013, 02:23:58 UTC
092c631 Charles Reiss 20 February 2013, 01:49:55 UTC Pull detection of being in a shutdown hook into utility function. 20 February 2013, 01:49:55 UTC
8a99222 Matei Zaharia 20 February 2013, 01:07:24 UTC Merge pull request #484 from andyk/master Fixes a broken link in documentation to issue tracker 20 February 2013, 01:07:24 UTC
a3e86b2 Matei Zaharia 20 February 2013, 01:07:00 UTC Merge pull request #483 from rxin/splitpruningrdd2 Added a method to create PartitionPruningRDD. 20 February 2013, 01:07:00 UTC
back to top