https://github.com/thinkaurelius/titan

sort by:
Revision Author Date Message Commit Date
47cfcb2 More exception wrapping. 29 July 2014, 18:15:36 UTC
d5a61a4 Update to new refactored KV API. 29 July 2014, 18:03:11 UTC
0fc1400 Better exception mapping: everything isn't temporary. Add tracing like BDB. React to exception class renaming. Improve logging a little bit. Locking is done by storage engine: declare so and ignore requests for it. Use a better name that doesn't conflict for FDB directory, which isn't a file-system directory. Allow enabling of trace file. 29 July 2014, 18:03:11 UTC
7b60832 Update to new API and new test method. 29 July 2014, 18:03:11 UTC
a7abed5 Add the new files from the foundationdb branch. 29 July 2014, 18:03:11 UTC
ce34565 [maven-release-plugin] prepare for next development iteration 29 July 2014, 13:42:49 UTC
023020f [maven-release-plugin] prepare release 0.5.0-M3 29 July 2014, 13:42:49 UTC
c0c7452 Merge branch 'titan05' of github.com:thinkaurelius/titan into titan05 29 July 2014, 13:41:23 UTC
e8d2e4b Fix outdated config keys in reindex tests Replaced hardcoded strings with references to ConfigOptions and calls to ConfigElement.getPath 29 July 2014, 13:22:40 UTC
d4efa84 Make Faunus copy DistributedCached'd jars to HDFS Hadoop automagically copies files and creates symlinks when adding jars to the DistributedCache under the local JobRunner, but Hadoop requires the user (Faunus, in this case) to manually copy jars from the local filesystem to HDFS when using an actual cluster. This commit extends AbstractDistCacheConfigurer and its subclasses to address both cases instead of just working in the local case. 29 July 2014, 13:20:39 UTC
bce7279 Temporary fix for relative ES directory, conf-file Relative paths for ES's directory and conf-file options used to be interpreted relative to the config file in which they appeared, same as storage.directory and storage.conf-file, but this broke a while back. It only broke for indices though -- not storage backends. This commit is a short-term fix that restores the old interpretation for indices. The code this commit touches is a relic from the days of hard-coded string config keys and should be refactored out of existince by extending ConfigOption. 29 July 2014, 13:18:07 UTC
eaa0c23 Tweak titan-hadoop test log config 29 July 2014, 12:53:59 UTC
2f5879a Comment, whitespace tweaks in stock Titan configs 29 July 2014, 12:53:23 UTC
69a575a Refactor assemblies to support Hadoop1/2 specifica Now that we have a pair of archive zipfiles, one with Hadoop 1 and the other with Hadoop 2, the mapred-site.xml and core-site.xml files that we ship in conf should be version-appropriate. Pretty much all interesting config keys changed between 1.x and 2.x, so we can't just share files without generating a bunch of deprecation warnings under Hadoop 2 and inviting confusion/mistakes. Now the Hadoop 1 and Hadoop 2 distro modules each have their own copies of the mapred-site.xml and core-site.xml files. The mechanism is more general -- any files or directories in titan-dist-hadoop-{1,2}/src/assembly/static/ will appear in their respective archive files. 29 July 2014, 12:49:15 UTC
e3dd571 Tweak a CassandraThrift pool default setting This int setting tweak should actually have no effect, since the boolean that controls whether it is read is still false. 29 July 2014, 12:45:08 UTC
d789912 Added documentation stubs 29 July 2014, 08:25:52 UTC
89ae42e Giving up on titan-hadoop-core deploy tweaks There is no way to exclude specific classifiers from the deploy stage short of detaching the from the build. Even disabling the default-deploy execution and manually configuring deploy-file executions for only a whitelist of classifiers is a deadend strategy, because deploy-file requires an explicit repositoryId instead of just defaulting to whatever repository is configured in the pom. I forgot how much of a headache this is, but the only way to get this behavior is more modules. Not going down that path right now... 28 July 2014, 13:15:45 UTC
7b9ac58 Second attempt at titan-hadoop-core pom tweaks Retrying 0b602d8f5b21c54fdb1f7587ad710e50721f21bf, hopefully without build errors this time 28 July 2014, 13:13:08 UTC
205397d Detach Hadoop job jars from titan-hadoop builds 28 July 2014, 12:56:45 UTC
0b602d8 Tweak titan-hadoop-core artifact deployment The shared-resources and example-data artifacts are now detached from the build, so they're no longer installed, signed, or deployed by default. I added explicit maven-install-plugin executions to install them locally to support the titan-hadoop-1 and -2 modules. The point of this is to avoid deploying these artifacts to Maven Central. This commit also redeclares the gpg plugin at the bottom of the titan-hadoop-core pom so that the test jars will get signed. Seems like the maven-jar-plugin's test-jar execution is ordered after maven-gpg-plugin's sign execution. 28 July 2014, 12:54:36 UTC
89de20f Tweak ES pom to sign test jars during releases 28 July 2014, 12:53:48 UTC
9074b3b Increase timeout in Expect-Cassandra tests 28 July 2014, 12:01:21 UTC
d27488d Fix outdated Titan config keys in Hadoop cfgfiles 28 July 2014, 11:27:12 UTC
d41426b Add experimental lint-type util for Titan cfgfiles 28 July 2014, 11:17:11 UTC
9810a51 Fix outdated ES config opts in default cfgfiles 28 July 2014, 11:16:36 UTC
a8d05fd Fix typo in configref ("know to" -> "known to") 28 July 2014, 08:03:27 UTC
1af014c Delete stale imports in ExpectedValueCheckingStore 28 July 2014, 07:58:27 UTC
940ac44 Merge branch 'titan05' of github.com:thinkaurelius/titan into titan05 28 July 2014, 07:56:24 UTC
457603c Configuration option and namespace tweaks * Created a new storage.lock namespace. The following storage options have been stripped of their lock- prefixes and moved to the storage.lock namespace: lock-backend lock-clean-expired lock-expiry-time lock-retries lock-wait-time storage.local-lock-mediator-prefix has also been renamed storage.lock.local-mediator-group. The definition of this option has also moved from ExpectedValueCheckingStore to GraphDatabaseConfiguration, where it now resides alongside the other LOCK_NS options. * Added @PreInitializeConfigOptions to some classes * Moved thrift-frame-size option from AbstractCassandraStoreManager to the Thrift manager, since both Astyanax and Embedded did nothing with this option aside from issue a warning. This option now storage.cassandra.thrift.frame-size. * Pulled index.[X].elasticsearch.max-result-set-size up a level to index.[X].max-result-set-size. It's now defined in GraphDatabaseConfiguration. ES is the only index that uses this option right now, but SOLR is very likely to use this option when it gets merged. 28 July 2014, 07:55:55 UTC
9846ac8 Updated documentation 28 July 2014, 07:32:17 UTC
4171592 Added @PreInitializeConfigOptions to classes so their config options can be found. 28 July 2014, 07:06:06 UTC
acd7d89 Merge branch 'titan05' of https://github.com/thinkaurelius/titan into titan05 28 July 2014, 06:45:32 UTC
169d0a6 Updated documentation 28 July 2014, 06:45:24 UTC
98d04d5 Updated the config printer to mark umbrella namespaces and use prefix in name construction. 28 July 2014, 06:42:14 UTC
2528561 Fix precondition string in ConfigElement Preconditions string interpolation uses String.format chars like %s not Slf4j replacement tokens like {} 28 July 2014, 06:27:04 UTC
7481943 Configuration namespace and option reorganization 28 July 2014, 06:26:34 UTC
1d799b6 Updating the documentation 28 July 2014, 06:08:44 UTC
01903da Updating the documentation and adding missing imports from gremlin 28 July 2014, 05:59:42 UTC
b2af5c8 Updating the documentation 28 July 2014, 05:27:19 UTC
dae0a97 Updating the documentation 28 July 2014, 04:13:03 UTC
669bd30 Merge branch 'titan05' of https://github.com/thinkaurelius/titan into titan05 28 July 2014, 00:52:07 UTC
b2a5001 Updating the documentation 28 July 2014, 00:51:59 UTC
64bac33 Fix two Hadoop Job/Task Context compat leaks 27 July 2014, 23:39:29 UTC
e8a4fe9 Moved user-log-prefix variable to GraphDatabaseCOnfiguration 27 July 2014, 23:22:12 UTC
7bd1bf9 Rename trigger log to user log 27 July 2014, 23:11:05 UTC
749cbf4 Merge branch 'titan05' of https://github.com/thinkaurelius/titan into titan05 27 July 2014, 20:42:41 UTC
5024d60 Updated config description and documentation 27 July 2014, 20:42:37 UTC
318062a Updated config description and documentation 27 July 2014, 20:42:08 UTC
8b791c5 Moved ModifierType and updated/moved some graph configuration options 27 July 2014, 19:36:51 UTC
b7b92f1 Fix typo in titan-es maven-clean-plugin config 27 July 2014, 13:48:35 UTC
26961fd Update titan-es .gitignore Ignore scripts and configuration generated for the use of the standalone ES daemon 27 July 2014, 13:47:19 UTC
5a180a3 Eliminate unused code, field in HBaseStatus This commit deletes some unused code from some of the utility classes that start and stop HBase daemons during testing. 27 July 2014, 13:46:35 UTC
306e299 Adding ES daemon helper to support Faunus tests The vast majority of ES-backed tests work fine with local-mode where ES runs embedded and does not accept sockets. However, this does not work well with Faunus. Running many short-lived map or reduce tasks, each with its own embedded ES instance running in local-mode tends to cause a wave of unclean ES shutdowns. Starting a backgrounded ES daemon in an external process and then running Faunus + Titan + ES tests against that external process is cleaner. This commit introduces a Java utility class that starts and stops an external ES daemon to support Faunus tests. The daemon writes a pidfile /tmp/titan-test-es.pid and writes data to titan-es/target/es-data. The config and scripts are lifted from the ES 1.2.1 distribution. Some of the pom glue and utility class code are adapted from similar previous work in titan-hbase. The recently introduced CassandraESReindexTest class already requires an external ES daemon to succeed. This commit just adds automated tooling to provide one and adds a @BeforeClass to CassandraESReindexTest that uses it. 27 July 2014, 13:45:40 UTC
4ba83ee titan-dist pom optimization Tweaking Maven plugin execution bindings to skip pointless plugin runs and slightly shorten execution times. 27 July 2014, 10:59:05 UTC
60dc280 Tweak lib file filter for zip/tar archives The zipfile/tarfile assembly descriptor is now slightly more inclusive. It used to exclude any jar in the dependency tree with classifier tests, javadoc, shared-resources, or example-data. Of those, tests could have potentially been problematic; there are some dependencies in the titan-dist tree that in turn depend on artifacts with classifier "tests" yet have dependency scope "compile". Anything with compile scope should go into lib, and now that's the case, even if the classifier is "tests". It's possible that these compile scopes are just oversights in the poms of our dependencies, but I can't easily tell and it's not worth the risk of excluding them. 27 July 2014, 10:53:05 UTC
3ca6adf Fix Hadoop bytecode incompatibility leaks This commit fixes several more instances of Job.getConfiguration() and TaskAttemptContext.getConfiguration() lingering in titan-hadoop-core. These calls can't be made directly from titan-hadoop-core because the Job and TAC types changed from classes to interfaces between Hadoop 1 and 2. Replaced them with calls to the associated helper methods on the HadoopCompat interface. 27 July 2014, 10:32:31 UTC
761e5e9 Split titan-dist into Hadoop 1 and 2 submodules Before this commit, Maven built one distribution zip/tar archive based on Hadoop 2. Now it generates a pair of archives, one for Hadoop 2 and another for Hadoop 1. Each archive runs a separate execution of the Expect-based integration tests. 27 July 2014, 10:30:12 UTC
2364624 Deprecating some Faunus config classes These are probably going to be removed soon. 27 July 2014, 06:01:21 UTC
08c3cf6 Expand Faunus Distributed Cache support to Hadoop1 This commit pulls most of the Hadoop2-specific DistributedCache support introduced by 71e7c54e067e8e9388fec5799a6a0a72210d2a2e into titan-hadoop-core, with a little bit of code in the Hadoop1Compat and Hadoop2Compat layers to account for different config key names and interface deprecations. 27 July 2014, 05:59:39 UTC
c2588d9 Javadoc'ing all methods in HadoopCompat interface 27 July 2014, 05:29:25 UTC
42c9aa7 Updated one additional test case to use TitanManagement for type making. 27 July 2014, 05:07:13 UTC
6ed7dfa Removed type maker methods from TitanGraph. Types have to be made inside an explicit transaction or through TitanManagement. Test cases are refactored accordingly. 27 July 2014, 05:04:43 UTC
7c25ccb Changed name from createEdge/PropertyIndex to buildEdge/PropertyIndex to consistently use the verb "build" when referring to index construction. 27 July 2014, 04:29:51 UTC
ca7fc47 Updated css files so that documentation looks better, i.e. is easier to read. 27 July 2014, 00:56:33 UTC
11c8df7 Updated previous fix for case of unindexed graph lookup. 26 July 2014, 22:09:42 UTC
6502ac3 Fixed TitanIndexTest.testSimpleUpdate (used wrong index) which reproduced #686. Fixes #686 by correctly consolidating additions after deletes of edges for mixed indexes. 26 July 2014, 21:58:19 UTC
a59a3b9 Added convertId to BlueprintsTestCase so that vertex labels don't get inadvertently created. Had to exclude a number of test cases due to bugs in the tests. 26 July 2014, 21:27:08 UTC
49249ac Fixes #656 by changing LongEncoding to only use lower case characters. Adds test case for case insensitivity. 26 July 2014, 18:02:45 UTC
902206a Introduce tx configuration option for disabling batch mutation on a per transaction level when batch loading is enabled for the entire graph. Use in ManagementSystem and the type inference map-reduce step. 26 July 2014, 17:08:26 UTC
fccacec Interpreting string value as vertex label on g.addVertex(Object). Intermediate update of documentation. 26 July 2014, 16:38:14 UTC
2edf8ce Merge branch 'titan05' of https://github.com/thinkaurelius/titan into titan05 26 July 2014, 16:37:36 UTC
d51fc22 Increase timeout in titan-dist Cassandra tests 26 July 2014, 03:32:24 UTC
71e7c54 Add DistributedCache support in Faunus + Hadoop2 It's now possible to forego supplying a mapred job jar, in which case Faunus under Hadoop 2 will iterate over all jars in the classpath and call job.addFileToClassPath on each one, which puts them in the DistributedCache and makes them available to the job at runtime. This is only lightly tested. It could also be generalized to Hadoop 1, although I'm not sure which types would be incompatible and which can be shared and go in core. 26 July 2014, 03:30:03 UTC
d7c9593 Change some maven module descriptions Technically this commit changes the <name/> tag in the poms of several modules, but <name/> is just a human-friendly text string. This commit does not change any artifact or filenames. 25 July 2014, 22:59:50 UTC
685dffe Stop packaging test resources in the hadoop jars titan-hadoop-1 and -2 needlessly included a couple of test resource files along with their classfiles when packaging themselves. Now these test resources are omitted from their jars. 25 July 2014, 22:58:28 UTC
50db021 Create titan-hadoop "universal binary" jar Similar to titan-hbase, titan-hadoop assembles the classfiles from titan-hadoop-core, titan-hadoop-1, and titan-hadoop-2 into a single jar. The compat shim loader in titan-hadoop-core reflectively loads classes from either titan-hadoop-2 or titan-hadoop-2 depending on what version of Hadoop is detected at runtime. This commit also updates titan-all and titan-dist to use the titan-hadoop jar. 25 July 2014, 22:56:25 UTC
28d44f2 Fix and extend titan-dist tests This commit should ideally be split up into smaller commits, but overlapping changes in titan-dist/pom.xml made that difficult. This commit fixes the existing Expect-based tests, all of which were broken before this commit. There were a couple of problems: 1. Vertex IDs assigned by Titan during even trivial gremlin.sh examples have changed since the Expect tests were originally written, so that the current vertex IDs disagree with the constants embedded in the Expect scripts. I replaced all of those constant vertex ID expectations with regexes for nonnegative integers. 2. A mismatch between the config files generated in titan-dist/pom.xml and the default config files used by CassandraStorageSetup prevented Cassandra from even starting Both of these are fixed. This commit also adds three new tests of Faunus: * graphson->cassandra, shutdown, then cassandra->graphson * graphson->hbase, shutdown, then hbase->graphson * graphson->graphson The Cassandra tests run once on BOP and then again on Murmur. The HBase tests run against whatever HBase version is in the zipfile (currently: 0.98). The tests start HBase automatically using the test harness in titan-hbase-parent. This commit also disables batch-loading in the default titan-hbase-output.properties and titan-cassandra-output.properties files shipped in the zipfile. This is a temporary workaround for the schema inferencer not forcing batch-loading off. This commit also adds hbase-server to the zipfile dependency tree. The zipfile was originally written with 0.94, which just had a single artifact named "hbase". 0.96 and 0.98 are split between the "hbase-client" and "hbase-server" artifacts, and HBase's MapReduce input format ships in the latter. Failing to include it in the zipfile produced ClassNotFoundException when attempting to use the HBase input format. Several sample Faunus config files included in the zipfile contain a path to ./graph-of-the-gods.json. I changed this to example-data/graph-ofthe-gods.json, so that the example files work without any modification or file copying when using MapReduce's local (in-process) job runner and directly accessing the local filesystem. The modification to the root-level pom.xml file resolves a dependency conflict between rexster and hbase-server over grizzly2's exact version number. 25 July 2014, 10:12:27 UTC
fe2f252 Hack support for HBase short CF names in Faunus Prior to this commit, Faunus's HBase input format would fail to read from a Titan database written with short-cf-names=true (currently the default), since it just assumed that long CF names were in use. This commit suggests future refactoring. Hiding the mapping between short and long names inside HBaseStoreManager a private datastructure prevents TitanHBaseInputFormat from reading it. Either the mapping needs to become public, or we would need to change the type of CF names from String to an enum or some interface that can supply both the short and long name through a pair of methods. 25 July 2014, 10:08:44 UTC
6f38f19 Prevent avoidable NPE in TitanGraphOutputMR TitanGraphOutputMapReduce has a static helper that constructs a configuration with some default settings commonly used in testing. These are Cassandra specific, which doesn't really belong in the store-agnostic TitanGraphOutputMapReduce class anyway, but moving it is a task for a future commit. This commit just modifies the default-setting logic to avoid an NPE when cassandra.yaml is not available as a classloader resource in the same package as TitanCassandraInputFormat. That's still the first place it looks, but if it comes up null, it tries the system classloader, and if that comes up null, then it does not attempt to set a default value for the cassandra.yaml path. 25 July 2014, 10:03:36 UTC
9a7547d Make shared hadoop test resources dep optional This changes titan-hadoop-2's dependency on titan-hadoop-core's shared-resources jar to be both optional and test-scoped. This change only affects titan-hadoop-2. 25 July 2014, 10:02:41 UTC
3dc3772 Add shared test resources to titan-hadoop-1 build 25 July 2014, 10:00:51 UTC
059814a Support external calls to titan-hbase test harness The test support code in titan-hbase-core can start and stop HBase daemons at several different supported versions. Prior to this commit, the harness assumed that the current working directory of the process was one of the titan-hbase-parent/titan-hbase-09X/ directories. Now the harness's assumption can be overridden by setting the test.hbase.parentdir system property. This supports reuse of the HBase daemon test harness from other modules, such as titan-dist. It's not the cleanest way to do it, but it works for now. 25 July 2014, 09:58:15 UTC
6d24a1b Make Backend.clearStorage/.close idempotent clearStorage already closes the Backend handles as it deletes their data, so it doesn't make sense to call it multiple times. Idempotence of close is slightly more intuitive. 25 July 2014, 09:56:12 UTC
88fe800 Make txs w/ locks write at QUORUM or higher Along with cb8660102019c44288ee5556a8851b4307a211da and the tests added by 7b159ef16be02f018053f6d0e0efa32809cdd8a9, this commit fixes strong-consistency transaction both to read actual values associated with expectations out of the backing store and to mutate data on the backing store when at least one lock is held. This commit also removes the warning added in cb8660102019c44288ee5556a8851b4307a211da since it's now obsolete. 24 July 2014, 03:44:55 UTC
7b159ef Adding test of EVCS transaction handling EVCS = ExpectedValueCheckingStore and associated manager and transaction classes. These classes hold a transaction which is supposed to provide global strong consistency and another transaction which does not guarantee any particular level of consistency. This new test checks that the strong consistency tx is used when reading data to check expectations and when writing mutations for a transaction which has taken at least one lock. 24 July 2014, 03:38:03 UTC
b6ab370 Updated doc 21 July 2014, 07:15:35 UTC
f853d94 Refactored KV interfaces to push down limit into the adapter and provide support for multi-query (the latter is still somewhat experimental since the test has no supporting implementation at this point). 21 July 2014, 07:11:34 UTC
2d80d98 [maven-release-plugin] prepare for next development iteration 21 July 2014, 06:20:05 UTC
380e94b [maven-release-plugin] prepare release 0.5.0-M2 21 July 2014, 06:20:05 UTC
8f81954 titan-hbase pom tweak for the release profile 21 July 2014, 06:17:51 UTC
e3dda38 Update and remove outdated Faunus sample configs 21 July 2014, 06:04:52 UTC
7aa4aed Update old commands in release documentation 21 July 2014, 05:44:16 UTC
92145f0 Empty compatible versions list for M2 21 July 2014, 05:40:38 UTC
cb86601 Warn when attempting to lock below QUORUM 21 July 2014, 05:40:12 UTC
fdf26f3 Update HBase 0.94 patch version Should stop https://issues.apache.org/jira/browse/HBASE-10312 during testing on 0.94. I thought I did this as part of 229f7d9e4436cdafc4e6943dabccf7ca5c0ef5da, but I think I left it out unintentionally. 21 July 2014, 05:40:05 UTC
efb790b Update index API use in SerializerGraphConfig 21 July 2014, 05:38:29 UTC
e6ba234 Merge branch 'hadoop-reindex' into titan05 21 July 2014, 05:38:09 UTC
400cf37 Fixed test case 21 July 2014, 04:49:09 UTC
a7a0f4d Added schema documentation 21 July 2014, 01:45:45 UTC
fc3c307 Removed unnecesarry methods from KeyValueStore 21 July 2014, 01:45:33 UTC
back to top