https://github.com/openstack/rally

sort by:
Revision Author Date Message Commit Date
3011fa6 Release notes v0.1.1 Change-Id: Ifaa083a54fb72cb5c195c80da064ec91032292d7 07 October 2015, 00:07:04 UTC
547a311 Merge "Updated scenario boot-and-delete-server-with-keypairs" 06 October 2015, 23:27:48 UTC
8a27449 verification: set timeout for requests.get when testing for Horizon The default timeout for requests.get is None. Because of that the requests.get call will hang forever if no Horizion dashboard is available. Change-Id: Ibbe7ff1ada234b6b733be2c29c278f0f0711219d Closes-bug: #1501696 06 October 2015, 11:14:24 UTC
0a312c2 Merge "Fix & Restore cover job" 06 October 2015, 10:02:18 UTC
a02bc92 Updated scenario boot-and-delete-server-with-keypairs Included kwargs missing in the create-server code Closes-Bug:#1445915 Co-Authored-By: Roman Vasilets <rvasilets@mirantis.com> Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net> Change-Id: I961334d097d566127f4930d94e7b21b16e728d54 06 October 2015, 08:44:22 UTC
f259c99 Fix & Restore cover job Change ignore-errors to ignore_errors which is needed by coverage 4.0 Restore coverage job (run cover job) Closes-bug: #1497897 Change-Id: I2df04cf6b239777cfc7b1bafac87aa4bf38d881c 06 October 2015, 07:58:37 UTC
08d67da Merge "config: fix missing benchmark opts" 06 October 2015, 07:57:08 UTC
ab58535 config: fix missing benchmark opts Fix missing benchmark opts for Ironic, Murano and VM workload. Fix configuration variable names for Murano and Sahara. Change-Id: I161f0218e94c1b6d2e2aa9cf085cb1be991a8e9e Closes-Bug: #1502846 Doc-Impact 06 October 2015, 05:21:46 UTC
4841be6 Merge "Updating Tempest test sets" 06 October 2015, 05:17:21 UTC
99d6d41 Merge "Reworked script generating tempest.conf" 06 October 2015, 04:55:45 UTC
1dfb995 Reworked script generating tempest.conf * The config.py script generating tempest.conf was significantly reworked. * The config.ini file was updated. * A context class to create/delete all resources needed for Tempest was added. How does it work? Before running tests: 1. The context class creates all roles needed for Tempest; 2. If the image_ref option is not specified in the tempest.conf file, the context class will create an image for this option and add ID of the created image to tempest.conf; 3. The same is for 'image_ref_alt', 'flavor_ref' and 'flavor_ref_alt'; 4. Once tests finish, all created resources will be deleted. All IDs of created resources will be deleted from tempest.conf. * The TempestConfigCreationFailure exception was moved to the exceptions.py file. In addition, the TempestResourceCreationFailure exception was added. * The rally-verify.sh script was changed. The index_verify.mako file was changed as well in accordance with changes in rally-verify.sh. * All relevant unit tests were updated in accordance with new changes. Closes-bug: #1454648 Change-Id: If32e51d6ce1f6bf7421021d151005cc75ed34953 05 October 2015, 22:38:10 UTC
c172006 workload: fix and rename benchmark script Benchmark script uploaded by the custom_image is installing a benchmark and should be named accordingly. Also, fix the size of the read benchmark. Change-Id: Id75db4b06acfa04145feb3bf07ea6a9c91b03d9f Closes-Bug: #1502838 05 October 2015, 12:23:52 UTC
fcff2b0 Merge "workload: fix custom_image cleanup" 05 October 2015, 12:14:42 UTC
5d5eeea workload: fix custom_image cleanup A VM ran by `custom_image` context is left running in case the script failed. Fix this by moving cleanup to a try/finally block letting the exception propagate upwards so no scenario is run when the context have failed. Change-Id: I90d783eeb50b1f0bfa77d59993ff116451d11878 Closes-Bug: #1502832 05 October 2015, 10:35:50 UTC
55f86a5 Merge "Replacing 'print' with 'LOG.xxx'" 05 October 2015, 06:16:57 UTC
07e2b0e Replacing 'print' with 'LOG.xxx' It is recommended to use the print() function only in rally.cli module. So this patch replaces the use of print() with LOG.xxx in the tempest.py and api.py files. Change-Id: Ifa8f9b708d002986926f5eb36c7a4ef0a2cbb131 04 October 2015, 19:24:03 UTC
6a0c2f5 Updating Tempest test sets 1. Tempest has the 'database' and 'messaging' sets as well. So these sets have been added. 2. Tempest doesn't have the 'dns' and 'application_catalog' sets. So these sets have been removed. Change-Id: Ib16f265a41131af52eeb0f69b00625bfce453046 04 October 2015, 19:17:32 UTC
0fa4f10 Merge "Nova-network: disassociate networks before deletion" 04 October 2015, 18:01:33 UTC
654c63e Merge "Small improvements for `rally verify import`" 03 October 2015, 09:10:14 UTC
758e461 Fix install_rally.sh set 777 access to sqlite file DB file should have 777 access so everybody will be able to access it. Hopefully sqlite supports multiple writers (it does serialization of writes) so everything will work even in case of simultaneously access by many users. Change-Id: I51ce88619e29de22ddd001ad2cfc6c9b3cccda11 Closes-Bug: #1501159 02 October 2015, 22:18:07 UTC
77861e2 Merge "Add resource fault detail in exception" 02 October 2015, 20:48:54 UTC
c94458d Add resource fault detail in exception This commit adds the fault attribute of resource to exception message when the resource goes into error state. This will allow easy lookup and tracking of the actual cause of the error rather than manually looking it up for each resource. Adding to exception also allows the detailed error to be available in the generated reports. Change-Id: I1293bc5b2fd1c344f0752d5cb89ccbbcebb351fc 02 October 2015, 18:13:10 UTC
178e989 Small improvements for `rally verify import` 1. Optional arguement "--set-name" was renamed into "--set" for consistency. See `rally verify start`. 2. The @envutils.with_default_deployment decorator was added to the import_results method. 3. When we import some results and don't specify set name for tests, in the verification table set name for these tests will be specified as None. So the default value of the "set_name" parameter was changed from None to "" to avoid this issue. Change-Id: Icd6659f1a78c6a426c50c67cc31b7cd85f9fbd11 02 October 2015, 14:22:25 UTC
5e6871d Merge "Add task argument to network wrapper" 02 October 2015, 11:55:43 UTC
2bfdd02 Merge "Fix Rally reports table stats calculation" 02 October 2015, 09:02:54 UTC
e7e6d6e Merge "Fix LB create and delete VIPs failure when concurrency > 1" 01 October 2015, 19:14:01 UTC
bc18883 Merge "Run test_task_samples in separate sqlite db" 01 October 2015, 02:43:50 UTC
d1b7f45 Merge "Remove usage of Exception.message" 01 October 2015, 02:35:18 UTC
6c13b34 Merge "Replacing 'import_file' with 'import_results'" 30 September 2015, 23:00:56 UTC
d076744 Nova-network: disassociate networks before deletion A Nova network must be disassociated from its project before it can be deleted. This adds automatic network disassociation to the delete_network() call in the nova-network wrapper. Change-Id: Ic4f218e9061270415d289d495c1e68c87015addd 30 September 2015, 21:30:26 UTC
03c21ae Merge "Remove psycopg2 from requirements" 30 September 2015, 20:50:20 UTC
367a1b8 Merge "Imporve error message if Rally can't connect to DB" 30 September 2015, 20:20:05 UTC
294f00b Fix Rally reports table stats calculation There were 3 bugs: * Success rate is always 100% * Percentile were improperly calculated * Order of atomic_actions was calulated wrongly This patch includes next changes: * Simplify percentile calculation based on GraphZipper and percentile method from processing utils * Removes useless streaming algorithms * Removes complexity in Charts * Fix the calculation of MainStatsTable * Add proper unit tests Closes-bug: #1500163 Co-Authored-By: Boris Pavlovic <boris@pavlovic.me> Co-Authored-By: Roman Vasilets <rvasilets@mirantis.com> Change-Id: I96b550d97abde39807ea6466eeb30b27e317fbfc 30 September 2015, 19:41:37 UTC
0903c73 Fix LB create and delete VIPs failure when concurrency > 1 Create pools in the scenario instead of context because only one VIP can be associated for a pool. Thus when concurrency>1 failures are avoided. Closes-bug: #1501467 Change-Id: Ibed79807f812a4e46cce0252cfffa8a59624081b 30 September 2015, 19:04:09 UTC
9596cac Fix overly narrow isfile check on tasks Using os.path.isfile() on input tasks prevents users from using symlinks, process substitution, and probably other things as input tasks. Replace it with a check that the task exists and is not a directory. Change-Id: I902e780b8024b41fbf6049392925470eae72bdb1 30 September 2015, 16:30:02 UTC
7ba8694 Add task argument to network wrapper This adds a new mandatory task argument to the network wrapper; this will be used in a future commit to generate the random names for ephemeral resources created by the wrapper. Change-Id: I5fc8053ecfba2ff477c3ff904384f42026ac0642 30 September 2015, 14:11:28 UTC
19ac8c0 Remove psycopg2 from requirements psycopg2 is not directly used in the code and it will be pulled by oslo.db . Change-Id: I8b9c5bc2a1a0cd221451f3a5d7454f55db3a3514 30 September 2015, 13:20:46 UTC
7b0e832 Run test_task_samples in separate sqlite db Add optinal attribute 'force_new_db' to tests.functional.utils.Rally and use it. Change-Id: Ia7f0faedb5b5f6323c5e0ed00948b03a36e4f341 30 September 2015, 12:12:06 UTC
e343df1 Remove usage of Exception.message This attribute was deprecated a long time ago. Change-Id: Iae1831af1828acf21b7ab07b0f3215604c9e9729 30 September 2015, 12:11:59 UTC
6c48f2d Imporve error message if Rally can't connect to DB If Rally can't connect to DB it will print ugly unclear trace. .... File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 385, in connect return self.dbapi.connect(*cargs, **cparams) OperationalError: (sqlite3.OperationalError) unable to open database file This patch attempts to fix this and print userfriendly message: OperationalError: (sqlite3.OperationalError) unable to open database file Looks like Rally can't connect to it's DB. Make a sure that connection string in rally.conf is proper: "sqlite:////some_path/to.sqlite" In other words it will be simpler to debug this issue Change-Id: Ie80ef5ca561be8eb5cdbf81160bf00ac7941c8f6 30 September 2015, 05:29:45 UTC
c8d698a Replacing 'import_file' with 'import_results' New 'import' command for the 'verify' category has been recently introduced in Rally. This command imports Tempest tests results into the Rally data base. However all methods related to the command have 'import_file' word-combination in their names. This patch replaces 'import_file' with 'import_results' that is more logical. Change-Id: Ia9f9b5eaad051bb5f6050f7ddc7a9e108ccddb17 29 September 2015, 17:27:43 UTC
9a17d84 Merge "Add new Murano scenarios" 28 September 2015, 17:38:37 UTC
626999e Merge "Add Neutron Floating IP benchmark scenarios" 28 September 2015, 10:21:12 UTC
950ccc4 Merge "Certification task: Add readme file" 27 September 2015, 09:33:12 UTC
6f67a46 Merge "Import tempest results into Rally database" 27 September 2015, 07:51:34 UTC
c9c68cf Merge "Make network context more configurable" 27 September 2015, 06:16:43 UTC
33c187b Merge "Fix project info page at the docs" 27 September 2015, 04:28:10 UTC
d109964 Certification task: Add readme file Add readme file that describes how to use certification task Change-Id: I8715815dbeaee0123e136eae5fab65f5816bafe6 27 September 2015, 02:49:00 UTC
9930439 Merge "Make code blocks in documentation prettier" 27 September 2015, 01:22:43 UTC
16da9b6 Merge "Set smoke in rally-jobs/rally-neutron.yaml" 26 September 2015, 04:16:15 UTC
ac1bd19 Adds nova image list plugin One of the functionalities Nova provides is listing images. This allows users to be able to consume the functionality, without having to go through Glance. (There are users who do not consume Glance). Currently, there isn't a benchmark provided by rally that does the above. This commit adds a plugin that calls nova client list method for Images, which will therefore be available for benchmarking. Includes functional and unit tests. Change-Id: If11d623bd5c9bf7f8c723908cf9e1e332de0639d 25 September 2015, 18:10:53 UTC
4f5e76c Merge "Remove task validation from api.Task.start" 25 September 2015, 17:13:22 UTC
aff628c Make code blocks in documentation prettier This commit tags code blocks with the appropriate language so that Sphinx can add syntax highlighting and make them look nicer. Change-Id: Id8f178110236b1d97015162b148f3e9127251a3a 25 September 2015, 16:05:16 UTC
b0d1a39 Remove task validation from api.Task.start The goals of this patch: * to separate log output of task validation and task start printout. * don't create task db record and set task's status during 'rally task validate' Change-Id: I6b22eeaebfd2854715b07bcca5c5dfcb8c756ad8 25 September 2015, 14:46:51 UTC
7bb2904 Merge "Document --plugin-paths/RALLY_PLUGIN_PATHS" 25 September 2015, 13:03:59 UTC
785c05e Merge "Release notes v0.1.0" 25 September 2015, 11:44:55 UTC
5806f21 Add Neutron Floating IP benchmark scenarios * Create and list floating IPs * Create and delete floating IPs * Ability to obtain network-id with network-name Change-Id: Iabd6b24fa6c1ee244b514ca90ee5d67a93443fbb 25 September 2015, 11:30:16 UTC
fd245db Import tempest results into Rally database Add a new subcommand to the `verify` command to import tempest results into an existing deployment in the Rally database. `verify import` will read a tempest log in subunit format, and import it into the current deployment (or the one specified in the command line) The command should be called as $ rally verify import --file [log_file] --deployment [uuid] This version of the patch will require a normal deployment to be created beforehand. Also, the log_file needs to be a tempest log in subunit format; `--file` parameter is required. Apart from `--file` and `--deployment` parameters, this command understand `--set-name` and `--no-use` from the `start` command. `--set-name` can be used to attach a name or a small description to the tempest result, and `--no-use` will mark the new verification object as a no-current. So, for example, if we want to assign a name to the tempest result we can use: $ rally verify import --file [log_file] --set-name [name] \ --deployment [uuid] Implements: blueprint verification-import Change-Id: I65194a2f456106fa5731a13f53d5985971aad43a 25 September 2015, 11:24:47 UTC
45059a0 Document --plugin-paths/RALLY_PLUGIN_PATHS These options were added in 71d01a but were never added to the docs. This removes the five duplicate places that plugin placement was discussed, and replaces them with a single place that documents the "new" options. Change-Id: Ief27578692b220895027291d02f5e204351c8c0f 25 September 2015, 10:47:09 UTC
c44089e Fix project info page at the docs Project info page about cores was outdated. Changed emails, areas of interests and added some new cores. Change-Id: I2bf7c685f2574fdec55a451f2ecf869bf4ac8075 25 September 2015, 10:44:24 UTC
cf82927 Release notes v0.1.0 Change-Id: I9cc351e251b2a4269127fd93d80905aeb7439807 25 September 2015, 09:56:36 UTC
592a4b6 Merge "Moving commands for (re,un)instaling Tempest to "verify" category" 25 September 2015, 09:53:10 UTC
deaefd5 Merge "Support to include other template in task file" 24 September 2015, 23:55:31 UTC
b28d9c1 Merge "[Murano-Apps] Fix Rally deployment by Murano" 24 September 2015, 18:19:29 UTC
a34a5b1 Merge "Add 'Who Is Using Rally' paragraph to the docs" 24 September 2015, 17:06:41 UTC
1f38497 [Murano-Apps] Fix Rally deployment by Murano This small patch fixes a bug in install_rally.sh, which actually was caught in Murano. While installing Rally, script updates PIP, so new pip location can differ from previous one, but bash cache is unchanged, so bash fails to run `pip' and installation fails. Change-Id: I3bd92258c6eb29f965a977f3d3e6034cb2bd3754 Closes-Bug: #1490586 24 September 2015, 16:25:46 UTC
e04e9f1 Support to include other template in task file If you want to create task file including other template by using jinja2 function "{% include template %}", Current rally can't achieve it. The reason why is current rally directly create a template object from the string when evaluate jinja2 snippet. Therefore the loader isn't specified in environment object. So I changed so that we can define task file including other template by specifying loader in environment and creating template from this environment. Change-Id: I173db7bd5dbbcb4531f3e1bd05f22c9a62a3d5e3 Closes-Bug: 1497732 24 September 2015, 14:37:28 UTC
bc76e60 Add 'Who Is Using Rally' paragraph to the docs Add 'who is using rally' paragraph to overview section in the rally.readthedocs.org. Change-Id: Ic22a265856f0b1d17844730f66036591dbdc3cd9 24 September 2015, 14:34:03 UTC
800d1cb Merge "Use Rally api in functional tests of task samples" 24 September 2015, 13:51:42 UTC
b9fa753 Merge "Certification task: load tests (macros and keystone)" 24 September 2015, 13:04:58 UTC
39dc6bd Add new Murano scenarios - added four new Murano scenarios which check performance of commands which work with packages, like 'import-package', 'list-packages', 'delete-package'. - added appropriate methods into the murano/utils.py - added unit tests Change-Id: I655bb0c8a0980c59cd4ab576f97ee94c2c3cd0f7 24 September 2015, 08:59:49 UTC
3fde82d Set smoke in rally-jobs/rally-neutron.yaml Few tests are not set with smoke. Change-Id: Iced6ddeb9559353387cfb3172897868bb3844e4a 24 September 2015, 08:01:07 UTC
a0445e5 Merge "Disable smoke-test mode for Neutron gate job" 24 September 2015, 05:14:14 UTC
570f08a Merge "[Reports] Fix math domain error with 0 load duration" 24 September 2015, 04:23:17 UTC
a996a38 [Reports] Fix math domain error with 0 load duration If a subtask errors out and records a load_duration of 0, then producing HTML output for the task errors out with the rather cryptic error "math domain error." This commit adds a simple check for a duration of 0, and produces an empty load profile chart. Closes-Bug: #1498919 Change-Id: Ic276da68166b318b6088b67e70a1ed24018081b7 23 September 2015, 18:29:37 UTC
5d856ca Merge "Certification task: reference task arguments file" 23 September 2015, 17:25:45 UTC
ae7837a Disable smoke-test mode for Neutron gate job Change-Id: Ic57a566bfe96f2b373c4872b73dc529b910a5ce4 23 September 2015, 16:41:01 UTC
c96d3a4 Merge "Implementation of 'rally task abort' command" 23 September 2015, 15:27:02 UTC
92159a6 Merge "Certification task: glance scenarios" 23 September 2015, 15:23:23 UTC
138fd25 Merge "Add context to plugin tests" 23 September 2015, 15:10:32 UTC
fc8dc58 Merge "Certification task: quota scenarios for cinder, nova" 23 September 2015, 14:40:51 UTC
44d6090 Use Rally api in functional tests of task samples All task samples would be validated by Rally Api now. For that purpose creates temporary database and dempoyment that would be deleted after functional tests finished. Change-Id: Idef522fa699737fc657dddc92071b1cfa54d0f81 23 September 2015, 14:35:29 UTC
333654c Merge "Remove required admin=True in LB VIP scenario" 23 September 2015, 13:01:58 UTC
555cec4 Certification task: load tests (macros and keystone) Change-Id: Ifb83e4031a3d211108e53672ccd4b46a1781ae01 23 September 2015, 12:36:04 UTC
16166cc Moving commands for (re,un)instaling Tempest to "verify" category This patch moves (re,un)install commands for Tempest from "tempest" category to "verify" category. Now to (re,un)install Tempest we can execute the following commands: $ rally verify install $ rally verify uninstall $ rally verify reinstall In addition, missing unit tests were added. The corresponding changes were made in rally-verify.sh script to pass Jenkins check. Implements: blueprint improve-tempest-manage-cli Change-Id: Ibe6713b755982acf1f7e4b89b13fd2a0dad7c034 23 September 2015, 12:19:24 UTC
199c779 Implementation of 'rally task abort' command When run with the --soft key, the 'rally task abort' command should wait until the currently running benchmark is finished, otherwise the command interrupts benchmarking immediately after running scenario iterations are finished. Add Task get_status(uuid) method to db sqlalchemy api. NOTE: db schema is updated with new Task statuses. You should execute `rally-manage db recreate` to fix existing databases. Co-Authored-By: Mikhail Dubov <mdubov@mirantis.com> Co-Authored-By: Andrey Kurilin <andr.kurilin@gmail.com> Co-Authored-By: Roman Vasilets <rvasilets@mirantis.com> Change-Id: Ia07d165037eb98a9542ffdc91b7279ef3c3d496f 23 September 2015, 12:19:23 UTC
f125173 Merge "Certification task: nova checks" 23 September 2015, 11:43:27 UTC
aeee955 Certification task: reference task arguments file Change-Id: Iad19c078c6f03e4b7f83c87fd5ea9e8c9fc13d14 23 September 2015, 11:39:26 UTC
7aedae1 Certification task: glance scenarios Change-Id: Ib35c6613731b926a264cb8135abd79ddd1112e47 23 September 2015, 10:47:28 UTC
f110dc6 Certification task: quota scenarios for cinder, nova Change-Id: Iaf81d3463e8466a0d3e613c88c642a3de19e9e8b 23 September 2015, 09:35:22 UTC
4fe060b Certification task: nova checks Change-Id: Ieb3cba97e8eedc34f3d33890e80437ebdedcac8a 23 September 2015, 09:32:34 UTC
07a9464 Merge "[docs] Imporve Plugin Reference" 23 September 2015, 09:12:47 UTC
54300a1 Merge "Certification task: keystone checks" 23 September 2015, 02:32:17 UTC
466bab0 Merge "Certification task: macros and cinder checks" 23 September 2015, 02:28:19 UTC
c9dc8f5 Certification task: keystone checks Change-Id: Ib88a9b84febcfcea47cabf970014631c1223296d 23 September 2015, 00:45:22 UTC
ce560ce Certification task: macros and cinder checks Change-Id: I4b947dc8494ed6184333ac2e473c35ecb3314d31 23 September 2015, 00:45:17 UTC
b76e89b [docs] Imporve Plugin Reference Tables with plugins looks quite ugly so this patch removes tables and use just rubrics and doctest_block types of nodes Change-Id: Ifb5d53cfa1d86ab477671d3485d63fbf09f9246c 22 September 2015, 21:47:15 UTC
0a3f1e1 Merge "[Reports] Fix the namings of things in Rally report" 22 September 2015, 20:21:09 UTC
eb60dfb Merge "Add missing lbaas extensions check" 22 September 2015, 14:47:46 UTC
374a65d Add context to plugin tests Most of our unit tests for the various plugins run with an empty context. This adds a minimal context, containing only a task ID, in order to support a future change to the way random names are generated. It also makes it easier to add bits to the universal test context in the future. Change-Id: I8455c03140896400ec2017a7aa3f0c726508ceae 22 September 2015, 13:54:23 UTC
back to top