https://github.com/wikimedia/operations-puppet

sort by:
Revision Author Date Message Commit Date
12976b8 tools: Install redis-tools on trusty bastions Change-Id: I7a7e2e82d848bf2531c0c7fa723f56c69e31a20b 17 April 2015, 03:02:31 UTC
e67ecd6 dynamicproxy: Don't open up proxy api only to internal users Open it to everyone! Rely on security groups to restrict it. This is being read up from wikitech. Change-Id: Ib2aedccae922ccf42c32262ff7c7c6510d888730 17 April 2015, 02:57:31 UTC
6e7d80c dynamicproxy: Do not bind redis only on localhost This allows specific opening up of redis to elsewhere for replication Bug: T96335 Change-Id: I97a9641678563804881f06c6014d9fc72df8ad67 17 April 2015, 02:34:57 UTC
e365a18 dynamicproxy: Include firewall for base proxy Everything should be opened up already. Bug: T96335 Change-Id: Iba3902ef2fcc08f8f3992319cc5c17088e7739fd 17 April 2015, 02:34:57 UTC
4658ed5 dynamicproxy: Explicitly open port for dynamicproxy-api Change-Id: Ifd620151d00a2df583ca17bd9b4732feec18961f 17 April 2015, 02:01:36 UTC
dd6973e tools: Enable firewall on webproxies Bug: T96335 Change-Id: I118fb4871939ddb4c51d8fc99407b089f63fe6c2 17 April 2015, 01:46:30 UTC
f5bc5cb tools: Explicitly open port for proxylistener Bug: T96335 Change-Id: I7da34ffcbb13de1597c36f7186a389ed8bc9f6b3 17 April 2015, 01:13:51 UTC
40e04d6 dynamicproxy: Add ferm rules for http / https Bug: T96335 Change-Id: I441bb25f91a4436c79d36771d82432d5186f262f 17 April 2015, 01:13:28 UTC
eec57f7 coal: pass a materialized list to numpy.median numpy.median() doesn't like generator inputs. Change-Id: I9ed218ed27acc32897239778617fec78433e542f 16 April 2015, 23:51:34 UTC
e4f1c52 dumps::zim: fix nginx listening port and docroot - with the previous setting nginx would not listen on 10.64.32.168 but we want it to so dataset1001 can proxy to it - the docroot being /srv/www/htmldumps we would try to get ./htmldumps/htmldumps/ when accessing http://dumps.wikimedia.org/htmldumps/ so that was a 404 Bug:T94457 Change-Id: I5380f9b5a70a2a5032d568cfc73f914cc7b07c66 16 April 2015, 22:42:27 UTC
71ce186 dumps::zim: open port 80 for http connections Node 'francium' has base::firewall and connections to port 80 must be allowed, at least from the dumps hosts, who proxy to this. It has a private IP though so external clients already can't access it. Want me to limit it to _only_ dataset1001 nevertheless? Bug:T94457 Change-Id: Ic5e12fd3fcb130df9186823c1a1144d820e928bb 16 April 2015, 22:27:20 UTC
e793d78 Merge "dumps::zim: fix template source line" into production 16 April 2015, 21:58:25 UTC
87be9f7 coal: explicitly import logging.handlers Change-Id: I9b1edc11662aea42834991b70cf2512211072512 16 April 2015, 21:57:53 UTC
3bf0b5f dumps::zim: fix template source line A template needs to be used like: content => template('dumps/nginx.dumps.conf.erb'), with nginx::site. Bug:T94457 Change-Id: I101037650bb81d7109eaacfbd2ed80f3e86ef310 16 April 2015, 21:57:18 UTC
3d1dcb3 Merge "dumps::zim: fix nginx setup / basic site template" into production 16 April 2015, 21:52:18 UTC
c1618b7 dumps::zim: fix nginx setup / basic site template Add missing nginx site template for zim dumps to fix puppet run on francium. Could not retrieve information from environment production source(s) puppet:///modules/dumps/nginx.zim.conf Basic nginx template and fix filename to .erb. Bug:T94457 Change-Id: I039f147da7773e5a79488489007eea6b5499b568 16 April 2015, 21:51:21 UTC
c372b8f Merge "integration: move redirect out of .htaccess" into production 16 April 2015, 21:32:28 UTC
a680e46 lint: indentation fixes in roles All of these fix a: WARNING: indentation of => is not properly aligned One more step towards being able to re-enable that check again. Bug:T93645 Change-Id: I6a49e08dfe220eefc24096b0da201eb214caddf1 16 April 2015, 21:27:57 UTC
59027b0 Have libvirtd use the newer wmf_ca_2014_2017.pem on labvirt* Change-Id: I1ee83a30041956fe92163149b18b3cf0f69ad43d 16 April 2015, 21:22:06 UTC
89ccec1 coal: add some comments, fix a couple of typos Change-Id: Idfc7d2745bb4a9294c364f7bd44f47b01ae87ca4 16 April 2015, 21:13:25 UTC
b9d3ca9 Merge "Populate labvirtstar from wmf_ca_2014_2017" into production 16 April 2015, 21:04:23 UTC
0a1225c Rename rrd-navtiming to 'coal'; log to Whisper file instead of RRD Change-Id: Ic1da7a5471fa83e423e8516f1cfe3aa33f8b7123 16 April 2015, 20:58:29 UTC
702ee9a Merge "Tidy up codfw nova config a bit." into production 16 April 2015, 20:53:38 UTC
5818010 Tidy up codfw nova config a bit. Still mostly c/p Change-Id: Ie1af02e9159f06f63005cd63ef07f9b9ad1f2e8c 16 April 2015, 20:51:53 UTC
07fe777 dumps::zim: libsqlite3 is actually libsqlite3-0 Fix the package name, libsqlite3 can't be found, it's called libsqlite3-0 here. Bug:T94457 Change-Id: I0f64f294fb13095c0a9a494722b457c788b2414f 16 April 2015, 20:30:27 UTC
9a01c9a dumps::zim: add role and firewall to francium Basic role for ZIM/HTML dumps and base::firewall per default. Holes for services will have to be added. Bug:T94457 Bug:T93113 Change-Id: Ia3a50d6601e3c530956150db113f988cba0b0ce9 16 April 2015, 20:18:12 UTC
54edcd9 site.pp: add node francium.eqiad.wmnet Adding francium back to puppet for html/zim dumps. It existed in DNS from the past and has been reclaimed from spares. Bug:T94457 Bug:T93113 Change-Id: Ib120d37eb823d9739ace5b110178828f3c5ceb03 16 April 2015, 20:08:42 UTC
bc97d85 Merge "Add a codfw nova config." into production 16 April 2015, 20:02:45 UTC
58f0618 Merge "html dumps will be served from host where they are produced, via proxy" into production 16 April 2015, 19:57:19 UTC
2a2c542 Populate labvirtstar from wmf_ca_2014_2017 This is a followup commit for f90aa14 setting up a certificate from our own internal CA and not the old defunct one Bug: T96291 Change-Id: I9f17270814b8de1e128b2143cb22fe13e03b8ef7 16 April 2015, 19:53:51 UTC
90a669b Add a codfw nova config. Most of this just points back at eqiad for now, but it's needed to keep labcontrol2001 happy. Change-Id: Ib5ba34144d2018b9d0e60b6023e46853055d396a 16 April 2015, 19:36:43 UTC
30ac326 Tune up use of the nova_ldap sink handler Change-Id: I1df2c1b5c02aba66de1848ac0117c2df447602f8 16 April 2015, 17:37:33 UTC
d8f11b2 dhcp: update mw2128 mac address Change-Id: I4dab5f0757a9b809481edce453bc919bb0b7bea6 16 April 2015, 15:43:42 UTC
2f69cec Add oozie queue that uses DRF scheduling mode Change-Id: I6d20ad0bd3fbdb66051ac6bb681f8afb52e18358 16 April 2015, 15:25:24 UTC
74d2356 Merge "Have sink create ldap host entries." into production 16 April 2015, 15:05:01 UTC
0393466 Change the keystone token cleanup cron. Now run hourly with a limit -- the previous query was so gigantic that it essentiall never finished; instead we have to whittle the table down gradually. Change-Id: I004f6bad81905c4026a6e778c5764f9e11ead04f 16 April 2015, 04:47:12 UTC
9e95f82 Ensure that apt preferences are named *.pref Currently, apt::pin does not append an extension to the given name parameter when creating the file resource in /etc/apt/preferences.d (apt accepts any file with no extension or the extension ".pref"). In this aspect, apt::pin behaves differently than apt::repository that appends ".list" to the files it creates, and is also used inconsistently as some callers use an (explicit) ".pref" extension while others do not. In addition, on Labs instances both the file /etc/apt/preferences.d/wikimedia and the file /etc/apt/preferences.d/wikimedia.pref are created with equal content, but only the former is managed by Puppet. This change ensures that files created by apt::pin or the install scripts have ".pref" appended to their names and that all callers are amended accordingly. Bug: T60681 Change-Id: I1ebf184ccd7d4bf8575ca12d9fa51064147479c9 16 April 2015, 14:08:05 UTC
dcde867 move prof perf tweaks to separate include Change-Id: Ieb78f79c45bf74f70b3669f228491b2503d0d2e7 16 April 2015, 13:41:28 UTC
28f55b1 remove ancient+unused varnish::packages from base role Change-Id: Iaf203cfe0e019b4f248f5fbff327a86de8053c08 16 April 2015, 12:51:44 UTC
a7fd6ed restbase: add ganglia aggregators Change-Id: I34b29af7e15c672c5195cff385a1b7d0cd5d6376 16 April 2015, 11:13:12 UTC
d3b938a restbase: add ganglia cluster Change-Id: I5eb524bdb8b6958b5f4da3e4b3244f0129fc3945 16 April 2015, 10:34:55 UTC
e66d1d9 Merge "Beta: Enable Greek (el) and Zulu (zu)" into production 16 April 2015, 09:12:49 UTC
46822cf eventlogging: adjust counters thresholds following the migration to statsite in T90111 counters now flush every 60s, so the rates and metric names needs adjusting after the change in I20e1da2c853 Bug: T90111 Change-Id: I6afbe02187c1159d13bc81b740d6f040389be1e3 16 April 2015, 08:32:05 UTC
4541e3e Beta: Enable Greek (el) and Zulu (zu) Bug: T96073 T95844 Change-Id: I2236a67a457c551d6a5ae976ea0508ae18bf744c 16 April 2015, 08:17:05 UTC
f339140 cache: change the label of the hiera lookup This worked in production "by chance" of being in the common/ hierarchy, but not in labs. Change-Id: I7de9e91e1a06e6c3f9427c366dd7d15229ac40a8 16 April 2015, 07:01:33 UTC
066c4e5 tools: Remove tomcat node definitions from puppet Uses regular generic webservice node now. Bug: T91066 Change-Id: I6d13d9cc5e8dd6d48aacc246d2f65aa49d90650c 16 April 2015, 02:24:21 UTC
8dc3849 Add missing .erb extension Change-Id: I64e6f09748f2e42192df0afb022f5751b4f6ff27 16 April 2015, 01:59:41 UTC
efd5d11 Labs: puppetize labsdb1005's mysql setup This mostly replicates the current config, but brings it in to the standard for passwords, etc. Bug: T88234 Change-Id: I8ce32a37aa517baa9d21ef9bb9d03f50ea9917ef 16 April 2015, 01:53:08 UTC
d172984 Have sink create ldap host entries. This is experimental -- in the long run we can use this to replace some of the ldap integration in OpenStackManager and allow instance creation/deletion in Horizon. Change-Id: I2badbf8ff2adc120b6e1a8001262be05e7a3daf8 16 April 2015, 00:08:14 UTC
b02c803 We need -y when calling salt-key -d remotely Change-Id: Iee93599c653e498954b012a560667de98322db2d 16 April 2015, 00:02:56 UTC
c679113 Fix insertion of the designate ip into the certmanager key Change-Id: I85f2d24bcf567dae4fa3438256a766c47987b4d4 15 April 2015, 23:49:43 UTC
72125f8 Create the .ssh dir before sticking a key in it Change-Id: I31cd4837b59750e839c28bb4de6749074e825e8e 15 April 2015, 23:35:56 UTC
b1af7be Move the cert_manager key to the designate user's home Change-Id: Ia0b7a37ca4c5f63d1c594109cd03cf92c33deb94 15 April 2015, 23:31:44 UTC
3a166e9 Give certmanager a homedir Change-Id: Iae41e9987912953be3a3b21abb780d092546a7f3 15 April 2015, 23:31:14 UTC
653a535 Merge "Just hardcode the designate ip." into production 15 April 2015, 23:18:08 UTC
0cd9692 Merge "Install the cert_manager with a file resource" into production 15 April 2015, 23:15:34 UTC
16ada5a Just hardcode the designate ip. I can't get scope.function_ipresolve to work the way I'd expect. Change-Id: Ief6add47aecf73872edc95ddcc81977e8cf3b873 15 April 2015, 23:12:18 UTC
ad39c71 Install the cert_manager with a file resource Change-Id: Iad2277715d4c1a427436c7a1a981f047fe697e21 ssh:userkey doesn't seem to work for the private key. 15 April 2015, 23:09:21 UTC
e2c7060 Merge "Avoid duplicate definition of puppetmaster::certmanager" into production 15 April 2015, 22:17:25 UTC
2cf640d tools: Set portreleaser to be epilog script for web queues Bug: T96059 Change-Id: Idd1498ea0e04a6e03e8510bb8742bfaccdd52fcb 15 April 2015, 22:14:02 UTC
c363f36 Avoid duplicate definition of puppetmaster::certmanager Change-Id: I260d4c0a6705a164fb521a11f0afe496029f2af1 15 April 2015, 22:12:42 UTC
ba04812 Merge "Set up ssh keys so that designate can clear salt and puppet certs." into production 15 April 2015, 22:09:44 UTC
3c97c8f Set up ssh keys so that designate can clear salt and puppet certs. Change-Id: I1ecca050b2ce2eb3020f36d2e09bc5cc32f259e0 15 April 2015, 22:05:06 UTC
2a483ab tools: Fix more silly copy paste errors Change-Id: I7049eb8b8e57d852ce90082db1338507b079ef78 15 April 2015, 21:26:14 UTC
07954bb tools: Fix missing import Stupid mistake Change-Id: I3080ba0eb381bc2544204a40b12c7b9687b7267a 15 April 2015, 21:10:46 UTC
278b041 tools: Fix scope issue + do not explicitly shutdown socket Change-Id: Ia1a152307a8515af8eb7b9ed579fdc0f5b7fe236 15 April 2015, 20:25:55 UTC
a9f4ece Revert "Revert "tools: Separate registration / unregistreation for proxylistener"" Don't close connection to proxylistener until we get something back This reverts commit cd21e12bd86b6bbde78d18b8b02d7e872f05bd72. Change-Id: I153cb28662bd61b12b758bfb23b675981b428a52 15 April 2015, 19:55:18 UTC
4973890 Add 2 new FairScheduler queues: priority and production Change-Id: Ic4360795fff179f50b78237616f7bf10ff3cede0 15 April 2015, 19:46:34 UTC
cd21e12 Revert "tools: Separate registration / unregistreation for proxylistener" Running into identd issues, need more debugging This reverts commit 10bdb685fa87532e988f90c93925ec0a9f0ef830. Change-Id: I0880323dda01f32c70bb13c77fe145f01bf43ed0 15 April 2015, 19:11:23 UTC
10bdb68 tools: Separate registration / unregistreation for proxylistener - Clients no longer need to keep a socket open to proxylistener - Have a separate portreleaser that should get called by epilog scripts for webservices. Bug: T96059 Change-Id: Iaa85955d9da8f83b89a6eea713286799351208ea 15 April 2015, 18:30:26 UTC
29ee03b tools: Remove remnants of portgranter code Service can be stopped via salt. Bug: T93046 Change-Id: I3278d974b378acd2a06e6808bc5297139606612b 15 April 2015, 18:27:06 UTC
8d4a295 mailman: SENDER_HEADERS use from only To give a better way to battle spam, use from as a value in headers as opposed to setting as none as is defult in Mailman behaviour by not assuming all emails are from list members. Bug: 46049 Change-Id: I9a3732ab64bde14d0f44c8b52065434cc4efcd22 15 April 2015, 15:58:03 UTC
a5f5f06 Typo fix It's @resolve Change-Id: I78c49ef44367e78821ce790fd79f87f5a860d9ff 15 April 2015, 15:39:29 UTC
200dbc6 Merge "Typo fixes in role::ganeti" into production 15 April 2015, 15:32:15 UTC
2497462 Merge "Use the already-existing $certname var in libvirtd.conf" into production 15 April 2015, 15:31:49 UTC
e51331b Typo fixes in role::ganeti noded is actually confd Change-Id: Ib856e8c70448868acc040deb84eca9066b9c433d 15 April 2015, 15:28:47 UTC
5ab5764 r::c::config::active_nodes -> hiera cache::$cluster::nodes This breaks torrus module testing (still relies on local copy of $r::c::config::active_nodes), but given that torrus CDN stuff doesn't seem to work in practice anyways, and that the modules shouldn't have this data access directly either, I'm not too concerned to merge over it. The changes for role::ipsec and role::analytics::kafkatee pass human inspection of "looks right", but neither one is actually applied on any real host currently (for the data access in question), therefore can't be compiler-tested, but also wouldn't break any live node and can be sorted out if necc when one exists in the future. The rest all checks out in puppet-compiler and seems to work! Change-Id: I06f3fecf610524e14fd9256c9477931a735419b8 15 April 2015, 15:28:32 UTC
7cbe87e Merge "Install labvirt-star cert on labvirt nodes." into production 15 April 2015, 15:20:42 UTC
e4614bb gdash: display udp errors in graphite dashboard Change-Id: I5ff46623cf52949e6523d1256e63503cd4232684 15 April 2015, 14:13:58 UTC
7a66a15 Typo fix in ssh::userkey A stray dollar sign character Change-Id: Ifb3d22641eda06c2813d893034a404524ac6574f 15 April 2015, 14:09:47 UTC
084dc0d Followup fix for 7ba51bc files need files in source. Also add the user parameter in ssh::userkey Change-Id: I4ab6febea2b0584ff0294f7620723c83e524136a 15 April 2015, 14:02:41 UTC
7ba51bc ganeti: Reference correctly the ganeti cluster nodes Fix a typo in the role and move the configuration under the role backend Change-Id: I5e7c19b3001925878dce1df85542c66f2079b31b 15 April 2015, 13:52:07 UTC
6457adb Merge "Move the keystone token cron into openstack::database-server" into production 15 April 2015, 13:45:43 UTC
de8f244 package_builder: fix dependency order for hooks On labs the D01.apt.wikimedia.org was never released because the parent directory creation depended on the file being created! Per doc at: https://docs.puppetlabs.com/puppet/latest/reference/lang_relationships.html#chaining-arrows -> (ordering arrow) Causes the resource on the left to be applied before the resource on the right. Written with a hyphen and a greater-than sign. Flip the dependencies to have the directory created before the file. Change-Id: Iaf195dbfd4f657e3743505fa2eb80d778f4b33a6 15 April 2015, 13:43:40 UTC
8eb5dcf html dumps will be served from host where they are produced, via proxy add the proxy piece to dumps server; add the nginx server piece to zim class Change-Id: Iecc2871e9499eeb2b98fdb11eb660818a2630782 15 April 2015, 13:29:25 UTC
93f5058 various role classes: moar small lint fixes Bug:T93645 Change-Id: I997f82a6cbd5d0dbbb986358436bc0f2f3c7819f 15 April 2015, 00:41:30 UTC
4a1a244 integration: move redirect out of .htaccess This redirect already exists but lives inside a .htaccess file in the document root. Let's not use .htaccess files to do Apache config, let's have it in the one puppetized template instead. Change-Id: I15e868c5a88103dd83b37abaecb0abfaad77005f 15 April 2015, 00:32:47 UTC
5e9346a Update upstart job def for brrd Invoke brrd via python -m. Change-Id: Idd67573a257ce182a46d05b852eebdf114599542 15 April 2015, 00:22:00 UTC
12dc1c7 remove more torrus api-cluster refs (followup fix for 6254a447?) Change-Id: Iba34a22f23c983c094e891fe3aa57ff15f4a3027 15 April 2015, 00:02:52 UTC
5212691 Merge "Set dedicated SUL rename runner loop" into production 14 April 2015, 23:56:38 UTC
2476371 remove squid references from torrus cdn stuff Change-Id: I73b0bb28ddaaa0b91195f2fea3beb71d114c5b38 14 April 2015, 23:53:18 UTC
5151d0e Set dedicated SUL rename runner loop Bug: T87397 Change-Id: I6b42515953dedfb9c35910a7f841bfa493fda5c4 14 April 2015, 23:52:33 UTC
4ce16a5 mailman: adjust io stat monitoring threshold There were still read spikes all the time triggering it. Based on the history in https://icinga.wikimedia.org/cgi-bin/icinga/history.cgi?host=sodium&service=mailman+I%2FO+stats raise those thresholds. Change-Id: Ide96685befb80eb7a27ebaab44890b551a0ece19 14 April 2015, 22:59:22 UTC
213ea9c access: add madhuvishy to various analytics groups madhuvishy is a new developer in Analytics. group memberships as requested on: Bug:T96053 Change-Id: I094bd1e7ce68abc58c471a60fb5f3963cb79e73b 14 April 2015, 22:29:20 UTC
2734e5d create user for Madhu Viswanathan creates a user account for Madhu Viswanathan, new Analytics Dev key from: https://office.wikimedia.org/w/index.php?title=User:MViswanathan_%28WMF%29&oldid=144487 UID matches existing wikitech/LDAP user 'madhuvishy' privileges for the user are handled in a separate patch Bug:T96053 Change-Id: I2c435150a168fbf0cf73a0e513326eef1eb87fdf 14 April 2015, 22:28:05 UTC
6254a44 get rid of $active_nodes[api] (unused) Change-Id: Iacf5d571b19f92953e369634c60b0171c50a7a11 14 April 2015, 22:22:00 UTC
d826b28 Merge "releases: install unzip in module, not on node level" into production 14 April 2015, 22:10:51 UTC
a690eae releases: install unzip in module, not on node level Do not install packages directly on nodes. Put it in reprepo::upload instead because role::releases::upload is on tin and the reason Reedy asked for zip back then was for releases: class role::releases::upload { class { '::releases::reprepro::upload': } } Also, update RT ticket number to imported Phab ticket. Bug:T83213 Change-Id: I4ec2a9e8ed237f061969faeeaced69772d4b5172 14 April 2015, 22:09:00 UTC
8cc03d3 labcontrol1001 needs to be trusty removing jessie lines T96048 Change-Id: Ia93913f1f214c46cfa0f0c31fa5f9fb66115007f 14 April 2015, 22:02:50 UTC
23d6eb4 Gzip SVGs on back upload varnishes. I noticed the front page of translatewiki.net loading <http://upload.wikimedia.org/wikipedia/commons/b/b0/Openstreetmap_logo.svg> which is 57.7 kB uncompressed, but 11.2 kB compressed. Big difference! So: gzip-compress backend responses with content-type: image/svg+xml. RT: 5795 Bug: 54291 Change-Id: I64388ed0f0555a2d2260628f189acd358a561c90 14 April 2015, 21:49:01 UTC
back to top