infrastructure March 2016

infrastructure@lists.fedoraproject.org

42 participants
92 discussions

badges-backend(and stg)
by Zach Villers 24 Mar '16

24 Mar '16

I've been working on getting the award-lifecycle-badges cron job to run from badges-backend. I beleive I have the script fixed, but I have a couple of problems; 1. This error message from badges-backend01.stg requests.exceptions.SSLError: hostname 'admin.fedoraproject.org' doesn't match either of '*.stg.fedoraproject.org', 'stg.fedoraproject.org' 2. The original reason (as far as I can tell) that the script fails is that the request to pull down all of the usernames from FAS times out. In a couple of limited (and babysat) tests on the production machine. My script works, but would take (in my estimation) 10-15 hours to run. I don't know if the reason behind this is that there are alot of lifecycle badges to be awarded, or the resources available to badges-backend + tahrir + fas isn't sufficient for the number of users/backlog we have, or if my fix is crap. I'd like to get some advice/suggestions on this and have placed an item on the meeting agenda today. Basically, to get around the timeout issue, I created a list of search terms (a*, b*, etc) so that I only pull in one letter of the alphabet at a time. The main function pulls down each list of usernames, checks to see if each user needs one of five lifecycle badges and awards the badge if the user qualifies. Here is a bit of the main loop; fas_credentials = fm_config['fas_credentials'] searchterms = gen_fas_searchterms() for search_elem in searchterms: results = get_fas_userlist(fas_credentials, search_elem)

1 0

Freeze break request: Update Autocloud for latest pungi/koji fedmsg updates
by Kushal Das 23 Mar '16

23 Mar '16

Hi all, I am applying for a freeze break request for Autocloud project. We need to be able to get koji build state changes from fedmsg so that we can test F24, and rawhide Cloud/Atomic builds. The following [1] hotfix patch is made for the same based on the similar change in fedimg. [1] https://github.com/kushaldas/autocloud/commit/6d0a1ea6268f052e258458d1ad09b… -- Fedora Cloud Engineer CPython Core Developer https://kushaldas.in https://dgplug.org

3 2

Freeze break request: Enable Basset to 0.3 and enable mediawiki extension
by Patrick Uiterwijk 22 Mar '16

22 Mar '16

Hi, Could I get +1s for: - the following patches - updating basset on basset01 - running the mediawiki and basset playbooks This will enable the mediawiki automated cleanup and account blocking. commit e86a0bb505017454f8e921374d1f593136fdc5ec Author: Patrick Uiterwijk <puiterwijk(a)redhat.com> Date: Tue Mar 22 20:51:07 2016 +0000 Add ACL for basset frontend Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com> diff --git a/roles/basset/frontend/tasks/main.yml b/roles/basset/frontend/tasks/main.yml index 54637ab..d2ccf6b 100644 --- a/roles/basset/frontend/tasks/main.yml +++ b/roles/basset/frontend/tasks/main.yml @@ -6,6 +6,15 @@ - basset - basset/frontend +- name: install basset config + template: src=frontend.cfg.j2 dest=/etc/basset/frontend.cfg + user=basset-frontend group=basset-frontend mode=0600 + notify: + - restart httpd + tags: + - basset + - basset/frontend + - name: install staging htpasswd copy: src={{private}}/files/httpd/basset.stg.htpasswd dest=/etc/httpd/conf.d/basset.htpasswd owner=root group=root mode=0644 diff --git a/roles/basset/frontend/templates/frontend.cfg.j2 b/roles/basset/frontend/templates/frontend.cfg.j2 new file mode 100644 index 0000000..476efa2 --- /dev/null +++ b/roles/basset/frontend/templates/frontend.cfg.j2 @@ -0,0 +1,6 @@ +[submission_access] +10.5.126.63 = mediawiki.new,mediawiki.edit +10.5.126.73 = mediawiki.new,mediawiki.edit +10.5.126.25 = fedora.fas.registration,fedora.fas.cla_sign +10.5.126.26 = fedora.fas.registration,fedora.fas.cla_sign +10.5.126.30 = fedora.fas.registration,fedora.fas.cla_sign commit b10be2e241a3b270236aa0f35f89609281e75595 Author: Patrick Uiterwijk <puiterwijk(a)redhat.com> Date: Tue Mar 22 20:46:39 2016 +0000 Open iptables on basset for wiki Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com> diff --git a/inventory/group_vars/basset b/inventory/group_vars/basset index 5bab0fa..85fc069 100644 --- a/inventory/group_vars/basset +++ b/inventory/group_vars/basset @@ -9,6 +9,9 @@ custom_rules: [ '-A INPUT -p tcp -m tcp -s 10.5.126.25 --dport 80 -j ACCEPT', '-A INPUT -p tcp -m tcp -s 10.5.126.26 --dport 80 -j ACCEPT', '-A INPUT -p tcp -m tcp -s 10.5.126.30 --dport 80 -j ACCEPT' + # wiki01, wiki02 + '-A INPUT -p tcp -m tcp -s 10.5.126.63 --dport 80 -j ACCEPT' + '-A INPUT -p tcp -m tcp -s 10.5.126.73 --dport 80 -j ACCEPT' ] fas_client_groups: sysadmin-main diff --git a/inventory/group_vars/basset-stg b/inventory/group_vars/basset-stg index ad45a6f..02049e5 100644 --- a/inventory/group_vars/basset-stg +++ b/inventory/group_vars/basset-stg @@ -7,6 +7,8 @@ num_cpus: 2 custom_rules: [ # fas01.stg '-A INPUT -p tcp -m tcp -s 10.5.126.86 --dport 80 -j ACCEPT', + # wiki01.stg + '-A INPUT -p tcp -m tcp -s 10.5.126.60 --dport 80 -j ACCEPT', ] fas_client_groups: sysadmin-main commit bc7f0faabfcef27470398703fdd2cf43a6daf270 Author: Patrick Uiterwijk <puiterwijk(a)redhat.com> Date: Tue Mar 22 20:44:02 2016 +0000 Enable mediawiki basset plugin Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com> diff --git a/roles/mediawiki/tasks/main.yml b/roles/mediawiki/tasks/main.yml index dc64683..ddf1e8e 100644 --- a/roles/mediawiki/tasks/main.yml +++ b/roles/mediawiki/tasks/main.yml @@ -36,6 +36,7 @@ - mediawiki119-RSS - mediawiki-FedoraBadges + - mediawiki119-basset - php-zmq - php-pecl-uuid tags: diff --git a/roles/mediawiki/templates/LocalSettings.php.fp.j2 b/roles/mediawiki/templates/LocalSettings.php.fp.j2 index a6c10b4..3362115 100644 --- a/roles/mediawiki/templates/LocalSettings.php.fp.j2 +++ b/roles/mediawiki/templates/LocalSettings.php.fp.j2 @@ -324,6 +324,18 @@ require_once "$IP/extensions/fedmsg-emit.php"; require_once "$IP/extensions/HTTP302Found/HTTP302Found.php"; require_once "$IP/extensions/intersection/DynamicPageList.php"; require_once "$IP/extensions/RSS/RSS.php"; +require_once "$IP/extensions/BassetSubmitter.php"; + +{% if env == "staging" %} +$basset_url = 'http://basset01.stg.phx2.fedoraproject.org/basset'; +$basset_username = '{{ basset_stg_frontend_user }}'; +$basset_password = '{{ basset_stg_frontend_pass }}'; +{% else %} +$basset_url = 'http://basset01.phx2.fedoraproject.org/basset'; +$basset_username = '{{ basset_prod_frontend_user }}'; +$basset_password = '{{ basset_prod_frontend_pass }}'; +{% endif %} + $wgShowExceptionDetails = true;

3 2

Freeze break: cachefilesd
by Kevin Fenzi 22 Mar '16

22 Mar '16

Greetings. I'd like to take download05 out of dns and test out using cachefilesd on it. We tried this a number of years ago with rhel6 and ran into problems, but perhaps rhel7 might be more stable. Basically this would be setting up a 500GB cache on the server and then caching 500GB of stuff from nfs. In theory this would reduce load on the backend NFS server. There is a pending netapp upgrade and storage folks would need to throttle our access while the upgrade was happening, so the more load we can take off the filer, the better it will be when we have to do the upgrade. I'd take download05 out of dns (so no one should hit it), setup cachefilesd and test. If all goes well on testing we could re-add it and see if handles normal load. If not or if it cannot handle regular load we can just repave it and put it back the way it is now. 4 download machines should be fine for the normal load we have, and this testing should long be done before the end of the week when we might need to stage Alpha. Thoughts? +1s? kevin

4 3

Freeze break: pkgs git config
by Kevin Fenzi 21 Mar '16

21 Mar '16

Greetings. It seems there is a fedpkg/pyrpgk update that depends on using the namespaced (/rpms/) git checkouts. I'd like to apply the following to pkgs02: diff --git a/inventory/group_vars/pkgs b/inventory/group_vars/pkgs index 2ebef26..fa29449 100644 --- a/inventory/group_vars/pkgs +++ b/inventory/group_vars/pkgs @@ -18,7 +18,7 @@ git_group: packager git_port: 9418 git_server: /usr/libexec/git-core/git-daemon git_server_args: --export-all --syslog --inetd --verbose -git_basepath: /srv/git/repositories/rpms +git_basepath: /srv/git/repositories git_daemon_user: nobody clamscan_mailto: admin(a)fedoraproject.org and then make sure we are using the systemd git socket instead of xinetd (which we seem to be for some reason currently). This should allow namespaced git checkouts and fix: https://fedorahosted.org/fedora-infrastructure/ticket/5178 and https://fedorahosted.org/fedora-infrastructure/ticket/5059 I also have already made this change in stg a while back and it works fine there. +1s? kevin

3 4

Re: The results of your email commands
by Sérgio Basto 21 Mar '16

21 Mar '16

Also , can't unsubscribe java-devel mailing list On Seg, 2016-03-21 at 18:33 +0000, java-devel- bounces(a)lists.fedoraproject.org wrote: > The results of your email command are provided below. Attached is > your > original message. > > - Results: > sergio(a)serjux.com is not a member of the java-devel mailing list > > - Done. > -- Sérgio M. B.

1 0

ocaml-devel@lists.fedoraproject.org is not delivering emails Re: Undelivered Mail Returned to Sender
by Sérgio Basto 21 Mar '16

21 Mar '16

On Seg, 2016-03-21 at 18:15 +0000, Mail Delivery System wrote: > This is the mail system at host lists.fedoraproject.org. > > I'm sorry to have to inform you that your message could not > be delivered to one or more recipients. It's attached below. > > For further assistance, please send mail to postmaster. > > If you do so, please include this problem report. You can > delete your own text from the attached returned message. > > The mail system > > <ocaml-devel(a)lists.fedoraproject.org>: host > mailman01.vpn.fedoraproject.org[192.168.1.118] said: 550 5.1.1 > <ocaml-devel(a)lists.fedoraproject.org>: Recipient address > rejected: User > unknown in local recipient table (in reply to RCPT TO command) -- Sérgio M. B.

1 0

Freeze break request: update Mailman3+Postorius+HyperKitty
by Aurelien Bompard 21 Mar '16

21 Mar '16

Hi! There's been a lot of recent changes in the Mailman stack, including a new feature that will let us migrate more lists. I'd like to update the software stack on prod and keep it under observation for a few days (there are apparently performance issues for some people). This freeze break does not include migrating the remaining lists, except trans-ru. I've received a request to migrate this one, it has been cleared of the filters that blocked it before, so it shouldn't be any different from the others. What say you? :-) Aurélien

3 4

[PATCH] releng sudoe cleanup
by Dennis Gilmore 19 Mar '16

19 Mar '16

From: Dennis Gilmore <ausil(a)fedoraproject.org> move releng-sudoers to 00releng-sudoers everywhere drop the no longer needed ftpsync-sudo file ansible-priave has some changes to match Signed-off-by: Dennis Gilmore <ausil(a)fedoraproject.org> --- inventory/group_vars/bodhi-backend | 2 +- inventory/group_vars/bodhi-backend-stg | 2 +- inventory/group_vars/buildarm | 2 +- inventory/group_vars/buildhw | 2 +- inventory/group_vars/buildppc | 2 +- inventory/group_vars/buildppcle | 2 +- inventory/group_vars/buildvm | 2 +- inventory/group_vars/buildvm-ppc64 | 2 +- inventory/group_vars/buildvm-ppc64le | 2 +- inventory/group_vars/buildvm-stg | 2 +- inventory/group_vars/koji | 2 +- inventory/group_vars/koji-stg | 2 +- inventory/group_vars/osbs-stg | 2 +- inventory/group_vars/sign-bridge | 2 +- inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org | 2 +- inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org | 2 +- roles/releng/tasks/main.yml | 5 ----- 17 files changed, 16 insertions(+), 21 deletions(-) diff --git a/inventory/group_vars/bodhi-backend b/inventory/group_vars/bodhi-backend index 796c058..dfc9440 100644 --- a/inventory/group_vars/bodhi-backend +++ b/inventory/group_vars/bodhi-backend @@ -42,6 +42,6 @@ fedmsg_error_recipients: nfs_mount_opts: "rw,hard,bg,intr,noatime,nodev,nosuid,nfsvers=3" fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" ## XXX - note that the csi_ stuff is kept at the host_vars/ level. diff --git a/inventory/group_vars/bodhi-backend-stg b/inventory/group_vars/bodhi-backend-stg index a4f7723..4f9204e 100644 --- a/inventory/group_vars/bodhi-backend-stg +++ b/inventory/group_vars/bodhi-backend-stg @@ -73,7 +73,7 @@ fedmsg_certs: - bodhi.updates.fedora.sync fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" # For the MOTD diff --git a/inventory/group_vars/buildarm b/inventory/group_vars/buildarm index c57d037..8d36e73 100644 --- a/inventory/group_vars/buildarm +++ b/inventory/group_vars/buildarm @@ -1,6 +1,6 @@ host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" ansible_ifcfg_blacklist: true koji_server_url: "http://koji.fedoraproject.org/kojihub" diff --git a/inventory/group_vars/buildhw b/inventory/group_vars/buildhw index ab559ca..6c2cc5e 100644 --- a/inventory/group_vars/buildhw +++ b/inventory/group_vars/buildhw @@ -1,7 +1,7 @@ --- host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" freezes: true koji_server_url: "http://koji.fedoraproject.org/kojihub" diff --git a/inventory/group_vars/buildppc b/inventory/group_vars/buildppc index d0891f9..76c7e4c 100644 --- a/inventory/group_vars/buildppc +++ b/inventory/group_vars/buildppc @@ -21,7 +21,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}" # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" koji_server_url: "http://koji.fedoraproject.org/kojihub" koji_weburl: "http://koji.fedoraproject.org/koji" diff --git a/inventory/group_vars/buildppcle b/inventory/group_vars/buildppcle index 8c001a2..9bafafe 100644 --- a/inventory/group_vars/buildppcle +++ b/inventory/group_vars/buildppcle @@ -20,7 +20,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}" # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" koji_server_url: "http://koji.fedoraproject.org/kojihub" koji_weburl: "http://koji.fedoraproject.org/koji" diff --git a/inventory/group_vars/buildvm b/inventory/group_vars/buildvm index 4b3a6d2..a16019f 100644 --- a/inventory/group_vars/buildvm +++ b/inventory/group_vars/buildvm @@ -16,7 +16,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}" # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" koji_server_url: "http://koji.fedoraproject.org/kojihub" koji_weburl: "http://koji.fedoraproject.org/koji" diff --git a/inventory/group_vars/buildvm-ppc64 b/inventory/group_vars/buildvm-ppc64 index dbfbab7..9012128 100644 --- a/inventory/group_vars/buildvm-ppc64 +++ b/inventory/group_vars/buildvm-ppc64 @@ -14,7 +14,7 @@ dns: 10.5.126.21 # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng,sysadmin-secondary -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" virt_install_command: "{{ virt_install_command_one_nic }} --graphics none" diff --git a/inventory/group_vars/buildvm-ppc64le b/inventory/group_vars/buildvm-ppc64le index 8c1ebd6..376d4e2 100644 --- a/inventory/group_vars/buildvm-ppc64le +++ b/inventory/group_vars/buildvm-ppc64le @@ -14,7 +14,7 @@ dns: 10.5.126.21 # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng,sysadmin-secondary -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" virt_install_command: "{{ virt_install_command_one_nic }} --graphics none" diff --git a/inventory/group_vars/buildvm-stg b/inventory/group_vars/buildvm-stg index 293d05b..08562ba 100644 --- a/inventory/group_vars/buildvm-stg +++ b/inventory/group_vars/buildvm-stg @@ -14,7 +14,7 @@ dns: 10.5.126.21 # the host_vars/$hostname file host_group: kojibuilder fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" datacenter: staging nfs_mount_opts: "rw,hard,bg,intr,noatime,nodev,nosuid" diff --git a/inventory/group_vars/koji b/inventory/group_vars/koji index df2bfa2..6096adb 100644 --- a/inventory/group_vars/koji +++ b/inventory/group_vars/koji @@ -19,7 +19,7 @@ custom_rules: [ ] fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" # These are consumed by a task in roles/fedmsg/base/main.yml fedmsg_certs: diff --git a/inventory/group_vars/koji-stg b/inventory/group_vars/koji-stg index b34c56d..4876829 100644 --- a/inventory/group_vars/koji-stg +++ b/inventory/group_vars/koji-stg @@ -36,7 +36,7 @@ fedmsg_certs: # NOTE -- staging mounts read-only nfs_mount_opts: "ro,hard,bg,intr,noatime,nodev,nosuid,nfsvers=3" -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" koji_server_url: "http://koji.stg.fedoraproject.org/kojihub" koji_weburl: "http://koji.stg.fedoraproject.org/koji" diff --git a/inventory/group_vars/osbs-stg b/inventory/group_vars/osbs-stg index 768067e..1b6424d 100644 --- a/inventory/group_vars/osbs-stg +++ b/inventory/group_vars/osbs-stg @@ -7,4 +7,4 @@ num_cpus: 2 tcp_ports: [ 80, 443 ] fas_client_groups: sysadmin-releng,fi-apprentice -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" diff --git a/inventory/group_vars/sign-bridge b/inventory/group_vars/sign-bridge index 55170e5..c01cbcd 100644 --- a/inventory/group_vars/sign-bridge +++ b/inventory/group_vars/sign-bridge @@ -10,4 +10,4 @@ num_cpus: 4 tcp_ports: [ 44333, 44334 ] fas_client_groups: sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" diff --git a/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org b/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org index 18e3815..f18bb81 100644 --- a/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org +++ b/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org @@ -10,7 +10,7 @@ gw: 10.5.129.254 main_bridge: br1 fas_client_groups: sysadmin-noc,sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" host_group: releng diff --git a/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org b/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org index 07d4904..c6e3970 100644 --- a/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org +++ b/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org @@ -10,7 +10,7 @@ gw: 10.5.129.254 main_bridge: br1 fas_client_groups: sysadmin-noc,sysadmin-releng -sudoers: "{{ private }}/files/sudo/releng-sudoers" +sudoers: "{{ private }}/files/sudo/00releng-sudoers" host_group: releng diff --git a/roles/releng/tasks/main.yml b/roles/releng/tasks/main.yml index cb99faf..08d0b18 100644 --- a/roles/releng/tasks/main.yml +++ b/roles/releng/tasks/main.yml @@ -185,11 +185,6 @@ copy: src="twoweek-updates" dest=/etc/cron.d/twoweek-updates when: inventory_hostname.startswith('compose-x86-01') -- name: sudoers for ftpsync - copy: src="{{ private }}/files/sudo/ftpsync-sudo" dest=/etc/sudoers.d/ftpsync mode=0440 - tags: - - configs - - name: install compose /etc/httpd/conf.d/compose.conf file copy: > src="compose.conf" -- 1.8.3.1

3 5

Freeze Break Request: Clean up iptables on all boxes.
by Stephen John Smoogen 18 Mar '16

18 Mar '16

And we have a lot of small fixes whcih. -- Stephen J Smoogen.

3 5

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure March 2016