infrastructure April 2017

infrastructure@lists.fedoraproject.org

50 participants
45 discussions

Freeze break: cleanup some epel5 remnants
by Kevin Fenzi 03 Apr '17

03 Apr '17

Greetings. We are still trying to sync pkgdb to koji for epel5 packages as well as syncing the epel5 updates/updates-testing repos to pub. This patch stops both those since epel5 is EOL now. +1s? kevin -- > diff --git a/roles/bodhi2/backend/files/fedora-epel-push b/roles/bodhi2/backend/files/fedora-epel-push > index ba3cc46..bffaefd 100644 > --- a/roles/bodhi2/backend/files/fedora-epel-push > +++ b/roles/bodhi2/backend/files/fedora-epel-push > @@ -5,7 +5,7 @@ DEST=/pub/epel > > OPTIONS="-rlptDvHh --stats --delay-updates $RSYNC_OPTS" > > -for rel in 5 6; do > +for rel in 6; do > > OUTPUT1=$(rsync $OPTIONS --exclude "repodata/*" --exclude "headers/*" \ > $SOURCE/dist-${rel}E-epel/ $DEST/${rel}/) > @@ -83,7 +83,7 @@ for rel in 7; do > fi > done > > -for rel in 5 6 7; do > +for rel in 6 7; do > if [ ${rel} -eq 7 ]; then > TARGET_DIR=${DEST}/${rel}/x86_64/e > else > diff --git a/roles/bodhi2/backend/tasks/main.yml b/roles/bodhi2/backend/tasks/main.yml > index b09ee17..15e2883 100644 > --- a/roles/bodhi2/backend/tasks/main.yml > +++ b/roles/bodhi2/backend/tasks/main.yml > @@ -147,6 +147,7 @@ > cron: name="owner-sync-el5" minute="7,17,27,37,47,57" user="root" > job="/usr/local/bin/owner-sync-pkgdb dist-5E-epel" > cron_file=update-koji-owner-EL-5 > + disabled=true > when: inventory_hostname.startswith('bodhi-backend01') and env == "production" > tags: > - bodhi

3 2

Weekly Koji Infra Tag Report
by Nobody 02 Apr '17

02 Apr '17

This is a list of packages in the various infrastructure koji tags Please check and make sure there are not any that can be removed/dropped epel6-infra (no matching packages) epel7-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- freeipa-ktutils epel7-infra puiterwijk compose-utils epel7-infra ausil fedmsg-beaker-repoupdate epel7-infra tflink anitya epel7-infra jcline the-new-hotness epel7-infra jcline fedocal epel7-infra pingou python-IPy epel7-infra kevin python-robosignatory epel7-infra puiterwijk pdc-updater epel7-infra ralph python-pdc epel7-infra ralph glusterfs epel7-infra kevin mirrormanager2 epel7-infra puiterwijk blockerbugs epel7-infra tflink python-django-jsonfield epel7-infra ralph f23-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- libphutil, f23-infra tflink arcanist, f23-infra tflink phabricator f23-infra tflink phabricator-extension-ipsilonauth f23-infra tflink libphutil f23-infra tflink arcanist f23-infra tflink f24-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- mediawiki-openid f24-infra kevin phabricator-extension-oauth f24-infra tflink python-twill f24-infra codeblock stickynotes2modernpaste f24-infra codeblock python-flask-testing f24-infra codeblock modern-paste f24-infra codeblock mediawiki-skin-fedora f24-infra puiterwijk mediawiki-FedoraBadges f24-infra kevin basset f24-infra puiterwijk phabricator f24-infra tflink mediawiki-Lockdown f24-infra kevin libphutil f24-infra tflink arcanist f24-infra tflink mediawiki-RSS f24-infra kevin mirrormanager2 f24-infra puiterwijk f25-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- python-flask-testing f25-infra codeblock modern-paste f25-infra codeblock python-coveralls f25-infra codeblock mdapi f25-infra pingou basset f25-infra puiterwijk mediawiki-FedoraBadges f25-infra kevin mediawiki-Lockdown f25-infra kevin mediawiki-RSS f25-infra kevin mediawiki-openid f25-infra kevin plus-plus-service f25-infra pingou python-pdc f25-infra ralph python-django-cors-headers f25-infra ralph python-django-rest-framework-composed-permissions f25-infra ralph patternfly1 f25-infra ralph fas f25-infra kevin libphutil, f25-infra tflink arcanist, f25-infra tflink phabricator f25-infra tflink phabricator-extension-ipsilonauth f25-infra tflink libphutil f25-infra tflink arcanist f25-infra tflink python-twill f25-infra codeblock stickynotes2modernpaste f25-infra codeblock mediawiki-skin-fedora f25-infra kevin f26-infra (no matching packages) f27-infra (no matching packages)

1 0

Re: FBR: Fix paste and lists flapping redirects
by Stephen John Smoogen 01 Apr '17

01 Apr '17

Plus one On Apr 1, 2017 17:49, "Patrick Uiterwijk" <puiterwijk(a)redhat.com> wrote: Hi all, After some debugging, I just found the reason for the issue where paste sometimes displayed mailman et vica versa. Here my explanation on IRC: puiterwijk | So... It turns out that when Varnish computes the hash of a request to see if the "primary" request HTTP headers. These being host, path, method and then take into account anything that's mentioned in the Vary header. puiterwijk | It explicitly does *not* take into consideration any "random" HTTP headers. puiterwijk | And here comes the fun part: in our setup, the "host" header is always localhost because we don't set apache's PreseveHostHeader for *most* sites (I'll come back to this in a minute). puiterwijk | Instead, we send the hostname via X-Forwarded-Host, and we pick the backend based on that... puiterwijk | But since the Host header that Varnish sees is the same between paste and lists requests, it's actually hashing them to the same request object, returning each others responses puiterwijk | The reason this has not impacted any other sites, is because we actually don't depend on just the X-Forwarded-Host header for those requests, but instead use req.url: one of the fields taken into account in the request hash puiterwijk | So, a very simple fix would be to just set PreserveHostHeader in the Apache config (for lists and paste, but maybe for all?). That'd make the host header actually get into the request object hash puiterwijk | Current Status: puiterwijk | OK puiterwijk | Nagios agrees with me that this fixes the problem Can I get +1s for the fix: diff --git a/playbooks/include/proxies-reverseproxy.yml b/playbooks/include/proxies-reverseproxy.yml index ac65440..e5720c9 100644 --- a/playbooks/include/proxies-reverseproxy.yml +++ b/playbooks/include/proxies-reverseproxy.yml @@ -70,6 +70,7 @@ localpath: / remotepath: / header_scheme: true + keephost: true proxyurl: "{{ varnish_url }}" - role: httpd/reverseproxy @@ -78,6 +79,7 @@ localpath: / remotepath: / header_scheme: true + keephost: true proxyurl: "{{ varnish_url }}" # The place for the raw originals @@ -150,6 +152,7 @@ - role: httpd/reverseproxy website: paste.fedoraproject.org destname: modernpaste + keephost: true proxyurl: "{{ varnish_url }}" - role: httpd/reverseproxy Regards, Patrick _______________________________________________ infrastructure mailing list -- infrastructure(a)lists.fedoraproject.org To unsubscribe send an email to infrastructure-leave(a)lists.fedoraproject.org

1 0

FBR: Fix paste and lists flapping redirects
by Patrick Uiterwijk 01 Apr '17

01 Apr '17

Hi all, After some debugging, I just found the reason for the issue where paste sometimes displayed mailman et vica versa. Here my explanation on IRC: puiterwijk | So... It turns out that when Varnish computes the hash of a request to see if the "primary" request HTTP headers. These being host, path, method and then take into account anything that's mentioned in the Vary header. puiterwijk | It explicitly does *not* take into consideration any "random" HTTP headers. puiterwijk | And here comes the fun part: in our setup, the "host" header is always localhost because we don't set apache's PreseveHostHeader for *most* sites (I'll come back to this in a minute). puiterwijk | Instead, we send the hostname via X-Forwarded-Host, and we pick the backend based on that... puiterwijk | But since the Host header that Varnish sees is the same between paste and lists requests, it's actually hashing them to the same request object, returning each others responses puiterwijk | The reason this has not impacted any other sites, is because we actually don't depend on just the X-Forwarded-Host header for those requests, but instead use req.url: one of the fields taken into account in the request hash puiterwijk | So, a very simple fix would be to just set PreserveHostHeader in the Apache config (for lists and paste, but maybe for all?). That'd make the host header actually get into the request object hash puiterwijk | Current Status: puiterwijk | OK puiterwijk | Nagios agrees with me that this fixes the problem Can I get +1s for the fix: diff --git a/playbooks/include/proxies-reverseproxy.yml b/playbooks/include/proxies-reverseproxy.yml index ac65440..e5720c9 100644 --- a/playbooks/include/proxies-reverseproxy.yml +++ b/playbooks/include/proxies-reverseproxy.yml @@ -70,6 +70,7 @@ localpath: / remotepath: / header_scheme: true + keephost: true proxyurl: "{{ varnish_url }}" - role: httpd/reverseproxy @@ -78,6 +79,7 @@ localpath: / remotepath: / header_scheme: true + keephost: true proxyurl: "{{ varnish_url }}" # The place for the raw originals @@ -150,6 +152,7 @@ - role: httpd/reverseproxy website: paste.fedoraproject.org destname: modernpaste + keephost: true proxyurl: "{{ varnish_url }}" - role: httpd/reverseproxy Regards, Patrick

2 1

Meeting Agenda Item: Introduction Ian Cole
by Ian Cole 31 Mar '17

31 Mar '17

Hi everyone! I briefly joined this team a little over 5 years ago but unfortunately got swamped and had to back out. However I have much more free time for side projects and would love to try to help out again. I have been a long time Fedora user, and started using it in high school when it first became a distro and it has been my distro of choice ever since. I have worked as a build engineer, a full stack Ruby/Rails engineer, and a data engineer managing data pipelines and the infrastructure around them. I have experience with some Java, Python, and Scala, but have the most experience in Ruby. Have worked with Puppet, Chef, Jenkins, and most recently used Ansible extensively when I was working as a data engineer for 2 years (I still use Ansible to configure my local dev environment because I love it so much). I would really like to help contribute in whatever way I can and really my Python and Ansible, but love learning whatever is relevant. Look forward to joining in on a meeting soon! My nickname on IRC is icole. -Ian Cole

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure April 2017