infrastructure March 2016

infrastructure@lists.fedoraproject.org

42 participants
92 discussions

freeze break request
by Dennis Gilmore 28 Mar '16

28 Mar '16

Hi, I need to update pungi on the compose boxes to fix some issues we have seen over the last few days, additionally the builders in the compose channels all need to be rebooted. Dennis

3 2

freeze break request
by Dennis Gilmore 28 Mar '16

28 Mar '16

Hi, I need to update pungi on the compose boxes to fix some issues we have seen over the last few days, additionally the builders in the compose channels all need to be rebooted. Dennis

1 0

Freeze Break Request: Add to list of servers to block from rsync
by Stephen John Smoogen 25 Mar '16

25 Mar '16

In order to clean up download load averages, we need to clean out some mirrors which are over-using the rsync. I would like the list of hosts to be blocked to be: blocked_ips: [ '8.39.100.100', '46.29.92.6', '69.47.68.211', '83.110.159.237', '103.193.116.147', '130.193.57.106', '130.193.60.205', '158.39.4.2', '169.53.165.245', '193.52.32.69', '195.23.131.253', '198.11.167.9', '202.202.43.41' ] -- Stephen J Smoogen.

3 2

[release] bodhi: 2.1.8
by Luke Macken 25 Mar '16

25 Mar '16

Hi all, Yesterday I released a new version of bodhi to production. Please file any issues that you encounter here: https://github.com/fedora-infra/bodhi/issues/new Thanks, luke 2.1.8 ----- Pull Requests - (@lmacken) #771, push: Only attempt to push unlocked updates https://github.com/fedora-infra/bodhi/pull/771 - (@trishnaguha) #773, Handling Status for revoking request and test for revoke action https://github.com/fedora-infra/bodhi/pull/773 - (@trishnaguha) #779, Time to stable https://github.com/fedora-infra/bodhi/pull/779 - (@ralphbean) #782, Hide "Push to Stable" if request is already "stable". https://github.com/fedora-infra/bodhi/pull/782 - (@ralphbean) #786, Add an error message when we fail to query datagrepper on the user page. https://github.com/fedora-infra/bodhi/pull/786 - (@lmacken) #791, models: Add a unique constraint to the Update.title https://github.com/fedora-infra/bodhi/pull/791 - (@lmacken) #792, Use the RPM epoch when comparing builds https://github.com/fedora-infra/bodhi/pull/792 - (@trishnaguha) #793, Modifying days to stable https://github.com/fedora-infra/bodhi/pull/793 - (@trishnaguha) #800, Display timezone in timestamps https://github.com/fedora-infra/bodhi/pull/800 - (@trishnaguha) #806, Remove microsecond from timestamp https://github.com/fedora-infra/bodhi/pull/806 - (@lmacken) #808, Only touch tags that we know about. https://github.com/fedora-infra/bodhi/pull/808 - (@lmacken) #809, Disallow adding a build from an existing update into another https://github.com/fedora-infra/bodhi/pull/809 - (@lmacken) #816, alembic: Update the unique title migration script to remove empty updates https://github.com/fedora-infra/bodhi/pull/816 - (@trishnaguha) #814, Make sure request is None after unpushing https://github.com/fedora-infra/bodhi/pull/814 Commits - 66616a0ac push: Only attempt to push unlocked updates https://github.com/fedora-infra/bodhi/commit/66616a0ac - 57496dd3c Handling status for revoking request on pending and testing update https://github.com/fedora-infra/bodhi/commit/57496dd3c - 59c6e9ce6 Test revoke action for stable and testing request on testing and pending update https://github.com/fedora-infra/bodhi/commit/59c6e9ce6 - ff2421f4f Handling status for revoking request:modified https://github.com/fedora-infra/bodhi/commit/ff2421f4f - 5e2e5666c tests: some basic str tweaks to get the test suite working in koji + epel7 https://github.com/fedora-infra/bodhi/commit/5e2e5666c - 6496a4476 Hide "Push to Stable" if request is already "stable". https://github.com/fedora-infra/bodhi/commit/6496a4476 - e9a01d279 Add an error message when we fail to query datagrepper on the user page. https://github.com/fedora-infra/bodhi/commit/e9a01d279 - 071f41eb3 Time to stable https://github.com/fedora-infra/bodhi/commit/071f41eb3 - 52840603a models: Add a unique constraint to the Update.title https://github.com/fedora-infra/bodhi/commit/52840603a - 8f233dd32 alembic: Add a migration script for the Update.title unique constrant https://github.com/fedora-infra/bodhi/commit/8f233dd32 - 097dce22b models: Add a new Build.epoch column https://github.com/fedora-infra/bodhi/commit/097dce22b - bb8be8ac2 models/validators: Add a new Build.evr property https://github.com/fedora-infra/bodhi/commit/bb8be8ac2 - f4891b2a5 utils: Update build_evr and get_nvr to return tuples https://github.com/fedora-infra/bodhi/commit/f4891b2a5 - 27f6d30e3 models: Convert the epoch to unicode to avoid a SAWarning https://github.com/fedora-infra/bodhi/commit/27f6d30e3 - 43d1a91c9 models: Use an Integer for the Update.epoch instead of a Unicode object https://github.com/fedora-infra/bodhi/commit/43d1a91c9 - b212fc8b8 metadata: Remove an incorrect warning message https://github.com/fedora-infra/bodhi/commit/b212fc8b8 - f297ddba8 Modifying days to stable https://github.com/fedora-infra/bodhi/commit/f297ddba8 - 9e96f82ea Display timezone in timestamps https://github.com/fedora-infra/bodhi/commit/9e96f82ea - 8bb4f5329 push: Use the appropriate lock path when resuming pushes in staging https://github.com/fedora-infra/bodhi/commit/8bb4f5329 - 5bb490827 tools: Add the bodhi-manage-releases to the setup.py console_scripts https://github.com/fedora-infra/bodhi/commit/5bb490827 - fe22cdbc3 Remove microsecond from timestamp https://github.com/fedora-infra/bodhi/commit/fe22cdbc3 - ba7151ffc Only touch tags that we know about. https://github.com/fedora-infra/bodhi/commit/ba7151ffc - 1cd706765 tests: Add a unit test that adds a build from one update into a different update https://github.com/fedora-infra/bodhi/commit/1cd706765 - 5f3f9ff55 validators: Disallow adding a build from an existing update into another (fixes #803) https://github.com/fedora-infra/bodhi/commit/5f3f9ff55 - 95505662c Set request to None when unpushing https://github.com/fedora-infra/bodhi/commit/95505662c - 91064e8ec Test for request when unpushing https://github.com/fedora-infra/bodhi/commit/91064e8ec - dc22a5755 alembic: Update the unique title migration script to remove empty updates https://github.com/fedora-infra/bodhi/commit/dc22a5755

1 0

fedbadges-backend.stg - another question
by Zach Villers 24 Mar '16

24 Mar '16

Hello again, does anyone have insight to these two errors? first the fedmsg warning and then getting the badge 'egg' from tahrir db fails. Thanks, Zach >>> import pkg_resources >>> import time >>> import urllib >>> import socket >>> from tahrir_api.dbapi import TahrirDatabase >>> import transaction >>> _fas_cache = {} >>> import fedmsg >>> import fedmsg.config >>> fm_config = fedmsg.config.load_config() >>> fm_config['cert_prefix'] = 'fedbadges' >>> fm_config['name'] = 'relay_inbound' >>> fm_config['Active'] = True >>> fedmsg.init(**fm_config) /usr/lib/python2.7/site-packages/fedmsg/core.py:158: UserWarning: fedmsg is not configured to send any messages for name 'relay_inbound' "for name %r" % config.get("name", None)) <fedmsg.core.FedMsgContext object at 0x306d190> >>> import fedbadges.utils >>> uri = fm_config['badges_global']['database_uri'] >>> tahrir = TahrirDatabase(uri, >>> notification_callback=fedbadges.utils.notification_callback) >>> badge = tahrir.get_badge(badge_id='egg') >>> badge >>> print badge None

1 0

Freeze break: bodhi upgrade & and masher permission changes
by Luke Macken 24 Mar '16

24 Mar '16

Hi all, I'd like to push out a production bodhi upgrade, along with some ansible changes that will change the permissions of how the masher is run. The latest bodhi code contains a number of fairly important bug fixes, and a couple of minor enhancements: https://github.com/fedora-infra/bodhi/compare/2.1.7...develop The backend masher changes that are in ansible will hopefully provide a huge speedup in terms of how long it takes to mash the updates repositories. The changes for this involve running the fedmsg-hub as the apache user, and changing the ownership of /mnt/koji/mash/{atomic,updates} accordingly. https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=94608f… https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=9889ac… https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=afbfec… https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=5b2523… I tested the bodhi & db upgrades in staging, and performed limited testing of the masher due to various constraints. Thanks, luke

5 10

Freeze break fas template update
by Dennis Gilmore 24 Mar '16

24 Mar '16

I had to make a cert for containerbuild user for koji to enable layered image builds to work. so we need to blacklist teh user in fas From 5e3ead9a5c934bfdc6e29bc6e729af2c2b173980 Mon Sep 17 00:00:00 2001 From: Dennis Gilmore <ausil(a)fedoraproject.org> Date: Thu, 24 Mar 2016 17:34:32 +0000 Subject: [PATCH] blacklist containerbuild from being created in fas Signed-off-by: Dennis Gilmore <ausil(a)fedoraproject.org> --- roles/fas_server/templates/fas.cfg.j2 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/roles/fas_server/templates/fas.cfg.j2 b/roles/fas_server/ templates/fas.cfg.j2 index 1c6bf8d..9461ed0 100644 --- a/roles/fas_server/templates/fas.cfg.j2 +++ b/roles/fas_server/templates/fas.cfg.j2 @@ -62,7 +62,7 @@ tgcaptcha2.jpeg_generator = 'vanasco_dowty' ### # Usernames that are unavailable for fas allocation -username_blacklist = "abuse,accounts,adm,admin,amanda,apache,askfedora,asterisk,bin,board,bodhi2,canna,census,chair,chairman,cvsdirsec,cvsdocs,cvseclipse,cvsextras,cvsfont,daemon,dbus,decode,desktop,dgilmore,directors,dovecot,dumper,fama,famsco,fas,fax,fedora,fedorarewards,fesco,freemedia,ftbfs,ftp,ftpadm,ftpadmin,ftpsync,games,gdm,gnomebackup,gopher,gregdek,halt,hostmaster,hotness,ident,info,ingres,jaboutboul,jan,keys,kojiadmin,ldap,legal,logo,lp,mail,mailnull,manager,marketing,masher,masta,mirrormanager,mysql,nagios,named,netdump,news,newsadm,newsadmin,nfsnobody,nobody,noc,notifications,nrpe,nscd,ntp,nut,openvideo,operator,packager,patrick,pcap,pkgdb,pkgsigner,postfix,postgres,postmaster,press,privoxy,pvm,quagga,radiusd,radvd,relnotes,relrod,rel-eng,root,rpc,rpcuser,rpm,rsc,s3-mirror,sales,scholarship,secalert,secondary-signer,security,server-wg,shutdown,smmsp,spevack,squid,sshd,support,sync,system,tickets,toor,updates,usenet,uucp,vcsa,vendors,vendor-support,voting,webalizer,webmaster,wikiadmin,wnn,www,xfs,zabbix" +username_blacklist = "abuse,accounts,adm,admin,amanda,apache,askfedora,asterisk,bin,board,bodhi2,canna,census,chair,chairman,containerbuild,cvsdirsec,cvsdocs,cvseclipse,cvsextras,cvsfont,daemon,dbus,decode,desktop,dgilmore,directors,dovecot,dumper,fama,famsco,fas,fax,fedora,fedorarewards,fesco,freemedia,ftbfs,ftp,ftpadm,ftpadmin,ftpsync,games,gdm,gnomebackup,gopher,gregdek,halt,hostmaster,hotness,ident,info,ingres,jaboutboul,jan,keys,kojiadmin,ldap,legal,logo,lp,mail,mailnull,manager,marketing,masher,masta,mirrormanager,mysql,nagios,named,netdump,news,newsadm,newsadmin,nfsnobody,nobody,noc,notifications,nrpe,nscd,ntp,nut,openvideo,operator,packager,patrick,pcap,pkgdb,pkgsigner,postfix,postgres,postmaster,press,privoxy,pvm,quagga,radiusd,radvd,relnotes,relrod,rel-eng,root,rpc,rpcuser,rpm,rsc,s3-mirror,sales,scholarship,secalert,secondary-signer,security,server-wg,shutdown,smmsp,spevack,squid,sshd,support,sync,system,tickets,toor,updates,usenet,uucp,vcsa,vendors,vendor-support,voting,webalizer,webmaster,wikiadmin,wnn,www,xfs,zabbix" # admingroup has powers to change anything in the fas UI admingroup = 'accounts' -- 1.8.3.1

3 3

Freeze Break: mirrorlists logrotate
by Kevin Fenzi 24 Mar '16

24 Mar '16

Greetings. mirrorlists have been collecting more logs in recent versions. I'd like to apply the patch below to add a logrotate file to them to keep this space under control. Longer term we should merge this with upstream mirrormanager and just have it in the package. I have it keeping 30 days right now, but I am not sure if that is too high or two low as I am not sure what we use these for, so suggestions there would be welcome. From a7dce4ea1a8fb05a933f75db6b77be7f5d8c16f9 Mon Sep 17 00:00:00 2001 From: Kevin Fenzi <kevin(a)scrye.com> Date: Thu, 24 Mar 2016 20:22:21 +0000 Subject: [PATCH] Add a logrotate file for /var/log/mirrormanager/*.log files. --- roles/mirrormanager/mirrorlist2/files/logrotate-mirrormanager | 9 +++++++++ roles/mirrormanager/mirrorlist2/tasks/main.yml | 5 +++++ 2 files changed, 14 insertions(+) create mode 100644 roles/mirrormanager/mirrorlist2/files/logrotate-mirrormanager diff --git a/roles/mirrormanager/mirrorlist2/files/logrotate-mirrormanager b/roles/mirrormanager/mirrorlist2/files/logrotate-mirrormanager new file mode 100644 index 0000000..3ed8328 --- /dev/null +++ b/roles/mirrormanager/mirrorlist2/files/logrotate-mirrormanager @@ -0,0 +1,9 @@ +/var/log/mirrormanager/*.log +{ + compress + compresscmd /usr/bin/xz + uncompresscmd /usr/bin/xz + compressext .xz + daily + keep 30 +} diff --git a/roles/mirrormanager/mirrorlist2/tasks/main.yml b/roles/mirrormanager/mirrorlist2/tasks/main.yml index b037d24..5183e4f 100644 --- a/roles/mirrormanager/mirrorlist2/tasks/main.yml +++ b/roles/mirrormanager/mirrorlist2/tasks/main.yml @@ -93,6 +93,11 @@ tags: - mirrorlist2 +- name: setup logrotate log for mirrormanager log files + copy: src=logrotate-mirrormanager dest=/etc/logrotate.d/mirrormanager + tags: + - mirrorlist2 + # Copy the mirrorlist log file every hour to be ready to be processed - name: mirrorlist copy cron cron: name="copy-mirrorlist" minute="50" hour="*/2" user="mirrormanager" -- 1.8.3.1

3 2

Freeze break: buildvmhosts and buildvms reboot for multipath iscsi
by Kevin Fenzi 24 Mar '16

24 Mar '16

Greetings. It seems that somehow our buildvmhost-10/11/12 machines are not currently properly multipathed to the iscsi on the netapp. Normally, multipath means there's a number of ways to reach the iscsi lun and the machine will use whichever one. With only one path (as it is now), all our iscsi connections will die next week when there's a netapp storage outage. So, I would like to in turn take out buildvm's from koji, let them finish building and reboot the buildvmhost to get multipath back on track. I tried restarting the service, but that didn't do any good, it's in a weird state (likely from iscsi issues a number of weeks back). Since we have signed off on Alpha, the buildvm's aren't critical to it's release. +1s? kevin

4 3

Plan for tomorrow's Fedora Infrastructure meeting - 2016-03-24
by Kevin Fenzi 24 Mar '16

24 Mar '16

(Sorry for the late send, I thought I sent this yesterday) The infrastructure team will be having it's weekly meeting tomorrow, 2016-03-24 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-03-24) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions / Apprentice feedback = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info Fedora 24 Alpha is go for release next tuesday (2016-03-29) - kevin #info Freeze ends next wed morning (2016-03-30) - kevin #info Friday (2016-03-25) is a holiday in the us, and Monday (2016-03-28) is in the eu - everyone #info Setup cachefilesd on download05, but it didn't seem to help us much - kevin #info Storage upgrade scheduled for the night of 2016-03-29 - kevin Throttling starting late afternoon, then upgrade starting 7pm EDT Upgrade done by around 2am. #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic badges-backend cron jobs - aikidouke #info https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedorapr… #topic = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) Schedule: 2016-03-24 - RFR - patrick #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure March 2016