infrastructure April 2017

infrastructure@lists.fedoraproject.org

50 participants
45 discussions

SSH Key types
by Patrick Uiterwijk 12 Apr '17

12 Apr '17

Hi all, As of right now, we are allowing SSH ECDSA and ed25519 keys to be used in the Fedora Account System. However, I would *strongly* suggest infrastructure team members to *not* use either of those, because that would prevent you from accessing any of the remaining RHEL6 machines[1] we still have. The reason this has been changed now is because we shut off hosted03, which was the final server that non-infra folks have SSH access to. Regards, Patrick [1]: https://fedoraproject.org/wiki/Infrastructure/RHEL6_hosts

1 0

Re: Fwd: fedmsg error log badges-backend01.phx2.fedoraproject.org
by Zach Villers 10 Apr '17

10 Apr '17

Justin, I don't know if this is the cause or not, but I will tell you what I've done in case it helps someone. My first commit to badges was figuring out that the script that ran daily to check for the X Year Badger badges wasnt running. The length of the list was so long that the connection timed out just trying to pull down the list of contributors to check. My fix was to just loop over the alphabet and pull in all of the "A" names, all the way to the "Z" names. I imagine that if the script fails to run now, for whatever reason, it does it 26 times. :) A better solution could involve ( and Im doing this from memory, so apologies if this is a wild goose chase ) - having puiterwijk or some other person smart about DBs write a query to pull out all of the badge anniversary dates and put a text file of results somewhere this script could pull in - having the loop check each time through to see if the database responds, waiting in between responses, before giving up - rewriting all of fedmsg in python3 ( maybe dont do this - I think it would be painful ) I haven't been around much lately due to work/life, but I just updated my ssh key. If I haven't been removed from the badges-admin group for being largely absent for several months. (which I believe is the primary reason people are removed) I will try to look at it this week. This would be a good task for a new contributor to look into as well. I don't remember if all the scripts for badges are in ansible, but I imagine they are. Regards, Zach -- Zach Villers zach(a)znix.site On Mon, Apr 10, 2017, at 07:44 PM, Justin W. Flory wrote: > Hi all, > > I had about 150-200 of these emails come in over the last few minutes. > Is there any kind of action we can take to quiet these down or get to > the bottom of what's causing them? This also happens intermittently > outside of the past 30 minutes too. > > Thanks! > > > -------- Forwarded Message -------- > Subject: fedmsg error log badges-backend01.phx2.fedoraproject.org > Date: Mon, 10 Apr 2017 23:41:09 -0000 > From: fedmsg(a)fedoraproject.org > To: sysadmin-badges-members(a)fedoraproject.org > > Message > ------- > [2017-04-10 23:41:09][moksha.hub ERROR] > ```python > Couldn't talk to pkgdb2 for u'mbs/mbs.fedoraproject.org', 404, > u'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">\n<title>404 > Not Found</title>\n<h1>Not Found</h1>\n<p>The requested URL was not > found on the server. If you entered the URL manually please check your > spelling and try again.</p>\n' > ``` > > > Process Details > --------------- > - host: badges-backend01.phx2.fedoraproject.org > - PID: 31829 > - name: fedmsg-hub > - command: /usr/bin/python /usr/bin/fedmsg-hub > - msg_id: 2017-18d2a3e1-2cb0-45a2-97d8-aba549a4e8fb > > Callstack that lead to the logging statement > -------------------------------------------- > ```python > File "/usr/lib64/python2.7/threading.py", line 784 in __bootstrap > self.__bootstrap_inner() > File "/usr/lib64/python2.7/threading.py", line 811 in __bootstrap_inner > self.run() > File "/usr/lib64/python2.7/threading.py", line 764 in run > self.__target(*self.__args, **self.__kwargs) > File > "/usr/lib64/python2.7/site-packages/twisted/python/threadpool.py", line > 167 in _worker > result = context.call(ctx, function, *args, **kwargs) > File "/usr/lib64/python2.7/site-packages/twisted/python/context.py", > line 118 in callWithContext > return self.currentContext().callWithContext(ctx, func, *args, **kw) > File "/usr/lib64/python2.7/site-packages/twisted/python/context.py", > line 81 in callWithContext > return func(*args,**kw) > File "/usr/lib/python2.7/site-packages/moksha/hub/api/consumer.py", > line 191 in _work > self.consume(message) > File "/usr/lib/python2.7/site-packages/fedbadges/consumers.py", line > 237 in consume > for recipient in badge_rule.matches(msg): > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 236 > in matches > if not self.criteria.matches(msg): > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 94 in > inner > return method(self, *args, **kwargs) > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 368 > in matches > child.matches(msg) for child in self.children > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 66 in > <lambda> > "not": lambda x: all([not item for item in x]) > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 368 > in <genexpr> > child.matches(msg) for child in self.children > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 96 in > inner > log.exception(e) > ``` > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 94, > in inner > return method(self, *args, **kwargs) > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 371, > in matches > return self.specialization.matches(msg) > File "/usr/lib/python2.7/site-packages/fedbadges/rules.py", line 418, > in matches > user=expectation['user'], > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 145, > in get_pkgdb_packages_for > return _getter(user) > File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line > 1053, in decorate > should_cache_fn) > File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line > 657, in get_or_create > async_creator) as value: > File "/usr/lib/python2.7/site-packages/dogpile/core/dogpile.py", line > 158, in __enter__ > return self._enter() > File "/usr/lib/python2.7/site-packages/dogpile/core/dogpile.py", line > 98, in _enter > generated = self._enter_create(createdtime) > File "/usr/lib/python2.7/site-packages/dogpile/core/dogpile.py", line > 149, in _enter_create > created = self.creator() > File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line > 625, in gen_value > created_value = creator() > File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line > 1049, in creator > return fn(*arg, **kw) > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 143, > in _getter > return _get_pkgdb2_packages_for(config, user) > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 166, > in _get_pkgdb2_packages_for > data = _get_page(1) > File "/usr/lib/python2.7/site-packages/fedbadges/utils.py", line 159, > in _get_page > username, req.status_code, req.text)) > IOError: Couldn't talk to pkgdb2 for u'mbs/mbs.fedoraproject.org', 404, > u'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">\n<title>404 > Not Found</title>\n<h1>Not Found</h1>\n<p>The requested URL was not > found on the server. If you entered the URL manually please check your > spelling and try again.</p>\n' > > _______________________________________________ > infrastructure mailing list -- infrastructure(a)lists.fedoraproject.org > To unsubscribe send an email to > infrastructure-leave(a)lists.fedoraproject.org > Email had 1 attachment: > + signature.asc > 1k (application/pgp-signature)

1 0

[PATCH] Fix a typo in Rawhide DNF nightly cron job
by Lubomír Sedlář 10 Apr '17

10 Apr '17

The variable needs to be called TMPDIR, not TPMDIR. Signed-off-by: Lubomír Sedlář <lsedlar(a)redhat.com> --- roles/releng/files/rawhide | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/roles/releng/files/rawhide b/roles/releng/files/rawhide index 62f4333..38e374d 100644 --- a/roles/releng/files/rawhide +++ b/roles/releng/files/rawhide @@ -1,4 +1,4 @@ # rawhide compose MAILTO=releng-cron(a)lists.fedoraproject.org 15 5 * * * root TMPDIR=`mktemp -d /tmp/rawhide.XXXXXX` && cd $TMPDIR && git clone https://pagure.io/pungi-fedora.git && cd pungi-fedora && LANG=en_US.UTF-8 ./nightly.sh && sudo -u ftpsync /usr/local/bin/update-fullfiletimelist -l /pub/fedora-secondary/update-fullfiletimelist.lock -t /pub fedora fedora-secondary -15 17 * * * root TPMDIR=$(mktemp -d /tmp/rawhide-dnf.XXXXXX) && cd $TMPDIR && git clone https://pagure.io/pungi-fedora.git && cd pungi-fedora && LANG=en_US.UTF-8 ./nightly-dnf.sh +15 17 * * * root TMPDIR=$(mktemp -d /tmp/rawhide-dnf.XXXXXX) && cd $TMPDIR && git clone https://pagure.io/pungi-fedora.git && cd pungi-fedora && LANG=en_US.UTF-8 ./nightly-dnf.sh -- 2.9.3

2 1

Review for PR on ansible
by Paul W. Frields 10 Apr '17

10 Apr '17

I'm trying to add to the filter on the ircbot for Magazine so it doesn't output anything that concerns Council in Pagure. Is this right, or even sane? * * * diff --git a/roles/fedmsg/irc/templates/ircbot.py b/roles/fedmsg/irc/templates/ircbot.py index 2b2e0c3..0dcb0e1 100644 --- a/roles/fedmsg/irc/templates/ircbot.py +++ b/roles/fedmsg/irc/templates/ircbot.py @@ -446,12 +446,13 @@ config = dict( nickname='fm-magazine', {% endif %} channel='#fedora-magazine', - # If the word modularity appears in any message, forward it. + # If the word magazine appears in any message, forward it. filters=dict( topic=[ '^((?!(pagure|planet|badges|fas.group|mailman|meetbot\.meeting)).)*$', ], - body=['^((?!(magazine|Magazine)).)*$'], + body=['^((?!(magazine|Magazine)).)*$', + "u'namespace': u'Fedora-Council'"], ), ), -- Paul W. Frields http://paul.frields.org/ gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233 5906 ACDB C937 BD11 3717 http://redhat.com/ - - - - http://pfrields.fedorapeople.org/ The open source story continues to grow: http://opensource.com

2 1

Looking for GSoC Mentor
by Radka Janekova 10 Apr '17

10 Apr '17

Hey guys, I have two netcore projects but can officially mentor but one and my original 2nd mentor kinda bailed on me, so as the subject says... The project in question without mentor is an ASP.NET Core website that would be checking users fas groups using ipsilon - that is why I'm poking infra :] What would be expected of you - some help with ipsilon side of things (I would still cover the code and deployment, etc...) and essentially being the official primary mentor for the project. Time requirements would be a LOT smaller than with regular GSoC project, probably less than an hour a week. There are two students that could be up for this project: https://fedoraproject.org/wiki/GSOC_2017/Student_Application_stephenonnen https://fedoraproject.org/wiki/GSOC_2017/Student_Application_spytec Best regards, Radka ------------------------------ *Radka Janeková* *radka.janek(a)redhat.com <radka.janek(a)redhat.com>*

1 0

April status update for Fedora Infrastructure Apprentices
by Kevin Fenzi 10 Apr '17

10 Apr '17

You are getting this email because you are in the 'fi-apprentice' group in the fedora account system (or are reading this on the infrastructure list). Feel free to reply just directly to me, or cc the infrastructure list for everyone to see and comment on. https://fedoraproject.org/wiki/Infrastructure_Apprentice At the first of every month(or so), I am going to be sending out an email like this one. I would like feedback on how things are going for you. I'd like to ask for everyone to send me a quick reply with the following data or anything related you can think of that might help us make the apprentice program more useful. 0. Whats your fedora account system login? 1. Have you logged in and used your fi-apprentice membership to look at our machines/setup in the last month? Do you plan to? 2. Has it helped you decide any area you wish to focus on or contribute to more? 3. Have you looked at or been able to work on any of the fi-apprentice 'easyfix' tickets? https://pagure.io/fedora-infrastructure/issues?status=Open&tags=easyfix 4. Do you still wish to be a member of the group? If not (for whatever reason) could you provide any hints to help others down the road? 5. Is there any help or communication or ideas you have that would help you do any of the above? 6. What do you find to be the hardest part of getting involved? Finding things to work on? Getting attention from others to help you? Finding tickets in your interest area? 7. Have you been able to make any weekly irc meetings? Do you find them helpful or interesting? 8. Have you logged into our Gobby instance and read/seen/added to our meeting agenda? https://fedoraproject.org/wiki/Gobby 9. Have you used any containers in the last week or so? (docker, rocket, etc) Any other general feedback is also quite welcome, including improvements to this email, the wiki page, etc. Note that we recently revamped the getting started and other pages. Please do take a minute to re-read them and let me know if they are more clear or need further adjustments. Any folks I do not hear from in the next week will be removed from the group. (Note that it's easy to be readded when you have time or whatever and it's nothing at all personal, we just want to keep the group up to date with active folks). Thanks, and looking forward to your feedback! kevin

10 9

Weekly Koji Infra Tag Report
by Nobody 09 Apr '17

09 Apr '17

This is a list of packages in the various infrastructure koji tags Please check and make sure there are not any that can be removed/dropped epel6-infra (no matching packages) epel7-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- freeipa-ktutils epel7-infra puiterwijk compose-utils epel7-infra ausil fedmsg-beaker-repoupdate epel7-infra tflink anitya epel7-infra jcline the-new-hotness epel7-infra jcline fedocal epel7-infra pingou python-IPy epel7-infra kevin python-robosignatory epel7-infra puiterwijk pdc-updater epel7-infra ralph python-pdc epel7-infra ralph glusterfs epel7-infra kevin mirrormanager2 epel7-infra puiterwijk blockerbugs epel7-infra tflink python-django-jsonfield epel7-infra ralph f23-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- libphutil, f23-infra tflink arcanist, f23-infra tflink phabricator f23-infra tflink phabricator-extension-ipsilonauth f23-infra tflink libphutil f23-infra tflink arcanist f23-infra tflink f24-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- mediawiki-openid f24-infra kevin phabricator-extension-oauth f24-infra tflink python-twill f24-infra codeblock stickynotes2modernpaste f24-infra codeblock python-flask-testing f24-infra codeblock modern-paste f24-infra codeblock mediawiki-skin-fedora f24-infra puiterwijk mediawiki-FedoraBadges f24-infra kevin basset f24-infra puiterwijk phabricator f24-infra tflink mediawiki-Lockdown f24-infra kevin libphutil f24-infra tflink arcanist f24-infra tflink mediawiki-RSS f24-infra kevin mirrormanager2 f24-infra puiterwijk f25-infra Package Tag Extra Arches Owner ----------------------- ----------------------- ---------------- --------------- python-flask-testing f25-infra codeblock modern-paste f25-infra codeblock python-coveralls f25-infra codeblock mdapi f25-infra pingou basset f25-infra puiterwijk mediawiki-FedoraBadges f25-infra kevin mediawiki-Lockdown f25-infra kevin mediawiki-RSS f25-infra kevin mediawiki-openid f25-infra kevin plus-plus-service f25-infra pingou python-pdc f25-infra ralph python-django-cors-headers f25-infra ralph python-django-rest-framework-composed-permissions f25-infra ralph patternfly1 f25-infra ralph fas f25-infra kevin libphutil, f25-infra tflink arcanist, f25-infra tflink phabricator f25-infra tflink phabricator-extension-ipsilonauth f25-infra tflink libphutil f25-infra tflink arcanist f25-infra tflink python-twill f25-infra codeblock stickynotes2modernpaste f25-infra codeblock mediawiki-skin-fedora f25-infra kevin f26-infra (no matching packages) f27-infra (no matching packages)

1 0

Meeting Agenda Item: Introduction 'Shailendra Yadav'
by Shailendra Yadav 09 Apr '17

09 Apr '17

Hi folks, IRC Handle: 'yadavShailendra' I would like to contribute to c/c++, java, shell scripting(Beginner) and Linux administration. I'm having RHCE participation certification and as well as one from edx. I'm open to work, but would be preferred for shell scripting. Thanks Shailendra Yadav

1 0

Checksum issues for mirrors in Brazil
by Davi Garcia 08 Apr '17

08 Apr '17

Hi team, Some users from Brazil identified a problem with our fedora-update mirrors for our region. After cleaning the DNF cache with "dnf clean all" and trying a "dnf update", they are getting error: Adding the -v flag, the output shows that the problem is "Downloading successful, but checksum doesn't match.". More detailed output at: https://paste.fedoraproject.org/paste/byFo88IC276CRT-NKEKLql5M1UNdIGYhyRLiv… We recommended to edit the fedora-updates.repo file, removing the comments of the "baseurl" line and commenting "metalink". This way they use the main repo and avoid bad mirrors, as a temporary workaround. Are we facing sync issues for our repos? Thanks in advance, Davi Garcia (aka mudblur)

3 3

Plan for tomorrow's Fedora Infrastructure meeting - 2017-04-07
by Stephen John Smoogen 05 Apr '17

05 Apr '17

The infrastructure team will be having it's weekly meeting tomorrow, 2017-04-07 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. = Introduction = We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2017-04-06) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson = Let new people say hello = #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info Fedora 26 Alpha is out - everyone! #info EPEL-4 and 5 has been mirrored to archives #info Freeze is done we will be freezing again soon. #info Kojipkgs is now using varnish vs squid = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus /suor decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic Things we need to do before next freeze #info get varnish fully tested #info update/reboot servers 2017-04-11->2017-04-13 #info put new nagios into play #info ??? = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. = Learn about some application or gsetup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the i/nfo in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: ??? = Meeting end stuff = #topic Open Floor #endmeeting -- Stephen J Smoogen.

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure April 2017