A bit before the freeze, the pkgs02 backups of /srv failed.
This is the largest and most anoying backup we have since it's tons and tons and tons of git repos with small files in it. After the freeze, I wonder if it wouldn't be worthwhile to run a 'git gc' on all our pkgs git repos. This would make git pack things into fewer files and in general make it happier for backups and maintainers.
I removed it from backups, ran a cleanup on the failed backup and then got a new clean backup (which took several days).
So, we should be able to re-add it into our normal backups now:
diff --git a/inventory/backups b/inventory/backups index c7d4193..e6e7d30 100644 --- a/inventory/backups +++ b/inventory/backups @@ -13,7 +13,7 @@ batcave01.phx2.fedoraproject.org infinote.fedoraproject.org pagure01.fedoraproject.org people02.fedoraproject.org -#pkgs02.phx2.fedoraproject.org +pkgs02.phx2.fedoraproject.org log01.phx2.fedoraproject.org qadevel.qa.fedoraproject.org:222 db-qa01.qa.fedoraproject.org
+1s?
kevin
On 20 April 2016 at 16:37, Kevin Fenzi kevin@scrye.com wrote:
A bit before the freeze, the pkgs02 backups of /srv failed.
This is the largest and most anoying backup we have since it's tons and tons and tons of git repos with small files in it. After the freeze, I wonder if it wouldn't be worthwhile to run a 'git gc' on all our pkgs git repos. This would make git pack things into fewer files and in general make it happier for backups and maintainers.
I removed it from backups, ran a cleanup on the failed backup and then got a new clean backup (which took several days).
git the tool to break rsync.. I wonder if we need to have a 'git backup tool for these sorts of things.. it just does a git checkout every day :).
So, we should be able to re-add it into our normal backups now:
diff --git a/inventory/backups b/inventory/backups index c7d4193..e6e7d30 100644 --- a/inventory/backups +++ b/inventory/backups @@ -13,7 +13,7 @@ batcave01.phx2.fedoraproject.org infinote.fedoraproject.org pagure01.fedoraproject.org people02.fedoraproject.org -#pkgs02.phx2.fedoraproject.org +pkgs02.phx2.fedoraproject.org log01.phx2.fedoraproject.org qadevel.qa.fedoraproject.org:222 db-qa01.qa.fedoraproject.org
+1s?
kevin
infrastructure mailing list infrastructure@lists.fedoraproject.org http://lists.fedoraproject.org/admin/lists/infrastructure@lists.fedoraprojec...
+1 because I forgot.
On 20 April 2016 at 16:43, Stephen John Smoogen smooge@gmail.com wrote:
On 20 April 2016 at 16:37, Kevin Fenzi kevin@scrye.com wrote:
A bit before the freeze, the pkgs02 backups of /srv failed.
This is the largest and most anoying backup we have since it's tons and tons and tons of git repos with small files in it. After the freeze, I wonder if it wouldn't be worthwhile to run a 'git gc' on all our pkgs git repos. This would make git pack things into fewer files and in general make it happier for backups and maintainers.
I removed it from backups, ran a cleanup on the failed backup and then got a new clean backup (which took several days).
git the tool to break rsync.. I wonder if we need to have a 'git backup tool for these sorts of things.. it just does a git checkout every day :).
So, we should be able to re-add it into our normal backups now:
diff --git a/inventory/backups b/inventory/backups index c7d4193..e6e7d30 100644 --- a/inventory/backups +++ b/inventory/backups @@ -13,7 +13,7 @@ batcave01.phx2.fedoraproject.org infinote.fedoraproject.org pagure01.fedoraproject.org people02.fedoraproject.org -#pkgs02.phx2.fedoraproject.org +pkgs02.phx2.fedoraproject.org log01.phx2.fedoraproject.org qadevel.qa.fedoraproject.org:222 db-qa01.qa.fedoraproject.org
+1s?
kevin
infrastructure mailing list infrastructure@lists.fedoraproject.org http://lists.fedoraproject.org/admin/lists/infrastructure@lists.fedoraprojec...
-- Stephen J Smoogen.
On Wed, 20 Apr 2016 16:43:56 +0000 Stephen John Smoogen smooge@gmail.com wrote:
On 20 April 2016 at 16:37, Kevin Fenzi kevin@scrye.com wrote:
A bit before the freeze, the pkgs02 backups of /srv failed.
This is the largest and most anoying backup we have since it's tons and tons and tons of git repos with small files in it. After the freeze, I wonder if it wouldn't be worthwhile to run a 'git gc' on all our pkgs git repos. This would make git pack things into fewer files and in general make it happier for backups and maintainers.
I removed it from backups, ran a cleanup on the failed backup and then got a new clean backup (which took several days).
git the tool to break rsync.. I wonder if we need to have a 'git backup tool for these sorts of things.. it just does a git checkout every day :).
Well, there is grokmirror which is setup for mirroring git repos, but I'm not sure it would save us too much. 10,000+ repos is just a lot of repos. ;(
kevin
On Wed, Apr 20, 2016 at 10:37:44AM -0600, Kevin Fenzi wrote:
A bit before the freeze, the pkgs02 backups of /srv failed.
This is the largest and most anoying backup we have since it's tons and tons and tons of git repos with small files in it. After the freeze, I wonder if it wouldn't be worthwhile to run a 'git gc' on all our pkgs git repos. This would make git pack things into fewer files and in general make it happier for backups and maintainers.
I removed it from backups, ran a cleanup on the failed backup and then got a new clean backup (which took several days).
So, we should be able to re-add it into our normal backups now:
diff --git a/inventory/backups b/inventory/backups index c7d4193..e6e7d30 100644 --- a/inventory/backups +++ b/inventory/backups @@ -13,7 +13,7 @@ batcave01.phx2.fedoraproject.org infinote.fedoraproject.org pagure01.fedoraproject.org people02.fedoraproject.org -#pkgs02.phx2.fedoraproject.org +pkgs02.phx2.fedoraproject.org log01.phx2.fedoraproject.org qadevel.qa.fedoraproject.org:222 db-qa01.qa.fedoraproject.org
+1s?
+1 for me
Pierre
infrastructure@lists.fedoraproject.org