Hi Matt,
I wanted to follow up on this question you had on DevConf.US 22 [1].
We would like to make these stats available to the community, unfortunately now it is just a DB query to our Testing Farm database.
So, currently that is: 449 packages
I am attaching lists for proof.
There are also a bunch of shared tmt tests in tests dist-git tests namespace, seems 83 of them:
https://src.fedoraproject.org/projects/tests/%2A
Best regards, /M
[1] https://youtu.be/M2FXrUs3YjE?t=3121
On 25. 08. 22 19:46, Miroslav Vadkerti wrote:
Hi Matt,
I wanted to follow up on this question you had on DevConf.US 22 [1].
We would like to make these stats available to the community, unfortunately now it is just a DB query to our Testing Farm database.
So, currently that is: 449 packages
I am attaching lists for proof.
I recognize some false positives in the list:
https://src.fedoraproject.org/rpms/pyproject-rpm-macros https://src.fedoraproject.org/rpms/pypy https://src.fedoraproject.org/rpms/python-packaging
The packages use STI, not TMT.
This package is retired on all branches, cannot use anything, used STI before, not TMT.
https://src.fedoraproject.org/rpms/python-dotenv https://src.fedoraproject.org/rpms/python-requests https://src.fedoraproject.org/rpms/python-shellingham https://src.fedoraproject.org/rpms/python-urllib3
The TMT tests were removed ~1 year ago.
There might be more such cases, I only checked a handful of packages I know or co-maintain.
Thanks Miro,
The false positives come from the fact that we gathered the requests data of Testing Farm, a final check to check if that corresponds with the current state would get rid of those false positives.
I will not more spend now more time on it, I believe it is only a few occasions.
But thanks for taking the time and looking into it.
Best regards, /M
On Mon, Aug 29, 2022 at 1:02 PM Miro Hrončok mhroncok@redhat.com wrote:
On 25. 08. 22 19:46, Miroslav Vadkerti wrote:
Hi Matt,
I wanted to follow up on this question you had on DevConf.US 22 [1].
We would like to make these stats available to the community,
unfortunately now
it is just a DB query to our Testing Farm database.
So, currently that is: 449 packages
I am attaching lists for proof.
I recognize some false positives in the list:
https://src.fedoraproject.org/rpms/pyproject-rpm-macros https://src.fedoraproject.org/rpms/pypy https://src.fedoraproject.org/rpms/python-packaging
The packages use STI, not TMT.
This package is retired on all branches, cannot use anything, used STI before, not TMT.
https://src.fedoraproject.org/rpms/python-dotenv https://src.fedoraproject.org/rpms/python-requests https://src.fedoraproject.org/rpms/python-shellingham https://src.fedoraproject.org/rpms/python-urllib3
The TMT tests were removed ~1 year ago.
There might be more such cases, I only checked a handful of packages I know or co-maintain.
-- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok
Thanks to both of you. Could we get the tests onto the Packager Dashboard? I can file a pr at https://pagure.io/fedora-qa/packager_dashboard/issues, or co-sign one if someone else wants to. :)
On Fri, Sep 9, 2022 at 4:14 AM Miroslav Vadkerti mvadkert@redhat.com wrote:
Thanks Miro,
The false positives come from the fact that we gathered the requests data of Testing Farm, a final check to check if that corresponds with the current state would get rid of those false positives.
I will not more spend now more time on it, I believe it is only a few occasions.
But thanks for taking the time and looking into it.
Best regards, /M
On Mon, Aug 29, 2022 at 1:02 PM Miro Hrončok mhroncok@redhat.com wrote:
On 25. 08. 22 19:46, Miroslav Vadkerti wrote:
Hi Matt,
I wanted to follow up on this question you had on DevConf.US 22 [1].
We would like to make these stats available to the community,
unfortunately now
it is just a DB query to our Testing Farm database.
So, currently that is: 449 packages
I am attaching lists for proof.
I recognize some false positives in the list:
https://src.fedoraproject.org/rpms/pyproject-rpm-macros https://src.fedoraproject.org/rpms/pypy https://src.fedoraproject.org/rpms/python-packaging
The packages use STI, not TMT.
This package is retired on all branches, cannot use anything, used STI before, not TMT.
https://src.fedoraproject.org/rpms/python-dotenv https://src.fedoraproject.org/rpms/python-requests https://src.fedoraproject.org/rpms/python-shellingham https://src.fedoraproject.org/rpms/python-urllib3
The TMT tests were removed ~1 year ago.
There might be more such cases, I only checked a handful of packages I know or co-maintain.
-- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok
-- Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE IRC mvadkert #tft #tmt #osci :: Mobile +420 773 944 252 Remote Czech Republic :: Red Hat Czech s.r.o
On 13. 09. 22 16:20, Matthew Miller wrote:
Thanks to both of you. Could we get the tests onto the Packager Dashboard? I can file a pr at https://pagure.io/fedora-qa/packager_dashboard/issues https://pagure.io/fedora-qa/packager_dashboard/issues, or co-sign one if someone else wants to. :)
The dashboard shows active PRs, updates, overrides, bugzillas or otherwise actionable items. I have no idea why and how we would list tmt tests there. What do you have in mind?
On Tue, Sep 13, 2022 at 10:28 AM Miro Hrončok mhroncok@redhat.com wrote:
The dashboard shows active PRs, updates, overrides, bugzillas or otherwise actionable items. I have no idea why and how we would list tmt tests there. What do you have in mind?
* "This package has no tests. You can create them easily ..." [Link to instructions for creating tests.] * "Tests for this package have failed since [date]"
... and similar?
Hi,
Sounds reasonable to me, we even talked about that few years ago with frantisekz.
Let's start with an issue.
Best regards, /M
On Tue, Sep 13, 2022, 4:57 PM Matthew Miller mattdm@redhat.com wrote:
On Tue, Sep 13, 2022 at 10:28 AM Miro Hrončok mhroncok@redhat.com wrote:
The dashboard shows active PRs, updates, overrides, bugzillas or otherwise actionable items. I have no idea why and how we would list tmt tests there. What do you have in mind?
- "This package has no tests. You can create them easily ..." [Link to
instructions for creating tests.]
- "Tests for this package have failed since [date]"
... and similar?
https://pagure.io/fedora-qa/packager_dashboard/issue/161
On Tue, Sep 13, 2022 at 11:52 AM Miroslav Vadkerti mvadkert@redhat.com wrote:
Hi,
Sounds reasonable to me, we even talked about that few years ago with frantisekz.
Let's start with an issue.
Best regards, /M
On Tue, Sep 13, 2022, 4:57 PM Matthew Miller mattdm@redhat.com wrote:
On Tue, Sep 13, 2022 at 10:28 AM Miro Hrončok mhroncok@redhat.com wrote:
The dashboard shows active PRs, updates, overrides, bugzillas or otherwise actionable items. I have no idea why and how we would list tmt tests there. What do you have in mind?
- "This package has no tests. You can create them easily ..." [Link to
instructions for creating tests.]
- "Tests for this package have failed since [date]"
... and similar?
ci@lists.stg.fedoraproject.org
-
Matthew Miller -
Miro Hrončok -
Miroslav Vadkerti