Hi there,
We are following CoreOS CL with great interest, as we are running all our k8s clusters on CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as from version 19.03. Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at least 18.09? What is the plan for Fedora CoreOS in this respect? Is it possible to replace/upgrade the version of docker in CoreOS ourselves? I would be really grateful for an answer. Kind regards Axel
On 12/12/19 9:30 AM, Axel Heindrichs wrote:
Hi there,
Hi Axel,
We are following CoreOS CL with great interest, as we are running all our k8s clusters on CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as from version 19.03. Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at least 18.09?
I don't know what the plans are for new docker versions in Container Linux.
What is the plan for Fedora CoreOS in this respect?
Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will probably be the next major fedora release (~April 2020) before that gets bumped higher.
Is it possible to replace/upgrade the version of docker in CoreOS ourselves?
I don't know about Container Linux. For Fedora CoreOS you *could* package layer a different version rpm on top, but it might make Operating System updates less reliable.
I would be really grateful for an answer. Kind regards Axel
Thanks Dusty.
What's the latest on including Podman in Fedora CoreOS?
Axel, have you looked into podman at all? It is a drop-in replacement for docker in most cases, and should be flexible enough to do what you what, but we might need to ask on podman mailing list for anything specifics.
-Nick
On Thu, Dec 12, 2019 at 8:24 AM Dusty Mabe dusty@dustymabe.com wrote:
On 12/12/19 9:30 AM, Axel Heindrichs wrote:
Hi there,
Hi Axel,
We are following CoreOS CL with great interest, as we are running all
our k8s clusters on CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as from version 19.03.
Is there a plan to move to a higher version of docker in CoreOS? 19.03
or at least 18.09?
I don't know what the plans are for new docker versions in Container Linux.
What is the plan for Fedora CoreOS in this respect?
Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will probably be the next major fedora release (~April 2020) before that gets bumped higher.
Is it possible to replace/upgrade the version of docker in CoreOS
ourselves?
I don't know about Container Linux. For Fedora CoreOS you *could* package layer a different version rpm on top, but it might make Operating System updates less reliable.
I would be really grateful for an answer. Kind regards Axel
CoreOS mailing list -- coreos@lists.fedoraproject.org To unsubscribe send an email to coreos-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/coreos@lists.fedoraproject.org
On 12/12/19 11:50 AM, Nick Stielau wrote:
Thanks Dusty.
What's the latest on including Podman in Fedora CoreOS?
podman is in Fedora CoreOS and is a replacement for the docker CLI.
Axel, have you looked into podman at all? It is a drop-in replacement for docker in most cases, and should be flexible enough to do what you what, but we might need to ask on podman mailing list for anything specifics.
Since Axel is running kubernetes he'll most likely want to consider the GPU support in CRI-O (alternative K8s runtime), rather than podman as an alternative to docker. We might have some CRI-O experts that could weigh in on the GPU support there.
-Nick
On Thu, Dec 12, 2019 at 8:24 AM Dusty Mabe <dusty@dustymabe.com mailto:dusty@dustymabe.com> wrote:
On 12/12/19 9:30 AM, Axel Heindrichs wrote: > Hi there, Hi Axel, > > We are following CoreOS CL with great interest, as we are running all our k8s clusters on CoreOS (both VMware and bare metal). However we decided against CoreOS for one specialised Data Science bare metal cluster, based on blades with GPUs, as CoreOS still ships with docker 18.06.3. NVIDIA GPUs are natively supported as devices in the Docker runtime as from version 19.03. > Is there a plan to move to a higher version of docker in CoreOS? 19.03 or at least 18.09? I don't know what the plans are for new docker versions in Container Linux. > What is the plan for Fedora CoreOS in this respect? Right now we have moby-engine (docker) 18.09 in Fedora CoreOS. It will probably be the next major fedora release (~April 2020) before that gets bumped higher. > Is it possible to replace/upgrade the version of docker in CoreOS ourselves? I don't know about Container Linux. For Fedora CoreOS you *could* package layer a different version rpm on top, but it might make Operating System updates less reliable. > I would be really grateful for an answer. > Kind regards > Axel _______________________________________________ CoreOS mailing list -- coreos@lists.fedoraproject.org <mailto:coreos@lists.fedoraproject.org> To unsubscribe send an email to coreos-leave@lists.fedoraproject.org <mailto:coreos-leave@lists.fedoraproject.org> Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/coreos@lists.fedoraproject.org--
Nick Stielau He/Him/His SFO, OpenShift
CoreOS mailing list -- coreos@lists.fedoraproject.org To unsubscribe send an email to coreos-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/coreos@lists.fedoraproject.org
If you want to use GPUs with CoreOS and Docker 18.06.3 you need to use the following: https://github.com/NVIDIA/nvidia-container-runtime, which installs a custom runtime and a prestart hook that is called by this runtime to enable GPUs in the container.
I wouldn't call the GPU support that comes with Docker 19.03 , "native", the only thing that this Docker version is doing is calling the nvidia-prestart-hook without the need to install the custom runtime. It is a hardcoded call of the prestart hook in containerd.
If you use GPUs with Fedora CoreOS, you only need to install the nvidia-prestart-hook, the Docker version that comes with Fedora can natively execute any prestart hooks (all OCI hooks are supported). Fedora or RHELs version of Docker use runC as the runtime.
coreos@lists.fedoraproject.org
-
Axel Heindrichs -
Dusty Mabe -
Nick Stielau -
Zvonko Kaiser