#kubernetes
Tag
-
A beginner's guide to managing Kubernetes resources in Python with kr8s
Managing Kubernetes resources with Python has never been easier thanks to the kr8s Kubernetes client for Python.
-
Comparison of kr8s vs other Python libraries for Kubernetes
I’ve been working on kr8s for a while now and one of my core goals is to build a Python library for Kubernetes that is the most simple, readable and produces the most maintainable code.
-
Livestream notes: Replacing aiohttp with httpx in kr8s
This post will be updated with notes from the livestream throughout the day. Today I will be streaming some open source code refactoring.
-
Introducing kr8s, a new Kubernetes client library for Python inspired by kubectl
For the last few months I’ve been tinkering with a new Kubernetes client library for Python called kr8s.
-
Debugging Data Science workflows at scale
May 12, 2023 15 minute read #python, #dask, #kubernetes, #apache-beam, #google-cloud, #google-kubernetes-engineThe more we scale up our workloads the more we run into bugs that only appear at scale.
-
Running Jupyter in your Dask Kubernetes cluster
Did you know that the Dask scheduler has a --jupyter flag that will start a Jupyter server running within the Dask Dashboard?
-
Oversubscribing GPUs in Kubernetes
Sometimes I want to oversubscribe the GPUs in my Kubernetes cluster. This is especially useful when I’m developing but could also be useful in light workloads where you have ample GPU memory and don’t mind the occasional failure.
-
Quick and dirty way to pre-pull container images on Kubernetes
Sometimes when I give live demos with Kubernetes clusters I want to make sure that the container images I’m going to use are already pulled onto all of the nodes in my cluster.
-
How to check your NVIDIA driver and CUDA version in Kubernetes
When using GPUs with Kubernetes it can be important to know which driver and CUDA versions are installed on the nodes.
-
Using Dask on KubeFlow with the Dask Kubernetes Operator
Kubeflow is a popular Machine Learning and MLOps platform built on Kubernetes for designing and running Machine Learning pipelines for training models and providing inference services.
-
Goodbye Docker Desktop for Mac, Hello Colima
Today is the deadline for the license changes to Docker Desktop for Mac and Windows. This means that if you are employed at a company with more than 250 employees or your company makes more than $10m you need to start paying a subscription to continue using Docker Desktop.
-
Docker Desktop for Mac alternatives for developers
In a couple of days Docker will begin charging employees of companies with >250 employees to use Docker Desktop.
-
Running Kubeflow inside Kind with GPU support
This week I’ve been playing around with Kubeflow as part of a larger effort to make it simpler to use Dask and RAPIDS in MLOps workflows.
-
Quick hack: Adding GPU support to kind
This post has been superseded with this tutorial that no longer requires any code changes. Please read that instead.
-
How to create a Helm chart repository with Chartpress, Travis CI, GitHub Pages and Jekyll
Helm has become a pervasive tool in the Kubernetes community for packaging, managing, upgrading and distributing applications.
-
How to merge Kubernetes kubectl config files
Sometimes when working with a new Kubernetes cluster you will be given a config file to use when authenticating with the cluster.
-
Debugging Kubernetes PVCs
Sometimes I find that something goes wrong in a container and some data stored in a persistent volume gets corrupted.
-
Adaptive Dask clusters on Kubernetes and AWS
Originally published on the Met Office Informatics Lab blog on July 21st, 2017. Introduction This article assumes a basic understanding of Amazon Web Services (AWS), Kubernetes, Docker and Dask.