Hey there 馃憢, I'm Bjoern, and I share what I've learned from building a B2B product that relies on Celery, the Python task queue 馃挭.
Imagine this: You are interacting with a web app where you upload an Excel workbook. When the upload is finished, the app lets you browse the workbook content, its version history and shows you the diffs between versions. Deep down in the engine room...
Before I wrote this article, I hadn't realised that SQLAlchemy is a highly controversial subject. Heated discussions on Reddit and X. Love it or hate it. The full drama. The polarising nature of the internet aside, what is true about SQLAlchemy is, t...
Celery dropped support for Windows a long time ago, somewhere around version 4. Celery 3 was the last version to support Windows, and back in 2018, when I published the first version of this article, it was a somewhat acceptable workaround. Not these...
By default, Celery routes all tasks to a single queue and all workers consume from this default queue. You can change this behaviour by telling Celery which tasks to send to which queues. This is known as task routing. This is useful if you have slow...
Using Redis or RabbitMQ as a Celery message broker can feel a bit over the top when you are just developing locally. In this blog post, I show you a simple alternative: the filesystem as a message broker. Kombu Kombu is a messaging library that provi...
Do you know what an FKT is? It stands for Fastest Known Time across a specific route or trail. FKTs are popular among trail runners and ultra-distance cyclists. FKTs are not timed to a specific protocol and there is no claim on an official record. In...
The greatest pain in my local Celery development setup is the overhead of running and debugging multiple things and processes. Most of my Celery apps require at least three components: Web application (eg Django, FastAPI or Flask) Celery worker(s) ...
Load testing is a way to determine the capacity, stability and response times of your application. During a load test, some specialised load testing software simulates demand on your app by spawning concurrent users and collects metrics such as respo...
If you run Celery tasks to perform API requests or other input/output operations and you want to increase throughput, then this is for you. Greenlets Gevent is a Python library that provides lightweight, cooperative concurrency via greenlets. Greenle...
