iot, coding, raspberry pi, redis, javascript, python,

Monitoring Redis Streams Consumer Group Lag with a Raspberry Pi Pico W

Simon Prickett Simon Prickett 1 min read
Monitoring Redis Streams Consumer Group Lag with a Raspberry Pi Pico W

When working with streaming data or any sort of system where a data structure acts as a buffer or queue betwen producers and consumers, we often want to know how far behind the consumers are with processing the data stream. This is commonly referred to as the consumer lag.

In this project, I build a visual representation of the lag for a Redis stream using new features of the XINFO GROUPS command added in Redis 7.

Screenshot from my live stream demonstrating Redis Consumer Groups
Redis Consumer Group overview from my live stream.

This was the seventh project in my Things on Thursdays IoT live streaming series.

In this first of two episodes, I demonstrate how Redis Streams Consumer Groups work. We also look at how to determine the lag for a given consumer group using features added in Redis 7.

Enjoying this article? Please consider buying me a coffee on Ko-Fi.
Your support helps to fund future projects!

In this second of two episodes for this project, I show you how to display a Redis Streams consumer group lag using MicroPython, a Raspberry Pi Pico W and some LEDs…

Main photograph by Cottonbro Studio on Pexels.

Simon Prickett
Written by Simon Prickett
Hugely Experienced Developer Relations Leader.