From Stream to Lake: Thinking About rsyslog as the River System Behind Your Data

I recently had a discussion about data lakes. It made me realize that people often picture them as the starting point of data collection — as if all information somehow appears in the lake. In reality, no lake exists without rivers. And in the world of IT systems, rsyslog is part of that river system.

rsyslog is the river system that feeds your data lake. (Image: Rainer Gerhards via AI)
Continue reading “From Stream to Lake: Thinking About rsyslog as the River System Behind Your Data”

Outdated readthedocs problem solved!

I am glad to tell that I finally managed to solve an issue that caused confusion for years. Someone had cloned and published the rsyslog documentation at readthedocs. Unfortunately, it was not maintained afterwards and also looked like an official rsyslog doc. That added a lot to the “rsyslog’s doc is bad and inconsistent” feel inside the community. This could now be resolved, and current, official doc is now available at readthedocs. I am very happy and glad for readthedocs staff members who helped us to finally resolve the issue.

The current rsyslog documentation is finally shown at readthedocs. (Screenshot: 2025-09-18, Rainer Gerhards)
Continue reading “Outdated readthedocs problem solved!”

Status update: omhttp, CI, backlog, and containers

Time goes fast, it is Sep 10 already. Mid August I said we will do a great refactoring of omhttp within a week or two. Well, that did not work out as planned. We still made solid progress, but more pressing work put it on hold for a bit. Time for a small update of what is happening in rsyslog.

Symbol image for “Status Update” type of postings. (Image: Rainer Gerhards via AI)
Continue reading “Status update: omhttp, CI, backlog, and containers”

rsyslog becoming target for social engineering PRs? Lessons learned.

In the past days I noticed PR patterns that do not look right. This is a smell, not a verdict. The upside is real: rsyslog is interesting enough to attract attention. That is actually great news. Now we have the problem ourselves, and that is the moment to engineer the right guardrails without losing our welcoming tone. You need to be a target in order to gain sufficient experience to tackle that hard problem.

IT Security (Symbol Image: Rainer Gerhards via AI)
Continue reading “rsyslog becoming target for social engineering PRs? Lessons learned.”

When Humans and AIs Overthink: a “complex” rsyslog crash that wasn’t

I chased a rare crash in highly-threaded code. It popped up now and then; earlier fixes didn’t stick. I suspected an advanced concurrency issue. I also asked Gemini, Copilot/Codex, and Claude for help. They agreed with me: surely something subtle—epoll, re-queueing, ownership flags…

Human and AI thought bubbles full of tangled lines; a small check mark off to the side.
My AI use on images as inferior, as you can see here. I hope you like that fact ;-)

We were all wrong—and, importantly, I was wrong in the same way the AIs were. Their analyses reinforced my initial hypothesis. The fact that the static analyzer reported nothing reinforced it even more—after all, that’s “proven non-AI tech.” In hindsight, if I had thought earlier about the limits of these tools (AI and non-AI), I might have changed direction sooner—but I was also primed by experience: in this part of the codebase, bugs are almost always complex.

Continue reading “When Humans and AIs Overthink: a “complex” rsyslog crash that wasn’t”

Dogfooding the rsyslog Commit AI Assistant

I’ve been using AI to help with commit messages for a while now. Yesterday, in a discussion with co-workers, it became clear that this may not just be a convenience feature — it’s turning into a real time saver.

That was the background for creating the new rsyslog Commit AI Assistant. It directly addresses a problem we ourselves face in daily development. True to dogfooding, we now use it internally whenever we craft a commit message — myself included.

The “rsyslog commit assistant” in action. You can even see my typos ;-) (Screenshot: Rainer Gerhards, actual session)

Want to give it a try: use the rsyslog commit Assistant.

Continue reading “Dogfooding the rsyslog Commit AI Assistant”