Turns out there was a leak in the bottom. Here are a few pics:
Closeup:

This looks wide from the top, but was thankfully hairline underneath. Water drips out when the plastic is warm - hence why I didn't notice it when I treated the water and it was still cold.
To give perspective (crack is on the left):

And here's some detective work. Left is a new chutney barrel, right is the barrel with the leak:

Notice how the bottom which touches the ground is bent up. It has melted at high temp and stayed like that.
From the side:

You can see it's been pushed up by about a cm. Must be putting quite a lot of stress on the plastic!
So, be careful using these boilers. Turns out chris was right
