It turned out that about 70% of the airbricks at the eves (soffit board area) were blocked. Clearing these, running a dehumidifier for a bit and the weather warming up seems to have solved the problem. Hopefully with the ventilation uncovered it won't come back.
