You almost certainly have what is called water hammer. There are a couple of solutions, the first (and the easiest) is fit an equilibrium ballvalve on your cold water storage tank. The valve will be about £20.00. Turn off your stop valve on the incoming main (that will be under your kitchen sink/in ...
