Where ever there are joints/overlaps on a roof there is a risk of water entry if they have not been sealed properly,so likely you are right that the flashings around the chimney should be replaced. As of course you will need to get on the roof and repair from the outside I am not sure if you can DIY...
