Yes, much like wet streets are a high predictor of rain. Or smoke, firefighters and wood are a high predictor of fire. The firefighters are not causing the fire, neither do the wet streets cause rain. This is what people are trying to tell you. If you remove the firefighters only, then you might make it worse. If you do something to cause the firefighters to go away, probably because there isn't a fire anymore, then you did the right thing. The important thing is not to goodhart's law yourself into doing the wrong thing.
This would be a fair analogy if we didn't have studies with a temporal component, but we do. We look at individuals before they get disease then track them over time to see what predicts disease. So we can see, per your analogy, that the fire is there, then the firefighters turn up.