Welcome To...
Do I lose a City Plan, goal or pool points if zombies later overrun a house I used?
The designers ruled on this several times between 2019 and 2020.
No. Points for a plan or goal that was already scored and for a pool that was already built stay with you. You do lose the end-game estate points, since the estates become smaller or fewer.