The last time they should have come off much earlier. Umpire had then play through heavy rain and lightning, then they called it as soon as England got in front. Then they couldn't get off fast enough.They had to come off, but its not a good look when its immediately after the umpires were approached (probably, but not necessarily, about the rain).
Still, England can't complain given the earlier delay.
So bad luck for them.