Britain is a Protestant country. St George's day is principally a Catholic festival.
Furthermore Britain is a nation which is more than just England. A state backed knees up which so obviously snubbed Scotland was politically sensitive for most of our history.
But Granny says we used to go mental on it.
Granny has probably conflated it with Empire day.