Why didn't the English speak Gaelic?

The Irish and the Scottish both spoke versions of Gaelic. Scotland and Ireland are both adjacent to England. Being so close to these Gaelic speaking countries how come England never spoke a version of Gaelic?