Farmers could ditch Tories at election if rural vote ignored