Millionaires in posh UK seaside town fear badgers could cause homes to collapse