TikTok is using AI to police its e-commerce platform, and sellers say it's doling out baffling violations that may push them to walk away