The Brexit Party has expelled a local councillor and dismissed a part-time official after they were filmed making racist comments.