MK Party's Floyd Shivambu says he won't join either the EFF or ANC and will instead consult on forming a new political party.