sctp: don't consider the interface name when removing an address

Checking the interface name can not be done consistently, so
don't do it.

(cherry picked from commit bf11fdaf0d095fecca61fa8b457d06e27fae5946)