xdma: Fix -Wunused-but-set-variable warnings
MFC after: 1 week
(cherry picked from commit d90c3b51cc3a15235054a5823928e8b654697768)