math/cglm: Fix build by removing -Werror
Reported by: fallout
(cherry picked from commit 1a984a49fb56983103648503784e507099d402be)