IPv6 packets can be routed via an IPv4 nexthop and vice-versa, so the
handling of the parsed address family is more strict than it needs to
be. If we have a valid header that matches a known peer, then we have
no reason to decline the packet.
Add a test case that approximates a setup like in the PR and
demonstrates the issue.
PR: 284857