if_epair: fix race condition on multi-core systems

[grembo]

Summary

As an unwanted side effect of the performance improvements in
24f0bfbad57b9, epair interfaces stop forwarding traffic on higher
load levels when running on multi-core systems.

This happens due to a race condition in the logic that decides when to
place work in the task queue(s) responsible for processing the content
of ring buffers.

In order to fix this, a field named state is added to the epair_queue
structure. This field is used by the affected functions to signal each
other that something happened in the underlying ring buffers that might
require work to be scheduled in task queue(s), replacing the existing
logic, which relies on checking if ring buffers are empty or not.

epair_menq() does:
  - set BIT_MBUF_QUEUED
  - queue mbuf
  - if testandset BIT_QUEUE_TASK:
      enqueue task

epair_tx_start_deferred() does:
  - swap ring buffers
  - process mbufs
  - clear BIT_QUEUE_TASK
  - if testandclear BIT_MBUF_QUEUED
      enqueue task

As 13.1-PRERELEASE is affected, MFCing is imperative.

PR: 262571
Reported by: Johan Hendriks <[e-mail]>
MFC after: 3 days

Test Plan

https://people.freebsd.org/~grembo/hang_epair.sh

[grembo]

Minor style change

[kp]

This looks good to me. I'll give bz@ another day to comment and then I'll commit.

I've run my previous benchmarks, and I'm not seeing major performance effects of this patch.