Notation | Attention layer type | Feature fusion structure |
---|---|---|
Self-attention-based Bi-LSTM | Self-attention mechanism | Pyramid-like feature fusion |
Attention-based Bi-LSTM | Attention mechanism | Pyramid-like feature fusion |
Bi-LSTM Without attention | Without attention mechanism | Pyramid-like feature fusion |
Fully fusion with self-attention-based Bi-LSTM | Self-attention mechanism | Fully feature fusion |
Fully fusion with attention-based Bi-LSTM | Attention mechanism | Fully feature fusion |
Fully fusion without attention-based Bi-LSTM | Without attention mechanism | Fully feature fusion |