Bidirectional Long-Range Parser: Efficient Sequence Understanding for Long-Form Data

BLRP, a novel attention mechanism, efficiently captures proximal and distant relationships between elements in long sequences by leveraging a local-window attention and a bidirectional aggregation technique, enabling competitive performance on challenging benchmarks across textual and visual domains.