Meaning
A distributed attention algorithm that passes key-value blocks in a logical ring across accelerators to support ultra-long contexts.
Articles Featuring This Term
Related Terms
- Integer Factorization Prime Number Decomposition
- Area Under the ROC Curve (AUC) Overall Classifier Accuracy Score
- Neural Vocoder
- Native Multimodal Architecture Unified Sensory Foundation Model
- Sensitivity and Specificity Detection vs False-Alarm Rates
- DualPipe Computation-Communication Overlap Parallelism
- Self-Attention Dynamic Contextual Weighting
- Group Relative Policy Optimization Critic-Free Group Policy Optimization
- Side-Channel Attack Hardware Telemetry Leakage Attack