#inference optimization

End-to-End Test-Time Training: Making Long Context Work Without the Memory Tax

How TTT-E2E achieves constant inference latency regardless of context length by treating long context as a learning problem rather than an architecture problem.