bug#29439: Quadratic complexity in sweep_markers

[Pip Cet]

Thanks! It is.

Of course, with markers being relatively expensive anyway, a
doubly-linked list would also solve the issue and be easier to
understand.