Lock Free vectors for fast concurrent writes
(ibraheem.ca)
from Arbitrary@reddthat.com to rust@programming.dev on 30 Jul 2023 19:02
https://reddthat.com/post/1051494
from Arbitrary@reddthat.com to rust@programming.dev on 30 Jul 2023 19:02
https://reddthat.com/post/1051494
threaded - newest
chunks: [AtomicPtr>; 64],
appears before the explanation of why 64 works, and was confusing at first glance since this is completely different than the previous use of64
, which was arbitrary. I was expecting a variable-size array of fixed-size arrays at first (using something like an rwlock you can copy/grow the internal vector without blocking - if there was a writer, the last reader of the old allocation frees it).Instead of separate flags, what about a single (fixed-size, if chunks are) atomic bitset? This would increase contention slightly but that only happens briefly during growth, not accesses. Many architectures actually have dedicated atomic bit operations though sadly it’s hard to get compilers to generate them.
The obvious API addition is for a single thread to push several elements at once, which can be done more efficiently.