They don't do it all at once, but according to a sort of clock: a certain fraction of the nuclei will decay in a certain period of time.
Like how popcorn pops. They don't pop all at the same time, but you know that after two minutes, they will all pop.
Though, popcorn is classical randomness (different masses, compositions.) Nuclear decay is due to quantum randomness.