John Wesley on Numbers 25:9

Twenty four thousand - St. Paul says twenty three thousand, 1Cor 10:8. The odd thousand here added were slain by the Judges according to the order of Moses, the rest by the immediate hand of God, but both sorts died of the plague, the word being used, as often it is, for the sword, or hand, or stroke of God.