Jamieson, Fausset and Brown on Hebrews 10:3

3. But--so far from those sacrifices ceasing to be offered (He 10:2).

in, &c.--in the fact of their being offered, and in the course of their being offered on the day of atonement. Contrast He 10:17.

a remembrance--a recalling to mind by the high priest's confession, on the day of atonement, of the sins both of each past year and of all former years, proving that the expiatory sacrifices of former years were not felt by men's consciences to have fully atoned for former sins; in fact, the expiation and remission were only legal and typical (He 10:4, 11). The Gospel remission, on the contrary, is so complete, that sins are "remembered no more" (He 10:17) by God. It is unbelief to "forget" this once-for-all purgation, and to fear on account of "former sins" (2Pe 1:9). The believer, once for all bathed, needs only to "wash" his hands and "feet" of soils, according as he daily contracts them, in Christ's blood (Joh 13:10).