We used small powder charges.

In this a Swedish navy cap lock pistol model 1854 is fired. Note the time from fire to bullet hitting metal.

https://youtu.be/sqgrpZ-2E6Y