Came here to say this.
I work with a lot of 19th century furniture and I see a lot of plaster filler in smaller voids.
It's generally mixed with red/brown brick dust to colour it.
It doesn't seem to age very gracefully and can stand out, so I remove it (if I'm restoring and not conserving).
I use coloured hard wax to fill any smaller holes now.
Looks fine under shellac polish.