Since what you're thinking about making is similar to a petit four, this KAF blog post on petit fours might help, freezing the cake before cutting it may cut down on crumbs.
Petit Four Blog Post
The petit four cutters we have are about 2 inches deep, which is a good half inch deeper than any other cookie/biscuit cutters we have.