Templating the groups doesn't improve performance that much, but it severely hinders usability. Switch things to be dynamically sized so that different ranked groups are the same type.
Could also now separate headers and implementation... but will probably leave it for now.