I would cut the inside plywood to fit the entire inside transom wall and the outside plywood to span the whole width of the transom. Start with that as a minimum and watch for flexing, signs of rivets getti loose, etc.
Mudmotors put a lot of pressure on a transom. The transom on my sportboat...