Yeah, I really really like the idea of making the assy at the shop and installing it and trimming it out on site. You did say 3 sheets of drywall... so maybe it's pretty straight?
How thick is the ply veneer? I'd be concerned about getting faces within veneer thickness of each other. Otherwise you can't sand them flush.