We had a playtest session last night. We were testing an entirely new system that works very differently from what we’re used to so the action was halting. I wrote it but I didn’t know if I was doing it right, mainly because I don’t yet know what “right” is for this system. That’s one of the unique things about playtesting. It’s not like GMing where you are enforcing rules and interpreting them. With playtests there are a lot of times when you don’t know what the rules should even be.
Playtesting is also a weird mix of GM fiat and paying attention to what the players want, even subconsciously. One of the first things to look for is frustration. If you spot it in a playtest session, you have to quickly go from GM to product development and ask them what makes the situation frustrating. Unfortunately in most situations the player won’t know how to answer that. A second line of questioning can go along the lines of what they would want to happen in that situation.
As the game writer, playtesting is also an odd experience because players are used to me knowing how the game is supposed to work. One of the players that was there for the initial development of The Artifact remembered this stage and how you’re not really sure how any of it is supposed to work. Keeping up the illusion of system mastery is tricky because I don’t have a mastery of it, there may barely be a system to master. Letting the illusion drop is problematic because then the players want to change everything. When that happens, the game grinds to a screeching halt because no one has the confidence to proceed.
For the whole session, as a designer and as a GM, I may realize that something is just not working. If I change it mid game, it will break the illusion of mastery of the game’s vision. There’s the temptation to change it right away but sticking with a bad rule can be very informative. It tells me not only that the rule is bad but can also show why the rule (or concept) doesn’t work. With that information it’s far easier to come up with a rule that does work well.
Playtesting can be deeply frustrating but it is also frequently rewarding. Some of the simplest solutions to problems come up when you’re under the gun to explain to a player how they can do what they want to do.