The Commodore PET sounds beautifully -ahem-, so it would be a shame to leave your replica without a pair of stereo speakers. Grab one of this Audio amplifier board, a Speaker and cannibalize an Audio jack you might have around. A little more wiring and you should be good to go:

You don't really need stereo, right?