When they want to. When they are interested they can probably handle it. Just tailor what you are doing to their needs.
My 6 and 10 year old play and have a great time. But we didn't pick it up until the 10 year old started asking serious questions and stating he wanted to play.