As kids, my brother and I would play the Cow Game on long drives where each of us got to count cows that appeared on our sides of the car. If you had to cross water, you lost half your cows. A cemetery meant all your cows died. I assume that's how the Game of Thrones was played too.
