I was wondering how Google indexed The Sun’s content but managed to get through the paywall the other day and thought I’d visit the site as GoogleBot, doubting really that my childish ruse would work.
It seems, however, that The Sun’s paywall really needs a bit of love and attention to stop people circumventing it.
Using default User Agent:
When using the site as GoogleBot:
How to spoof your User-Agent:
I use chrome, so I just downloaded User-Agent Switcher, selected GoogleBot and then refreshed the page.