Only real place to find out what google is doing on the site
Find crawl errors / palces that bots are getting lost, going round in circles
You wouldn’t build a house on quick sand so don’t build a nice website of lose foundations
Getting the data, I could spend hours talking to you, and showing you – but I only have 20 mins so follow this bit.ly link for a article I have written in advance
Forget about big data – you just need to analyse the key bits of data.
We only care about google so just look at what activity Googlebot is doing