Gathering Data

Gathering Data  Cleaning Data  Analysing Data  Presenting Data

SIP:Enterprise is all about monitoring what people say about your queries (your brand, your competitors, etc). To do this, we have built a large, distributed Crawler – a program which, similarly to how Google searches the Web, goes and visit websites from all around the world.

There is one big difference though: our Crawler visits the web in near realtime. That way, when someone mentions your query, we pick it up very quickly and can tell you about it right away. How do we do that? By having many servers (lots of them!).

These servers run 24/7, and cover all of the possible sources of information:

• Micro-blogging sites such as Twitter & Sina Weibo
• Blogs including Blogger, WordPress, Typepad and Sina
• Video sites including YouTube, Vimeo, Metacafe, Bliptv, Youku, Tudou
• Social networks such as Facebook ,MySpace, Renren and Kaixin.
• Discussion forums
• News sites, whether international, national or regional
• Images sites such as Flickr
• Corporate sites

and plenty of others.

All of these sources are covered regardless of their language. SIP:Enterprise understands many languages including English, Chinese, Russian, Japanese, Korean, German, Italian, Spanish, Dutch – and the list keeps growing.

Because we built our own Crawler, we do not buy our data from anybody else. This means we are not dependent on a data provider, whose costs we would have to push on to our Customers. It also means we are in total control of which sites we visit and what data we collect.

All of this means that whichever Query you track, SIP:Enterprise gives you the most complete coverage of Social Media, so you will not miss a mention and will always be kept up to date.