And, by the way, there are Web-site operators with more hits per day than Microsoft. Not to mention, Web-site traffic has just begun to build. But wait until there are a few hundred million Web-enabled information appliances operating out there. In other words, massive clickstreams growing at astonishing rates are here for a while. And, at the same time marketing analysts are wondering if they should have wished more carefully, database professionals are trying to figure out what in cyberspace to do.
Several approaches are in use.
They then summarize it, after which it captures about 1GB per day, and store it in a SQL Server database. They further aggregate the data into a set of cubes stored with Microsoft OLAP Services. About 350 analysts throughout Microsoft and partner organizations can access the OLAP cubes and drill through to the SQL Server database. In addition, the fully detailed, unaggregated clickstream resides in a separate database for batch reporting and data mining. They don't publicly disclose the size and retention period of this batch database.