By Mark Sweiger, President and Principal, Clickstream Consulting
This is the third in a series of articles that focus on the application of clickstream data warehouse technology to an e-business environment. In this installment we examine Internet search engines.
No matter what kind of e-business you run, there must be a good answer to the question, How do I drive traffic to my web site? As we noted in the last months column there are 10s of millions of web sites already on the Internet, and the statistical odds of anyone stumbling upon your place of e-business gets slimmer every day. You must invest in various kinds of e-business site promotion techniques to get the traffic to come your way.
Internet site promotion comes in many forms, not all of which are under the direct control of the e-business. The prime example of this is search engines, which provide a path to your sites content assuming the search engine indexes your site. Getting search engines to index your site is not necessarily automatic or timely, and what they index is problematic-subject to the widely differing indexing approaches of various search engines. There is also the issue of your links position in the search order for a particular query. Obviously, you would like to have your site as close to the top of the list as possible for relevant search terms. If your placement in the list is too low, beyond the first ten results, statistics show that there is very little likelihood that your link will ever be seen, much less acted on, by search engine users.
Suppose you put up a new Web site this month. You may be surprised to know that it will typically take at least 8 weeks for search engines to index your site, and even then your position in the search order for popular search terms will likely be far down the list. Worse yet, it may take much longer than 8 weeks for indexing if you do not manually submit your site to the search engines to get on their indexing queues. It is very important to submit your site to all of the search engines on a regular basis until your site traffic builds enough that the search engines seek it out as a popular destination. But even more important is the design of your web pages to highlight certain keywords that users will likely use to find your site. Site pages must be designed to highlight appropriate search keywords that get your URLs into the Top Ten search order positions for the most widely used search engines.
Lets illustrate this problem with an example. Suppose your e-business had a new product that was used to do clickstream log file analysis. A good home page keyword for the search engines would seem to be clickstream. You can test this keyword to see how often it was used as a search term in the prior month at the GoTo.com search engine site using the following GoTo Suggestion Tool:
http://inventory.go2.com/inventory/Search_Suggestion.jhtml
At the time of this writing, entering the keyword clickstream produced the following statistics for all indexed search term phrases containing at least that keyword:
| Count |
Serarch Term |
| 108 |
clickstream |
| 54 |
clickstream analysis |
| 27 |
clickstream consulting |
| 23 |
clickstream data |
| 11 |
clickstream analysis software |
| 11 |
clickstream data warehouse |
| 10 |
clickstream processing |
| 8 |
clickstream data processing software |
| 8 |
clickstream processing software |
This means that in the prior month, there were 108 search queries on the term clickstream: to the GoTo.com search engine. But the statistics show that the second most used search term, clickstream analysis, was used 54 times, meaning that this phrase would also be a good keyword to emphasize in homepage content. But, before we get too excited, lets test the name of the most popular commercial clickstream log file analysis tool, WebTrends, as a search term. Without reproducing the entire table, the term WebTrends was searched 1,470 times by real users during the same time period, more than an order of magnitude above more general terms like clickstream and clickstream analysis.
In the cruel world of Internet search engines, this means that if your homepage mentioned the name of your primary competitor, WebTrends, at a sufficient level to get a good search position on that term, at least 10 times more potential customers might see and act on your URL than in a search on the more generic terms of clickstream or clickstream analysis. You see, it doesnt matter what keywords youd like users to search upon, they choose the terms, not you. But almost no e-business employee I know would even consider mentioning the name of their primary competitor with enough frequency to rise to a top search position unless they change their thinking to fit the unusual environment of the Internet. And as this example demonstrates, without such new thinking your revenue potential could be cut by a factor of 10 or more.
There are quite a few software tools that can help you deal with search engines. Some of the standouts include Trellians Submit Wolf (www.trellian.com) which automatically submits your sites homepage URL to 1500 search engines and web directories for indexing. 1st Place Softwares WebPosition Gold (www.webpositionoline.com) also submits your site to the search engines, but, in addition, it tests the search result rank of any site page/search term combination against all the popular search engines, and it makes suggestions on how to alter page content to get a better search ranking on a per search engine basis before you submit it for indexing.
Since maintaining a good search ranking for the desired set of search terms is a constant battle against competitors trying to do the same thing, many sites opt to subscribe to a service that does this never-ending task for them. While many of these services use software tools like Submit Wolf and WebPosition Gold, they also typically hand-edit page content and meta tags to guarantee a search rank level (like Top 10 or Top 20) for a fixed set of keywords. A good example of a provider of this type of service would be Webster Group International (www.wgi.com).
I should also mention that it is possible to buy your way to the top search position of one major search engine, GoTo.com. While this site eventually indexes all content without any specific payment requirement, the position of a link in the search order is determined by a continuous auction for the top position. For example, at the time of this writing, searching for the term data warehousing at GoTo, produced the following top three links:
<
> www.searchbuilder.com (Cost to advertiser: $0.38)
<
> www.ringdale.com (Cost to advertiser: $0.37)
<
> www.hotdwjobs.com (Cost to advertiser: $0.35)
In this example, GoTo charges Searchbuilder.com $0.38 for every clickthrough on the search term data warehousing, Ringdale.com is charged $0.37, and HotDWJobs.com is charged $0.35. If HotDWJobs.com wanted to be first in the search order, they could increase their position bid to $0.39 and edge-out SearchBuilder.com in subsequent searches. The position bidding is done by interested parties as a continuous, real time auction.
In next article, we explore more mechanisms for site promotion by analyzing the many faces of online advertising. Dont miss it.
|