« Women of Internet Marketing Wednesdays - Part 27 | Main | Search Enging Strategies Chicago - Early Bird Rate Expires Today »

November 14, 2007

Compete Search Analytics - My Review

By Alex Cohen

Compete.com, a competitive intelligence tool in the family of Quantcast and HitWise, recently launched a new search analytics tool. I got a tour with Product Manager Jeremy Crane.  Overall, I think the product provides some useful basic functionality at a great price and a few clever features.  One major issue can limit your insight (see the caveats).  Read on for my full review of Compete Search Analytics.  I have a lighthearted discussion of the competitive intelligence market over at Digital Alex.

Full disclosure (see WOMMA guidelines): Compete's PR agency gave me some free credits (20 credits or $40 worth) to play with the tool.

What You Can Learn From Compete Search Analytics

Essentially, Compete Search Analytics is a competitive intelligence and keyword discovery tool with a few basic functions:

  1. Keyword Referrals - Learn which sites receive traffic from a word.
  2. Site Referrals - Discover the phrases that bring visitors to a particular site
  3. Compare Sites - Essentially the same as site referral, just with the ability to compare the results side by side.   

The data are reported for a rolling 90 days.  Reports usually cost 1 or 2 credits ($2 - $4).  Expanded reports, such as the complete list of thousands of keywords that brought users to a site, cost 10 credits ($20).

How To Use Compete Search

Aside from the obvious ability to do some competitive intelligence and keyword research, I think there are a few interesting ways to get the most out of the tool.

  1. Keyword Share - If you're targeting a particular basket of keywords, you can determine how much of the share of traffic from those keywords you're getting vs. your competitors.  Compete calculates the share for you directly. 

    Compete does not report an estimated volume of referrals from a particular word for a site in this report.  If you want that metric from this data, you'll need to export the data and calculate it thusly Average Monthly Referrals * Site Share = # keyword referrals for a site. 

    This report can also be useful for uncovering competitors you never even knew you had.  You can examine their sites to size up the competition and, perhaps, integrate their brand terms into your PPC campaigns (in compliance with the rules of the various engines).  Hat tip to Avinash for talking with me about keyword share down at eMetrics.

  2. Browse By Category

    One of the more interesting features in the site referrals report is that you can browse by category of sites, Job Search sites, for example.  The categories they list are Compete's current standard taxonomy based on the work they've already done on consulting projects (they do custom work as well, just like comScore.

    They don't always have a a category that corresponds to the industry you're looking for.  Jeremy says they may add more categories in the future and reveal which sites are in each category.  Next year's features may include custom segmentation based on the X domains that you're interested in.

    Not all of the segments seem to have reliable data, sometimes you get some surprising and humorous results, which I noted over at Digital Alex.

    I compiled the complete list of site categories at the bottom of this post.   

  3. Browse by Lifestyle Segment

    Even more interesting than category segments are the behavioral segments.  These reports attempt to lump together the keywords that interest particular groups of users, such as Bargain Hunters or LGBT (lesbian, gay, bisexual and transgender).  The data are based are sites that "fill into the realm of that behavioral group". 

    This is an interesting and potentially useful tool for media planners depending upon how reliable the data are (see Compete's data collection methodology here).  Democratic candidates take note: I ran the report for the Liberals and apparently Huffington Post and a site call Common Dreams news top the list.  Better work those PR contacts.

    The complete list of behavioral segments is also at the end of the post.

Caveat 1: Is This Organic or Paid Traffic?

Perhaps the biggest drawback to Compete Search Analytics is that it does not distinguish whether a site is getting traffic from organic or paid search.  This can lead to some confusing analysis. 

Jeremy says Compete hopes to to break out paid search in some form in a future release, hopefully by the end of 2007.  That would be one sweet stocking stuffer for the web analytics community, since even Hitwise doesn't separate these data.  It's a tall order, however, since many of these data are stored in destination URLs and campaign IDs that come in more variations than I can count.

Key Metrics and How They're Calculated

Keyword Engagement

The site level reports, like site referrals, report a "Keyword Engagement" metrics.  Compete is just using a different name for time on site (as opposed to something like Eric Peterson's more in depth assessment of engagement). 

As you may have known from following any of the web analytics blogs, there is no standard for how to calculate average time on site.  Google Analytics time on site has changed more than once.

For the record, Compete Search Analytics does include single page visits in their time on site metrics. What's interesting about Compete's calculation vs. typical tag based web analytics is that every URL event has a timestamp, so they can get time on site for single page visits.  As with regular sites, there is no way to adjust for tabbed browsing. Jeremy says they throw out referrals for weird outlier phrases that would distort results. 

The time on site for keywords are indexed against each other with 100 having the most time and 1 the least.  I'm not particularly fond of time on site, especially in isolation.  At least showing the average time on site and labeling it as such would be a start.  

Keyword Effectiveness

Effectiveness, as Compete defines it, is a combination of the volume of traffic a keyword brings and the time on site.  Again, the same limitations that apply to time on site will apply here as well.

I asked Jeremy why they aren't including other metrics for engagement or effectiveness, such as bounce rate, page views, etc.  Evidently, they do plan to add more columns (metrics) in upcoming releases.

Jeremy's Tip
When you're looking at the Compare Sites report (which lets you contrast keyword searches and "engagement" on 2 sites) and you see both metrics as >1000%, you can assume almost no one is going to the 2nd domain you're comparing.

He suggests looking at category terms and compare volume and engagement to see who's winning in the non-brand areas.

Future Changes to Compete Search Analytics

Jeremy gave me a glimpse into what the future may hold for the product.  Dates, I'm sure, are subject to change.

  • May offer filtering tools for keyword data after the purchase, also things like related terms
  • An enterprise solution could be on the way
  • Selectable time frames will eventually be available, possibly in the first half of 2008
  • Eventually, flexible rollup of keywords (you need a certain amount of data to get long tail terms)
  • Trended data for high volume terms, domain (100s of unique visitors required) in the second half of 2008
  • Engine breakouts, related terms
  • undefined access in the future, including integration for bid management tools
  • More columns in reports, such as page views and bounce 

Caveat 2: No Love For Subdomains

If the site your most interested in analyzing happens to reside in a subdomain, you're out of luck. Compete Search Analytics reports are not available at the subdomain level. 

It also appears that Compete might be lumping subdomain data into the main domain.  Based on a report I ran for Commerce360's website, you might think Maine Senator Susan Collins was on Commerce360's board.  Actually, she was the subject of a post at the Commerce360 blog. 


Areas For Improvement

Judging from the list of upgrades in the works that Jeremy mentioned, I expect the a continual stream of updates to come out of the Compete Search Analytics camp in the coming quarters.  Aside from the aforementioned caveats, there were several things I noticed that could be easily remedied.

  • Export Options - Right now you're stuck with a CSV.  It would be nice to have a few more options: PDF, Excel, Google Docs, etc.  Being able to share the data with the charts intact is easier than recreating them or grabbing a screenshot.
  • Report Subscriptions - Currently, when you run a report you only have access to that report for that day's snapshot and you need to download it for posterity.  Running the report when you log back in another time costs credits.  Apparently, it's storage problem to retain everyone's old reports.

    One thing I suggested to Jeremy is that they let you "subscribe" to a particular report and be permitted to access that report whenever you want.  I'd love to be able to buy the reports for my client's once and never have to worry about been nickled and dimed every time I wanted to see the updated data.  20 credits?  50 credits?  Compete would have to work out the LTV and the potential effect on sales of other reports for regular user, but I think it could be done.

  • Better Sorting Options - Whenever you get keyword data, it's ranked in such a way that all you really see are head terms in the top 50.  You have to spend $20 to get the full list.  It would be great if you could filter and sort the data to hone in on the things you're looking for without having to shell out all 10 credits.
  • More Data Transparency - Regarding the keyword engagement metric, I disagree with the choice of the word "engagement", since it presents a picture of involvement with a site based on only one metric. 

    It's okay if you want to show time on site, but at least show the actual values next to the engagement calculation and label it as time on site.  Is the top performer 5 seconds and the bottom one 1 second or is it 600 seconds vs. 500 seconds?  There's no sense of scale here.  

For Search Marketing Gurus, Alex Cohen of Digital Alex

This is a complete list of the site categories and behavior segments available in the site referral report  in Compete Search Analytics.  Just pick a category of sites or behavioral segment and find out which words most often lead to sites in that category or sites favored by that segment.  I've noticed some quirky results in an off few of these reports, so just use common sense when interpreting the data.


  • Automotive Dealers
  • Automotive Information
  • Automotive Manufacturer
  • Parts
  • Vehicles


  • Blog
  • Technorati 100

Career and Education 

  • Associations/Development/Resources
  • College and University
  • Job Search
  • K-12
  • Online Classes
  • Student Resources
  • Test Preparation

Entertainment Guide 

  • Films/Television/Music/Books
  • General Entertainment
  • Museums and Galleries
  • Nightlife
  • Performing Arts
  • Restaurants and Dining
  • Television and Radio

Excluded Sites 

  • Error and Internal Sites
  • Spyware and Virus

Financial Services 

  • Auto Financing
  • Banking
  • Brokerage
  • Credit Cards
  • Credit Reporting
  • Financial Media
  • General Loan
  • General Services
  • Home Loan Financing
  • Insurance
  • Investment Banking
  • Online Payment
  • Real Estate
  • Tax Services


  • Gambling
  • Leisure Gaming


  • Federal
  • Foreign
  • Military
  • State and Local


  • Alternative
  • Companies and Drugs
  • Dieting/Fitness/Beauty
  • Female Health
  • Geriatrics
  • Hospitals and Research Centers
  • Information and Support Networks
  • Insurance and Physicians
  • Male Health
  • Pediatrics

Hobbies and Interests

  • Celebrity
  • Computer and Website Personalization
  • Cooking
  • Crafts
  • Environment and Nature
  • Fashion and Style
  • Games
  • Genealogy
  • General Interest
  • Home Improvement
  • Humor
  • Motorcycle/RV/Drag Racing
  • Movies
  • Music and Artists
  • Photography and Art
  • Politics
  • Reading and Writing
  • Science
  • Sports: Fantasy
  • Sports: General
  • Technology
  • Volunteer and Non Profit

Incentive Programs 

  • Freebies and Marketing Promotions
  • Paysite
  • Rewards Program
  • Survey Site

Music and Video

  • File Sharing
  • Music
  • Radio
  • Videos

News and Media 

  • Journals and Professional Magazines
  • Magazines: Automotive
  • Magazines: Business
  • Magazines: Entertainment
  • Magazines: Hobbies and Interests
  • Magazines: News
  • Magazines: Sports
  • News: Business
  • News: International
  • News: Other
  • News: Regional
  • News: Sports
  • News: Weather and Traffic
  • News: World
  • Social Generated News


  • General
  • Specialized


  • Consumer and Industry Electonics
  • Food
  • General Merchandise
  • Household Goods
  • Internet Security
  • Miscellaneous
  • Packaged Goods
  • Software/Downloads/AddIns


  • Citation and Formatting
  • Consumer Reviews
  • Dictionary/Thesaurus/Encyclopedia
  • Lifestyle
  • Maps/Atlases/Almanacs/Satellites
  • Topical
  • Translation


  • Coupon and Bargain
  • Document Search/Business Database/Research Tools
  • Image
  • Regional
  • Shopping
  • Specialty
  • Universal


  • Ad Networks and Servers
  • Assorted
  • Business
  • Cleaning/Home Remodeling/Landscaping
  • Telecommunications
  • Webhosting


  • Apparel
  • Auction
  • Books and Magazines
  • Children and Baby Needs
  • Digital Printing
  • Electronics
  • Entertainment
  • Food and Groceries
  • Games/Music/Movies
  • General and Department Store
  • Health and Beauty
  • Home and Garden
  • Jewelry
  • Office and School Supplies
  • Rebates
  • Shoes and Accessories
  • Software and Downloads
  • Specialty and Hobbies
  • Sports and Fitness

Social Networking

  • Personal
  • Professional


  • Aggregators
  • Air: Airlines
  • Air: Airports
  • Air: Promotional Sites
  • Bus and Train
  • Car Rental
  • Corporate Site
  • Cruise: Agencies
  • Cruise: Cruiselines
  • Lead Generators
  • Lodging: Casinos
  • Lodging: Hotel Chains
  • Lodging: Hotel Properties
  • Lodging: Independent and Resorts
  • Lodging: Promotional Sites
  • Lodging: Property Management
  • Redirects
  • Search Engines
  • Technology Providers
  • Theme Parks
  • Tour Operators
  • Tourism and Guides
  • Transportation Services
  • Traveler Information
  • Vacation Packagers
  • Vacation Rental

Web Analytics

  • Competitive
  • Local

Web Communication

  • Calendars and Address Books
  • Dating Network
  • Ecards
  • Email
  • Evites
  • Forums
  • Messaging and Chat
  • Photo Sharing


  • Accessories
  • Agent
  • Carriers
  • Content
  • MVNOs
  • OEMs


  • Adult

Behavioral Segment

  • African American
  • Asian
  • Auto Enthusiast
  • Automotive 3rd Party
  • Automotive Domestic
  • Automotive Imports
  • Bargain Hunting
  • Conservative
  • Environmentally Conscious
  • Family Interest
  • Female Interest
  • Hispanic
  • LGBT
  • Liberal
  • Male Interest
  • Premium Brand Driven
  • Religion
  • Senior
  • Sports Enthusiast
  • Teenager

For Search Marketing Gurus, Alex Cohen of Digital Alex


TrackBack URL for this entry:

Listed below are links to weblogs that reference Compete Search Analytics - My Review:


Alex, thanks for posting, I bought credits some time ago, and then sat on them, and just today started playing with it, your post should help us tremendously save time. Much appreciated.

Hey Wil,

You're very welcome! Even with the many caveats, I do think it's at least worth exploring.

The cheapest thing to do is to buy reports for your top 5 most important keywords and see if you find any surprising competition.

Drop me a line if you get stuck.


Compete search analytic have SEO and SEM tools that helpful to search the competitors, keyword strategy and so on. That is the best competitive tool. It is also use in the beta testing. http://www.natural-skin-care.us

The comments to this entry are closed.

Get SMG Today - Free!

Get SMG by RSS What Is RSS?
Get Search Marketing Gurus Today via RSS! Add to Google Reader or Homepage
Add to netvibes
Get SMG in Your Bloglines
Get SMG in Your NewsGator Online

Get SMG by E-Mail
Subscribe to SMG via Email
Enter your email address:

Delivered by FeedBurner

SMG Conversations

If You Like SMG Favorite Us on Technorati!
Add to Technorati Favorites
If You Like What SMG Has To Say, Joins Us At These Places!
Subscribe on YouTube to SMG's Videos
follow Li on Twitter
Follow Li on FriendFeed

Copyright 2006, 2007, 2008 SearchMarketingGurus.com