Home > Analytics Tools, Google Adwords, Landing Pages, Omniture, PPC Basics > Tracking Paid versus Organic keywords in Omniture SiteCatalyst

Tracking Paid versus Organic keywords in Omniture SiteCatalyst

I received an interesting plea for help recently via e-mail regarding tracking paid versus organic keywords in Omniture SiteCatalyst.  Although many functions are available within vanilla installations of SiteCatalyst, and several settings can be added to implementations after the fact – the little guy is often left holding the stick.  It’s easier for Omniture to say, just buy Search Center, because well, 9 times out of 10, they make money that way.  For simple keyword tracking without incurring any residual fees, get ready to roll-up your sleeves.

Here is an excerpt from the e-mail I was talking about.

I’ve been searching omniture’s “knowledge center” for information / instructions / etc. to help me track paid search keywords in sitecatalyst. We’re tracking clicks/conversions on ads, but can’t seem to correlate keywords and ads in any kind of usable way. Omniture, of course, doesn’t shed any light other than to try to upsell me to SearchCenter, which is out of the question.

You have published a number of very interesting posts relevant to SiteCatalyst, and I believe there was one that alluded to tracking keywords in paid search with SiteCatalyst. I’m wondering if you might write a post sometime that outlines the steps one might take to do that?

-Jim

Dirty, just plain dirty.  First off, if anyone at Omniture is reading this post, and there is probably a good chance someone is, this is part of the reason your reputation isn’t stellar.  Just sayin’.

To Jim, I’m going to walk you through this, because no matter how many times I e-mail my own marketing folks, they don’t seem to get how to do this.  It might be easier just to point them to this post in the future.

What you’re interested in finding is in the administrator section of your Omniture web interface.  If you navigate to Admin -> Report Suites, this will bring up a list of all your “Report Suite ID’s”, with Site Title, and Base URL.  Select the report suite or suites in question (you can choose multiple), and hover over Edit Settings -> General -> Paid Search Detection.

You probably don’t have any entries in the “Current Paid Search Detection Rules”.  We’re going to add one.  If you want to use different tracking codes for different search engines, you can choose specific engines in the drop-down list.  I would recommend using one tracking code for all search engines to start.  If you simply enter “kw” or “keyword” or “kid” into the field and hit Add.  Once that’s done, you can start coding your search ad’s target URL with the keyword embedded, for example:

http://www.ppc-advice.com/index.php?kw=omniture

That will basically enable SiteCatalyst to recognize incoming referred clicks from any search engine as paid keywords.  By default, any keywords in your “Traffic Sources” report should enable you to correlate to Campaigns and Tracking code, but not necessarily “Pages” unless you specify a “Data Correlation” ahead of time.  Data correlations can be setup in the admin section as well, under Traffic -> Data Correlations.

For the most part, just getting paid and organic keywords segmented using the above configuration piece should help a lot on it’s own, but it is a bit of work going into the Adwords or Yahoo Search interface and making sure those codes are added.  Luckily, both systems enable you to automatically insert keywords into target URLs with the help of dynamic keyword insertion strings.  For example, in Adwords you would just input:

http://www.ppc-advice.com/index.php?kw={keyword:nil}

If you really want to get fancy, you can also use a campaign id in your target URL string, so that not only can you see the traffic referred to the site on the keyword level, but also on the tracking code level (for an entire ad group, for instance).  A very nice example being:

http://www.ppc-advice.com/index.php?kw={keyword:nil}&cid=omniture

So, next time Omniture’s support team tells you that you need to upgrade, think twice.  Sometimes you just need to get the right person on the phone, or drop magical words into the conversation to get a good solid response.  I hope what I provided here addresses most of your question.  If you need more information than what is provided within SiteCatalyst after following these instructions, and you have a big enough marketing budget to carry the additional burden, Search Center is a great product that can make your life easier.

However, the overall ROI you see in advertising spend has to make sense.  In your case, it sounds like it wouldn’t at this point.

  • Jim

    Garry,

    THANK YOU! Since I sent that request to you, I have been back-and-forth with Omniture “support” on this same issue. Lots of back-and-forth, but the end result was… nothing.

    I saw your email this morning, read the post, and I’m excited to give it a whirl. Your explanation looks so easy. Trying (unsuccessfully) to get the same clear answer from Omniture has been like pulling teeth (again and again).

    So, thank you VERY much, and I’ll report back as soon as we follow your instructions and test it.

  • Jim

    Garry,

    THANK YOU! Since I sent that request to you, I have been back-and-forth with Omniture “support” on this same issue. Lots of back-and-forth, but the end result was… nothing.

    I saw your email this morning, read the post, and I’m excited to give it a whirl. Your explanation looks so easy. Trying (unsuccessfully) to get the same clear answer from Omniture has been like pulling teeth (again and again).

    So, thank you VERY much, and I’ll report back as soon as we follow your instructions and test it.

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim,

    No problem at all. I hope it works out for you. At the very least, you can try this approach, then question support again with what you learn from your tests. You may have to enable a few correlations to get at the info you want.

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim,

    No problem at all. I hope it works out for you. At the very least, you can try this approach, then question support again with what you learn from your tests. You may have to enable a few correlations to get at the info you want.

  • Jim

    Garry,

    Thanks again for your time/thoughts on this. I have executed your suggestions — the “kw” addtion within the admin, and the addition of ?kw={keyword:nil} to the google ad URL.

    Now, how do I find the data?

    As usual, I can find my metrics on the ad itself within the SiteCatalyst report suite by going go Campaigns > Tracking Code > Tracking Code. How can I break down that ad-specific cid to see clicks/conversions listed for each key word? I can do a “breakdown” by “Search Keywords > All” but those show me what the search query was, not (specifically) the keywords.

    Could you please coach me through the next step — looking at the performance of the keywords within the ad?

    Thanks again for your help! Very kind of you.

    Jim

  • Jim

    Garry,

    Thanks again for your time/thoughts on this. I have executed your suggestions — the “kw” addtion within the admin, and the addition of ?kw={keyword:nil} to the google ad URL.

    Now, how do I find the data?

    As usual, I can find my metrics on the ad itself within the SiteCatalyst report suite by going go Campaigns > Tracking Code > Tracking Code. How can I break down that ad-specific cid to see clicks/conversions listed for each key word? I can do a “breakdown” by “Search Keywords > All” but those show me what the search query was, not (specifically) the keywords.

    Could you please coach me through the next step — looking at the performance of the keywords within the ad?

    Thanks again for your help! Very kind of you.

    Jim

  • http://blogs.omniture.com/author/bgaines Ben Gaines

    Garry/Jim,

    Omniture Client Services is committed to providing value, and not simply to up-selling where it truly is not in the best interest of the client; we apologize that the desired information has not been presented in the online Knowledge Base in such a way that finding it was clear and easy. Based on the feedback you’ve provided here, we have added an article titled, “How can I track my paid search listings as marketing campaigns in SiteCatalyst?” (KB ID 9408) to explain how to use built-in, non-SearchCenter paid search detection and campaign tracking in SiteCatalyst to view data for ad name, campaign, search engine, etc. to report on pay-per-click ROI. We appreciate that you have brought this need to our attention, and, as always, welcome any other feedback regarding support and documentation in Omniture products. Please feel free to contact me at [omniturecare] at [omniture dot com] if you have any additional questions or feedback on this addition to our documentation library.

    Thanks,
    Benjamin
    Omniture, Inc.

  • http://blogs.omniture.com/author/bgaines Ben Gaines

    Garry/Jim,

    Omniture Client Services is committed to providing value, and not simply to up-selling where it truly is not in the best interest of the client; we apologize that the desired information has not been presented in the online Knowledge Base in such a way that finding it was clear and easy. Based on the feedback you’ve provided here, we have added an article titled, “How can I track my paid search listings as marketing campaigns in SiteCatalyst?” (KB ID 9408) to explain how to use built-in, non-SearchCenter paid search detection and campaign tracking in SiteCatalyst to view data for ad name, campaign, search engine, etc. to report on pay-per-click ROI. We appreciate that you have brought this need to our attention, and, as always, welcome any other feedback regarding support and documentation in Omniture products. Please feel free to contact me at [omniturecare] at [omniture dot com] if you have any additional questions or feedback on this addition to our documentation library.

    Thanks,
    Benjamin
    Omniture, Inc.

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim

    You may want to setup a data correlation for Tracking Code Paid Keywords. That way you’ll be able to break down tracking code source by individual keywords. Although I haven’t done this specifically within SiteCatalyst, that should theoretically work.

    If you’re lucky, you’ll have a few subrelations/correlations available in your SiteCatalyst contract that have been left for occasions like this. If you’re really interested in knowing which keywords coincide with which tracking codes, you may have to run a Datawarehouse request.

    It’s probably beyond the scope of this post, and something you may need Client Care’s help in understanding, but at least you’ll know what to ask for.

    G

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim

    You may want to setup a data correlation for Tracking Code < -> Paid Keywords. That way you’ll be able to break down tracking code source by individual keywords. Although I haven’t done this specifically within SiteCatalyst, that should theoretically work.

    If you’re lucky, you’ll have a few subrelations/correlations available in your SiteCatalyst contract that have been left for occasions like this. If you’re really interested in knowing which keywords coincide with which tracking codes, you may have to run a Datawarehouse request.

    It’s probably beyond the scope of this post, and something you may need Client Care’s help in understanding, but at least you’ll know what to ask for.

    G

  • http://www.ppc-advice.com Garry Przyklenk

    @Ben

    Was wondering when someone at Omniture would stop by and say hi (and sorry to Jim).

    BTW: Where are my royalties for that KB article?

    G

  • http://www.ppc-advice.com Garry Przyklenk

    @Ben

    Was wondering when someone at Omniture would stop by and say hi (and sorry to Jim).

    BTW: Where are my royalties for that KB article?

    G

  • Jim

    Thanks again, Garry. I am still trying to get this to work. You’ve been very helpful. The report Omniture authored — noted above — doesn’t help, and their support people, although friendly and enthusiastic, haven’t been able to provide a good answer.

    So, I’m still pretty much where I started, but I really appreciate your suggestions and pointers.

    Thanks again,

    Jim

  • Jim

    Thanks again, Garry. I am still trying to get this to work. You’ve been very helpful. The report Omniture authored — noted above — doesn’t help, and their support people, although friendly and enthusiastic, haven’t been able to provide a good answer.

    So, I’m still pretty much where I started, but I really appreciate your suggestions and pointers.

    Thanks again,

    Jim

  • http://www.vividhchaudhary.com/ VC

    Thank Gary. This was really useful. I have some sense of how the Paid Search Detection works.

    @Ben, I tried to look for the article you mentioned but can’t find it. Can you please add the article URL here.

    Thanks.

    VC

  • http://www.vividhchaudhary.com VC

    Thank Gary. This was really useful. I have some sense of how the Paid Search Detection works.

    @Ben, I tried to look for the article you mentioned but can’t find it. Can you please add the article URL here.

    Thanks.

    VC

  • http://www.vividhchaudhary.com/ VC

    Also, I was wondering
    1. If I can track different match types using the paid search detection.
    2. How do I separate traffic from different search engines (Google, Yahoo & MSN)
    3. How the landing page URL looks like with the specific query string parameters so that I can request the eng. to do the same. Does anyone have such a sample URL?

    Thank you very much.

    -VC

  • http://www.vividhchaudhary.com VC

    Also, I was wondering
    1. If I can track different match types using the paid search detection.
    2. How do I separate traffic from different search engines (Google, Yahoo & MSN)
    3. How the landing page URL looks like with the specific query string parameters so that I can request the eng. to do the same. Does anyone have such a sample URL?

    Thank you very much.

    -VC

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim

    If you’ve installed the “kw” switch in your Report Suite admin, all paid search keywords tagged using “?kw=whatever” should start showing up in both your Search Keywords -ALL and Search Keywords – Paid reports in SiteCatalyst. If they aren’t specifically showing up in your Paid reports, there is a problem with that switch.

    Using the keyword:null function in Adwords should give you the precise keyword that matched your keyword preference, but it wouldn’t specifically give you match type: exact, phrase, or broad.

    Can you clarify what the issue is?

    G

  • http://www.ppc-advice.com Garry Przyklenk

    @Jim

    If you’ve installed the “kw” switch in your Report Suite admin, all paid search keywords tagged using “?kw=whatever” should start showing up in both your Search Keywords -ALL and Search Keywords – Paid reports in SiteCatalyst. If they aren’t specifically showing up in your Paid reports, there is a problem with that switch.

    Using the keyword:null function in Adwords should give you the precise keyword that matched your keyword preference, but it wouldn’t specifically give you match type: exact, phrase, or broad.

    Can you clarify what the issue is?

    G

  • http://www.ppc-advice.com Garry Przyklenk

    @VC

    AFAIK, the following is true:

    1. You probably cannot. I say probably because you could go into adwords and tag each keyword individually, but it’s a pain in the butt to do this manually.
    2. Search engines should be segmented auto-magically by SiteCatalyst.
    3. I don’t understand the question. But theoretically, the query string at the end of the URL would still show up after a user clicks your Adwords ad. In addition, once you setup the “kw” switch, you can test functionality by just entering any URL, plus the switch, plus a phony test string.

    Hope this helps.
    G

  • http://www.ppc-advice.com Garry Przyklenk

    @VC

    AFAIK, the following is true:

    1. You probably cannot. I say probably because you could go into adwords and tag each keyword individually, but it’s a pain in the butt to do this manually.
    2. Search engines should be segmented auto-magically by SiteCatalyst.
    3. I don’t understand the question. But theoretically, the query string at the end of the URL would still show up after a user clicks your Adwords ad. In addition, once you setup the “kw” switch, you can test functionality by just entering any URL, plus the switch, plus a phony test string.

    Hope this helps.
    G

  • Pingback: Jobs für Jedermann » Blog Archive » Omniture Web Analytics Consultant - London(London)

  • Heather

    Hi Garry,

    Thanks so much for the post! I am having the same problem as other people have mentioned…

    I have added all of my Search Detection rules into Omniture and tagged my paid keywords with the stings and still I’m not seeing any data in Omniture. Do you have any suggestions what to do next? Or do you know any other good non-Omniture resources you can suggest?

    Thanks again for the helpful post!

  • Heather

    Hi Garry,

    Thanks so much for the post! I am having the same problem as other people have mentioned…

    I have added all of my Search Detection rules into Omniture and tagged my paid keywords with the stings and still I’m not seeing any data in Omniture. Do you have any suggestions what to do next? Or do you know any other good non-Omniture resources you can suggest?

    Thanks again for the helpful post!

  • http://www.ppc-advice.com Garry Przyklenk

    Hi Heather,

    One possible reason you’re not seeing the keywords show up in Omniture is that your website or CMS might be filtering out the query strings, or passing your destination URL through a redirect of some sort.

    If you test a URL on your site by typing something like:

    http://www.ppc-advice.com/?kw=test

    Does the query string stay in the address bar as you typed it?

    If so, you may want to see whether Omniture is detecting the keyword following your query string by either looking at a packet sniffer such as the Firebug extension for Firefox, or by using the Omniture Debug Tool.

    If this is beyond your comfort level, throw me your website’s URL and I’ll test it for you.

    Regards,
    G

  • http://www.ppc-advice.com Garry Przyklenk

    Hi Heather,

    One possible reason you’re not seeing the keywords show up in Omniture is that your website or CMS might be filtering out the query strings, or passing your destination URL through a redirect of some sort.

    If you test a URL on your site by typing something like:

    http://www.ppc-advice.com/?kw=test

    Does the query string stay in the address bar as you typed it?

    If so, you may want to see whether Omniture is detecting the keyword following your query string by either looking at a packet sniffer such as the Firebug extension for Firefox, or by using the Omniture Debug Tool.

    If this is beyond your comfort level, throw me your website’s URL and I’ll test it for you.

    Regards,
    G

  • Beth

    Hi Garry,

    Great post. Would you happen to know how I can produce a report from the Natural Keywords and the correlated pages of the website?

    I would like to see the keyword and traffic to what page of my website. Does this make sense?

    Thanks,

    Beth

  • Beth

    Hi Garry,

    Great post. Would you happen to know how I can produce a report from the Natural Keywords and the correlated pages of the website?

    I would like to see the keyword and traffic to what page of my website. Does this make sense?

    Thanks,

    Beth

  • Jason

    Thanks for the article, Garry. Very helpful!

    Currently our Traffic Sources > Search Keywords-Natural says ‘No data match this criteria.’ Two questions:
    1) Is it safe to assume that, without Paid search set up, all data in Search Keywords-All includes all natural keywords?
    2) Will data begin showing up in this report once Paid search is set up? (Does SiteCatalyst split out results automatically?)

    Thanks,
    Jason

  • Jason

    Thanks for the article, Garry. Very helpful!

    Currently our Traffic Sources > Search Keywords-Natural says ‘No data match this criteria.’ Two questions:
    1) Is it safe to assume that, without Paid search set up, all data in Search Keywords-All includes all natural keywords?
    2) Will data begin showing up in this report once Paid search is set up? (Does SiteCatalyst split out results automatically?)

    Thanks,
    Jason

  • http://www.ppc-advice.com Garry Przyklenk

    1) Is it safe to assume that, without Paid search set up, all data in Search Keywords-All includes all natural keywords?

    If you’re running paid search campaigns, Keywords-All will show all. If you’re not running paid search campaigns, Keywords-All will show natural. I don’t have the secret sauce, but I think Omniture just grabs the keyword parameter from referring links in search engines.

    2) Will data begin showing up in this report once Paid search is set up? (Does SiteCatalyst split out results automatically?)

    Depending on your site traffic and SiteCatalyst latency, you should start seeing results within 45 minutes to an hour on average. Unless you filtered your office’s IP address. In that case, you’ll have to hit it from an outside IP to see test results for any reports.

    Hope that helps.
    G

  • http://www.britannia.co.uk/ David

    Garry,

    Great article and very helpful. I’ve successfully split out my paid and natural search, and now want to know: which paid search queries came from which search engine? I’ve got an ongoing debate with our marketing agency, who believe Google sent us X paid search visitors this week, but I’ve only tracked Y (where X is 6Y). I’m trying to prove that the paid search only delivered Y visitors from Google (I can do this) by demonstrating which search terms contributed to the traffic, and by what amount.

    I can find all my paid search terms, and I can find all the paid traffic from Google, but I can’t correlate the two – I’m just getting “n/a” where I’d hope to see some numbers!

    Can you help?

    Thanks

    David

    • http://www.ppc-advice.com Garry Przyklenk

      If I understand correctly, you’re correlating a search engine, say Google.com with “Paid Keywords” and seeing n/a?

      By default, this correlation should be setup out of the box in SiteCatalyst. Are you also setting a campaign ID in your paid search target URLs? Because you could double check the same reporting results that way as well.

  • http://www.britannia.co.uk David

    Garry,

    Great article and very helpful. I’ve successfully split out my paid and natural search, and now want to know: which paid search queries came from which search engine? I’ve got an ongoing debate with our marketing agency, who believe Google sent us X paid search visitors this week, but I’ve only tracked Y (where X is 6Y). I’m trying to prove that the paid search only delivered Y visitors from Google (I can do this) by demonstrating which search terms contributed to the traffic, and by what amount.

    I can find all my paid search terms, and I can find all the paid traffic from Google, but I can’t correlate the two – I’m just getting “n/a” where I’d hope to see some numbers!

    Can you help?

    Thanks

    David

    • http://www.ppc-advice.com Garry Przyklenk

      If I understand correctly, you’re correlating a search engine, say Google.com with “Paid Keywords” and seeing n/a?

      By default, this correlation should be setup out of the box in SiteCatalyst. Are you also setting a campaign ID in your paid search target URLs? Because you could double check the same reporting results that way as well.

  • http://www.britannia.co.uk/ David

    Garry,

    Exactly. I contacted Omniture Client Care and they enabled the correlation – surprisingly it wasn’t out-of-the-box. This has done the trick – I’ve also got a campaign ID in the target URLs and this is confirming the same figures.

    Thanks for your help

    David

    • http://www.ppc-advice.com Garry Przyklenk

      Nice, surprise surprise. ;-)

  • http://www.britannia.co.uk David

    Garry,

    Exactly. I contacted Omniture Client Care and they enabled the correlation – surprisingly it wasn’t out-of-the-box. This has done the trick – I’ve also got a campaign ID in the target URLs and this is confirming the same figures.

    Thanks for your help

    David

    • http://www.ppc-advice.com Garry Przyklenk

      Nice, surprise surprise. ;-)

  • Sgroove

    Hi Guys, I'm new in this Blog.
    Well, I'm in the same problem with Omniture Traffic Sources Report.
    I have the switch ?=cid to all my adwords link and I've added the entry in the “Current Paid Search Detection Rules”.
    Now, is there any way i can get my Traffic Sources Report Populated?
    Thanks a lot.

  • http://www.ppc-advice.com Garry Przyklenk

    Sgroove,

    If you're literally using the parameter “?=cid” in your target URL, I'd say that is the problem. If however, you're using “?cid=” then further investigation is required. Not to sound like a smart ass or anything, but there is a big difference. Hopefully that's the problem, but if not, you may have to ensure the parameter is set and identified within your s_code.js file (this file might be renamed by your implementation consultants or webmasters).

    If you want, you can always direct message me on Twitter, or send me an email using the contact form and if I have time I'll have a look at your site to see if I can track down the problem.

    Another great resource (and to Omniture's credit) that didn't exist back when I wrote this article is the @Omniturecare Twitter account managed by Ben Gaines. He's a smart guy and very attentive, he can also help.

    Regards,
    Garry

  • Sgroove

    Thank you so much for the fast reply.
    I'll check the s_code.js tomorrow and I'll see if there is an error there.
    In case there is nothing wrong there, what do you suggest me to do?
    Changing the “?=cid” with “?=kw” ?
    Thanks again.

  • Sgroove

    Hi Guys, I'm new in this Blog.
    Well, I'm in the same problem with Omniture Traffic Sources Report.
    I have the switch ?=cid to all my adwords link and I've added the entry in the “Current Paid Search Detection Rules”.
    Now, is there any way i can get my Traffic Sources Report Populated?
    Thanks a lot.

  • http://www.ppc-advice.com Garry Przyklenk

    Sgroove,

    If you're literally using the parameter “?=cid” in your target URL, I'd say that is the problem. If however, you're using “?cid=” then further investigation is required. Not to sound like a smart ass or anything, but there is a big difference. Hopefully that's the problem, but if not, you may have to ensure the parameter is set and identified within your s_code.js file (this file might be renamed by your implementation consultants or webmasters).

    If you want, you can always direct message me on Twitter, or send me an email using the contact form and if I have time I'll have a look at your site to see if I can track down the problem.

    Another great resource (and to Omniture's credit) that didn't exist back when I wrote this article is the @Omniturecare Twitter account managed by Ben Gaines. He's a smart guy and very attentive, he can also help.

    Regards,
    Garry

  • Sgroove

    Thank you so much for the fast reply.
    I'll check the s_code.js tomorrow and I'll see if there is an error there.
    In case there is nothing wrong there, what do you suggest me to do?
    Changing the “?=cid” with “?=kw” ?
    Thanks again.

  • Vivek P.

    excellent post !! just when I was about to evaluate SearchCenter….

  • http://www.ppc-advice.com Garry Przyklenk

    1) Is it safe to assume that, without Paid search set up, all data in Search Keywords-All includes all natural keywords?

    If you’re running paid search campaigns, Keywords-All will show all. If you’re not running paid search campaigns, Keywords-All will show natural. I don’t have the secret sauce, but I think Omniture just grabs the keyword parameter from referring links in search engines.

    2) Will data begin showing up in this report once Paid search is set up? (Does SiteCatalyst split out results automatically?)

    Depending on your site traffic and SiteCatalyst latency, you should start seeing results within 45 minutes to an hour on average. Unless you filtered your office’s IP address. In that case, you’ll have to hit it from an outside IP to see test results for any reports.

    Hope that helps.
    G