Skip to:
Content
Pages
Categories
Search
Top
Bottom

Allow Bot Indexing of Site while registration is required to log-in…

  • Avatar of Pisanojm
    Pisanojm
    Participant

    @pisanojm

    Ok, so here is my next question… How can I allow google, bing, etc. to index my site while the site is re-directing back to the landingpage for registration purposes… i.e. the bots can’t get in…
    Ok to filed some questions… yes, the site is public…. yes, the site requires registration to see “anything”. so, I guess, in this sense, it’s only semi-private… is there some kind of .htaccess /robots.txt trick that will accomplish this?

Viewing 2 replies - 1 through 2 (of 2 total)
  • Avatar of techguy
    techguy
    Participant

    @crashutah

    I thought that there was a solution on the Google Webmaster page: http://www.google.com/webmasters/ I think you can provide them the login and they’ll index it.

    Just know that if you do that, then they’ll likely cache some of the “private” pages which makes it so they aren’t technically private since you could potentially find them in Google’s cache.

    Avatar of Pisanojm
    Pisanojm
    Participant

    @pisanojm

    The only thing I’ve found at the webmasters site slightly related is the robots.txt generator… am I missing something?

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.