Skip to:
Content
Pages
Categories
Search
Top
Bottom

Search Results for 'bots'

Viewing 25 results - 201 through 225 (of 331 total)
  • Author
    Search Results
  • #108368

    In reply to: Spam registrations

    cjones81
    Member

    These automated bots are usually just that, automated that are programmed to look for specific strings in search engines that return a list of buddypress sites and then harvested. I was getting hammered with 20+ blogs getting created a day that was spam. I tried ever plugin and .htaccess tricks known to man and none of them worked. I was tired of all of the spam I was getting so I put on my tin foil and went to war. I was determined to win this war and to stop 99.9% of automated spam dead in its tracks.
    First I went to cpanel and under the “Website Traffic” on the left side of the page and clicked “View all traffic” then clicked on my domain name.

    When the statistics page for that domain loaded I looked on the left hand side of the page for “Search Keyphrases”, this will show me a list of the keyphrases that was used to find my site.

    I found all the keyphrases that was used by the spammers to find my site in the search engines and here is the list of the keyphrases.

    1. intext create an account username required email address required blog details inurl register
    2. to start connecting please log in first. you can also create an account. .cr. blogs
    3. allintext create an account account details profile details blog details yes i d like to create a new blog
    4. yes i d like to create a new blog
    5. “blog url required ” inurl /register
    6. “yes i’d like to create a new blog”
    7. intext create an account blog details inurl register
    8. to start connecting please log in first. you can also create an account. .be.blogs
    9. inurl register yes i d like to create a new blog
    10. intext blogs create an account username email address blog details inurl register
    11. to start connecting please log in first. you can also create an account. .de.

    What I did was I went downloaded the buddypress to my desktop and open every file with NotePad++ and started searching for “create an account; blog details; yes i d like to create a new blog” Once I found those strings, I changed the name to something else and on the registration page I removed the “yes i/d like to create a new blog” along with its checkbox completely and i searched everything with the word “blog” and changed it to something completely different. I Also renamed the “bp-blog.php” and the /bp-blog/ folder.
    Make sure to search through the other files in the buddypress folder for anything calling the “bp-blog.php” and the /bp-blogs/ and rename it accordingly.

    It has been a week since I done this and I have yet to be spammed. I went from 20 a day to zero overnight by doing this.

    mars-hill
    Member

    Hi Mikey3D, thanks for the fix – testing that in webmaster tools seems to be working. Have added to robots.txt.

    @mikey3d
    Participant

    You haven’t add Disallow: /? in your robots.txt file.

    mars-hill
    Member

    Thanks for your explanation, Boone. The fix is beyond my technical capabilities, and I appreciate you moving it to trac and looking into it.

    Boone Gorges
    Keymaster

    acpage is the way that BP renders activity pagination to those clients with javascript disabled – such as search engines.

    I started a ticket for discussion of technical issues: https://trac.buddypress.org/ticket/3116

    #107922
    fizk
    Member

    r-a-y,

    Thanks, I’ve disabled registration. Hopefully this stops the bots completely.

    #107896
    gregfielding
    Participant

    I did install the plugin, but am afraid to hit the “Database Optimize” button because we use multiple databases.

    And yes, there is a way to block specific bots and ip addresses

    Rob Watson
    Member

    # There are lots of WordPress hacks designed to take the contents of your wp-config
    # file (username and password) and dump them to a text file a spambot can pickup and
    # send to a hacker. If you block access to wp-config file in your .htaccess using
    # this method, you block those hackers from getting your database login information.
    Order deny,allow
    deny from all

    # Turn off directory indexing to keep anyone from seeing the contents of a directory
    # if there is no index file.
    Options All -Indexes

    # Block known spambots and crawlers. Update the following section with newly discovered
    # spambots and crawlers. This blocks them from ripping off posts and images (costing
    # bandwidth in the process.
    RewriteEngine On
    RewriteBase /
    RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Bot mailto:craftbot @yahoo.com [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
    RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Download Demon [OR]
    RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Express WebPictures [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
    RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
    RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
    RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
    RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
    RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^Image Stripper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Image Sucker [OR]
    RewriteCond %{HTTP_USER_AGENT} Indy Library [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Internet Ninja [OR]
    RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
    RewriteCond %{HTTP_USER_AGENT} ^JOC Web Spider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
    RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Mass Downloader [OR]
    RewriteCond %{HTTP_USER_AGENT} ^MIDown tool [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Mister PiX [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Net Vampire [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]

    RewriteCond %{HTTP_USER_AGENT} ^Offline Explorer [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Offline Navigator [OR]
    RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Papa Foto [OR]
    RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]
    RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
    RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Teleport Pro [OR]
    RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Web Image Collector [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Web Sucker [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebGo IS [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Website eXtractor [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Website Quester [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Xaldon WebSpider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Zeus
    RewriteRule ^.* – [F,L]

    # BEGIN WordPress

    RewriteEngine On
    RewriteBase /
    RewriteRule ^index.php$ – [L]
    RewriteCond %{REQUEST_FILENAME} !-f
    RewriteCond %{REQUEST_FILENAME} !-d
    RewriteRule . /index.php [L]

    # END WordPress

    #106770
    Virtuali
    Participant

    You must search for anti-spam plugins that filter out spam activity that the users make.

    If the “spammers” are going past the captcha, that means they are not robots, actually people, just spamming your site.

    So keep the captcha for robots, and you will need to search for anti-spam software to filter out the spam content posted on your site.

    #105839
    modemlooper
    Moderator

    You create a file called robots.txt and you specify which URL so for instance it could be anything after /activity

    User-agent: Googlebot
    Disallow: /activity/*

    This blocks google from scraping your images. This is a MUST for social networks that are using Albums.
    User-agent: Googlebot-Image
    Disallow: /

    #105821

    In reply to: BP_register_Slug

    imjscn
    Participant

    @modemlooper, thanks for your suggestion on different forms for different users in the register.php.
    I also want to change the register slug. Because spam bots know bp register slug. We can get rid of a lot of them by simply change the register slug. But, how?

    #104816
    thinkinbox
    Member

    Solved. I’m an idiot.
    user_spam_remover Plugin was improperly configured.

    As a side note: If you use buddypress for commenting, the User Spam Remover plugin won’t pick up on buddypress activity as being actual site activity – thus causing users to be mistaken as spam bots.

    #103930
    thealchemist
    Member

    @hnla I know that there will be a segment of the population who will be prevented from joining because I am blocking IP addresses. But, I want/need these prevented in the first place and I do not understand why this is not addressed in the core and has to be something I must “hunt through the forum threads to reducing spam signups”. Its not like this is an unknown issue.

    Besides, I HAVE searched for “reduce spambots” “reduce fake sign ups” “Reduce and reducing spam sign ups” with zero results.

    #103925
    thealchemist
    Member

    What I have to ask is “Why?” and “How?” are these spambots accessing and creating users? I have one site that uses WP multisite with BP and there’s a great plugin “BP Registration Options” that works well enough to grab and display all new member requests and displays IP addresses; which I then add to WP-Ban. Its taken a month but I am now down to a dozen or so spambot signups per day.

    Now, I have another WP/BP site that is NOT multisite and “BP Registration Options” does not work the same. BUT I copy the IP addresses from the one and paste it into the “WP Ban” of this site. However, I am still 100+ spambot signups per day. So, I have a plugin “Pending Activations” (which doesn’t work in multisite) but this plugin does not display the IP address of the offending spambot signups. Thus, my battle with the signups continues …

    So … How are the spambots signing up? Why does the registration form not have CAPTCHA? and how can we stop them from signing up?

    #103270
    Andrea Rennick
    Participant

    “how to disallow bots to follow signup link?”

    Put a nofollow, noindex on it, right in the theme where it is linked. And change the default text that is linked. If you look at your access logs and your visitor stats, you’ll see they basically google for you.

    #103240
    Hugo Ashmore
    Participant

    @imjscn try hunting for a plugin called KB robots text it allows you to edit the WP robots text from the dashboard and might be handy to have available.

    #103232
    imjscn
    Participant

    @hnla,
    I failed to search out your robots.txt thread. But I found this one was recommended in another thread: http://perishablepress.com/press/2010/07/14/blackhole-bad-bots/
    I will try it and feed back.
    By the way, the .htaccess referer trap doesn’t work.

    #103231
    Hugo Ashmore
    Participant

    #2 stops bots following the link on other pages, but BP spammers come without a reference page. They know which link is BP register page. I’m not sure if there’s another way for BP.
    Jenny this is why I said or mentioned adding a referer trap in .htaccess. Yes bots do link directly so you disallow any direct links that do not contain a referer in the header get request

    #103230
    Hugo Ashmore
    Participant

    True search here is a chore :)

    Robots.txt is a file that lives in the root document directory of a site, however I seem to remember issues in the past adding one as WP might be trying to add it’s own one?

    What results – if any do you get from running:

    http://example.com/robots.txt (your site name obviously)

    #103228
    imjscn
    Participant

    @hnla, I got 2 results from googling:
    #1. “
    #2. `sign in`
    #1 requiires to be added in header, I don’t know how to add it in register.php’s header without bothering other pages;
    #2 stops bots following the link on other pages, but BP spammers come without a reference page. They know which link is BP register page. I’m not sure if there’s another way for BP.
    The above is the reason why I ask Andrea.

    I did track down the solutions in this forum. If you pay attention, this topic was posted one month ago. I did my homework. But of course, I didn’t read all the threads, because search in this site is not as efficient as other places. No result if a word or a letter not match. Only accessed the threads that I searched out by different words combinations that I could imagine.

    As for the .htaccess method, my research shows it worked for a while, but stop working since WP 2.9. I tried it, I can comfirm it’s not working on my site.

    #103226
    Hugo Ashmore
    Participant

    @imjscn Jenny have you tried googling on ‘nofollow’ links? before asking Andrea_r how to do this or better still have you implemented my advise earlier in the thread for a robots.txt file implementation? and other tip/s?

    It’s important to tell us what you have tried other than add plugins – not everything is solvable using plugins and this aspect really requires a few approaches as has already been said.

    Did you track down any of the threads on this support forum that go into great detail on the various approaches one can take, a good one is to set a referrer trap in .htaccess so that direct linking to the register page is prevented and register will only accept requests that have an accompanying referrer in the header that comes from your site – mentioned in one of those threads with example code iirc

    #103225
    imjscn
    Participant

    BP Humanity does blocks the spamers completely, but they still try. For the past month, the total bandwidth comsumed by /register page is 3000MB
    @andrea_r , how to disallow bots to follow signup link?

    #102391
    Hugo Ashmore
    Participant

    it’s no solution and pointless running as yet one more plugin, this is simply a Order Allow Deny Apache directive and would be placed in you httpd.config file preferably or in your .htaccess and then list IP or domains to deny. Blocking IPs isn’t something that should be done lightly as it can have repercussions and is only effective on domains if there is one specific troublemaker these spam bots use spoofed domains they will change on the fly so little point trying to block them.

    Preventing spam is a multi faceted approach and the many areas and things that need to be done covered at length on the support forum, you need to use all of them to effectively reduce spam and if possible don’t let people sign up for blogs from the sign up page

    #102380
    thealchemist
    Member

    @arezki … so … does this plugin block attempts to sign up? How does it determine if something should be blocked? I looked at the plugin file on WP.org and it isn’t very specific. I can go into my server cpanel and block IPs all day long and I still get tons of spambots. I get user activation keys and blog setups with out a spambot actually doing the compelte process. grrrr.

    #101222

    In reply to: User/Member Management

    djsteve
    Participant

    have they checked their junk mail / spam folders?
    If your users aren’t happy about this, just wait until they start using it – lol it’s a crude work in miserable progress imho – the signup issueS are just the beginning. I would consider buddypress more of a hobby thing for those who want to spend long hours in multiple forums trying to hash out why everything does not work well together. You will find spam robots have no problem signing up and activated dozens of accounts daily. Once your users actually get activated they will have a great time trying to sort out real blog posts from spam, they may wish they never signed up in the first place – especially if they create their own group.

Viewing 25 results - 201 through 225 (of 331 total)
Skip to toolbar