Welcome to the E-Blah Community!
We would like to welcome you to our community and invite you to register an account or login.
Being a registered member is important, as it gives you several advantages over the normal Guest status. After registering you will be able to download files and images, post messages, and access member-only portions of the forum - just to name a few. Registration is quick and simple, and only takes about a minute of your time.

E-Blah Community    General Discussion    Chit - Chat  ›  bots
Users Browsing Forum
Baidu Spider and 1 Guests

bots  This thread currently has 1,145 views. Print
2 Pages 1 2 » Recommend Thread
threewishes
March 24, 2009, 6:56am Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
I have noticed a yahoo! and googlebot as members on my forum.  Is this something that E-Blah has built into their application?

What are the bots looking for?

How can I add tags to get more hits on my forum?

(remember I have only my url point to the Pl? forum.)
Logged Offline
Private Message Private message
silas_the_monk
March 24, 2009, 8:17am Report to Moderator Report to Moderator
E-Blah Member
Posts: 13
Posts Per Day: 0.01
Time Online: 6 hours 4 minutes
Quoted from threewishes
I have noticed a yahoo! and googlebot as members on my forum.  Is this something that E-Blah has built into their application?

What are the bots looking for?

It is how search engines know what to deliver up when someone comes looking for your fascinating content.

Quoted from threewishes
How can I add tags to get more hits on my forum?

(remember I have only my url point to the Pl? forum.)


Oh yes. You can put a "robots.txt" in your document root which tells the well-behaved bots which parts of your web-site to visit.
You can put the relevant meta tags in your web page headers to tell the searh engines what your web page is about.
You can tell some of the search engines directly about your web-site.
You can also make sure that other sites link to yours (though there are ethics and ettiquette to this of course).
There is a section on this site for showcasing E-Blah sites - that would be a legitimate start.

This should help quite a bit.
http://www.google.co.uk/intl/en/webmasters/

If you are really desparate you can even pay Google!
Logged Offline
Private Message Private message Reply: 1 - 19
threewishes
March 24, 2009, 1:44pm Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
So let me understand this. those bots are coming automatically already even though I havent 'advertised' yet?

what should I put in robot.txt?

How can I attach meta tags to my forums homepage?
Logged Offline
Private Message Private message Reply: 2 - 19
Martin
March 24, 2009, 2:00pm Report to Moderator Report to Moderator

I love E-Blah
10 Series Support Team
Posts: 5,171
Gender: Male
Posts Per Day: 1.98
Reputation: 98.41%
Reputation Score: +247 / -4
Time Online: 39 days 9 hours 4 minutes
Location: UK
Age: 53
Bots trawl the web, it's their purpose  

meta tags example

<meta name="Robots" content="index,follow">
<meta name="revisit-after" content="3 days">

no need for robots.txt unless you want to specify folders to disallow.



Martin's Reputation: Increase
Logged
Site Site Private Message Private message Reply: 3 - 19
iCONICA
March 24, 2009, 2:46pm Report to Moderator Report to Moderator

Forum Moderation
Posts: 1,431
Gender: Male
Posts Per Day: 0.97
Reputation: 98.25%
Reputation Score: +56 / -1
Time Online: 16 days 2 hours 20 minutes
Location: Manchester UK
Quoted Text
Oh yes. You can put a "robots.txt" in your document root which tells the well-behaved bots which parts of your web-site to visit.
You can put the relevant meta tags in your web page headers to tell the searh engines what your web page is about.
You can tell some of the search engines directly about your web-site.
You can also make sure that other sites link to yours (though there are ethics and ettiquette to this of course).
There is a section on this site for showcasing E-Blah sites - that would be a legitimate start.Oh yes. You can put a "robots.txt" in your document root which tells the well-behaved bots which parts of your web-site to visit.
You can put the relevant meta tags in your web page headers to tell the searh engines what your web page is about.
You can tell some of the search engines directly about your web-site.
You can also make sure that other sites link to yours (though there are ethics and ettiquette to this of course).
There is a section on this site for showcasing E-Blah sites - that would be a legitimate start.


Don't use robots.txt unless you want to disallow certain directories.
Don't use meta tags, E-Blah adds meta keywords automatically if your settings permit.
Submitting to search engines is pointless, they'll find you and crawl you before long anyway. There's little if any evidence to suggest that submissions speed up finding your site.
Getting sites to link to you is very good, providing they're valuable sites, You don't want zero authority sites linking to you. 1 link from about.com is worth much more than 1000 links from worthless sites.
The E-Blah showcase is a good place to start. Eblah.com is a relatively high authority domain and your allowed to link in there and it's not a no-follow link either.



The <meta name="Robots" content="index,follow"> is harmless, little if any benefit but not detrimental.
The revisit-after meta tag tells the bots not to return until the period has elapsed, it doesn't tell them to return when that period has elapsed, a common mis-understanding. Leave it out.

You might want to create a xml sitemap.xml file of your forum periodically, it'll help bots find your threads and content if they have trouble finding it via links in your pages. xml-sitemaps.com does upto 500 pages free.



Logged Offline
Site Site Private Message Private message Windows Live Messenger WLM Reply: 4 - 19
threewishes
March 24, 2009, 2:57pm Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
Posted on E-Blah showcase thanks!

How do I make sure the E-Blah is setup correctly? (E-Blah adds meta keywords automatically if your settings permit.
)

Logged Offline
Private Message Private message Reply: 5 - 19
iCONICA
March 24, 2009, 3:01pm Report to Moderator Report to Moderator

Forum Moderation
Posts: 1,431
Gender: Male
Posts Per Day: 0.97
Reputation: 98.25%
Reputation Score: +56 / -1
Time Online: 16 days 2 hours 20 minutes
Location: Manchester UK
Go to your settings panel, the "view all settings", press CTRL + F to search for text and search threshold or auto-tagging. When you find that setting, set it to around 1,2 or 3. Then upload a stopwords.txt to your prefs directory.
Google stopwords for a list.


Logged Offline
Site Site Private Message Private message Windows Live Messenger WLM Reply: 6 - 19
threewishes
March 28, 2009, 8:36pm Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
Is it good to have an Alexa bot visiting my site? It has been spending time in my member list.
Logged Offline
Private Message Private message Reply: 7 - 19
iCONICA
March 29, 2009, 8:01am Report to Moderator Report to Moderator

Forum Moderation
Posts: 1,431
Gender: Male
Posts Per Day: 0.97
Reputation: 98.25%
Reputation Score: +56 / -1
Time Online: 16 days 2 hours 20 minutes
Location: Manchester UK
ThreeWishes. All bots that are named visiting are good. Bots that collect email addresses and attempt spam etc.. Justin, didn't program their names into the software obviously.

Alexa bot gives you a ranking among other similar websites. GeekIMO currently has an Alexa rank of about 700,000 and eblah.com has 289,000 lower is better.


Logged Offline
Site Site Private Message Private message Windows Live Messenger WLM Reply: 8 - 19
threewishes
March 29, 2009, 8:19am Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
Okie thanks!
Logged Offline
Private Message Private message Reply: 9 - 19
unclejack
March 29, 2009, 8:28am Report to Moderator Report to Moderator

E-Blah Member
Posts: 157
Gender: Male
Posts Per Day: 0.07
Reputation: 100.00%
Reputation Score: +5 / -0
Time Online: 4 days 22 hours 22 minutes
Location: England, UK
Age: 38
am I right in believing that bots only see the content of a guest so if you have boards only accessable by certain member levels the bots can't access them ?




eBlah version 10.3.5  - http://www.maxwellshouse.co.uk
Logged Offline
Private Message Private message Reply: 10 - 19
iCONICA
March 29, 2009, 1:46pm Report to Moderator Report to Moderator

Forum Moderation
Posts: 1,431
Gender: Male
Posts Per Day: 0.97
Reputation: 98.25%
Reputation Score: +56 / -1
Time Online: 16 days 2 hours 20 minutes
Location: Manchester UK
All bots, Uncle Jack, only view the forum as a guest. So things that aren't available to guests, aren't available to bots. They may appear to be accessing the admin Center when you look at the where-is but they're simply seeing the admin page with an error saying they don't have permissions to view that area. E-Blah is safe in that respect.


Logged Offline
Site Site Private Message Private message Windows Live Messenger WLM Reply: 11 - 19
threewishes
March 29, 2009, 2:33pm Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
So you need to make guest able to see posts then?
Logged Offline
Private Message Private message Reply: 12 - 19
iCONICA
March 29, 2009, 4:47pm Report to Moderator Report to Moderator

Forum Moderation
Posts: 1,431
Gender: Male
Posts Per Day: 0.97
Reputation: 98.25%
Reputation Score: +56 / -1
Time Online: 16 days 2 hours 20 minutes
Location: Manchester UK
If you want your site to be indexed by search engine crawlers, then yes. You'd need to make your site's threads accessible to guests.

Many people make the mistake of locking out their sites, in hope more people will register. But then it won't be indexed and you won't be found from search engine queries.  


Logged Offline
Site Site Private Message Private message Windows Live Messenger WLM Reply: 13 - 19
threewishes
March 29, 2009, 6:54pm Report to Moderator Report to Moderator
E-Blah Member
Posts: 264
Posts Per Day: 0.25
Time Online: 2 days 43 minutes
Thanks I allow guest to view posts now.
Logged Offline
Private Message Private message Reply: 14 - 19
2 Pages 1 2 » Recommend Thread
Print

E-Blah Community    General Discussion    Chit - Chat  ›  bots

Thread Tags
i