Search Me!


Google Panda Refresh #25 – How much queries will effect?

7:16 PM
The headache of SEOs has begun again when Matt Cutts confirmed the Google Panda Refresh #25 earlier this week while speaking at SMX West Panel. We guys are working on “next generation of Penguin” and will update later this year, he added more.

For the inpatient readers, “Google will update its 25th Panda Refresh within Friday 15th to Monday 18th March”.

Last Panda Refresh happened about 8 weeks ago that refreshed about 1.2% queries at all. The 23rd Panda hit about 1.3% where Panda 22nd and previous had the same values so It can be assumed that this update may hit between 0.8 to 1.2% queries.

Moreover, the biggest news is that Google plans to penalize the whole sites for the cause of single “bad backlink” because of they allowed webmasters to remove unnecessary backlinks through a Google Webmasters Disavow Tool.

Dear Google, Please Don’t Google Me!

4:17 PM
Beginners Guide To Robots.txt Files

What is Robots.txt?
Robots.txt is a simple notepad file that is used by website owners to restrict the robots and crawlers to crawl of specific webpages or the whole website for search engines but sometimes for malicious software.

Where it is Located?
Robots.txt is always located in the root directory of your website means if you’ve created the Robots.txt file and placed it in the right path so its URL will look like this:

How to Create?
Open your notepad from windows and save that file as named robots.

How to Restrict Robots?
Open your saved Robots.txt file and start writing paths and restrictions as given below:
User-agent: *
Disallow: /

Above given transactions will restrict crawl your whole website. How? Let’s read further:

“User-agent:” The attribute is used to define the crawlers and robots that will be restricted to crawl your website.

“*” Next to User-agent: there is an asterisk key that was used to restrict all the crawlers on web to crawl this website.

“Disallow:” This attribute is used to define the files and directories of your website that will be restrict from crawlers to crawl.

“/” This forward slash was made to restrict the root directory of your website from the crawlers.
If you want to restrict the specific webpages of your website, you can define them instead of this forward slash. For example, if you want to restrict the fake.html that is under the /shop named directory or path of your website, you’ll need to write as “Disallow: /shop/fake.html” or if you want to restrict the whole /shop directory, you can do this by “Disallow: /shop/” where the next forward slash is restricting the whole sub-directory from search engine robots or crawlers.

Any questions regarding this Beginners Guide to Robots.txt or Advanced Robots.txt will be appreciated.