ZOMDir > Blog

Monday, 18 September 2017

How to fix broken links

When I detect a redirected or broken link with Broken Links at a Glance I follow in general the following steps:

  • Follow the link to analyse it 
  • Try another URL of the same site 
  • Try to contact the website owner
  • Search for an alternative webpage 
  • Remove the link


1. Follow the link to analyse it

Always follow the link to see what happens. 

When you got a 404 Page not found you might go to the next step.

When you link to a website that doesn't exist anymore you might get the error "Server not found". 

If that's the case and the HTTP error code wasn't 503 assume this link is broken and go to step 4 or depending on the situation to step 5. 

2. Try another URL of the same site

When you thought you linked to the homepage of a website and you got a 404 error then it is often easy to navigate to the new homepage of that website.

Update your webpage by replacing the old link with the new address of the homepage.

When you linked to a specific page, it could be that that information is still available at another location. 

So you have to search at that site for the same information. 

When found, you should update your webpage by replacing the old link with the new address. 

When not found, take the next step.

3. Try to contact the website owner

As you probably have experienced, websites aren't as static as you want. However that doesn't always mean that the information is gone. 

Due to a website reorganisation the information you want to link to might be at another address. 

When you are not able to find it yourself, you might contact the website owner. Almost every website has a contact information page. 

If you can't find an e-mail address you might try the e-mail address info@websitename.com.

Make clear that you linked to a webpage with information regarding ... and ask what the new address is for this information because the webpage you linked to has vanished.  

4. Search for an alternative webpage

Linking out is good practice, so I prefer and advise you to keep linking. 

When all previous steps failed search for another webpage with the information you want to link. 

Simple use your favorite search engine and hunt for the information you want to link to. 

Often you will find an alternative. 

When found, update your webpage by replacing the old link with the new address of the alternative webpage found. 

Otherwise, you should remove the link as described in the next step.

5. Remove the link

Too bad, the webpage you linked to doesn't exist anymore, and you can't find an alternative webpage to link to.

When that's the case you should update the webpage where you linked from and remove the link completely. 

Mind that this might have the consequence that you should rewrite your text.



That said, the process of fixing broken links is relative straightforward.  

For the best results, check your links at a regular base. For example every month.

Finally I like to tell you something about redirected links and broken links. 


Why check redirected links?

Redirected links are often indicated by the HTTP status code 301

In general a HTTP status code which has the format 3XX indicates a redirected link.

Often people think -incorrectly- that a redirected link isn't a problem. Okay, sometimes it isn't a problem, but sometimes it is. 

To find out you have to click these links to see where they redirect to.


From http to https

When the redirect is logical, for example from http:// to https:// it is advised to update your webpage with the redirected link by removing the old location (http://...) with the new location (https://...). 

By doing this, the next time you check your website for broken links, you have to check fewer redirected links.


Another system

It might happen that the website you link is using now another content management system with the side effect that old pages are redirected. When the redirect is logical update your webpage and replace the old location with the new location. However when the redirect isn't logical, then consider this as a broken link.


For sale or sold

It might happen that the website you link to is gone and a domain name speculant redirects your page to a "domain for sale landing page". You should consider this as a broken link. 

It might happen that the website you link to is now owned by someone else who works in a complete different business. In that case you should consider this as a broken link.


Hyjacked

It also might happen that the website you link to is hyjacked and is now selling shoes instead of ... whatever you where linking to. Also in this case you should consider this as a broken link. You might consider to warn the original website owner by sending a mail to info@websitename.com. Inform what you have discovered and ask polite to inform you when the website is restored so you are able to restore your link.



What are broken links?

Broken links are often indicated by the HTTP status code 404

However other status codes also might indicate a broken link. When the status code starts has the format 4XX or 5XX the link is probably broken.

I have experienced that websites which respond with a 408 or a 500 HTTP status code still might work although the may be a little slow. 

When that's the case you have to decide for yourself if you consider this as a broken link or not. 

When you link to a small website which probably doesn't get much visitors it might occur that the first time someone visits that website (the broken link checker) the response is slow while at a second visit (you checking the links marked as broken) the response is reasonable.

A website which responds with a 503 HTTP status code is in maintenance mode. You might ignore this broken link for the moment, however you might assume that in a few days that website will work.

Hope this helps,
Hans

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds

To learn more view this Slideshare presentation

Testing free broken link checkers for windows (or how to seperate 1 men from many boys)

After I have tested 8 free webbased broken link checkers I thought it is time to check free broken link checkers for windows.

Roughly the same requirements apply as in the earlier test. They are:

  • scan as much links as possible
  • scan as fast as possible
  • give correct results
  • respects robots.txt
I selected 8 windows based broken link checkers, including SEO checking tools. 4 of them are very limited in the free edition, like checking 500 links. Of the remaining 4 windows based broken link checkers only one broken link checker is fast enough for me. 

Xenu's Link Sleuth

Xenu's Link Sleuth is the only link checker which checks links at a reasonable speed. Of course it depends on your hardware, the configuration of Xenu's Link Sleuth and the site you check.  In my test environment Xenu's Link Sleuth checks 9 links per second.

All other windows based link checkers are much much slower. Number two checked 1 link per second. For other tools I recorded speeds like 1 link per 6 seconds and 1 link per 20 seconds. 

If you have a relative small site (less than 1,000 links to test) I recommend the free online link checker Broken Links at a Glance.

Hope this helps,
Hans

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds


To learn more view this Slideshare presentation


Thursday, 14 September 2017

8 free online broken link checkers compared (only 2 could be advised)

Broken links

Broken links at your website are very annoying and lowers the user experience dramatically. Hence it lowers probably your ranking in search engines.

It is good practice to check your site at a regular base for broken links. Lets say every month.

You should then check and re-check your site till all links are fine. 

Check and update also the redirected links. A redirected link is often no problem, but sometimes it redirects to a phising or malware site. 

Broken links and redirected links could be find by a broken link checker. A broken link checker analyses your site but isn't able to correct a broken link. That is a manual action which should be done by yourself.


Types of broken link checkers

There are a lot of broken link checkers available. These link checkers could have characteristics like:
  • Platform (e.g. Windows, webbased, Wordpress plug-in, Chrome plug-in, etcetera)
  • Price (e.g. free, initial free - paid upgrade possible, paid)
  • Capabilities (e.g. link checker, seo tool, link checker plus another check, maximum links that will be checked)
For this article I have tested the following free generic online broken link checkers:


Two online broken link checkers are fine

The two link checkers that could be advised are Broken Links at a Glance and Dead link checker.

Here is why.


Test method

Before I tested the broken link checkers I made a list of characteristics of a fine broken link checker. A broken link checker should:

  • scan as much links as possible
  • scan as fast as possible
  • give correct results
  • respects robots.txt
  • be mobile friendly


Given this list I started to test the broken link checkers with some large news sites.

That was a good start, because it made clear that speed is more important as I thought before. Based on these tests 4 of the 8 link checkers failed.

The second test was about good results. I tested this with https://httpstat.us/. This time 2 of the 4 remaining link checkers failed.

The two remaining link checkers both respects robots.txt. 

Only Broken Links at a Glance is optimized for mobile, so at the end the results are:


1. Broken Links at a Glance

Broken Links at a Glance is intended for websites up to 1,000 unique links and checks 5 links per second on average. Thats respectable although there are other broken links checkers with better numbers. 

However Broken Links at a Glance respects the directives in the robots.txt file, is mobile friendly and is ad free. Broken Links at a Glance checks all links coded at a webpage, not only the visible and clickable links.


2. Dead Link Checker

Dead link checker checks the first 2,000 links on any website. That's second best. Besides that on average it checks 5 links per second. 

Like Broken Links at a Glance, Dead link checker is ad free, respects robots.txt and checks all links coded at a webpage.

Dead link checker isn't optimized for mobile. Besides that you have to enter a code before you are able to start the test.


3. Dr. Link Check

The third place in this test is for Dr. Link Check. The free link checks of Dr. Link Check are limited to 1,000 links per website. On average it checks 10 links per second. That is the highest speed of all tested broken link checkers.

At this moment (September 2017) Dr. Link Check checks only "normal" page links. In version 2.0 which is coming soon they will not only check "normal" page links, but also verify links to images, style sheets, scripts and other resources required to properly display your website.

Dr. Link Check doesn't respect robots.txt and isn't optimized for mobile. Dr. Link Check is the only website which doesn't allow you to check the same website within 10 minutes.

When I tested the site https://httpstat.us/ with  Dr. Link Check, it wasn't able to check all links.

I doubted if I should advise Dr. Link Check. The latest test decided for me not to advise this link checker.


4. Online Broken Link Checker

Of the tested link checkers Online Broken Link Checker has the highest limit of pages to crawl. There is a 3,000-page limit, however there are no limits on number of hyperlinks within those webpages. That's great however there are some downsides.

Online Broken Link Checker: 

  • is slower than the top 3 link checkers. On average it checks 2.5 links per second;
  • doesn't crawl subfolders / URLs with slashes;
  • has problems with https://httpstat.us/;
  • doesn't respect robots.txt;
  • isn't optimized for mobile.


5. Internet Ninja's Find Broken Links, Redirects & Site Crawl Tool

Internet Ninja's Find Broken Links, Redirects & Site Crawl Tool is the best of the rest. This tool crawls up to 1,000 pages of your website. However it's slow. On average it isn't able to check a link in a second.


6. W3C Link Checker

The W3C Link Checker has the option "Check linked documents recursively". When this option is checked then, in theory, by default the recursion depth is unlimited. However in practice less than 500 pages will be checked. The W3C Link Checker is slow. On average it isn't able to check a link in two seconds.


7. Online Website Link Checker

The Online Website Link Checker crawls max 500 pages for free. It has a nasty pop-up which might be closed after a few seconds and it is slow. 


8. Broken Link Checker

Broken Link Checker by WebToolHub doesn't mention a maximum of pages or links that will be checked. It isn't that relevant because this checker is slow. On average it isn't able to check a link in a second.


In summary

Of the 8 tested free online broken link checkers Broken Links at a Glance and Dead link checker are the best link checkers available.

As alternative you might try Dr. Link Check or Online Broken Link Checker

I hope this advise is useful for you.
Hans

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds


To learn more view this Slideshare presentation

Monday, 5 June 2017

Four years ZOMDir

June 5, 2017, ZOMDir is exactly four years old. Time to reflect.


According to the stats more than 33.000 links are added and more the 7.000 links are removed. 

The total number of links is somewhere between 25.000 and 26.000 links. A respectable number of links.

So in 4 years time more than 20% of the links was removed. That even applied to the first link added to ZOMDir. 

To honor DMOZ (the inspirator of ZOMDir), the first link added was DMOZ.org. However last year this directory vanished, as did Yahoo a year earlier.

Luckily I have a backup of both directories but I doubt if I'm able to transfer these links to ZOMDir.

Popularity

Till now ZOMDir isn't very popular. Almost never ZOMDir occurs in the search results of Google or Bing. 

When ZOMDir occurs in the search results then it is because someone searches for "bridge" (the card came). Probably because a lot of the first links added are related to Dutch bridgeclubs.

Regarding languages. Most links added are Dutch, some are in English and some are in Frysk.

The most links have been added by my father and myself. Note that my father loves to bridge :-)

I've tried make editing ZOMDir a game by allowing people to create an account and earn karma points. So I created a herolist. It's clear that some people added some links but that it wasn't that addicting as supposed.

Luckily, ZOMDir is a hobby project so that it isn't a great success doesn't matter that much. I'm still glad I have this hobby.

One of the fun things is that I have created a lot of tools. These tools reflect my opinion regarding websites. They should be safe, fast, accessible and have a certain quality.

Should I stay or should I go?

ZOMDir isn't that succesfull as I hoped when I created the site. Although I think I created a superb linkdirectory almost nobody is really interested.

Should I quit like Yahoo! and DMOZ? No, that isn't necessary. There isn't a reason to continu but at the other hand there isn't a reason to stop.

So expect a few more links at ZOMDir.com the next year, and feel free to help.

Best regards,
Hans

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds

To learn more view this Slideshare presentation

Friday, 30 December 2016

Which speedtest should I use?

There are a lot of speedtests which measure your download speed (or bandwidth) in bits per second. 

Chosing the right speedtest can be time consuming. Use this guide for finding your speedtest.

Fast internet

If you expect a download speed of 50Mbps or more? You should use:
Google Fiber's speedtest

Slow internet

If you want to measure the download speed in kbps you might try:
- Speedtest4.php
- Internet Speedtest of Toast.net

Instant results

Do you want instant results? Then you might try:
Internet Speed at a Glance
- or the slightly slomer Fast.com

Accurate results

Do you need an accurate speedtest? Make sure that you are the only person using the to be tested internet connection. Close all other programs and use one of the following speed tests:
- TestMy.net
- Bandwidth Place
- TestMySpeed
- Measurement Lab

Note that I don't suggest to use Ookla's speedtest.net despite this is one of the most used speedtests. When you use a computer this test is probably fine, however when you use a mobile phone or tablet you have to install an app. Hmmm. I don't like that.

Other speedtests

Not enough choice? Check this overview of speedtests at ZOMDir.com.


--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds

To learn more view this Slideshare presentation

Sunday, 20 March 2016

Will linkbuilding for SEO become meaningless?

Recently I have read about RankBrain's Judgment Day.

Although it is stated in other words. One of the statements in this article is that:

Soon external signals (e.g., links) will not be used for relevance of the organic search results.
This is nonsense. Recent research learned that Links are still relevant. Even Gary Illyes states that RankBrain is something different as suggested in the article above.
Lemme try one last time: Rankbrain lets us understand queries better. No affect on crawling nor indexing or replace anything in ranking 
— Gary Illyes (@methode) March 18, 2016
I think it is better to believe the latest.

Hans

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds
To learn more view this Slideshare presentation

Monday, 29 February 2016

Linkbuilding from directories done right

Since the rise of Google linkbuilding is extremely important. The reason? 

Google was the first search engine who used the number of links to a webpage as an indicator of the relevance of that page.


Links are still relevant

Update: March 24, it became in the news that content and links are the number one and two ranking factors (or vice versa). See: Google's top 3 ranking factors.

Nowadays linking is still an important indicator. A recent study of Backlinko makes clear that ...
Backlinks remain an extremely important Google ranking factor. We found the number of domains linking to a page correlated with rankings more than any other factor.

Another indication that the original Pagerank algorithm is still a huge factor comes from this accidental SEO test from Moz. The concluded that ...

What our data suggests is that, on average, there’s a 15% traffic loss following a 301 redirect; but any individual redirect could be much better, or much worse.

What’s particularly fascinating about this number, 15%, is that it is exactly the amount of PageRank loss Google described in the original PageRank paper.

How to get links the wrong way?

Since it is clear that a lot of links helps your website to become higher in the search results people created "fly-by-night" directories and "Private Blog Networks" to create links by them self. 

It is clear that Google don't like these tactics because they corrupt the search results. So Google declared the war on link schemes.


Content marketing

Therefor a lot of people believe that content marketing is the answer. Write helpful attractive content which help users and people will come, link to you and you will earn a high position in the search results.

That doesn't mean that a link from a directory is useless. If the directory has a page with links that belongs to the same category (which could be considered as 
helpful attractive content) and your link belongs also to this category then it is a perfect fit.

Create helpful links

If your link is the only link in a category then it is either a very detailed category either it is suspicious. 

A single link on a page could be treated by Google as a link scheme which can negatively impact a site's ranking in search results.

The latest is also the case when your link belongs to another category.

So when you add a link to a directory make sure that it is the correct category and that there are other relevant links in that category.

Good luck with linkbuilding,
Hans

By the way, almost as important as links to your site are the links from your site. A study from Reboot Online Marketing learned that outgoing links have positive effects. So feel free to link to me ;-)

--
ZOMDir.com is a dynamic directory and a wiki
Everyone is able to add a link in 10 seconds
To learn more view this Slideshare presentation