Dead-end URLs direct users to pages that are non-existent, resulting in a 404 error page upon access. The term “404” signifies a standard HTTP response code, signifying the absence of the requested URL. Encountering a 404 error can be frustrating, prompting users to seek alternative sites. Given that broken links are perceived as unprofessional by both users and search engines, it’s crucial to proactively address and rectify these issues to enhance online presence and increase website traffic.Important Note: While this tutorial is tailored for WordPress bloggers, its insights are applicable to any website owner.Bloggers often update their content more frequently, increasing the likelihood of encountering broken links. For WordPress users, two types of plugins can be employed to manage these issues:
Plugins designed to identify broken links, such as the Broken Links Checker.
Plugins that automate 301 redirects, like Redirection.
As a plugin minimalist, I advocate for manual interventions to avoid plugin usage. However, efficiently addressing broken links and 404 errors justifies the installation of additional plugins. (Refer to the list of plugins used by Six Revisions.) Regardless of whether you use plugins, it’s highly recommended to periodically check your website for broken links and 404 errors.Pages may be indexed by Google despite not existing on your website due to:
Mistakenly referencing an invalid internal link due to a typo. Utilizing a plugin like Link to Post can help prevent such errors.
Changing a post’s permalink after it has been indexed by Google.
Google Webmaster Tools is an essential resource for detecting these errors. If you haven’t already, register your site and utilize this vital tool.One of GWT’s key features is the Remove URL tool, which enables the removal of invalid pages from Google’s search results. Let’s explore how to eliminate these URLs from Google’s index.After signing up for Google Webmaster Tools, verifying your site, and following Google’s Getting Started guide, the process for identifying invalid pages is as follows:
Select Diagnostics from the left menu and choose Crawl Errors.
Choose the Not Found category.
Review the page containing the broken link if available.
Verify if the URL is indexed in Google by pasting it into the search bar and checking for results.
Click on Site Configuration and select Crawl Access.
Select Remove URL.
Click on New removal request.
Choose the first option to remove the page entirely from Google search results, or the fourth option if you wish to retain the page but remove its cached version. This is beneficial if Google displays an outdated version of the page.Click on Next.Enter the URL of the page you wish to remove from Google.Ensure the first option is selected, then click on Add.The URL to be removed should now appear in the list. You can add more pages for removal if desired.Click on Submit Removal Request.Your request is now pending; typically, it takes 2 to 3 days for Google to remove the URL.Click on Site Configuration and select Crawl Access.Ensure the URL you requested to remove does not appear in the list of pending requests.Click on Removed URLs to confirm the URL is listed. To verify the URL’s removal from Google, paste the URL into the search box and check for results.Xenu Link Sleuth is another outstanding tool I use to identify broken links on my websites. You can download it here. Unlike WordPress plugins, Xenu is a standalone desktop application for Windows that displays all your site links—valid or invalid—and organizes them in a readable format. Using Xenu is straightforward:
Click on File and select Check URL.
Enter your website’s URL (e.g., https://www.webfx.com/blog/web-design/).
Wait for all links (site-wide!) to be checked.
When prompted, click Yes to generate a report.
Enter your FTP server details if desired, or simply click Cancel to generate an XHTML report locally. In the report, click on Broken links.Sort the table of contents by link to view all pages with broken links.Once you’ve identified all broken links, navigate to the posts and pages containing these references and either fix or remove them.What are your own techniques and tools for identifying broken links?How frequently do you search your site for broken links? Why is it important to eliminate invalid links, and what impact do they have on your website’s reputation?
6 Critical WordPress Plugins You Should Have Installed