Magento 2 Module – Robots Tag Management
- SKU
- M2-ROBOTS
Description / Magento 2 Module – Robots Tag Management
MAGENTO 2 · META ROBOTS · CMS · PRODUCTS AND CATEGORIES
Set indexing rules where you manage content.
Kowal Robots
Control the robots tag for CMS pages, products, and categories. Extend your settings with URL path rules and automatic nofollow marking for selected links.
Robots attributes · URL rules · Nofollow links
HOW IT WORKS IN PRACTICE
01 · You select a page or rule
You edit a CMS page, product, category, or list of paths.
02 · You set directives
You choose index/noindex and follow/nofollow.
03 · You check the result in the store
You verify the robots tag and the links affected by the change.
What does your store gain?
Explore the module features, use cases, and configuration method.
Robots for CMS pages, products, and categories
The module lets you set the robots tag directly in the admin panel for CMS pages, products, and categories. It integrates with Magento forms and attributes, and the selected values are used on the frontend.
The current description indicates support for category staging with draft versions and compatibility with Magento 2.4+. Deployment on Adobe Commerce with staging should be verified in the version of the environment you use.
Available robots tag values
- INDEX, FOLLOW — allow indexing and following links.
- INDEX, NOFOLLOW — indexing with a directive for links.
- NOINDEX, FOLLOW — exclude the page from the index while keeping link following enabled.
- NOINDEX, NOFOLLOW — a combination of both directives.
- default — inherit the global setting.
Rules for URL paths
In Stores → Configuration → Kowal → Robots, you enable the module and complete separate lists of noindex and nofollow paths. Add entries one per line.
Matching compares the beginning of the request path, ignoring surrounding slashes. Query parameters are not part of this comparison. Plan rules so that their prefixes cover the correct subpages.
Login, registration, and customer account
Automatic rel='nofollow' applies to supported login, registration, and account link blocks. These are elements related to sessions and forms, usually without the goal of positioning them as offer pages.
URLs may include, for example, referer= or SID=. Marking links helps organize signals for crawlers, but nofollow alone does not protect such URLs from being indexed.
Wishlist and comparison
Wishlist and comparison links may lead to individual or temporary content that depends on the session. This applies, for example, to /wishlist/index/index/ and /catalog/product_compare/.
In Search Console, such or other auxiliary URLs may appear in reports as ‘Duplicate without user-selected canonical’ or ‘Crawled – currently not indexed’. These are examples of situations to analyze, not issues that adding nofollow alone is guaranteed to remove.
What does nofollow mean for SEO?
rel='nofollow' gives Google a hint about how to treat the link. It does not guarantee that the crawler will never visit it, that the URL will not be indexed, or that crawl budget usage will improve.
The earlier description associated nofollow with not passing PageRank and link juice. Google treats these markings as hints, so they should not be presented as an absolute block. To exclude a page from indexing, use noindex on a page that the crawler can fetch.
Link coverage depends on theme blocks
The code also supports selected links in the product list toolbar, review rendering, ‘add to’ buttons, and product information blocks. The actual result depends on how the theme renders these blocks.
Check the HTML after deployment and match the scope to the store’s linking strategy. Links present on many pages may also be visited by crawlers from other sources.
For SEO specialists and administrators
The solution is intended for SEO specialists, Magento administrators, and store owners who want to manage the visibility of selected pages and organize indexing directives.
Installation is performed via Composer. Kowal helps with configuration and deployment. The interpretation of nofollow and noindex is described by Google Search Central.
Installation via Composer
Package kowal/module-robots, module Kowal_Robots. Configure access to the Kowal repository, install the package, enable the module, update Magento, and clear the cache. In production, include compilation and static content deployment according to the store’s process.
From configuration to result
1. You select a page or rule
You edit a CMS page, product, category, or list of paths.
2. You set directives
You choose index/noindex and follow/nofollow.
3. You check the result in the store
You verify the robots tag and the links affected by the change.
Auxiliary page outside search results
For the selected CMS page, you set NOINDEX, FOLLOW. A crawler that can fetch the page receives a directive regarding its indexing.
You separately analyze links to login, wishlist, and comparison. The nofollow marking is a hint about the link, not a ban on indexing the target page.
Match indexing to your store structure
Want to adapt the module to your store? Ask about a Kowal Robots implementation and discuss the configuration or required extensions.
More Information
| Theme compatibility | Luma / Blank, KOWAL |
|---|
Module Installation Instructions
Installation via Composer
You will receive the Composer repository access details, meaning the customer email address and license token, by email after purchase. They are also available in the customer panel after logging in at kowal.store. Replace TWOJ_EMAIL_KLIENTA with your account email address and TWOJ_TOKEN with the token you received. Run the commands in the Magento root directory.
composer config repositories.kowal composer https://repo.kowal.storecomposer config http-basic.repo.kowal.store 'TWOJ_EMAIL_KLIENTA' 'TWOJ_TOKEN'composer require kowal/module-robotsCompleting the installation
After installing the package, update Magento and clear the cache:
php bin/magento setup:upgradephp bin/magento cache:flushIn a production environment, also run DI compilation and deploy static files according to the store deployment process.