Overview
You can optimize the search index by marking generated pages as duplicates if they differ in dynamic content only. The crawler indexes only one from each set of pages that match a specified regex pattern.
Prerequisites
- Access to a SuperUser account
Solution
Testing
You can test that regex has successfully excluded the URL by:
- Go to the site's Search Results
- Search for the keyword that you've excluded in your Regular Expression.
Comments
0 comments
Please sign in to leave a comment.