Chris Coddington

Can't seem to find where this attribute is set:

Content for this URL is excluded by the server because a no-index attribute.

This is the warning in the crawl log for an entire subsite.



Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

Janie Pumphrey

Did you ever find a solution for this I am getting the same error.



Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

Gangatha Mkele

Try removing all your crawl rules and run the crawl again.





Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

TheKid

Two reasons I can think of...

1. Check the 'Advanced Settings' of the 'Pages' document library and ensure that "Allows items from this document library to appear in search results' is set to Yes.

2. Perhaps more likely, goto the Site Settings and choose 'Search Visibility' under 'Site Administration'. I would suspect you have 'fine grained' permissions set and you have this set to 'Do not index'.

HTH, Vince

http://blog.thekid.me.uk






Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

Tarjei Lægreid

Another possibility is that the template pages are not published/approved. Go to your master page gallery and check that all your template pages (at least the ones that won't index) have approval status "Approved".

- Tarjei





Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

Berecca

Thanks so much - my content was being crawled fine before I added rules - then I added a rule (http://servername/*) and I got this error. Removed all rules and it crawled perfectly again!

What am I doing wrong with my rules




Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

Mosquiton

This is solution for me, add crawl rules but remove the check on

"Follow links on the URL without crawling the URL itself"

and "magically" all work

Bye





Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

GarethMD

Bingo,

Method 2 suggested by TheKid worked for me, thx...





Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

deepakjg

Are there any other solutions to this problem In my case I have sites in which most of the .ASPX pages are not getting indexed but all the documents are. I do not have any Crawl Rules and have verified that the Document Libraries and Sites are correctly configured to index everything.

Thanks in advance.





Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

adam.salah

Check your content sources, or if you have scopes defined, then check the scope rules. There could be cpntentclass based exclusions

You can also check the site/collection level search visibility http://yoursite/_layouts/srchvis.aspx which maybe set to false






Re: SharePoint - General Question and Answers and Discussion Content for this URL is excluded by the server because a no-index attribute.

deepakjg

Thanks for your reply.

I have checked and re-checked . I do NOT have any Content Rules or any Scope Rules configured. And yes, the Sites and Site Collection are configured to show Search Results in the URL you mentioned. Any other thoughts This is really bugging my client and me.