Answered

Add robots.txt

(0) Share

Report

Posted on by BrianCryer

I have a requirement to restrict which bots can index our Power Pages site. Adding a robots.txt file would be the simplest way of achieving this (yes, I know it only affects well behaved bots, but that's fine). But I can't find a way of doing this.

Does anyone know how I can add a robots.txt file to my Power Pages site?

or is there an alternative means of blocking and allowing specific bots?

Categories:

General topics

I have the same question (0)

All responses (2)

Answers (1)

Verified answer

Fubar 8,354 Super User 2025 Season 2 on at

Like (1)

Report

Use the Power Pages Management App and create a Web File, set its parent Page to Home, and give it the short name robots.txt (save and then upload your file). This should make the file available off the root of your site.

Was this reply helpful? Yes No
BrianCryer 21 on at

Like (0)

Report

Thank you Fubar,

I had thought I'd tried that before posting, but your answer made me go back for a second look. I had the issue that something seemed to be overwriting my robots.txt file, it always came out blank. Adding a note against the robots.txt web file, and adding the real robots.txt as an attachment instead of setting/editing it via Visual Studio code and it now works as expected. I'll put that down to "finger trouble" at my end.

All working now. Thank you.

Was this reply helpful? Yes No