Unsolved 503 Service Unavailable (temporary?) Rogerbot takes a break
-
A lot of my Moz duties seem to be setting hundreds of issues to ignore because my site was getting crawled while under maintenance. Why can't Rogerbot take a break after running into a few of these and then try again later? Is there an official code for Temporary Service Unavailability that can smart bots pause crawls so that they are not wasting compute, bandwidth, crawl budget and my time?
-
@awilliams_kingston said in 503 Service Unavailable (temporary?) Rogerbot takes a break:
A lot of my Moz duties seem to be setting hundreds of issues to ignore because my site was getting crawled while under maintenance. Why can't Rogerbot take a break after running into a few of these and then try again later? Is there an official code for Temporary Service Unavailability that can smart bots pause crawls so that they are not wasting compute, bandwidth, crawl budget and my time?
You can use HTTP status code 503 for Temporary Service Unavailability to signal bots to pause crawls and try later.
-
@KerryDuggan said in 503 Service Unavailable (temporary?) Rogerbot takes a break:
Hi Kerry/
It says chat is not available right now.
I'll send an email with the same message. -
@awilliams_kingston Hi,
Thanks for reaching out!
My apologies for the delayed response. Can you pop us an email at help@moz.com or message us via chat in Moz Pro and we can look into this for you?
Have a lovely day,
Kerry.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rogerbot directives in robots.txt
I feel like I spend a lot of time setting false positives in my reports to ignore. Can I prevent Rogerbot from crawling pages I don't care about with robots.txt directives? For example., I have some page types with meta noindex and it reports these to me. Theoretically, I can block Rogerbot from these with a robots,txt directive and not have to deal with false positives.
Reporting & Analytics | | awilliams_kingston0 -
520 Error from crawl report with Cloudflare
I am getting a lot of 520 Server Error in crawl reports. I see this is related to Cloudflare. We know 520 is Cloudflare so maybe the Moz team can change this from "unknown" to "Cloudflare 520". Perhaps the Moz team can update the "how to fix" section in the reporting, if they have some possible suggestions on how to avoid seeing these in the report of if there is a real issue that needs to be addressed. At this point I don't know. There must be a solution that Moz can provide like a setting in Cloudflare that will permit the Rogerbot if Cloudflare is blocking it because it does not like its behavior or something. It could be that Rogerbot is crawling my site on a bad day or at a time when we were deploying a massive site change. If I know when my site will be down can I pause Rogerbot? I found this https://developers.cloudflare.com/support/troubleshooting/general-troubleshooting/troubleshooting-crawl-errors/
Technical SEO | | awilliams_kingston0 -
Solved Why is MOZ crawl taking so long?
I began my site crawl on November 3rd and now it is November 7th and it is still "in progress". Why is this happening?
Product Support | | CarisaS_Wenda0 -
I think i hv mistakenly subscribed for the service, and paid for two months already
I didn't recognise it before, and subscribed your service for two months already. Therefore, I unsubscribed immediately, but it already billed me for two month service. As you can check and see, I should have not use or even login for month, would you waive the latest bill and cut my service immediately? sorry for any inconvenience caused, thanks!
Product Support | | CalvinC0 -
Forgot to cancel and never used this service how can I be refunded??
I was considering starting in online business but decided not to but forgot to cancel 30 day trial therefore I am unable to use the service but yeah I still got billed and I never use the service how can I get refunded?
Product Support | | myintimatebox.com0 -
Is there an option to purchase only the Followerwonk service?
I am only interested in this service. Also, I am in a demo period and although I've linked my Moz account to Followerwonk, the features are still unavailable to me to test them out. Thanks!
Product Support | | dgadoury0 -
Maintenance Alert: Moz Analytics + Pro unavailable for Maintenance tonight from 7-7:30pm PST
Hello! We've posted this within the apps, as well as on our social channels, but I wanted to share it here as well. We are doing required database maintenance tonight starting at 7pm, Pacific time. This update will help make things work a bit quicker. Woot! The rest of the tools will still be available at http://moz.com/researchtools. Thank you for your patience!
Product Support | | jennita2
