Welcome to Admin Junkies, Guest — join our community!

Register or log in to explore all our content and services for free on Admin Junkies.

✔️ Resolved Too many robots crawling?

Status
Not open for further replies.

Alex

Service Team
Service Team
Joined
Oct 6, 2022
Messages
563
Credits
870
Not sure how quickly these stats update but 150 robots does seem on the high side. Site is handling okay, but are they warranted?

You can disallow all and allow only certain crawlers through .htaccess in FTP.IMG_2526.jpeg
 
150 bots isn't so weird as it seems though. A lot of them go through Cloudflare, only allowing known bots. So I wouldn't worry too much about it.
 
150 bots isn't so weird as it seems though. A lot of them go through Cloudflare, only allowing known bots. So I wouldn't worry too much about it.
All good, just wanted to make sure it wasn't anything sus.
 
Status
Not open for further replies.

Log in or register to unlock full forum benefits!

Log in or register to unlock full forum benefits!

Register

Register on Admin Junkies completely free.

Register now
Log in

If you have an account, please log in

Log in
Activity
So far there's no one here

Users who are viewing this thread

New Threads

Would You Rather #9

  • Start a forum in a popular but highly competitive niche

    Votes: 5 20.8%
  • Initiate a forum within a limited-known niche with zero competition

    Votes: 19 79.2%
Win this space by entering the Website of The Month Contest

Theme editor

Theme customizations

Graphic Backgrounds

Granite Backgrounds