Skip to main content
tdro

Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

tdro micro.thedroneely.com (edited) view Markdown Plaintext Embed Permalink 125/50 words 42s read

Some of you were curious. Text assistants and bots are booming, as shovelers seek the god oracle and magnum opus. Here’s the numbers for a naked robots.txt. Inferences, up to you.

7,151,956 8,800,740 × 100 81.27 %
(1) Approximately (at least) 81% of requests are machine generated
In (30 day) levels of aggression, with the most aggresive/inefficient crawler at the bottom;
  1. Applebot/0.1 [20.1 ]
  2. heritrix/3.4.0-20200304 [21.8 MiB]
  3. YandexBot/3.0 [28 MiB]
  4. GPTBot/1.0 [30.1 MiB]
  5. IonCrawl [31.6 MiB]
  6. CCBot/2.0 [40.6 MiB]
  7. DataForSeoBot/1.0 [51.2 MiB]
  8. SeznamBot/4.0 [58.6 MiB]
  9. facebookexternalhit/1.1 [64.1 MiB]
  10. Google-Read-Aloud [86 MiB]
  11. PetalBot [91.3 MiB]
  12. Barkrowler/0.9 [98.6 MiB]
  13. SemrushBot/7~bl [141.1 MiB]
  14. BLEXBot/1.0 [152 MiB]
  15. AhrefsBot/7.0 [159.5 MiB]
  16. MJ12bot/v1.4.8 [285.2 MiB]
  17. bingbot/2.0 [373.4 MiB]
  18. Googlebot/2.1 [535.2 MiB]
  19. Bytespider [543 MiB]
  20. DotBot/1.2 [806 MiB]
  21. Amazonbot/0.1 [2.6 ]
#web
Related Tags — #web
tdro

Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

tdro micro.thedroneely.com view Markdown Plaintext Embed Permalink 26/50 words 9s read

Rule #1 of finding technical feeds; type ‘OPML’ into GitHub search. GitHub is like a social network for software engineers and I’m a conservationist of time.

#web
tdro

Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

tdro micro.thedroneely.com view Markdown Plaintext Embed Permalink 17/50 words 6s read

Are you a safe kid? I’ve just had a memory of a past time in a library.

#web
tdro

Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

tdro micro.thedroneely.com view Markdown Plaintext Embed Permalink 12/50 words 4s read

Authors

Gallery

Following (6)

Web Ring