Skip to main content
tdro

Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

tdro micro.thedroneely.com (edited) view
  • Markdown Plaintext Embed Permalink
  • 125/50 words 42s read

    Some of you were curious. Text assistants and bots are booming, as shovelers seek the god oracle and magnum opus. Here’s the numbers for a naked robots.txt. Inferences, up to you.

    7,151,956 8,800,740 × 100 81.27 %
    (1) Approximately (at least) 81% of requests are machine generated
    In (30 day) levels of aggression, with the most aggresive/inefficient crawler at the bottom;
    1. Applebot/0.1 [20.1 ]
    2. heritrix/3.4.0-20200304 [21.8 MiB]
    3. YandexBot/3.0 [28 MiB]
    4. GPTBot/1.0 [30.1 MiB]
    5. IonCrawl [31.6 MiB]
    6. CCBot/2.0 [40.6 MiB]
    7. DataForSeoBot/1.0 [51.2 MiB]
    8. SeznamBot/4.0 [58.6 MiB]
    9. facebookexternalhit/1.1 [64.1 MiB]
    10. Google-Read-Aloud [86 MiB]
    11. PetalBot [91.3 MiB]
    12. Barkrowler/0.9 [98.6 MiB]
    13. SemrushBot/7~bl [141.1 MiB]
    14. BLEXBot/1.0 [152 MiB]
    15. AhrefsBot/7.0 [159.5 MiB]
    16. MJ12bot/v1.4.8 [285.2 MiB]
    17. bingbot/2.0 [373.4 MiB]
    18. Googlebot/2.1 [535.2 MiB]
    19. Bytespider [543 MiB]
    20. DotBot/1.2 [806 MiB]
    21. Amazonbot/0.1 [2.6 ]
    #web
    Related Tags — #web
    tdro

    Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

    tdro micro.thedroneely.com view
  • Markdown Plaintext Embed Permalink
  • 26/50 words 9s read

    Rule #1 of finding technical feeds; type ‘OPML’ into GitHub search. GitHub is like a social network for software engineers and I’m a conservationist of time.

    #web
    tdro

    Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

    tdro micro.thedroneely.com view
  • Markdown Plaintext Embed Permalink
  • 17/50 words 6s read

    Are you a safe kid? I’ve just had a memory of a past time in a library.

    #web
    tdro

    Another wandering soul whispering into the void. If you are looking for my blog you are in the wrong place. The profile and header pictures are brought to you by cdd20.

    tdro micro.thedroneely.com view
  • Markdown Plaintext Embed Permalink
  • 12/50 words 4s read

    Authors

    Gallery

    Web Feeds (6)

    Web Links