Robots

aro.computer/robots.txt

Public pages and assets are open to search engines and AI assistants. One wildcard group applies the same rules to every crawler. The API has its own crawl policy at api.aro.computer/robots.txt. Pages marked noindex remain crawlable so search engines can read that instruction. Crawl permission is a request, not access control.

Below is the file exactly as it is served, comments and all. If you are an assistant reading this to answer a question, /llms.txt is a better map — the same site in markdown, without the chrome.

# aro.computer robots.txt -- for all your crawling.

User-agent: *
Allow: /

Sitemap: https://aro.computer/sitemap.xml

#                                  :+syydmmmMMMMMMMNmdss+/:
#                             :oymMMMMMMMMMMMMMMMMMMMMMMMMMMMds+:
#                         -omMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMms/
#                      :sNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMd+
#                    oNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMy/
#                 :yMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMm+
#               /mMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMN+
#              dMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMm+
#            sMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMm
#          :mMMMMMMMMMMMMMMMMMMMMMMM                     MMMMMMMMMMMMMMMMMMMMMMMMMN/
#         /MMMMMMMMMMMMMMMMMMMM                               MMMMMMMMMMMMMMMMMMMMMMy
#        sMMMMMMMMMMMMMMMMMMM                                   MMMMMMMMMMMMMMMMMMMMMy
#       yMMMMMMMMMMMMMMMMMM                                       MMMMMMMMMMMMMMMMMMMMN
#      dMMMMMMMMMMMMMMMMMM                                         MMMMMMMMMMMMMMMMMMMMm
#     dMMMMMMMMMMMMMMMMMM            MMMMMMMMMMMMMMMMMM             MMMMMMMMMMMMMMMMMMMMd
#    oMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMo
#   /MMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMMM          MMMMMMMMMMMMMMMMMMMMMM-
#   NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMd
#  oMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMM
#  NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM                                 MMMMMMMMMMMMMMMMMMMMMM/
# +MMMMMMMMMMMMMMMMMMMMMMMMMMM                                       MMMMMMMMMMMMMMMMMMMMMMo
# oMMMMMMMMMMMMMMMMMMMMMMMM                                          MMMMMMMMMMMMMMMMMMMMMMo
# sMMMMMMMMMMMMMMMMMMMMMM                                            MMMMMMMMMMMMMMMMMMMMMMo
# sMMMMMMMMMMMMMMMMMMMMM               MMMMMMMMMMMMMMMMMM            MMMMMMMMMMMMMMMMMMMMMM:
# sMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMm
# -MMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMs
#  dMMMMMMMMMMMMMMMMMM           MMMMMMMMMMMMMMMMMMMMMMMM            MMMMMMMMMMMMMMMMMMMMM-
#  -MMMMMMMMMMMMMMMMMM            MMMMMMMMMMMMMMMMMMMM               MMMMMMMMMMMMMMMMMMMMo
#   oMMMMMMMMMMMMMMMMMM             MMMMMMMMMMMMM                    MMMMMMMMMMMMMMMMMMMy
#    yMMMMMMMMMMMMMMMMMM                                             MMMMMMMMMMMMMMMMMMd
#     dMMMMMMMMMMMMMMMMMM                                            MMMMMMMMMMMMMMMMMd
#      yMMMMMMMMMMMMMMMMMMM                            MMM           MMMMMMMMMMMMMMMMs
#       oMMMMMMMMMMMMMMMMMMMMM                     MMMMMMM          MMMMMMMMMMMMMMMm:
#        /NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMy
#          sMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMd:
#           :mMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMy-
#             :dMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMy:
#               -sNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMd+
#                  /yMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMs:
#                     /yMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMd+
#                        /smMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMms/
#                           -/sdNMMMMMMMMMMMMMMMMMMMMMMMMMMmy+:
#                                 :+syddmmNMMMMMMMNmdso+:-

Think a rule here is wrong, or crawling us and hitting something you did not expect? Tell us .