you may have heard about a robots.txt file and now everyone is talking about having AI search friendly.