I never had a robots.txt
file on my website—I simply forgot to add it. Apparently, for Google’s crawler, no robots.txt
equals “don’t index.” 🤔 Ever since I added a robots.txt
file, Google’s crawler has been hanging out on my website non-stop. Now, I can finally find my pages on Google! 🤔