![Christian Oliveira on Twitter: "I recently had to deal with some robots.txt behaviour that "didn't make sense" and made me feel confused, until I discovered some things I didn't know, so I Christian Oliveira on Twitter: "I recently had to deal with some robots.txt behaviour that "didn't make sense" and made me feel confused, until I discovered some things I didn't know, so I](https://pbs.twimg.com/media/EJ6eumxW4AE1dg2.jpg)
Christian Oliveira on Twitter: "I recently had to deal with some robots.txt behaviour that "didn't make sense" and made me feel confused, until I discovered some things I didn't know, so I
![robots.txt file allows only google and its partners- other crawlers are blocked. - Google Search Central Community robots.txt file allows only google and its partners- other crawlers are blocked. - Google Search Central Community](https://storage.googleapis.com/support-forums-api/attachment/thread-22528582-4063670068939866613.png)
robots.txt file allows only google and its partners- other crawlers are blocked. - Google Search Central Community
![Fix robots.txt to allow search engines access to CSS, JavaScript and image files [#2364343] | Drupal.org Fix robots.txt to allow search engines access to CSS, JavaScript and image files [#2364343] | Drupal.org](https://www.drupal.org/files/issues/drupal-fix-robotstxt-to-allow-access-to-css-js-png-2364343-29-broken_patch_25.png)