WordPress announced an important change to how it will block search engines from indexing websites. This change abandons the traditional Robots.txt solution in favor of the Robots Meta Tag approach. The change brings WordPress in line with the reason for blocking Google, which is to keep the blocked pages from showing in Google’s search results.

This is the Robots Meta Tag that WordPress will use:

<META NAME=’ROBOTS’ CONTENT=’NOINDEX,NOFOLLOW’ />

Blocking Google From Indexing
It has long been a standard practice to use Robots.txt to block the “indexing” of a website.

The word “indexing” meant crawling of the site by GoogleBot. By using the Robots.txt blocking feature you could stop Google from read more
https://techevangelistseo.com/how-to-build-a-wordpress-ajax-form/