User-agent: * Disallow: /cbdefense/ Disallow: /wp-admin/ Disallow: /file-category/ Disallow: /*.pdf Disallow: /vdflookup/ Disallow: /file-tag/ Allow: /wp-admin/admin-ajax.php