{var%20f='http://v.t.sina.com.cn/share/share.php?appkey=1515056452',u=z||d.location,p=['&url=',e(u),'&title=',e(t||d.title),'&source=',e(r),'&sourceUrl=',e(l),'&content=',c||'gb2312','&pic=',e(p||'')].join('');function%20a(){if(!window.open([f,p].join(''),'mb',['toolbar=0,status=0,resizable=1,width=440,height=430,left=',(s.width-440)/2,',top=',(s.height-430)/2].join('')))u.href=[f,p].join('');};if(/Firefox/.test(navigator.userAgent))setTimeout(a,0);else%20a();})(screen,document,encodeURIComponent,'','','https://www.manongdao.com/data/attach/logo/logo.png', '推荐 成全新的幸福 的问题《Restrict robot access for (specific) query string》','https://www.manongdao.com/q-811022.html','页面编码gb2312|utf-8默认gb2312'));){kind=link}
Using robot.txt is it possible to restrict robot access for (specific) query string (parameter) values?
ie
http://www.url.com/default.aspx #allow
http://www.url.com/default.aspx?id=6 #allow
http://www.url.com/default.aspx?id=7 #disallow
相关问题
- should rel-canonical also include protocol (http/h
- Fetch as Google Webmaster tools
- Will dynamically generated content via Javascript
- When will my site's CSS affect my search engin
- Microdata/Schema.org/SEO: How to properly set a Co
相关文章
- Rendering plain text through PHP
- Dynamic robots.txt
- When does Googlebot execute javascript?
- Pretty Paths in Rails
- Is this Anti-Scraping technique viable with Robots
- xpath in =importXML() for extracting meta descript
- Does the user agent string have to be exactly as i
- Short URL or long URL for SEO
You only need to specify the url's that are disallowed. Everything else is allowed by default.
Can just the query variable defined such as
Disallow: /default.aspx?id=*
or better still
Disallow: /?id=