parse any HTML to XML using html5lib

2019-08-05 09:56发布

站内问答 / Python
609 1 5

I need to tidy up HTML pages and convert them to XML in Python; losing some "bad" parts if needed.

I used TagSoup for some time, but it doesn't understand new "article", "footer" tags, and doesn't like "meta" when they are not in the head; making resulting XML almost impossible to process.

I like what html5lib does so far, but my fifth test (very weird tests) failed; when parsing

<div attr="val"">

using html5lib + xml.dom treebuilder, I got the following in the resulting XML string:

<div attr="val" "="">

which is not a good result for well-formed xml.

When I tried html5lib + lxml as a treebuilder, I got that converted to

<div attr="val" U00022="">

which is better, but the problem is that lxml "eats" closing tags/slashes for <link> tags, making them just <link ... > when outputting XML.

What would you recommend to use?

1条回答
三岁会撩人
2楼-- · 2019-08-05 10:24

You can use method to set an Element to be self-closing or not, something like this:

from lxml import etree

tree = etree.Element('div', attrib={'attr':'val', 'U00022':''})
etree.tostring(tree)
'<div U00022="" attr="val"/>'

# parse as self-closing tag
etree.tostring(tree, method='xml')
'<div U00022="" attr="val"/>'
# parse as normal HTML
etree.tostring(tree, method='html')
'<div U00022="" attr="val"></div>'

Then just do whatever you want from it. When you're trying to write from the Element, you can also add method too:

tree = html5lib.parse('<div attr="val" U00022="">', treebuilder='lxml', namespaceHTMLElements=False)
tree.write('yourfilename', method='html')

Printout:

<html><head></head><body><div u00022="" attr="val"></div></body></html>
查看更多
0人赞 添加讨论(0) 举报
登录 后发表回答
相关问题
查看全部
相关文章
查看全部
收藏的人(5)