Mf d Z dZddlZddlZddlZddlZddlZddlmZ ddl m
Z
m Z m Z m
Z
mZmZmZmZmZ ddlmZmZmZ eZ ddlmZ dZn
# e$ r d ZY nw xY w ddl Z dZ n
# e$ r d Z Y nw xY w ddl Z dZ e j! j" Z"n# e$ r d Z d
Z"Y nw xY wd Z# G d d
e$ Z% G d de$ Z& G d de& Z' G d de& Z( G d de' Z)dS )zHelper classes for tests.MIT N)
BeautifulSoup) CharsetMetaAttributeValueCommentContentMetaAttributeValueDoctypePYTHON_SPECIFIC_ENCODINGS SoupStrainerScript
StylesheetTag)DetectsXMLParsedAsHTMLHTMLParserTreeBuilderXMLParsedAsHTMLWarning)SelectorSyntaxErrorTF)r u-
A bare string
A tag
A tag that supposedly has contents.
AT&T
This numeric entity is missing the final semicolon:
r r r )r r doctype_stringr r r s r r z/HTMLTreeBuilderSmokeTest._document_with_doctypeo sK .0@0@0@A>)yy ~~f%%t++r c Z | d | d dS )z?Make sure normal, everyday HTML doctypes are handled correctly.htmlz4html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"Nr r s r test_normal_doctypesz-HTMLTreeBuilderSmokeTest.test_normal_doctypesv s@ !!&))) !! B D D D D Dr c ~ | d }|j d }d| k sJ d S )Nz
r r )r rH strip)r r r s r test_empty_doctypez+HTMLTreeBuilderSmokeTest.test_empty_doctype| s> yy &&-"W]]__$$$$$$r c dD ]}| d| \ }}|j d }|j t k sJ |dk sJ | d d t | dk sJ |j j d dk sJ d S )N)r DocTyper r r s r r r s r test_mixed_case_doctypez0HTMLTreeBuilderSmokeTest.test_mixed_case_doctype s 6 / / $ ; ;(! ! K mA&G$////f$$$$;;v&&'8K(8(8'89=OOOOO 6?1%..... / /r c 4 d}| | d S )Nznhtml PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"r )r r s r test_public_doctype_with_urlz5HTMLTreeBuilderSmokeTest.test_public_doctype_with_url s$ C !!'*****r c 0 | d d S )Nz$foo SYSTEM "http://www.example.com/"r r s r test_system_doctypez,HTMLTreeBuilderSmokeTest.test_system_doctype s !!"HIIIIIr c 0 | d d S )Nz#xsl:stylesheet SYSTEM "htmlent.dtd"r r s r test_namespaced_system_doctypez7HTMLTreeBuilderSmokeTest.test_namespaced_system_doctype !!"GHHHHHr c 0 | d d S )Nz#xsl:stylesheet PUBLIC "htmlent.dtd"r r s r test_namespaced_public_doctypez7HTMLTreeBuilderSmokeTest.test_namespaced_public_doctype r r c $ d}t j d 5 }| | }ddd n # 1 swxY w Y | d dd | dd k sJ |g k sJ dS )zJA real XHTML document should come out more or less the same as it went in.
Hello.
Goodbye.
TrecordNutf-8
r )warningscatch_warningsr r replacer r wr s r test_real_xhtml_documentz1HTMLTreeBuilderSmokeTest.test_real_xhtml_document s
$D
1
1
1 %Q99V$$D % % % % % % % % % % % % % % %{{7##++E3776>>%QT;U;UUUUU Bwwwwww
:>>c d}t j d 5 }| | }d d d n # 1 swxY w Y dt | d k sJ g |k sJ d S )Ns. contentTr r zns1:foo)r r r rG find_allr s r test_namespaced_htmlz-HTMLTreeBuilderSmokeTest.test_namespaced_html s G
$D
1
1
1 %Q99V$$D % % % % % % % % % % % % % % % C
i00111111 Qwwwwwwr c < d}t j d 5 }| | }|j j dk sJ d d d n # 1 swxY w Y |\ }t |j t sJ t |j t j k sJ d S )Ns7 stringTr rV )
r r r rX rV rI messager strMESSAGE)r r r r warnings r test_detect_xml_parsed_as_htmlz7HTMLTreeBuilderSmokeTest.test_detect_xml_parsed_as_html s P
$D
1
1
1 /Q99V$$D8?h..... / / / / / / / / / / / / / / / '/+ABBBBB7?##'='EEEEEEEs (A
AAc d}| | }|| k sJ d}| | }|| d k sJ d S )Nzs r )r r. r rx s r test_processing_instructionz4HTMLTreeBuilderSmokeTest.test_processing_instruction sl
.yy &&&&.yy V,,,,,,,,r c 8 t j | j dS )zMake sure you can copy the tree builder.
This is important because the builder is part of a
BeautifulSoup object, and we want to be able to copy that.
N)copydeepcopyr r s r
test_deepcopyz&HTMLTreeBuilderSmokeTest.test_deepcopy s
d*+++++r c | d }|j j rJ t |j dk sJ dS )zA
tag is never designated as an empty-element tag.
Even if the markup shows it as an empty-element tag, it
shouldn't be presented that way.
N)r r r r r s r !test_p_tag_is_never_empty_elementz:HTMLTreeBuilderSmokeTest.test_p_tag_is_never_empty_element sE yy 6****46{{i''''''r c | dd | dd | dd dS )zA tag that's not closed by the end of the document should be closed.
This applies to all tags except empty-element tags.
r zzz
Nr8 r s r test_unclosed_tags_get_closedz6HTMLTreeBuilderSmokeTest.test_unclosed_tags_get_closed sL
*** *** )))))r c | d }|j j sJ t |j dk sJ dS )zA tag is designated as an empty-element tag.
Some parsers treat as one tag, some parsers as
two tags, but it should always be an empty-element tag.
z r N)r r r r r s r #test_br_is_always_empty_element_tagzr r s r test_nested_formatting_elementsz8HTMLTreeBuilderSmokeTest.test_nested_formatting_elements s -.....r c v d}| | }d| d d k sJ d S )Nz
Ordinary HEAD element test
Hello, world!
ztext/javascriptr type)r find)r r r s r test_double_headz)HTMLTreeBuilderSmokeTest.test_double_head sB yy DIIh$7$7$???????r c : d}| | | | }| d }|j t k sJ | d }||j k sJ | d }||j k sJ d S )Nz
foobaz
foobarrU r baz)r8 r r r r r; r< )r r r commentr r s r test_commentz%HTMLTreeBuilderSmokeTest.test_comment s - yy ))8),, G++++ iiui%%#*****iiui%%#.......r c d}d}| | | | | | }|j |k sJ | | }|j |k sJ | d }|j dk sJ dS )zWhitespace must be preserved in
and
zz
N)r8 r preprettifytextarea)r
pre_markuptextarea_markupr s r -test_preserved_whitespace_in_pre_and_textareazFHTMLTreeBuilderSmokeTest.test_preserved_whitespace_in_pre_and_textarea& s *
> $$$ )))yy$$x ""j0000yy ))}%%''?::::yy011}%%''+DDDDDDDr c d}| | d}| | d}| | dS )z+Inline elements can be nested indefinitely.zInside a B tagz!
Nr )r b_tag nested_b_tagdouble_nested_b_tags r test_nested_inline_elementsz4HTMLTreeBuilderSmokeTest.test_nested_inline_elements8 sT ' : &&& O &&&&&r c | d }|j }|j j j dk sJ |j j dk sJ dS )z Block elements can be nested.z*
Foo
FooN)r
blockquoter rk rV )r r r s r test_nested_block_level_elementsz9HTMLTreeBuilderSmokeTest.test_nested_block_level_elementsC sO yyEFF_
|~$----|"e++++++r c ` d}| |d | d dS )z$One table can go inside another one.z[
Here's another table:
foo
zh
Here's another table:
foo
z{
Foo
Bar
Baz
Nr )r r s r test_correctly_nested_tablesz5HTMLTreeBuilderSmokeTest.test_correctly_nested_tablesJ sT "
! " " "
; < < < < r barrj divzfoo bar)class_)r r r rx s r *test_multivalued_attribute_with_whitespacezCHTMLTreeBuilderSmokeTest.test_multivalued_attribute_with_whitespace^ sa 0yy u~'!22222 x499U99========r c f d}| | }dg|j j d k sJ d S )Nz1
cssrj )r r rx s r (test_deeply_nested_multivalued_attributezAHTMLTreeBuilderSmokeTest.test_deeply_nested_multivalued_attributej s= Eyy w$(,w///////r c ^ d}| | }ddg|j d k sJ d S )Nzrq rk rj )r r rx s r "test_multivalued_attribute_on_htmlz;HTMLTreeBuilderSmokeTest.test_multivalued_attribute_on_htmlr s< -yy SzTYw ///////r c 2 | dd d S )Nzzr r s r 3test_angle_brackets_in_attribute_values_are_escapedzLHTMLTreeBuilderSmokeTest.test_angle_brackets_in_attribute_values_are_escapedz s *,CDDDDDr c 2 | dd d S )Nz$
• AT&T is in the s&p 500
u)
• AT&T is in the s&p 500
r r s r 3test_strings_resembling_character_entity_referenceszLHTMLTreeBuilderSmokeTest.test_strings_resembling_character_entity_references} s,
2 :
r c 2 | dd d S )Nz
Bob's Bar
z
Bob's Bar
r r s r test_apos_entityz)HTMLTreeBuilderSmokeTest.test_apos_entity s* #
r c X d}| | }d|j j k sJ d S )Nz%
“Hello” -☃
u “Hello” -☃r r rV rx s r *test_entities_in_foreign_document_encodingzCHTMLTreeBuilderSmokeTest.test_entities_in_foreign_document_encoding s5 9yy !TV]222222r c d}| d| | d| | d| | d| d S )Nu zzzzr r expects r 0test_entities_in_attributes_converted_to_unicodezIHTMLTreeBuilderSmokeTest.test_entities_in_attributes_converted_to_unicode si H 3V<<< 3V<<< 3V<<< 5v>>>>>r c d}| d| | d| | d| | d| d S )Nu
piñata
z
piñata
z
piñata
z
piñata
z
piñata
r r' s r *test_entities_in_text_converted_to_unicodezCHTMLTreeBuilderSmokeTest.test_entities_in_text_converted_to_unicode si B -v666 -v666 -v666 /88888r c 2 | dd d S )Nz#
I said "good day!"
z
I said "good day!"
r r s r ,test_quot_entity_converted_to_quotation_markzEHTMLTreeBuilderSmokeTest.test_quot_entity_converted_to_quotation_mark s* > 9 ; ; ; ; ;r c d}| d| | d| | d| d S )Nu �z�z�z
�r r' s r test_out_of_range_entityz1HTMLTreeBuilderSmokeTest.test_out_of_range_entity sQ , ,f555 -v666 &11111r c | d }d|j j j j k sJ d|j j k sJ | | dS )zDMostly to prevent a recurrence of a bug in the html5lib treebuilder.z!
foo
r N)r h2rV r; r+ r r@ r s r test_multipart_stringsz/HTMLTreeBuilderSmokeTest.test_multipart_strings s^ yy=>>dgn166666dfk!!!! &&&&&r c ^ | dd | dd dS )zqVerify consistent handling of empty-element tags,
no matter how they come in through the markup.
z
z
Nr r s r r z0HTMLTreeBuilderSmokeTest.test_empty_element_tags s:
*,=>>> -/@AAAAAr c z d}| | }|j j J | | dS )8Prevent recurrence of a bug in the html5lib treebuilder.z?
foo
N)r r bodyr@ r contentr s r #test_head_tag_between_head_and_bodyz
r )r rP expecteds r 1test_entities_in_strings_converted_during_parsingzJHTMLTreeBuilderSmokeTest.test_entities_in_strings_converted_during_parsing s* ?Y x(((((r c X d}| | }|j j dk sJ d S )Ns
Foo
u ‘Foo’r$ )r quoter s r )test_smart_quotes_converted_on_the_way_inzBHTMLTreeBuilderSmokeTest.test_smart_quotes_converted_on_the_way_in# s6 &yy v} bbbbbbbr c T | d }|j j dk sJ d S )Nzu )r rq rV r s r 0test_non_breaking_spaces_converted_on_the_way_inzIHTMLTreeBuilderSmokeTest.test_non_breaking_spaces_converted_on_the_way_in* s0 yy.//v} 8888888r c d}d d }| | }|j d |k sJ d S )NrZ r[ r )r r r )r rP r\ r s r &test_entities_converted_on_the_way_outz?HTMLTreeBuilderSmokeTest.test_entities_converted_on_the_way_out. sO >Y``ahiiyyv}}W%%111111r c d}| d }| | }| d }| dd }| d }||k sJ d S )Nu
Sacré bleu!
z
iso-8859-1r z
ISO-8859-1)r r r )r unicode_htmliso_latin_htmlr resultr\ s r test_real_iso_8859_documentz4HTMLTreeBuilderSmokeTest.test_real_iso_8859_document4 s
~ &,,\:: yy (( W%%
'' g>> ??7++ !!!!!!r c d}| d }| | }| d | d k sJ | d | d k sJ d S )Nsk
Shift-JISŃR[fBOꂽ{̃t@CłB
z shift-jisr euc_jp)r. r r )r shift_jis_htmlrf r s r test_real_shift_jis_documentz5HTMLTreeBuilderSmokeTest.test_real_shift_jis_documentP s
$ &,,[99 yy && {{7##|':':7'C'CCCCC{{8$$ (;(;H(E(EEEEEEEr c d}| |d }|j dv sJ | d | d d k sJ d S )Ns Hebrew (ISO 8859-8) in Visual Directionality
Hebrew (ISO 8859-8) in Visual Directionality
iso8859-8)
from_encoding)ro z
iso-8859-8r )r original_encodingr r. )r hebrew_documentr s r test_real_hebrew_documentz2HTMLTreeBuilderSmokeTest.test_real_hebrew_documenta s Eyy ; 8 8 %)DDDDD{{7## " "; / / 6 6w ? ?
r c d}d|z }| | }| dddi }|d }d|k sJ t |t sJ d| d k sJ d S )
NzEj
%s
Shift-JIS markup goes here.r z
http-equivz Content-typer8 ztext/html; charset=x-sjisztext/html; charset=utf8r )r r rI r r )r meta_tagrl r parsed_metar8 s r 'test_meta_tag_reflects_current_encodingz@HTMLTreeBuilderSmokeTest.test_meta_tag_reflects_current_encodingn s 2
7:BC yy (( ii ~(FGG i(*g5555 '#<===== )GNN6,B,BBBBBBBr c d}d|z }| | }| dd }|d }d|k sJ t |t sJ d| d k sJ d S ) Nz'ru r encodingr_ charsetzx-sjisr )r r rI r r )r rv rl r rw r{ s r 3test_html5_style_meta_tag_reflects_current_encodingzLHTMLTreeBuilderSmokeTest.test_html5_style_meta_tag_reflects_current_encoding s >
7:BC yy (( ii:i66 i(7"""" '#<===== ////////r c dD ]Z}| | }t D ];}|dv r| | }d|v sJ | d |vsJ <[d S )N)sB idnambcsoem undefined
string_escapez
string-escapes meta charset=""asciir r r r r r rz encodeds r 2test_python_specific_encodings_not_used_in_charsetzKHTMLTreeBuilderSmokeTest.test_python_specific_encodings_not_used_in_charset s
? ?F 99V$$D 5
?
? ++h//)W4444 w//w>>>>>
? ? ?r c | d }d|j d< d|j k sJ d S )Nz textr r ztext)r rq r. )r datas r 5test_tag_with_no_attributes_can_have_attributes_addedzNHTMLTreeBuilderSmokeTest.test_tag_with_no_attributes_can_have_attributes_added s? yy '' u
&$&--//999999r c n | d }d|j k sJ d S )Nz0