lp:beautifulsoup

Branch merges

Propose for merging

3 branches proposed for merging into this one.

Merged into lp:~dguitarbite/beautifulsoup/beautifulsoup at revision 437

Pranav Salunke: Pending requested 2016-04-06

Diff: 1562 lines (+584/-160)

18 files modified

AUTHORS.txt (+1/-1)
LICENSE (+1/-1)
NEWS.txt (+70/-3)
bs4/__init__.py (+82/-21)
bs4/builder/__init__.py (+5/-1)
bs4/builder/_html5lib.py (+116/-22)
bs4/builder/_htmlparser.py (+3/-0)
bs4/builder/_lxml.py (+16/-6)
bs4/dammit.py (+6/-4)
bs4/diagnose.py (+4/-1)
bs4/element.py (+66/-36)
bs4/testing.py (+34/-4)
bs4/tests/test_html5lib.py (+32/-0)
bs4/tests/test_soup.py (+30/-12)
bs4/tests/test_tree.py (+39/-6)
doc/source/index.rst (+33/-16)
prepare-release.sh (+44/-24)
setup.py (+2/-2)

api

Related source package recipes

1 recipe using this branch. (?)

Create packaging recipe

Related snap packages

Related bugs

Related blueprints

603. By Leonard Richardson on 2021-04-09

Brought in fuzz tests from the oss-project into Beautiful Soup's unit test suite.

602. By Leonard Richardson on 2021-02-14

NavigableString and its subclasses now implement the get_text()
  method, as well as the properties .strings and
  .stripped_strings. These methods will either return the string
  itself, or nothing, so the only reason to use this is when iterating
  over a list of mixed Tag and NavigableString objects. [bug=1904309]

601. By Leonard Richardson on 2021-02-14

The 'html5' formatter now treats attributes whose values are the
  empty string as HTML boolean attributes. Previously (and in other
  formatters), an attribute value must be set as None to be treated as
  a boolean attribute. In a future release, I plan to also give this
  behavior to the 'html' formatter. Patch by Isaac Muse. [bug=1915424]

600. By Leonard Richardson on 2021-02-13

The behavior of methods like .get_text() and .strings now differs
  depending on the type of tag. The change is visible with HTML tags
  like <script>, <style>, and <template>. Starting in 4.9.0, methods
  like get_text() returned no results on such tags, because the
  contents of those tags are not considered 'text' within the document
  as a whole.

  But a user who calls script.get_text() is working from a different
  definition of 'text' than a user who calls div.get_text()--otherwise
  there would be no need to call script.get_text() at all. In 4.10.0,
  the contents of (e.g.) a <script> tag are considered 'text' during a
  get_text() call on the tag itself, but not considered 'text' during
  a get_text() call on the tag's parent.

  Because of this change, calling get_text() on each child of a tag
  may now return a different result than calling get_text() on the tag
  itself. That's because different tags now have different
  understandings of what counts as 'text'. [bug=1906226] [bug=1868861]

599. By Leonard Richardson on 2021-02-13

Corrected the use of special string container classes in cases when a
  single tag may contain strings with different containers; such as
  the <template> tag, which may contain both TemplateString objects
  and Comment objects. [bug=1913406]

598. By Leonard Richardson on 2021-02-13

Added a second way to pass specify encodings to UnicodeDammit and
  EncodingDetector, based on the order of precedence defined in the
  HTML5 spec, starting at:
  https://html.spec.whatwg.org/multipage/parsing.html#parsing-with-a-known-character-encoding

  Encodings in 'known_definite_encodings' are tried first, then
  byte-order-mark sniffing is run, then encodings in 'user_encodings'
  are tried. The old argument, 'override_encodings', is now a
  deprecated alias for 'known_definite_encodings'.

  This changes the default behavior of the html.parser and lxml tree
  builders, in a way that may slightly improve encoding
  detection but will probably have no effect. [bug=1889014]

597. By Leonard Richardson on 2021-02-13

Performance improvement when processing tags that speeds up overall
  tree construction by 2%. Patch by Morotti. [bug=1899358]

596. By Leonard Richardson on 2021-02-13

Improve the warning issued when a directory name (as opposed to
  the name of a regular file) is passed as markup into the BeautifulSoup
  constructor. [bug=1913628]

595. By Leonard Richardson on 2021-02-13

Corrected output when the namespace prefix associated with a
  namespaced attribute is the empty string, as opposed to
  None. [bug=1915583]

594. By Leonard Richardson on 2020-10-24

Exclude more tests from the package. Patch by Ville Skyttä.