xml:parse() - infinite loop

the input file

I did some brief debugging: the method FragmentXmlLoader::loadXml() goes into an infinite loop with this input document. Specifically, when it starts parsing the <template head="R..." element, it repeatedly gets to line 332 in that file:

      if (theXQueryDiagnostics->errors().empty()
          &&
          theFragmentStream->current_offset == 0)
      {
        if (theFragmentStream->state == FragmentIStream::FRAGMENT_FIRST_START_DOC)
          FragmentXmlLoader::startDocument(theFragmentStream->ctxt->userData);
        xmlParseCharData(theFragmentStream->ctxt, 0);
        theFragmentStream->current_offset = getCurrentInputOffset(); // update current offset

And theFragmentStream->current_offset is set (again) to 0 at this point, meaning it will get to the same point the next time through, and so on.

Mauro - FYI, this wiki.xml file has no character references in it at all; did you put the right input file on this bug? In any case, it certainly does exhibit a bug.

@Chris, you are right, since I added the <?xml version="1.0" encoding="UTF-8" ?> xmllint also prints it properly. But with "xmllint --encode ascii wiki.xml" you get my describe behaviour, strange default..

Anyway, so all characters are valid UTF-8. But what I found is that most characters in that document aren't those they appear to be. For example most y's aren't actually the ordinary Y (&#121;) but rather the "Latin Capital Letter Y with hook" (&#435;). Similarily, some i's aren't actually the ordinary I (&#105;), but the "Cyrillic Small Letter Byelorussian-Ukrainian I" (&#1110). Hope that helps.