xml - 将�解码为真实字符

Question

当我从 Twitter 的 Stream API 读取数据然后写入 xmlfile 时。

但是一些特殊字符�会导致错误（我的意思是当我在 Chrome 中打开那个 xmlfile 时，Chrome 说那个字符有错误！）

我想�在写入 xmlfile 之前将该编码序列 ( ) 转换为真实字符 (�)！

如何实施？

- - - - - - -添加 - - - - - - -

这是 XMLFile 内容：

<?xml version="1.0" encoding="UTF-8"?>
<root>
<text>@carlyraejepsen would be a dream if you follow me, please follow me?, I love you so much you're my inspiration</text>
<text>someone please bring me a caramel apple and a mocha from black cat. i'll love you forever</text>
<text>“@G_MartinFlyKick: Marry me Juliet.I love you and that's all I really know.”&amp;#55357;&#56834;&#55357;&#56834;&#55357;&#56834;&#55357;&#56834;&#55357;&#56834;</text>
<text>"I need to see a picture of him cuz Im trying to imagine you guys making love and all I see is u climbing on top of a big question mark"lmao</text>
<text>@District3music hi, I LOVE YOU follow me please? &amp;lt;3 xx 23</text>
<text>RT @syardley_: So appreciative of my family and people I love, wouldn't be where I am without them. #thankful</text>
<text>#DISTRICT3HALLOWEENFOLLOWSPREE #DISTRICT3HALLOWEENFOLLOWSPREE #3EEKERFROMTHENETHERLANDS love you! Please follow ? @District3music x42</text>
<text>Arguably my favorite electronic music producer @Kluteuk is coming back to Toronto on Dec 22nd. So stoked. Guy has made so many tunes I LOVE.</text>
<text>The stakes are high, the water's rough, but this love is ours.</text>
<text>@NiallOfficial Answer me, I love you very much. Venezuela loves. jhgj</text>
<text>Love this shit http://t.co/qSP79NKx</text>
</root>

这是来自 Chrome 的错误：

This page contains the following errors:

error on line 5 at column 91: xmlParseCharRef: invalid xmlChar value 55357
Below is a rendering of the page up to the first error.

Answer 1

字符引用�表示代理代码点 (U+D83D)，因此尝试将其转换为字符是错误的。它不是一个字符，甚至不是半个字符。

您需要回溯到生成参考的点。原因可能是字符编码混乱。在 UTF-16 中，代理代码单元可能会出现，但当数据被解释为字符并例如转换为另一种编码或转换为字符引用时，必须成对处理。

Answer 2

您可以在服务器响应后使用正则表达式来替换它。python中的简单示例：

import re 
pattern = re.compile(r'&#')
new_content = pattern.sub(' ', SERVER_RESPONSE)