Unicode issue when importing some tracks
Here're the tags of a track Funkwhale can't import :
IDv2 tag info for SeaDrive/My Libraries/Musique (1)/Linkin Park/Meteora/10 From the Inside.mp3
APIC=cover front, (image/jpeg, 40258 bytes)
COMM=ARTISTS=XXX=Linkin Park
COMM=BARCODE=XXX=093624884224
COMM=CATALOGNUMBER=XXX=9362 48842 2
COMM=COMPOSERSORT=XXX=Linkin Park
COMM=ENGINEER=XXX=John Ewing, Jr. / Fox Phelps
COMM=LABEL=XXX=Warner Bros. Records
COMM=LYRICIST=XXX=Linkin Park
COMM=MEDIA=XXX=CD
COMM=MIXER=XXX=Andy Wallace
COMM=MUSICBRAINZ_RELEASEGROUPID=XXX=09474d62-17dd-3a4f-98fb-04c65f38a479
COMM=MUSICBRAINZ_RELEASETRACKID=XXX=d6db27ab-5e56-35e2-a20e-3e692d24309f
COMM=ORIGINALDATE=XXX=2003-03-24
COMM=ORIGINALYEAR=XXX=2003
COMM=PRODUCER=XXX=Don Gilmore / Linkin Park
COMM=RELEASECOUNTRY=XXX=TH
COMM=RELEASESTATUS=XXX=official
COMM=RELEASETYPE=XXX=album
COMM=SCRIPT=XXX=Latn
TALB=Meteora
TCOM=Linkin Park
TIT2=From the Inside
TPE1=Linkin Park
TPE2=Linkin Park
TPOS=1/1
TRCK=10/13
TXXX=MusicBrainz Album Artist Id=f59c5520-5f46-4d2c-b2c4-822eabf53419
TXXX=MusicBrainz Album Id=13bc8649-5b1b-331a-b57a-a41db1c8335c
TXXX=MusicBrainz Artist Id=f59c5520-5f46-4d2c-b2c4-822eabf53419
TXXX=musicbrainz_albumartistid=f59c5520-5f46-4d2c-b2c4-822eabf53419
TXXX=musicbrainz_albumid=13bc8649-5b1b-331a-b57a-a41db1c8335c
TXXX=musicbrainz_artistid=f59c5520-5f46-4d2c-b2c4-822eabf53419
TYER=2004
UFID=http://musicbrainz.org=b'511529d3-54a0-4433-b4e0-ca90cb4c42f6\x00'
(it has been tagged with Picard)
When importing it (using in-place import) :
1/1 Importing /opt/funkwhale_1/data/music/server/Linkin Park/Meteora/10 From the Inside.mp3...
Error while importing /opt/funkwhale_1/data/music/server/Linkin Park/Meteora/10 From the Inside.mp3: DataError ERREUR: séquence d'échappement Unicode non supportée
LINE 1: ..., "import_status" = 'errored', "import_details" = '{"error_c...
^
DETAIL: \u0000 ne peut pas être converti en texte.
CONTEXT: données JSON, ligne 1 : ...: "f59c5520-5f46-4d2c-b2c4-822eabf53419", "mbid":...
Successfully imported 1 tracks
1 tracks could not be imported:
- /opt/funkwhale_1/data/music/server/Linkin Park/Meteora/10 From the Inside.mp3: DataError ERREUR: séquence d'échappement Unicode non supportée
LINE 1: ..., "import_status" = 'errored', "import_details" = '{"error_c...
^
DETAIL: \u0000 ne peut pas être converti en texte.
CONTEXT: données JSON, ligne 1 : ...: "f59c5520-5f46-4d2c-b2c4-822eabf53419", "mbid":...
For details, please refer to import reference 'cli-2019-11-05T12:12:09.872908+00:00' or URL https://zic.lapiole.local/content/libraries/d8a629f7-be67-4b34-a7fd-f12f08759746/upload?import=cli-2019-11-05T12%3A12%3A09.872908%2B00%3A00
Environment :
- Funkwhale 0.20.1 (non Docker)
- CentOS 7
- Python 3.6.3 (funkwhale installed in a venv)
- PostgreSQL 11.5 (running on a different VM)