danvics/soulsync
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix duplicate detector ignoring similarity settings for remixes

Browse source 
Normalization was stripping parenthetical content before comparison,
so 'title' and 'title (xxx remix)' both became 'title' and always
matched at 1.0 regardless of the user's threshold setting.
This commit is contained in:
Broque Thomas 2026-03-18 12:47:34 -07:00
parent 2564e6bf4f
commit 8abcf386d5
1 changed files with 6 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
core/repair_jobs/duplicate_detector.py
View file

@ -207,9 +207,11 @@ class DuplicateDetectorJob(RepairJob):
def _normalize(text: str) -> str:
"""Normalize text for fuzzy comparison."""
"""Normalize text for fuzzy comparison.
Keeps parenthetical content (remixes, live, etc.) so that similarity
thresholds can distinguish 'title' from 'title xxx remix'.
"""
t = text.lower()
t = re.sub(r'\(.*?\)', '', t)
t = re.sub(r'\[.*?\]', '', t)
t = re.sub(r'[^a-z0-9 ]', '', t)
t = re.sub(r'[^a-z0-9() ]', '', t)
return t.strip()