1908051 - Intl.Segmenter grapheme splitting is incorrect for Indic languages

Status: RESOLVED DUPLICATE of bug 1899411

(Core :: Internationalization, defect)

Description

[FlameWolf]

Attachment: indic-grapheme-splitting.js

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:128.0) Gecko/20100101 Firefox/128.0

Steps to reproduce:

Run the below script in the browser console:

let input = "തേങ്ങാക്കുല";
let segmenter = new Intl.Segmenter();
let segments = [...segmenter.segment(input)].map(x => x.segment);
console.log(segments);

Actual results:

segments is an Array of length = 6:

[
  "തേ",
  "ങ്",
  "ങാ",
  "ക്",
  "കു",
  "ല"
]

Expected results:

segments should be an Array of length = 4:

[
    "തേ",
    "ങ്ങാ",
    "ക്കു",
    "ല"
]

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Core::Internationalization' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[André Bargull [:anba]]

Fixed by the update in bug 1899411. That means the next release (Firefox 129) will handle this case properly.