Hi Orama team! π
I built a Korean morphological tokenizer plugin for Orama: garu-orama-tokenizer.
Korean search with the default tokenizer has a real pain point β particles like μ/λ/μ΄/κ°/μ/λ₯Ό glue onto the noun, so searching for νκ΅ misses νκ΅μ, νκ΅λ₯Ό, νκ΅κ°. And verb inflections like λ¨Ήμλ€ vs λ¨Ήλλ€ never match each other. This plugin runs real morphological analysis under the hood, powered by garu-ko (a 1.9MB WASM analyzer that runs in browsers, Node, and edge).
Usage follows the standard Orama pattern (same as @orama/tokenizers/mandarin):
import { create, insert, search } from '@orama/orama'
import { createTokenizer } from 'garu-orama-tokenizer'
const db = await create({
schema: { title: 'string', body: 'string' },
components: { tokenizer: await createTokenizer() }
})
Would you consider linking this from the Tokenizers docs page or your community integrations list? Happy to send a docs PR if that's easier.
Links:
Hi Orama team! π
I built a Korean morphological tokenizer plugin for Orama: garu-orama-tokenizer.
Korean search with the default tokenizer has a real pain point β particles like
μ/λ/μ΄/κ°/μ/λ₯Όglue onto the noun, so searching forνκ΅missesνκ΅μ,νκ΅λ₯Ό,νκ΅κ°. And verb inflections likeλ¨Ήμλ€vsλ¨Ήλλ€never match each other. This plugin runs real morphological analysis under the hood, powered by garu-ko (a 1.9MB WASM analyzer that runs in browsers, Node, and edge).Usage follows the standard Orama pattern (same as
@orama/tokenizers/mandarin):Would you consider linking this from the Tokenizers docs page or your community integrations list? Happy to send a docs PR if that's easier.
Links: