nlptoolkit-dictionary
v1.0.16
Published
Turkish Dictionary
Downloads
201
Readme
Turkish Dictionary
This resource is a dictionary of Modern Turkish, comprised of the definitions of over 50.000 individual entries. Each entry is matched with its corresponding synset (set of synonymous words and expressions) in the Turkish WordNet, KeNet.
The bare-forms in the lexicon consists of nouns, adjectives, verbs, adverbs, shortcuts, etc. Each bare-form appears the same in the lexicon except verbs. Since the bare-forms of the verbs in Turkish do not have the infinitive affix ‘mAk’, our lexicon includes all verbs without the infinitive affix. The bare-forms with diacritics are included in two forms, with and without diacritics. For example, noun ‘rüzgar’ appear both as ‘rüzgar’ and ‘rüzgâr’.
Special markers are included as bare-forms such as doc, s, etc.
Some compound words are included in their affixed form. For instance, ‘acemlalesi’ appears as it is, but not as ‘acemlale’.
Foreign words, especially proper noun foreign words, are included, so that the system can easily recognize them as proper nouns. For instance, the words ‘abbott’, ‘abbigail’ are example foreign proper nouns. Including foreign proper nouns, there are 19,000 proper nouns in our lexicon.
From derivational suffixes, we only include words which has taken -lI, -sIz, -CI, -lIk, and -CIlIk derivational affixes. For example, the bare-forms ‘abacı’, ‘abdallık’, ‘abdestli’ and ‘abdestlilik’, are included, since they have taken one or more derivational affixes listed above.
Each bare-form has a set of attributes. For instance, ‘abacı’ is a noun, therefore, it includes CL_ISIM attribute. Similarly, ‘abdestli’ is an adjective, which includes IS_ADJ attribute. If the bare-form has homonyms with different part of speech tags, all corresponding attributes are included.
|Name|Purpose| |---|---| |CL ISIM, CL FIIL, IS_OA|Part of speech tag(s)| |IS_DUP|Part of a duplicate form| |IS_KIS|Abbreviation, which does not obey vowel harmony while taking suffixes.| |IS_UU, IS_UUU|Does not obey vowel harmony while taking suffixes.| |IS_BILES|A portmanteau word in affixed form, such as ‘adamotu’| |IS_B_SI|A portmanteau word ending with ‘sı’, such as ‘acemlalesi’| |IS_CA|Already in a plural form, therefore can not take plural suffixes such as ‘ler’ or ‘lar’.| |IS_ST|The second consonant undergoes a resyllabification.| |IS_UD, IS_UDD, F_UD|Includes vowel epenthesis.| |IS_KG|Ends with a ‘k’, and when it is followed by a vowel-initial suffix, the final ‘k’ is replaced with a ‘g’.| |IS_SD, IS_SDD, F_SD|Final consonant gets devoiced during vowel-initial suffixation.| |F GUD, F_GUDO|The verb bare-form includes vowel reduction.| |F1P1, F1P1-NO-REF|A verb, and depending on this attribute, the verb can (or can not) take causative suffix, factitive suffix, passive suffix etc.|
Simple Web Interface
Turkish Dictionary Search Link 1 Turkish Dictionary Search Link 2
Turkish MorphoLex Search Link 1 Turkish MorphoLex Search Link 2
Video Lectures
For Developers
You can also see Python, Cython, C++, C, Swift, Java, Php, or C# repository.
Requirements
Node.js
To check if you have a compatible version of Node.js installed, use the following command:
node -vYou can find the latest version of Node.js here.
Git
Install the latest version of Git.
Npm Install
npm install nlptoolkit-dictionaryDownload Code
In order to work on code, create a fork from GitHub page. Use Git for cloning the code to your local or below line for Ubuntu:
git clone <your-fork-git-link>A directory called util will be created. Or you can use below link for exploring the code:
git clone https://github.com/starlangsoftware/dictionary-js.gitOpen project with Webstorm IDE
Steps for opening the cloned project:
- Start IDE
- Select File | Open from main menu
- Choose
Dictionary-Jsfile - Select open as project option
- Couple of seconds, dependencies will be downloaded.
Detailed Description
TxtDictionary
Dictionary is used in order to load Turkish dictionary or a domain specific dictionary. In addition, misspelled words and the true forms of the misspelled words can also be loaded.
To load the Turkish dictionary and the misspelled words dictionary,
a = TxtDictionary()To load the domain specific dictionary and the misspelled words dictionary,
constructor(comparator: WordComparator = WordComparator.TURKISH,
fileName: string = "turkish_dictionary.txt",
misspelledFileName: string = "turkish_misspellings.txt")And to see if the dictionary involves a specific word, Word getWord is used.
getWord(nameOrIndex: any): WordTxtWord
The word features: To see whether the TxtWord class of the dictionary is a noun or not,
isNominal(): booleanTo see whether it is an adjective,
isAdjective(): booleanTo see whether it is a portmanteau word,
isPortmanteau(): booleanTo see whether it obeys vowel harmony,
notObeysVowelHarmonyDuringAgglutination(): booleanAnd, to see whether it softens when it get affixes, the following is used.
rootSoftenDuringSuffixation(): booleanSyllableList
To syllabify the word, SyllableList class is used.
constructor(word: string)Cite
@inproceedings{yildiz-etal-2019-open,
title = "An Open, Extendible, and Fast {T}urkish Morphological Analyzer",
author = {Y{\i}ld{\i}z, Olcay Taner and
Avar, Beg{\"u}m and
Ercan, G{\"o}khan},
booktitle = "Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)",
month = sep,
year = "2019",
address = "Varna, Bulgaria",
publisher = "INCOMA Ltd.",
url = "https://www.aclweb.org/anthology/R19-1156",
doi = "10.26615/978-954-452-056-4_156",
pages = "1364--1372",
}For Contibutors
package.json file
- main and types are important when this package will be imported.
"main": "dist/index.js",
"types": "dist/index.d.ts",- Dependencies should be maximum (not only direct but also indirect references should also be given), everything directly in the code should be given here.
"dependencies": {
"nlptoolkit-corpus": "^1.0.12",
"nlptoolkit-dictionary": "^1.0.14",
"nlptoolkit-morphologicalanalysis": "^1.0.19",
"nlptoolkit-xmlparser": "^1.0.7"
}tsconfig.json file
- Compiler flags currently includes nodeNext for importing.
"compilerOptions": {
"outDir": "dist",
"module": "nodeNext",
"sourceMap": true,
"noImplicitAny": true,
"removeComments": false,
"declaration": true,
},- tests, node_modules and dist should be excluded.
"exclude": [
"tests",
"node_modules",
"dist"
]index.ts file
- Should include all ts classes.
export * from "./CategoryType"
export * from "./InterlingualDependencyType"
export * from "./InterlingualRelation"
export * from "./Literal"Data files
- Add data files to the project folder. Subprojects should include all data files of the parent projects.
Javascript files
- Classes should be defined as exported.
export class JCN extends ICSimilarity{- Do not forget to comment each function.
/**
* Computes JCN wordnet similarity metric between two synsets.
* @param synSet1 First synset
* @param synSet2 Second synset
* @return JCN wordnet similarity metric between two synsets
*/
computeSimilarity(synSet1: SynSet, synSet2: SynSet): number {- Function names should follow caml case.
setSynSetId(synSetId: string){- Write getter and setter methods.
getRelation(index: number): Relation{
setName(name: string){- Use standard javascript test style.
describe('SimilarityPathTest', function() {
describe('SimilarityPathTest', function() {
it('testComputeSimilarity', function() {
let turkish = new WordNet();
let similarityPath = new SimilarityPath(turkish);
assert.strictEqual(32.0, similarityPath.computeSimilarity(turkish.getSynSetWithId("TUR10-0656390"), turkish.getSynSetWithId("TUR10-0600460")));
assert.strictEqual(13.0, similarityPath.computeSimilarity(turkish.getSynSetWithId("TUR10-0412120"), turkish.getSynSetWithId("TUR10-0755370")));
assert.strictEqual(13.0, similarityPath.computeSimilarity(turkish.getSynSetWithId("TUR10-0195110"), turkish.getSynSetWithId("TUR10-0822980")));
});
});
});- Enumerated types should be declared with enum.
export enum CategoryType {
MATHEMATICS, SPORT, MUSIC, SLANG, BOTANIC,
PLURAL, MARINE, HISTORY, THEOLOGY, ZOOLOGY,
METAPHOR, PSYCHOLOGY, ASTRONOMY, GEOGRAPHY, GRAMMAR,
MILITARY, PHYSICS, PHILOSOPHY, MEDICAL, THEATER,
ECONOMY, LAW, ANATOMY, GEOMETRY, BUSINESS,
PEDAGOGY, TECHNOLOGY, LOGIC, LITERATURE, CINEMA,
TELEVISION, ARCHITECTURE, TECHNICAL, SOCIOLOGY, BIOLOGY,
CHEMISTRY, GEOLOGY, INFORMATICS, PHYSIOLOGY, METEOROLOGY,
MINERALOGY
}- If there are multiple constructors for a class, define them as constructor1, constructor2, ..., then from the original constructor call these methods.
constructor1(symbol: any){
constructor2(symbol: any, multipleFile: MultipleFile) {
constructor(symbol: any, multipleFile: MultipleFile = undefined) {
if (multipleFile == undefined){
this.constructor1(symbol);
} else {
this.constructor2(symbol, multipleFile);
}
}- Importing should be done via import method with referencing the node-modules.
import {Corpus} from "nlptoolkit-corpus/dist/Corpus";
import {Sentence} from "nlptoolkit-corpus/dist/Sentence";- Use xmlparser package for parsing xml files.
var doc = new XmlDocument("test.xml")
doc.parse()
let root = doc.getFirstChild()
let firstChild = root.getFirstChild()