Journals / Veri Bilimi / 2021 / Cilt: 4 - Sayı: 1

Benchmark Effect of Web Search Engines on Text Mining

Pages
84–92
Publication Date
2021-01-15
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

According to the results, dictionary with the 73.9% highest similarity for Google search engine, dictionary with the 68.7% highest similarity for Bing search engine and dictionary with the 60.5% highest similarity for Yandex search engine were produced.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:There have been many studies about creating a dictionary and these studies have come from past to present with different methods and different analyzes.
📊
Key Findings & Data:Therefore, the performance of the web search engines directly effects the model which is using web documents for automatic dictionary creation.
💡
Conclusion & Impact:According to the results, dictionary with the 73.9% highest similarity for Google search engine, dictionary with the 68.7% highest similarity for Bing search engine and dictionary with the 60.5% highest similarity for Yandex search engine were produced.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Automatic Dictionary Creation · Hash Similarity · Natural Language Processing

Özet

There have been many studies about creating a dictionary and these studies have come from past to present with different methods and different analyzes. Especially with the emergence of the World Wide Web, efforts to create dictionary based on instant data have gained importance. Therefore, the performance of the web search engines directly effects the model which is using web documents for automatic dictionary creation. The web search engines were evaluated in terms of their suggested documents relationality to the query in the research. For this purpose, an automatic dictionary creating model using web documents were developed. First of all, the topic seed words are determined by the documents presented to the system initially. Search is executed by these seed words initially. Then TF-IDF metric was used as meaningful word selection method for returned first document. The top n meaningful words were selected from the highest TF-IDF values. The value of n was determined experimentally. When searching the web with these words added to the dictionary, new documents were suggesting by the web search engine. By repeating the process, experimental dictionaries of a certain size were obtained. By the way, the documents suggested by each web engine are generally different, so that the dictionary similarity produced from the top suggested documents can measure web engines performance of selecting relational documents. Hash similarity was used to evaluate dictionary performance. According to the results, dictionary with the 73.9% highest similarity for Google search engine, dictionary with the 68.7% highest similarity for Bing search engine and dictionary with the 60.5% highest similarity for Yandex search engine were produced.

🔖

Cite This Article

TOPRAK, A., TURAN, M. (2021). Benchmark Effect of Web Search Engines on Text Mining. Veri Bilimi, Cilt: 4 - Sayı: 1, 84–92. https://ajindex.com/articles/821864

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (7)

  1. B V.Z. Kepuska and P. Rojanasthie, “Speech corpus generation from DVDs of movies and tv series,” Journal of International Technology and Information Management, vol. 20(1), pp. 49-82, 2011. R. Ellen, “Automatically constructing a dictionary for information extraction tasks,” Proceedings of the Eleventh National Conference on Artificial Intelligence, pp. 811-816, 1993.
  2. S. Koeva, I. Stoyanova, M. Todorova and S. Leseva, “Semi-automatic compilation of the dictionary of Bulgarian multiword expressions,” Proceedings of GLOBALEX 2016, pp. 86-95, 2016. https://doi.org/10.5281/zenodo.1469527
  3. K.E. Silverman, V. Anderson, J.R. Bellegarda, K.A. Lenzo and D. Naik, “Design and collection of corpus of polyphones and prosodic contexts for speech synthesis research and development,” Sixth European Conference on Speech Communication and Technology, PP. 5-9, 1999. A. Toprak, “Creating English dictionary with natural language processing,” Published Master Thesis, Istanbul Commerce University Institute of Science, Istanbul, 2019.
  4. C. Caldera, R. Berndt, E. Eggeling, M. Schröttner and D.W. Fellner, “PRIMA-towards an automatic review / paper matching score calculation,” The Sixth International Conference on Creative Content Technologies (CONTENT 2014), pp. 70-75, 2014. A. Mishra, and S. Vishwakarma, “Analysis of TF-IDF model and its variant for document retrieval,” International Conference on Computational Intelligence and Communication Networks (CICN), pp. 772-776, 2015. https://www.doi.org/10.1109/CICN.2015.157
  5. J. Lavid, H.J. Arús, B. Clerck and V. Hoste, “Creation of a high-quality, register-diversified parallel (English-Spanish) corpus for linguistic and computational investigations,” 7th International Conference on Corpus Linguistics (CILC2015), vol. 198, pp. 249-256, 2015. https://doi.org/10.1016/j.sbspro.2015.07.443 S.H. Sarkar and K. Mumit, “Automatic bangla corpus creation,” PAN Localization Working Papers, vol. 3(1), pp. 22-26, 2010.
  6. B. Megyesi, J. Nasman and A. Palmer, “The uppsala corpus of student writings: corpus creation, annotation, and analysis,” Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 3192-3199, 2016.
  7. F. Famili, W. Shen, R. Weber and E. Simoudis, “Data preprocessing and intelligent data analysis,” Intell. Data Anal, vol. 1(4), pp. 3-23, 1997. https://doi.org/10.1016/S1088-467X(98)00007-9 V. Agarwal, “Research on data preprocessing and categorization technique for smartphone review analysis,” Intern