THE IMPORTANCE OF INTERNET TEXTS IN THE DEVELOPMENT OF THE LANGUAGE CORPUS

O.Abdullayeva; M.Norpulotova

doi:10.5281/zenodo.7189101

THE IMPORTANCE OF INTERNET TEXTS IN THE DEVELOPMENT OF THE LANGUAGE CORPUS

12.10.2022 International Scientific Journal "Science and Innovation". Series B. Volume 1 Issue 6

O.Abdullayeva , M.Norpulotova

Abstract. It is convenient to use the Internet to create a corpus. Because if the written texts of a certain language are in the electronic version or in the form of a book, they are scanned and converted into word (word) form, and many errors in the text are encountered and need to be corrected. Audio texts should be transcribed. In this process, it is preferred to build a language corpus from the ready-made electronic version of written texts. The Web can present unexpected questions about the nature of language. It also provides a convenient tool for working with and checking text.

Keywords: corpus, internet, webcorpus, webCorp, NLP, BNC.

References:

1. Kilgarriff A., Grefenstette G. Introduction to the special issue on the Web as corpus. Computational Linguistics, 29 (3), 2003. pp. 333-347. 2. Terra E., Clarke C. Frequency estimates for statistical word similarity measures. In Proceedings of the Human Language Technology and North American Chapter of Association of Computational Linguistics Conference 2003, 244-251. 3. Stuart K. New perspectives on corpus linguistics. file:///D:/about%20corpora/Dialnet-NewPerspectivesOnCorpusLinguistics-1426958.pdf 4. McEnery T., Wilson A. Corpus Linguistics. Edinburgh University Press, Edinburgh, 1996. 5. McEnery T., Hardie A. Corpus linguistics: Method, theory and practice. Cambridge: Cambridge University Press, 2012. 6. http://www.webcorp.org.uk/ 7. Radev D., McKeown K. Building a generation knowledge source using internet-accessible newswire. In proceedings of the Fifth Applied Natural Language Processing conference. Washington D. C., April 1997, pp. 221-228 8. Grefenstette G., Nioche J. Estimation of English and non-English Language Use on the WWW. In proceedings of RIAO (Recherche d’Informations Assistee par Ordinateur), Paris, 2000 9. Jones R and Ghani R. Automatically building a corpus for a minority language from the web. 38th Meeting of the ACL, Proceedings of the Student Research Workshop. Hong Kong. October 2000, pp. 29-36 10. Resnik P. Mining the web for bilingual text In proceedings of the 37th Meeting of ACL. Maryalnd, USA, June 1999, pp. 527-534. 11. Fujii A., Ishikawa T. Utilizing the world wide web as an encyclopaedia: Extracting term descriptions from semi-structured text. In proceedings of the 38th Meeting of the ACL, Hong Kong, October 2000, pp. 488-495 12. Grefenstette G. The WWW as a Resource for Example-Based MT Tasks. Invited Talk, ASLIB ‘Translating and the Computer’ conference, London. October, 1999. 13. Volk M. Using the Web as Corpus for linguistic research. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.104.6964&rep=rep1&type=pdf 14. Hundt M., Nesselhauf N. C.Biewer. Corpus linguistics and the web. – Amsterdam-New York, 2007. (https://books.google.co.uz/books?id=SdsA_xydxyQC&pg=PA69&dq=corpus+linguistics&hl=ru&sa=X&ved=0ahUKEwjco42UzqrkAhVBw4sKHSCACu84ChDoAQhVMAY#v=onepage&q=corpus%20linguistics&f=false)