Within India, many languages are spoken as well as used as a communication platform in day-to-day life which represents the basic requirements to be able to generate NLP based functionalities in different Indian languages. Text processing of digital content has experienced a great expansion process in recent years in the development of innovative technologies that develop new content of information in a very quick and understandable form. This paper presents a survey on various text sequence processing challenges like Word Sense Disambiguation, Part of Speech tagging, Named Entity Recognition in the Gujarati Language. It is an Indo-Aryan Linguistic originated from Sanskrit. Text Process generating each word in the corpus corresponding to a specific part of speech to text conversion like noun, verb, adjective, pronoun, adverb, conjunction, etc. It is a very critical task and preprocessing moves for entire natural language processing behaviors. There are many challenges part in text processing like ambiguities reduction, foreign text detection, stop words and annotation task finding, etc.