en
Книжки
Jacob Perkins

Python 3 Text Processing with NLTK 3 Cookbook

  • niodeyaцитує3 роки тому
    Most of the time, the default sentence tokenizer will be sufficient
  • niodeyaцитує3 роки тому
    Once you have a custom sentence tokenizer, you can use it for your own corpora
  • niodeyaцитує3 роки тому
    The PunktSentenceTokenizer class uses an unsupervised learning algorithm to learn what constitutes a sentence break. It is unsupervised because you don't have to give it any labeled training data, just raw text
  • niodeyaцитує3 роки тому
    This difference is a good demonstration of why it can be useful to train your own sentence tokenizer, especially when your text isn't in the typical paragraph-sentence structure
  • niodeyaцитує3 роки тому
    tokenizer. You can get raw text either by reading in a file, or from an NLTK corpus using the raw() method
fb2epub
Перетягніть файли сюди, не більш ніж 5 за один раз