We created a Slovak language model in the Spacy library. When creating the model, we used pretraining and training in the Spacy library. During the pretraining, we used Fasttext vectors and the text we collected. We used data from Slovak Dependency Treebank during the training. We created a model with an accuracy of 86.249%. We also examined the effect of pretraining on the model. All achieved results are described in the final part.