I have about 40,000 documents( of which 6,000 are test set) I ran cross validation, selected a model that works well for me and recorded a 98% recall with a document classification task. Now, to finally deploy my model, I have a question! :
Do I train my model on all my data(all 40,000 of them)? If so, how do I know I'm not over-fitting to it? Stop it the very first time it reaches 100% accuracy?