zoukankan      html  css  js  c++  java
  • Training models: why it is necessary to split dataset to traninig, valiadation and test set?

    while training a model no matter what kind of task it aims to achieve, we always need to split existing dataset to three parts, namely training set, validation set and test set.

    Training set is used to train your model, that being said, used to calculate the gradient and update parameters; Validation set is used to evaluate the model performance. Now you might start wondering, these two sets sound perfectly enough to do the job of training the model, you can update the model parameter and you can evaluate the model performance, why bother using the test set?

    Well, the aforementioned question makes perfect sense and I will explain the importance of test set in the following part.

    To quote from Fchollet's new book Deep Learning with Python and I paraphrase, while developing a model, parameter tuning , such as hyperparameter selection, is always conducted using the feedback signal from the performance  of the model on the validation data. To put it in a nutshell, some information is leaked from the valiadation set, and the model could quickly overfit on the validation set. This notion is called "information leak". To avoid information leak, we need a completely different and never-seen dataset to test your model's performance.

  • 相关阅读:
    请求内部转发与重定向区别
    JSTL标签
    JSP学习总结
    JSP执行过程
    Cookie实现--用户上次访问时间
    python 关键知识点
    PIL 学习
    python 与 matlab 混编
    matplotlib 中文显示 的问题
    中文文本分类1
  • 原文地址:https://www.cnblogs.com/SongHaoran/p/8359562.html
Copyright © 2011-2022 走看看