Skip to content

Commit cb54a8f

Browse files
authored
FAQ (minor modifications)
[skip ci]
1 parent 87c3a01 commit cb54a8f

1 file changed

Lines changed: 7 additions & 5 deletions

File tree

README.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -264,13 +264,14 @@ By default you can start from blending. It is easier to apply and more chances t
264264
[Bagging](https://en.wikipedia.org/wiki/Bootstrap_aggregating) or Bootstrap aggregating works as follows: generate subsets of training set, train estimator on these subsets and then find average of predictions. When we train several different algorithms on the same data and then find average we can call this bagging as well. See [simple blending](https://github.com/vecxoz/vecstack#12-what-is-blending-how-is-it-related-to-stacking).
265265

266266
### 16. How many models should I use on a given stacking level?
267-
268-
***Note:*** Always remember that higher number of levels or models does NOT guarantee better result. The key to success in stacking (blending) is diversity - low correlation between models.
267+
268+
***Note 1:*** The best architecture can be found only by experiment.
269+
***Note 2:*** Always remember that higher number of levels or models does NOT guarantee better result. The key to success in stacking (blending) is diversity - low correlation between models.
269270

270271
It depends on many factors like type of problem, type of data, quality of models, correlation of models, expected result, etc.
271-
Some configurations are listed below.
272+
Some example configurations are listed below.
272273
* Reasonable starting point:
273-
* `L1: 2-10 models -> L2: blend (weighted average)`
274+
* `L1: 2-10 models -> L2: blend (weighted average) or single model`
274275
* Then try to add more 1st level models and additional level:
275276
* `L1: 10-50 models -> L2: 2-10 models -> L3: blend (weighted average)`
276277
* If you're crunching numbers at Kaggle and decided to go wild:
@@ -280,7 +281,8 @@ You can also find some winning stacking architectures on [Kaggle blog](http://bl
280281

281282
### 17. How many stacking levels should I use?
282283

283-
***Note:*** Always remember that higher number of levels or models does NOT guarantee better result. The key to success in stacking (blending) is diversity - low correlation between models.
284+
***Note 1:*** The best architecture can be found only by experiment.
285+
***Note 2:*** Always remember that higher number of levels or models does NOT guarantee better result. The key to success in stacking (blending) is diversity - low correlation between models.
284286

285287
For some example configurations see [Q16](https://github.com/vecxoz/vecstack#16-how-many-models-should-i-use-on-a-given-stacking-level)
286288

0 commit comments

Comments
 (0)