[FWD] ‎Ensemble learning

Reference: http://www.jdl.ac.cn/user/hchang/course_staffs/08_ensemble%20learning.pdf


There is no single learning algorithm that in any domain always induces the most accurate learner.

Ensemble learning:

• We construct a group of base learners which, when combined, has higher accuracy than the individual learners.
• The base learners are usually not chosen for their accuracy, but for their simplicity.
• The base learners should be accurate on different instances, specializing in different subdomains of the problem, so that they can complement each other.

這感覺好像 VirusTotal 的精神，雖然我們不知道最終結果是甚麼，但如果被越多家防毒軟體抓到，檔案有較高的機率是病毒。

---

Bagging (bootstrap aggregating)

---

AdaBoost

---

Random forest

Reference: http://blog.yhathq.com/posts/random-forests-in-python.html