Decision trees and random forests
Machine Learning · Engineering
Study notes
Loan approval: tree splits first on income > 50k, then credit score; leaves say approve/deny. A single deep tree memorizes training (overfits). Random forest trains 100 trees on random subsets, majority vote: robust. Feature importance from forests shows income matters most.