Bias and Variance Cheat Sheet

  • Both are Machine Learning terms
  • High Bias
    • Also known as underfitting
    • Your model cannot learn from features
    • Bias means your model is too simple and keen on its own understanding and fail to learn new things
  • High Variance
    • Also known as overfitting
    • You model is too complex, it is specific to training data
    • Variance means your model cares about too much details, thus unable to generalize
  • Fighting Bias
    • Make your model more complex
  • Fighting Variance
    • Add regulation so your model will be less affected by outlier features
    • Make your model simpler thus more general

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s