An attempt to explore the intuition of optimization – how minimizing an objective results in optimal parameters. The Idea Remember the last time you picked up only a few important things to read, a day before an exam. What you did there was optimize your available time (not really, but for the day) to maximize your output (marks). In machine learning, the idea of optimization revolves around improving metrics like F1 score, accuracy of models etc....