What is information theory? How is information theory related to machine learning? These are some of the questions that we…