The last Machine & Deep-Learning Compendium you’ll ever need

In the last 3 years, I have been curating everything related, directly or indirectly, to machine-learning (ML), deep-learning (DL), Statistics, Probability, NLP, NLU, deep-vision, etc. I started curating a compendium because I wanted to expand the scope of my knowledge. I believe that every researcher and data scientist (DS) should strive to learn more on a daily basis, not by hitting task-related walls and solving them, but as a lifelong learning practice.

Read More

Why does the optimal policy exist?

In a finite Markov Decision Process (MDP), the optimal policy is defined as a policy that maximizes the value of all states at the same time¹. In other words, if an optimal policy exists, then the policy that maximizes the value of state s is the same as the policy that maximizes the value of state s’.² But why should such a policy exist?

Read More