In the famous Bel Air Apartments in Ranchi, there are three watchmen meant to protect the precious fruits in the campus. However, one day a thief got in without being noticed and stole some precious mangoes. On the way out however, he was confronted by the three watchmen. The first watchman asked the thief to part with $\frac{1}{3}$rd of the mangoes and $1$ more. The second watchman also asked the thief to part with $\frac{1}{3}$rd of the remaining mangoes and $1$ more. The third watchman asked the thief to part with $\frac{1}{5}$th of the mangoes and $4$ more. As a result, the thief had no mangoes left. What was the number of mangoes he had stolen?