Would Allah ever decrease our good deeds?

According to Surah Muhammad Verse 35: "So do not weaken and call for peace while you are superior; and Allah is with you and will never deprive you of [the reward of] your deeds." - Quran 47:35 But according to one hadith: Prophet Muhammad (peace and blessings of Allah be upon him) said: “The one who omits to pray Asr, all his good deeds will be lost.” Narrated by al-Bukhaari (553). So the Quran is saying that Allah will never decrease our good deeds but the hadith says if we omit Asr, all our good deeds will be lost. There seems to be a contradiction here. Can somebody comment on this and clear me off this confusion? Thank you.