Saying Wallahi when having bad thoughts about family members

Aoa Sometimes I get bad thoughts in my head about my family members, for example "Wallahi (I swear to Allah) I hope that something bad happens to them." I do not mean anything like this and worry that this might make something horrible happen to them. My question is what should I do to stop these thoughts and whether I need to do something different as I keep saying Wallahi for horrible things in my thoughts. Thanks so much May Allah forgive us and guide us on the right path