Low level throwing stars?

They are in every potion store as far as I know...

 

I would advice you to try and farm some tobis at gs2.
(Seeing as ur a cleric)

 

Just ask for tobis they are like 5k each

 

Stick with tobis, then around level 40 or 50 start saving up money for a handful of steely sets (don't buy ilbis, explanation later). Around 70-80's you should be using all steelies by then. Around 100-120 you'll be training at night shadows so this is when you want to start farming for the materials you need to craft balanced fury (+30 att star) you'll want to craft two of them. Once you have 2 sets, you just keep them @ 199 at all times and use shadow stars in 4th job, it'll eat up the steelies but keep the damage buff of your bfurys (therefore negating the use of ilbis when you have larger sets of stars like the steelies)