Wordly luxury is things like you addiction to coffee and stimulants, or urge to look up useless stuff on internet, or even urge to make these blogposts, as well as your jimmies being constantly rustled by ''diffrunt people''.
The later also makes easy to lump you in certain ''category'' you seem to want to avoid.

Buddhism isn't really about self-annihilation, not in the sense you might interpret it, i believe, though i haven't read any elaborate sentiments about it from you to judge.