You have kill rights on him; you can destroy his ship ONE TIME without CONCORD getting involved. Now, whilst it may seem like his bling-bling ships are off limits to your reactionary aggression, there are a couple of dirt easy ways you can hurt him.
a) If he flies something super bling, and that something is a battleship like a nightmare or mach, you can take him down. Get in your harbinger, and fit her out for maximum DPS, decent armour resists and some buffer. You will want some help, however. This help should come in the form of logistics. There's nothing he can realistically do in a mission space to kill you or escape if you have logistics. Fit a dampener with range script to try to prevent him even being able to lock the logi (who can hold range). A good logi pilot won't need this assist, however.
Cut him down. Ransom him. Blow him up anyway. Laugh at him. Scoop any faction mods that drop and roll about in the wealth laughing.
If he flies a Tengu / other T3 to mission, you will likely struggle at your current skill-set to stick out enough damage to kill it. You can try to neut it out, but it will be hard to get neuts and enough DPS onto a T1 Amarr hull, not to mention holding it down.
Remember to scout and follow him on an alt, so he doesn't get a gist of your intentions.
b) Wait until he is in a Noctis or something that is similarly fragile and expensive. Find it, blow it up. Even a Punisher will do for this. Don't mess about, let him finish salvaging before popping him. You'll get loots and extra tears, and the killmail will be padded.
Keep an eye on your character sheet to check the expiration of killrights. Locator agents are cheap, actually (they cost less than half a mil, a lot less if you're near) and either level 3 or 4 agents will locate him anywhere.
Executing this can be hard and so much can go wrong, but think it over and see what you can come up with.
BTW, if you pull off a), you've got a post for C&P