Most cops love fast cars, and they read about them just like we do, so they know what's going on.
My last car, Subaru WRX STi was targeted a lot, like the community was a bunch of high profiled criminals running around. Many STi's got stopped for no reason at all, and since most people don't know the law, they allowed their cars to be searched.
The ISF is in a different league than the STi, but some cops will be looking for it.
I also notice you live in LA, which is the whole Street Racing scene started, so you should expect to draw a lot more attention to yourself, not much you can do about it.
Avoiding the attention has to do with knowledge, tactics and equipment. I'm not going to elaborate further on that in public, for obvious reasons.
Cheers,
