So, if I don't care about PSN at all, is it safe to go online with CFW?

I'm still new to the PS3 CFW scene and I've been keeping my console offline since installing CFW because I was worried about getting my system banned. But then I stopped and thought, "Wait, I never planned to use this console on the PSN anyway, so does it really matter if the console gets banned?"

That said, if all I want to do with it online is download covers for my games, transfer files via FTP, and maybe swap discs remotely through webman, etc, couldn't I just disable my PS3's...

So, if I don't care about PSN at all, is it safe to go online with CFW?