Is there any cost to create a report suite for sandboxing purpose?

As far as I know, it's really just the cost of the server calls on your account.  A sandbox suite shouldn't have that much traffic... but if you are concerned, your CSM should be able to check your contract and if there are any additional limitations.

At least on our contract, I know there is no limitation on the suites that we can create.