Im trying to integrate ads in my app. I have set up the Chartboost account, Does my app need to be live on google play before I can test to see if the ads will actually work and stuff?
No, but it does take them a while to start serving ads. You will need to set up a publishing campaign and fill in the information there to make it live. To short cut the time a bit you can then set it to "Test" mode which will make ads server a little faster and more reliably.