If it's been 3 days you're safe to text him, not pushy at all. It would be pushy if you tried multiple times over the course of several days, with no reply.
Ok I will tomorrow after varsity try outs, but what if he doesn't text back? What if he likes his ex again? what if he doesn't like me? what if.... Ok I better stop with that