When I am moving it sounds like a wheel bearing is going out. But if I push the clutch in while moving the sound goes away.

I'm thinking transmission?

Throw out bearing.

I just put in a new clutch kit with throw out and pilot bearing.

Then it may be a internal transmission issue, or carrier bearing on the driveshaft. What brand clutch and components did you use?

I believe it was a power torque kit from Oreileys

Does it make the noise while sitting still in neutral, foot off the clutch?