Are all parts infinite?

Yes, once you've unlocked a part or purchased it via the Item Shop, you'll have an infinite quantity of that part.