No size does not matter. If you're in complete control of your body, understand how your body moves (instinctively), and know the limitations that you can break then no size doesn't matter. Like the old saying goes:"You are your worst enemy, defeat him and you are unstoppable."
Make your training as you would have it in the real world