If you're using a pattern, get one where the neck and shoulders fit you. Changing the sizing of everything else is much easier.

I'd also suggest that you look up "full bust adjustment". Most commercial patterns are made for a "B" cup. The full bust adjustment looks complicated, but if you take it step by step, it's really quite easy.