This is going to be a recurring theme for you, because there's only so much a normal microphone can do to pick up your voice, which means picking up everything else as well.
I have heard about some highly specialized equipment (not in the consumer grade phone peripherals market, I'm afraid) which picks up your voice by "listening" to movement of your skull as it resonates with your voice. But it's going to be years until we see this on the consumer market.