Please read up on distutils. Specifically, the section on Extension Modules.
Making assumptions about compilers is bad policy; your instinct may not have all the facts. You could do some marketplace survey -- ask what they can handle regarding source distribution of extension modules.
It's relatively easy to create the proper distutils setup.py
and see who can run it and who can't.
Built binary distributions are pretty common. Perhaps you can sign up some users will help create binary distributions -- with OS-native installers -- for some considerations.