Use numpy-devel conda package

Hopefully this should fix the downstream projects:

RuntimeError: module compiled against API version 0xc but this version of numpy is 0xa