Try to remove numpy from the host dependencies

5 jobs for fix-camera-model-segfault in 18 minutes and 54 seconds (queued for 1 second)