Draft: Speedup some hardware stuffs

This PR tries to speed up some stuffs relative to #105

This does not fix the real problem, but just mitigate it for the hardware objects.