Support executing queries without pyarrow when it's missing

Support executing queries without pyarrow when it's missing #533