Ouch, yeah, 4 hours travel time each day for only 4 hours of work is definitely not worth it. If that were me, far too much of the paycheck would be spent on just getting there and back and keeping the vehicle maintained, so can't say I blame you at all for deciding this isn't working.
Hope something good much closer to home happens for you in the near future.