on his bicycle

with (和...一起,通常表伴随状态用)
in his car (在汽车里,可以用in；自行车只能是骑在上面,所以要用on)
by bicycle (前面不加his等形容词,表示一类交通工具)