A neural representation framework called RapidVol is proposed to speed up slice-to-volume ultrasound reconstruction by using tensor-rank decomposition and a small neural network.