From the Latin phrase "(musculus) rectus", or "a straight (muscle)".
Rectus therefore means straight in Latin.