A peripheral IV should be removed when it is no longer needed, if it becomes non-functional, or if there are signs of complications such as infection or phlebitis. The removal process involves stopping the IV infusion, removing the dressing, and carefully withdrawing the catheter. The site is then covered with a sterile gauze or bandage to stop any bleeding.