Columnar epithelial cells can be identified under a microscope by their elongated, rectangular shape. They often appear tightly packed together, forming a continuous layer. In some regions, such as the small intestine, these cells may have microvilli on their apical surface, which further enhances their absorptive capacity.