Initiating impact ionization of avalanche breakdown essentially requires applying a high electric field in a long active region, hampering carrier-multiplication with high gain, low bias and superior noise performance. Here we report the observation of ballistic avalanche phenomena in sub-MFP scaled vertical indium selenide (InSe)/black phosphorus (BP) heterostructures. The heterojunction is engineered to avalanche photodetectors (APD) and impact ionization transistors, demonstrating ultra-sensitive mid-IR light detection (4 {\mu}m wavelength) and ultra-steep subthreshold swing, respectively. These devices show an extremely low avalanche threshold ( Comment: To appear on Nature Nanotechnology; 41 pages, 4 figures, 15 supplementary figures