Multifocal imaging suffers from a number of limitations. Here the authors report an open-source 3D reconstruction algorithm to enable label-free tracking of spherical and filamentous structures which they use to characterise fluid flow and flagellar beating of human and sea urchin sperm.