A probe with a magnetic yoke for nondestructive evaluation of mechanical properties was developed. This probe can evaluate magnetic properties of ferromagnetic materials without machining them to a shape of ring core or frame core, that is, in-situ measurements. In this paper, magnetic properties measured by the magnetic yoke probe were compared with mechanical property. The magnetic properties measured by the probe have a good correlation with those mechanical properties. This shows a potential to apply the probe to NDE of mechanical properties in ferromagnetic materials. The effect of air gap between the probe and the specimen was also investigated, to consider the problem of contact in practical use.