TractSeg is a novel convolutional neural network‐based approach that directly segments tracts in the field of fiber orientation distribution function (fODF) peaks without using tractography, image registration or parcellation, and is demonstrated to be much faster than existing methods while providing unprecedented accuracy.