High-Dimensional Statistics With Systematically Corrupted Data