Prefactorization And Vertex Algebras Associated To Holomorphic Fibrations, The Toroidal Algebra, And Averages Of Unlabeled Networks