Spaces:

nanotron
/

ultrascale-playbook

Running

App Files Files Community

nouamanetazi HF staff commited on 13 days ago

Commit

8951992

·

1 Parent(s): f0752ea

assets

Files changed (43) hide show

assets/images/5Dparallelism_8Bmemoryusage.svg +0 -0
assets/images/activationrecomputation_memory.svg +2029 -0
assets/images/cp_70bmemoryusage.svg +2424 -0
assets/images/cp_8Bmemoryusage.svg +2334 -0
assets/images/cp_attnmask.svg +0 -0
assets/images/cp_memoryusage.svg +2334 -0
assets/images/cp_overlap_all2all.svg +221 -0
assets/images/cp_overlap_allgather.svg +185 -0
assets/images/cp_zigzagmask.svg +0 -0
assets/images/diving_primergpu.svg +0 -0
assets/images/diving_primergpu2.svg +0 -0
assets/images/dp_ourjourney_memoryusage.svg +2256 -0
assets/images/dp_overlap1.svg +364 -0
assets/images/dp_overlap2.svg +670 -0
assets/images/dp_overlap3.svg +400 -0
assets/images/dp_scaling.svg +1976 -0
assets/images/dp_zero1.gif +0 -0
assets/images/dp_zero1_overlap.svg +451 -0
assets/images/dp_zero2.gif +0 -0
assets/images/dp_zero2_overlap.svg +451 -0
assets/images/dp_zero3_bwd.svg +0 -0
assets/images/dp_zero3_fwd.svg +0 -0
assets/images/dp_zero3_overlap.svg +517 -0
assets/images/memory_profile.svg +0 -0
assets/images/memusage_activations.svg +2353 -0
assets/images/pp_1f1b.svg +0 -0
assets/images/pp_1f1b_interleaved.svg +0 -0
assets/images/pp_afab.svg +827 -0
assets/images/pp_afab2.svg +0 -0
assets/images/pp_comm_bandwidth.svg +1479 -0
assets/images/pp_memoryusage.svg +1632 -0
assets/images/tp_memoryusage.svg +1963 -0
assets/images/tp_overlap.svg +251 -0
assets/images/tp_scaling.svg +1958 -0
assets/images/tp_sp_memoryusage.svg +2151 -0
assets/images/tp_sp_overlap.svg +309 -0
assets/images/tp_sp_scaling.svg +1898 -0
assets/images/what_we_learnt_heatmap copy.svg +0 -0
assets/images/what_we_learnt_heatmap.svg +0 -0
assets/images/what_we_learnt_parallel_coordinates.html +0 -0
assets/images/what_we_learnt_parallel_coordinates.svg +0 -0
assets/images/zero3_memoryusage.svg +2333 -0
assets/images/zero_memory.svg +0 -0