feat: reduce nb experts per token in moe architectures#450

llcnt merged 11 commits intomainPrunaAI/pruna:mainfrom

feat/reduce_nb_experts_per_tokenPrunaAI/pruna:feat/reduce_nb_experts_per_tokenCopy head branch name to clipboard