opensource/developer-roadmap
3
0
Fork 0
mirror of https://github.com/kamranahmedse/developer-roadmap.git synced 2026-10-25 09:34:00 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
inference-engineering-resources
developer-roadmap/roadmaps/inference-engineering/content/expert-parallelism@62y78y-RXZT_QCUfd-YFE.md
T
Javier CanalesandClaude Opus 5.5 4f7e267d15 feat(inference-engineering): add learning resources to roadmap topics 
Add curated papers, official docs, open-source repos and books to 64
topics of the Inference Engineering roadmap, following the content
style guide (typed links, ordered by type, max 8 per topic).

Also normalise the heading on the Post-Training Quantization and
Multi-Cloud topics.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-01 13:24:34 +02:00

656 B
Raw Permalink Blame History

Expert Parallelism

Expert Parallelism distributes MoE experts across GPUs so each GPU hosts multiple complete experts. Tokens are routed to the GPU holding their activated experts, and each expert runs independently within a single GPU without splitting across multiple. EP has lower inter-GPU communication overhead than Tensor Parallelism and scales well to multi-node deployments via InfiniBand.

Visit the following resources to learn more:

Reference in New Issue View Git Blame Copy Permalink