Deploying DeepSeek with PD Disaggregation and Large-scale Expert Parallelism on 96 H100 GPUs

lmsys.org

Deploying DeepSeek with PD Disaggregation and Large-scale Expert Parallelism on 96 H100 GPUs

lmsys.org

cm0002@lemmy.world to

Artificial Intelligence@lemmy.worldEnglish · 2 months ago

Deploying DeepSeek with PD Disaggregation and Large-Scale Expert Parallelism on 96 H100 GPUs | LMSYS Org

lmsys.org

DeepSeek is a popular open-source large language model (LLM) praised for its strong performance. However, its large size and unique architecture, which us...

You must log in or register to comment.

Chat

Artificial Intelligence@lemmy.world

ai_@lemmy.world

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !ai_@lemmy.world

Welcome to the AI Community!

Let’s explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

Be kind and respectful.
Share high-quality contributions.
Stay on-topic.
Enhance accessibility.
Verify information.
Encourage meaningful discussions.

You can access the AI Wiki at the following link: AI Wiki

Let’s create a thriving AI community together!

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

6 users / day
31 users / week
623 users / month
956 users / 6 months
1 local subscriber
1.66K subscribers
218 Posts
244 Comments
Modlog

mods:
ikidd@lemmy.world