bssunilreddy
Keymaster
Chinese GPU Manufacturers Push Out Support For Running DeepSeek’s AI Models On Local Systems, Intensifying the AI Race
Chinese consumer GPU manufacturers have now started to bring support for running DeepSeek's R1 LLM models on local systems, jumping into the global AI race.Well, China has been making some serious rounds in the AI industry by not only releasing a model capable of competing with mainstream options by OpenAI but also excelling in AI hardware capabilities. We recently reported on how Huawei is preparing to challenge NVIDIA's dominance through its Ascend 910C AI chip, and now it seems like Chinese GPU manufacturers, notably Moore Threads and Baidu's Kunlun, have stepped up to bring support for DeepSeek's R1 model with their consumer GPUs, fueling the race for computational capabilities.
Starting with Moore Threads, the firm has brought in support for DeepSeek's distillation models through a deployment service, and it is claimed that it is compatible with Moore Threads' MTT S80 and MTT S4000 consumer GPUs, with the latter one designed specifically for workstation workloads. Along with this, the firm has brought in support for DeepSeek's model on its KUAE cluster as well, which is said to be an in-house cluster explicitly designed for AI workloads, featuring the MTT S4000 GPUs.
This is certainly an outstanding achievement by Moore Threads, given that bringing the ability to run DeepSeek's AI models on local machines will fuel the professional consumers' adoption of the company's products. And, the MTT S80 and MTT S4000 GPUs can also be deployed for inference workloads, which means that the manufacturer has brought in extensive support. However, we are unaware of the performance of DeepSeek's models on these GPUs, but it surely won't be on the level of what AMD and NVIDIA offer.
In addition, Baidu, the famous Chinese tech company, has built its in-house AI cluster featuring the Kunlun Core P800 AI chips. According to MyDrivers, the Core P800 performs 20-50% better than similar mainstream GPUs, supports 8-bit inference, and has significantly low deployment and maintenance costs. The AI chip is said to completely support DeepSeek's V3/R1 AI models, and inference deployment is said to be achieved pretty easily.
Baidu's AI cluster is said to consist of 30,000 Core P800 AI GPUs and will be up and running soon. Chinese GPU manufacturers' achievements clearly show that they haven't been held back by global influence and have instead focused on shifting their hardware arsenal to domestically manufactured products, making them sustainable in the long run.
Source: https://wccftech.com/chinese-gpu-ma...-running-deepseek-ai-models-on-local-systems/
