An Edge-Cloud Collaboration Framework for Generative AI Service Provision with Synergetic Big Cloud Model and Small Edge Models
CoRR(2024)
摘要
Generative artificial intelligence (GenAI) offers various services to users
through content creation, which is believed to be one of the most important
components in future networks. However, training and deploying big artificial
intelligence models (BAIMs) introduces substantial computational and
communication overhead.This poses a critical challenge to centralized
approaches, due to the need of high-performance computing infrastructure and
the reliability, secrecy and timeliness issues in long-distance access of cloud
services. Therefore, there is an urging need to decentralize the services,
partly moving them from the cloud to the edge and establishing native GenAI
services to enable private, timely, and personalized experiences. In this
paper, we propose a brand-new bottom-up BAIM architecture with synergetic big
cloud model and small edge models, and design a distributed training framework
and a task-oriented deployment scheme for efficient provision of native GenAI
services. The proposed framework can facilitate collaborative intelligence,
enhance adaptability, gather edge knowledge and alleviate edge-cloud burden.
The effectiveness of the proposed framework is demonstrated through an image
generation use case. Finally, we outline fundamental research directions to
fully exploit the collaborative potential of edge and cloud for native GenAI
and BAIM applications.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要