LLM/Model & Papers
Hugging Face x Microsoft
Curiosity: How can partnerships between major AI platforms accelerate open-source AI adoption?
Hugging Face ร Microsoft: Deepening Collaboration
Curiosity: How can partnerships between major AI platforms accelerate open-source AI adoption? What does the expanded Microsoft-Hugging Face collaboration mean for developers?
At MS BUILD, Satya Nadella announced the expansion of the partnership between Microsoft and Hugging Face to make open models and open-source AI more accessible across hardware.
Partnership Expansion
Retrieve: Key collaboration areas.
Focus Areas:
- ๐ New AMD GPU support
- โ๏ธ Cloud through Azure AI
- ๐ป Local inference with ONNX Runtime
Key Announcements
Innovate: Five major updates.
| Announcement | Details | Impact |
|---|---|---|
| ๐ป Azure Model Catalog | Expanded Hugging Face collection with Llama 3, Mistral 7B, fine-tuned models | โฌ๏ธ Easy access |
| โก AMD MI300X | Optimized containers using Hugging Face TGI | โฌ๏ธ Performance |
| ๐ค Phi-3 Family | Open release on Hugging Face | โฌ๏ธ Availability |
| ๐ WebGPU | Local inference with Transformers.js and ONNX Runtime Web | โฌ๏ธ Browser AI |
| ๐ป Dev Mode | Seamless integration between Spaces and VS Code | โฌ๏ธ Developer experience |
Collaboration Benefits
Retrieve: Why this matters.
For Developers:
- โ Access to popular models in Azure
- โ Optimized hardware support
- โ Local inference capabilities
- โ Better development tools
For Ecosystem:
- โ More accessible open-source AI
- โ Cross-platform support
- โ Hardware optimization
- โ Unified developer experience
Architecture Overview
Innovate: Partnership ecosystem.
graph TB
A[Microsoft Azure] --> B[Azure AI]
A --> C[AMD MI300X VMs]
A --> D[ONNX Runtime]
E[Hugging Face] --> F[Model Catalog]
E --> G[Text Generation Inference]
E --> H[Transformers.js]
E --> I[Spaces]
B --> F
C --> G
D --> H
I --> J[VS Code Dev Mode]
style A fill:#e1f5ff
style E fill:#fff3cd
style J fill:#d4edda
Key Takeaways
Retrieve: Microsoft and Hugging Face expanded their partnership to make open-source AI more accessible across hardware, with support for AMD GPUs, Azure AI, ONNX Runtime, and improved developer tools.
Innovate: By leveraging this collaboration, you can access popular models in Azure, use optimized AMD hardware, run local inference with WebGPU, and develop seamlessly with VS Code integration.
Curiosity โ Retrieve โ Innovation: Start with curiosity about AI platform partnerships, retrieve insights from Microsoft-Hugging Face collaboration, and innovate by building applications that leverage both platformsโ strengths.
Next Steps:
- Explore Azure Model Catalog
- Try AMD MI300X optimization
- Test WebGPU inference
- Use VS Code Dev Mode
Learn More: https://huggingface.co/blog/microsoft-collaboration
Translate to Korean
ํ๊น ํ์ด์ค์ ๋ง์ดํฌ๋ก ์ํํธ์ ํ๋ ฅ ๊ฐํ
์ด์ MS BUILD์์ Satya Nadella๋ ์๋ก์ด AMD GPU, Azure AI๋ฅผ ํตํ ํด๋ผ์ฐ๋, ONNX Runtime ๋ฅผ ํตํ ๋ก์ปฌ ์ถ๋ก ์ ์์์ผ๋ก ํ๋์จ์ด ์ ๋ฐ์ ๊ฑธ์ณ ๊ฐ๋ฐฉํ ๋ชจ๋ธ๊ณผ ์คํ ์์ค AI์ ๋ ์ฝ๊ฒ ์ก์ธ์คํ ์ ์๋๋ก Microsoft ์ Hugging Face ๊ฐ์ ํํธ๋์ญ ํ์ฅ์ ๋ฐํํ์ต๋๋ค. ๐
- ๐ป Azure Model Catalog์์ Llama 3, Mistral 7B์ ๊ฐ์ ์ธ๊ธฐ ์๋ ๊ฐ๋ฐฉํ ๋ชจ๋ธ ๋ฐ ์ต๊ณ ์ฑ๋ฅ์ ๋ฏธ์ธ ์กฐ์ ๋ชจ๋ธ์ ์ฌ์ฉํ์ฌ ํฌ์น ์ผ๊ตด ์ปฌ๋ ์ ์ ํ์ฅํ์ต๋๋ค.
- โก Hugging Face Text Generation Inference๋ฅผ ์ฌ์ฉํ์ฌ Azure์ ์๋ก์ด AMD MI300X VM์ ์ต์ ํ๋ ์ปจํ ์ด๋
- ๐ค Hugging Face์ ์คํ ๋ฆด๋ฆฌ์ค Microsoft Phi-3 ์ ํ๊ตฐ
- ๐ Transformers.js ๋ฐ ONNX ๋ฐํ์ ์น์ ์ฌ์ฉํ WebGPU๋ฅผ ํตํ ๋ก์ปฌ ์ถ๋ก
- ๐ป Hugging Face Spaces์ VS Code ๊ฐ์ ์ํํ ํตํฉ์ ์ํ ์๋ก์ด ๊ฐ๋ฐ ๋ชจ๋
์์ธํ ์์๋ณด๊ธฐ: https://huggingface.co/blog/microsoft-collaboration
