High-Performance server for NATS.io, the cloud and edge native messaging system.
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Low-latency AI engine for mobile devices & wearables
Olares: An Open-Source Personal Cloud to Reclaim Your Data
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images - Privacy First, Zero Internet. Download an LLM and use it on your mobile device. No data ever leaves your phone. Supports text-to-text, vision, text-to-image
[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
Deep learning gateway on Raspberry Pi and other edge devices
Microsoft AI for Good Lab — Biodiversity research hub. Open-source AI models, edge devices, and tools for biodiversity monitoring and conservation. Your source for MegaDetector, SPARROW, PytorchWildlife, Bioacoustics, and more.
DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.
speech to text benchmark framework
Real-time voice assistant — WebRTC streaming, faster-whisper ASR, local LLM, Vui Nano (300M) TTS. OpenAI Realtime API compatible. Voice cloning, barge-in, ~9× realtime on a 4090. Apache 2.0.
Real-time portrait segmentation for mobile devices
The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment
AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. Our intent is to present a curated collection of solution accelerators that can help engineers establish their AI/ML environments and solutions rapidly and with minimal friction.
EfficientSAM3 compresses SAM3 into lightweight, edge-friendly models via progressive knowledge distillation for fast promptable concept segmentation and tracking.
On-Device Training Under 256KB Memory [NeurIPS'22]
A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.
Add a description, image, and links to the edge-ai topic page so that developers can more easily learn about it.
To associate your repository with the edge-ai topic, visit your repo's landing page and select "manage topics."