Alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

XQUIC Library released by Alibaba is a cross-platform implementation of QUIC and HTTP/3 protocol.

End-to-end benchmark for AI-generated GPU kernels, drawn from real production traces — turn a PyTorch reference into a DSL kernel (Triton, Gluon, FlyDSL, CuteDSL) and grade it on compilation, numerical correctness, and speed-of-light efficiency, on both AMD and NVIDIA GPUs.

A lightweight, lightning-fast, in-process vector database

An end-to-end agent project for GPU kernel implementation, analysis, profiling, and iterative optimization. It helps an agent turn PyTorch logic or an existing kernel into a high-performance GPU kernel through a structured, profile-driven workflow.

An easy-to-use framework for large scale recommendation algorithms.

High-performance embedded graph database for analytics and real-time transactions

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

Local-first telemetry collector for AI coding agents — unified OpenTelemetry events for Claude Code, Codex, Cursor and more. Token usage, cost, traces and security audit, exported anywhere.

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.