Skip to content
@aisa-group

AI Safety and Alignment Group

AI Safety and Alignment Group at the ELLIS Institute Tübingen and Max Planck Institute for Intelligent Systems

ELLIS Institute Tübingen

AI Safety and Alignment Group

ELLIS Institute Tübingen · Max Planck Institute for Intelligent Systems

Group page · Updates · Datasets

AI safety · alignment · evaluation

We develop algorithmic approaches to reduce harms from increasingly capable general-purpose AI systems. Our work focuses on the alignment and evaluation of autonomous language-model agents, frontier-model risks and capabilities, and model generalisation and steerability.

Research projects

Project Paper Dataset Website
ResearchArena arXiv Trajectories research-arena.ai
PostTrainBench arXiv Trajectories posttrainbench.com
InferenceBench arXiv Trajectories inferencebench.ai
Instrumental Choices arXiv Agent traces instrumentalchoices.com
Evaluation awareness arXiv EvalAwareBench —
Skill-Inject arXiv — skill-inject.com
Prompt injection in agent skills arXiv — —
QuantSightBench arXiv — quantsightbench.com

Teaching

The AI Safety course at the University of Tübingen is openly available.

Browse all repositories or follow the group on Substack.

Popular repositories Loading

  1. PostTrainBench PostTrainBench Public

    Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours

    Python 611 70

  2. tue-ai-safety-course tue-ai-safety-course Public

    AI safety course at the University of Tübingen (Summer Semester 2026)

    HTML 151 13

  3. skill-inject skill-inject Public

    Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks

    Python 101 6

  4. InferenceBench InferenceBench Public

    Benchmarking Open-Ended Inference Optimization by AI Agents

    Python 50 8

  5. promptinject-agent-skills promptinject-agent-skills Public

    Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections

    Python 24 4

  6. decomposing-eval-awareness decomposing-eval-awareness Public

    Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.

    Python 21 4

Repositories

Showing 10 of 21 repositories
  • compaction Public
    aisa-group/compaction's past year of commit activity
    TypeScript 3 MIT 0 0 0 Updated Oct 28, 2026
  • InferenceBench Public

    Benchmarking Open-Ended Inference Optimization by AI Agents

    aisa-group/InferenceBench's past year of commit activity
    Python 50 Apache-2.0 8 1 0 Updated Oct 26, 2026
  • ResearchArena Public
    aisa-group/ResearchArena's past year of commit activity
    Python 8 MIT 3 2 0 Updated Oct 21, 2026
  • MoonMapBench Public

    How does a blind model see the Moon? LLM elevation guesses scored against spacecraft elevation maps.

    aisa-group/MoonMapBench's past year of commit activity
    Python 1 MIT 0 0 0 Updated Oct 12, 2026
  • posttrainbench-website Public

    Website for PostTrainBench

    aisa-group/posttrainbench-website's past year of commit activity
    JavaScript 2 1 0 0 Updated Oct 6, 2026
  • PostTrainBench Public

    Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours

    aisa-group/PostTrainBench's past year of commit activity
    Python 611 MIT 70 13 11 Updated Oct 2, 2026
  • aisa-group/training_against_probes's past year of commit activity
    Python 8 0 0 0 Updated Oct 2, 2026
  • aisa-group/instrumental-evasion's past year of commit activity
    Python 5 1 0 0 Updated Sep 30, 2026
  • decomposing-eval-awareness Public

    Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.

    aisa-group/decomposing-eval-awareness's past year of commit activity
    Python 21 4 0 0 Updated Sep 29, 2026
  • perfect-crime Public
    aisa-group/perfect-crime's past year of commit activity
    Python 6 3 0 0 Updated Sep 25, 2026

Top languages

Loading…

Most used topics

Loading…