Bar chart showing cumulative ABAP code generation success rates by model and feedback round.

Benchmarking LLMs for ABAP: Why ABAP-1 Isn't a Code Generator (Yet)

Live benchmark results: abap-llm-benchmark.marianzeis.de In a lot of SAP webcasts and webinars, especially around AI, the question comes up very early: which model are you using, and which one do you recommend? For CAP and UI5 the answer is usually pretty simple: use the current best model from Anthropic. If you add good context via MCP servers from the community or SAP, you are basically fine. There is just a lot of public knowledge available, and most of it is in JavaScript/TypeScript, which LLMs handle extremely well. ...

February 9, 2026 · 6 min · 1253 words · Marian Zeis
Screenshot of Eclipse showing GitHub Copilot working with the ABAP MCP server.

Finally: An MCP Server for ABAP

Finally, there is an MCP server for ABAP. You can use it directly in Eclipse via https://mcp-abap.marianzeis.de/mcp. Setup instructions are here: Eclipse configuration (GitHub Copilot) Why a community ABAP MCP server? SAP has announced an MCP server for ABAP, so why create a community one? The trigger for me was the release of Agent Mode in GitHub Copilot for ADT, which finally makes it possible to edit ABAP code by Copilot. LLM models are already really good, but ABAP knowledge is still a recurring problem. So I wanted an MCP server that is actually tailored for ABAP. ...

February 4, 2026 · 3 min · 476 words · Marian Zeis
LibreChat screenshot showing an MCP-assisted SAP Notes lookup workflow.

Supercharged Local Open Source Joule for Consultants: Search Your Data & Code

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. Joule for Consultants costs 250 € and mainly searches SAP Help, SAP Community and SAP for Me (Notes). That is useful, but it stops where real projects start: your own systems, codebase and sensitive data. Even though public assistants like ChatGPT and Claude can already reach SAP Help and SAP Community, the real gap is internal/authenticated data and code. ...

October 29, 2025 · 6 min · 1149 words · Marian Zeis