Bar chart showing cumulative ABAP understanding success rates by model and feedback round.

SAP’s ABAP-1 Loses Every ABAP Benchmark, Even “Explaining”

Previous post (code generation benchmark): Benchmarking LLMs for ABAP Live benchmark results (old + new): abap-llm-benchmark.marianzeis.de In my first evaluation (based on the TH Köln benchmark paper), I extended the original setup with additional models and focused on a very concrete question: how well can LLMs generate ABAP code that actually compiles and passes ABAP Unit tests? I also tested SAP’s model ABAP-1, and it performed very poorly for code generation. To be fair: SAP also states this in the documentation. ABAP-1 is primarily meant for explaining ABAP code not for reliably generating full working implementations. ...

March 3, 2026 · Marian Zeis
Screenshot showing the integration of SAP RAP actions in the AI agent workflow.

Building an Enterprise-Ready SAP AI Agent with Open Source

There is currently a huge hype around the new MCP (Model Context Protocol) servers. I’ve built one for SAP Docs, and there are excellent community projects like the ADT API MCP Server. These tools are fantastic for individual developers. You install them, connect them to your IDE or a local LLM, and suddenly your AI assistant knows about SAP. Architecture overview (in one picture) Before diving into the details, here is the high-level architecture I’m aiming for: ...

March 3, 2026 · Marian Zeis
Bar chart showing cumulative ABAP code generation success rates by model and feedback round.

Benchmarking LLMs for ABAP: Why ABAP-1 Isn't a Code Generator (Yet)

Live benchmark results: abap-llm-benchmark.marianzeis.de In a lot of SAP webcasts and webinars, especially around AI, the question comes up very early: which model are you using, and which one do you recommend? For CAP and UI5 the answer is usually pretty simple: use the current best model from Anthropic. If you add good context via MCP servers from the community or SAP, you are basically fine. There is just a lot of public knowledge available, and most of it is in JavaScript/TypeScript, which LLMs handle extremely well. ...

February 9, 2026 · Marian Zeis
Screenshot of Eclipse showing GitHub Copilot working with the ABAP MCP server.

Finally: An MCP Server for ABAP

Finally, there is an MCP server for ABAP. You can use it directly in Eclipse via https://mcp-abap.marianzeis.de/mcp. Setup instructions are here: Eclipse configuration (GitHub Copilot) Why a community ABAP MCP server? SAP has announced an MCP server for ABAP, so why create a community one? The trigger for me was the release of Agent Mode in GitHub Copilot for ADT, which finally makes it possible to edit ABAP code by Copilot. LLM models are already really good, but ABAP knowledge is still a recurring problem. So I wanted an MCP server that is actually tailored for ABAP. ...

February 4, 2026 · Marian Zeis
LibreChat screenshot showing an MCP-assisted SAP Notes lookup workflow.

Supercharged Local Open Source Joule for Consultants: Search Your Data & Code

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. Joule for Consultants costs 250 € and mainly searches SAP Help, SAP Community and SAP for Me (Notes). That is useful, but it stops where real projects start: your own systems, codebase and sensitive data. Even though public assistants like ChatGPT and Claude can already reach SAP Help and SAP Community, the real gap is internal/authenticated data and code. ...

October 29, 2025 · Marian Zeis
Chart showing share and absolute numbers of all blog posts from 2003-05 to 2025-05.

Engagement in Free-Fall: Why SAP Community Blogs Struggle to Be Seen

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. Back in April 2024 I opened this little series with From Open Exchange to Corporate Monologue, followed in August by SAP Community in Decline and, just before Christmas, the GPT-assisted look at question quality. Twelve months, two platform releases and several batch-downloads later it is time for round four - this time with a split focus: ...

May 13, 2025 · Marian Zeis
Line chart of average monthly question quality scores (LLM-rated) over time.

Has the Quality of SAP Community Questions Gotten Worse? A Data-Driven Perspective

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. The SAP Community is and will remain the central point of entry for all issues and discussions relating to SAP. Over the past few years (and since the migration at the beginning of the year) I have had a feeling that the quality of questions in the technology area (the area I follow most closely) has gradually declined. ...

December 18, 2024 · Marian Zeis
Chart showing the share of SAP vs non-SAP blog posts over time.

SAP Community in Decline: Engagement Continues to Fall with Little Investment

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. Half a year after the major migration, it’s time to publish the latest figures and uncover any hidden insights in the data. So, what’s new? The trend from the past few months (or even years) has continued. More significant members of the community are moving away from Twitter, which was once a vital medium of exchange (and where I got my start). ...

August 5, 2024 · Marian Zeis
Chart showing the share of SAP vs non-SAP blog posts over time (share and absolute numbers).

From Open Exchange to Corporate Monologue: The Transformation of SAP’s Community

This post is a mirrored copy of my LinkedIn article, kept here so it remains searchable and independent from external platforms. You can still find the original on LinkedIn: LinkedIn Pulse article. The SAP community has had to overcome many challenges recently. The central exchange, especially for developers, Twitter has become an increasingly toxic platform and many long-time members have stopped using it or have switched to alternatives. Twitter was also one of my first ports of call and helped me a lot. There are still some, but it’s getting noticeably less. ...

April 7, 2024 · Marian Zeis

Welcome to My Blog

Hello World! 🚀 Welcome to my new blog! I’m excited to finally have a space where I can share my thoughts, experiences, and learnings from my journey as an Independent UI5/ABAP Developer. What to Expect On this blog, I’ll be writing about: UI5 Development - Tips, tricks, and best practices for building modern SAP Fiori applications ABAP Programming - Backend development insights and patterns Open Source - Updates on my open source projects and contributions SAP Ecosystem - General thoughts about the SAP development landscape Developer Tools - Useful tools and workflows that make development easier Why a Blog? As developers, we learn so much every day - from solving tricky bugs to discovering new patterns and approaches. I’ve always found that writing things down helps me understand them better, and sharing knowledge with the community is something I’m passionate about. ...

December 27, 1999 · Marian Zeis