LLM Cost Control and Governance with LiteLLM - An Overview

Using LLMs in the enterprise requires oversight

LLMs have arrived in many teams: developers use Claude Code, Copilot, or Codex, in support they help with triaging inquiries and drafting responses, and in some places automated agents independently take on tasks like monitoring or ticket sorting. In many companies, however, the adoption of LLM-based tools is outpacing the ability of internal governance to keep up. One of the fundamental questions that keeps coming up is: Where exactly are LLM costs actually being incurred?

Weiterlesen →

Enterprise Architecture as an AI Enabler

Artificial intelligence is no longer limited to research projects and isolated pilot initiatives. More and more companies want to integrate AI models into their processes, make internal data usable, and develop concrete applications that generate measurable business value. However, it often becomes clear that the real challenge is not simply selecting a powerful AI model. The much greater challenge is integrating that model meaningfully into the existing organization and IT landscape.

This is exactly where the role of the Forward Deployed Engineer (FDE) is becoming increasingly important.

Weiterlesen →

Establishment of enterprise architecture

Operationalization of Enterprise Architecture Management (EAM) in the Ministry of the Interior, Digitalization, and Municipalities

Initial situation

The Ministry of the Interior, Digitalization, and Municipalities of Baden-Württemberg wanted to structure its architecture activities more effectively and align them with the state’s strategic guidelines.
Increasing digitalization, requirements from the VwV-IT (Administrative Procedure Regulation for IT), the cloud strategy, and the large number of parallel projects made it clear that:

Clearly defined architecture processes, a consistent and customized metamodel, and better integration into existing IT and project processes are required.

Weiterlesen →