The Marmation ReviewDecisions2 min read / Essay

When the enterprise assistant you already own is enough.

Custom RAG should be justified by an actual functional gap, not by the allure of building a private AI product.

Written for

CIO, CTO, CFO

The argument in brief.

The proposal may be unnecessary. Packaged knowledge tools often provide connectors, administration, policy integration and managed upgrades that custom teams would have to recreate. The question is not whether bespoke RAG can work. It is whether it adds value after operating cost and risk are included.

Put it under pressure

Put the idea under realistic pressure

A business may need an assistant to answer ordinary policy questions, in which case a configured enterprise tool could be sufficient. Another may need a specialized approval interface integrated with multiple internal APIs and document-level exceptions. Custom engineering may be justified in the second case.

Read the reasoning
Where the recommendation changes

When the recommendation changes

Where a packaged product has restrictive licensing, inadequate source handling or a poor UX for the task, building can be rational. But the burden of proof sits with the custom proposal.

Read the reasoning

The reasoning behind the recommendation.

An IT leader is asked to commission an internal AI knowledge assistant. The business already pays for an enterprise productivity platform with built-in search, knowledge connectors and user access. An external developer proposes rebuilding the same experience with a bespoke retrieval stack.

The decision behind the technology

The proposal may be unnecessary. Packaged knowledge tools often provide connectors, administration, policy integration and managed upgrades that custom teams would have to recreate. The question is not whether bespoke RAG can work. It is whether it adds value after operating cost and risk are included.

A better way to frame the work

Evaluate the actual user tasks, source coverage, permission behavior, latency, data policy, action integrations and total licensing costs. Run representative tests in the existing platform. Record which requirements remain unsatisfied, not just which custom features are technically possible.

Put the idea under realistic pressure

A business may need an assistant to answer ordinary policy questions, in which case a configured enterprise tool could be sufficient. Another may need a specialized approval interface integrated with multiple internal APIs and document-level exceptions. Custom engineering may be justified in the second case.

When the recommendation changes

Where a packaged product has restrictive licensing, inadequate source handling or a poor UX for the task, building can be rational. But the burden of proof sits with the custom proposal.

What to decide before moving forward

Before buying custom engineering, document the commercial product’s tested limitations and the operational advantages of a bespoke solution. Treat the purchase decision as an architecture problem, not an identity statement.

References and context

Microsoft Copilot Studio knowledge sources; AWS Bedrock knowledge bases.

Source notes

References supplied with this manuscript. Source scope and limitations are retained; inclusion is not an endorsement of every claim.

  1. Copilot Studio knowledge sources Microsoft Learn

    Capability, licensing and source permission limitations vary.

  2. Knowledge bases for Amazon Bedrock AWS Docs

    Verify feature, costs, regional availability on deployment.

Discuss the decision in front of you Return to Decisions