Technical judgment
Build, buy or integrate?
Custom development is the right answer less often than vendors suggest. These are the questions we ask before recommending anything, and the honest answer is often a smaller build than the one you came in with.
When is SaaS enough?
When the AI capability is not part of how you compete and a vendor already solves the workflow well. Buy it, integrate it and spend your engineering elsewhere.
Typical cases: meeting transcription, generic document OCR, standard support deflection. The test is whether your data or your process would make a custom system materially better. If not, SaaS wins on cost and time.
When is an API-based solution enough?
When a hosted model plus your own retrieval, prompts, tooling and evaluation gives the quality you need, and your data policy allows the data to leave your environment.
This is the default starting point for most GenAI systems. The differentiation lives in the context you supply, the workflow you build around the model and the evaluation that proves it works, not in the model weights.
When is custom AI justified?
When the problem is specific to your data, the decision is repeated at volume, and a measurable business outcome depends on getting it right.
Demand forecasting on your sales history, fraud patterns in your transactions, defect detection on your production line. Here a hosted general model is the wrong shape, and a purpose-built ML system earns its cost.
When is fine-tuning justified?
When evaluation shows the base model consistently fails on behaviour, format or domain style that retrieval and prompting cannot fix, and you have enough good examples to teach it.
Fine-tuning does not add knowledge that changes weekly; retrieval does that. It is a targeted intervention decided by evidence from evaluation, not a default step in every project.
When may self-hosting be justified?
When data residency, latency, predictable volume or per-token economics make a hosted API the wrong choice, and you have or will build the operating capability to run models.
Open-weight models on your own infrastructure remove a data boundary and can lower unit cost at sustained volume. They also transfer availability, patching and capacity planning to your team.
When may dedicated infrastructure be justified?
When sustained, predictable GPU utilisation is high enough that reserved or dedicated capacity is cheaper than on-demand, and the workload is stable enough to plan against.
Dedicated GPUs are not automatically cheaper than cloud compute. Utilisation determines the economics, and bursty experimentation usually belongs on-demand. Infrastructure and GPU decisions sit with the AI GCC pillar.