Data Engineering11 min read

Why Healthcare Data Needs More Than Infrastructure

General-purpose data platforms provide storage and compute but not healthcare intelligence. The clinical layer — HL7 parsing, patient identity resolution, care gap detection, clinical metrics — is a build project that takes 12-18 months. THB DataCloud connects to any data source and delivers solved healthcare use cases.

THB Engineering
March 2, 2026
healthcare data platformhealthcare dataclinical intelligenceTHB Healthcare Sync Agent

A hospital CTO makes a reasonable decision: the team needs a modern data platform. They evaluate options, run benchmarks, negotiate a contract, and deploy a cloud data warehouse. Eighteen months later, the warehouse is clean and performant. Patient data from the HIS lands on schedule. The BI team queries it with no complaints. And the care management team is still asking IT for the HbA1c compliance report — via ticket, one week turnaround, every month.

The infrastructure works. The intelligence is missing. It always was.

This is the pattern that repeats across healthcare organisations that invest in data infrastructure expecting healthcare data solutions. General-purpose warehouses and data platforms are excellent at what they do — structured SQL analytics and large-scale data engineering. What none of them does is understand an HL7 message, resolve a patient identity across source systems, or know what a care gap is. You get the blank canvas. The clinical intelligence layer is yours to build.

The Gap Between Infrastructure and Intelligence

Healthcare organisations need more than storage and compute. They need solved use cases — care gap detection, patient identity resolution, clinical metrics, cohort computation, engagement routing. These are not features you configure on a blank platform. They require years of domain engineering.

What Infrastructure Alone Does Not Include

The clinical intelligence layer that healthcare organisations must either build from scratch — or get from a purpose-built platform.

Healthcare Sync Agent

A purpose-built hospital connector — 10 years of production HIS integration experience distilled into a single agent. Handles HL7 v2 ADT/ORU/ORM and FHIR R4 across 150+ regional HIS variants, with ICD-10 validation, LOINC normalisation, and duplicate resolution before data reaches a fact table.

🔗

Clinical MDM

Patient identity resolved on phone, MRN, national ID, and date of birth — with configurable confidence thresholds. Safe-merge policy: below threshold, records stay separate rather than risk a wrong merge.

🩺

Care Gap Engine

200+ protocol definitions running continuously. Gaps open, are actioned, and close within the same pipeline — stateful, audited, and routed to the right channel.

📊

Prebuilt Clinical Metrics

ALOS, bed occupancy, 30-day readmission, OT utilisation, lab turnaround, care gap compliance — computed on every data refresh, no SQL required.

🔧

Versioned API Layer

Stable API contract over fact tables. Downstream applications — HIS, insurance portals, AI agents, BI tools — onboard against the API and don't break when source schemas change.

🔄

Standards as Updates

ICD-10 revisions, NABH indicator updates, and FHIR profile changes arrive as platform updates — not separately scoped and budgeted engineering projects.


What General-Purpose Data Platforms Actually Sell

General-purpose data platforms sell compute, storage, and a query engine. They are well-regarded and heavily used across finance, retail, and technology. They are horizontal infrastructure — designed to serve any industry, optimised for none.

None of them have ever processed an HL7 ADT message. None ship a care gap engine, a clinical data model, or patient MDM logic — and none of that is on their roadmap, because healthcare is not their primary market. The healthcare intelligence layer is not their problem to solve.

When a hospital deploys one of these platforms, it is buying infrastructure. Everything that converts raw HIS data into something a COO can act on is a build project that starts the day the deployment is complete.


The Engineering Program You Inherit

Before a hospital can get a care gap report out of a general-purpose platform, this is what the engineering team still has to build:

The HL7 parser. HL7 v2 is a standard in name only — every HIS vendor implements it differently. ADT events carry different field sequences. Date formats vary by message type. The same clinical event arrives from multiple source systems in different encodings. A parser that handles the specific quirks of three or four HIS vendors in a production hospital network takes 3-6 months to build and only stabilises after live exposure surfaces the edge cases that no spec document covers.

The clinical data model. Fact tables for appointments, admissions, lab results, billing, prescriptions. Dimension tables for patients, doctors, facilities, departments. Aggregate views for metrics computation. Temporal partitioning for time-range queries. The schema decisions made here affect every downstream consumer permanently — and they can't be made well without people who have built clinical data models in production before.

Patient MDM. The same patient shows up in HIS, lab, pharmacy, and billing under different identifiers and different formatting conventions. Matching them requires deterministic logic on MRN, national ID, date of birth, and phone, with a safe-merge policy that leaves ambiguous records separate rather than creating wrong golden records. A wrong merge in a clinical database is a patient safety problem. Getting this right takes domain knowledge that only comes from working with clinical data at scale.

The care gap engine. One protocol takes a few days to encode correctly. The full set — chronic disease management, preventive screening, medication adherence, specialist follow-up — plus keeping those definitions current when clinical guidelines update — is a continuous clinical informatics programme, not a one-time build.

Beyond the build: ICD-10 revisions land annually. NABH quality indicators update each accreditation cycle. On a custom stack, each update is a separately scoped project that trails the standard change by weeks or months.

The team to do all of this is typically 4-8 data engineers, 1-2 clinical informatics analysts, a BI architect, and a platform engineer — 12-18 months before anyone in care management can pull a patient list.


How THB DataCloud Solves This

THB DataCloud is a healthcare data solution platform. It connects to whatever data infrastructure your organisation already has — your existing database, your data warehouse, your HIS, your lab system, your claims platform — and delivers solved healthcare data use cases on top.

You don't need to rip out your existing infrastructure. DataCloud sits alongside it, ingests data from your source systems, and produces the clinical intelligence layer that generic platforms leave you to build.

Connects to Anything

DataCloud's ingestion layer connects to any data source a healthcare organisation operates — HIS systems, EMR platforms, lab information systems, pharmacy systems, billing engines, existing data warehouses, and cloud data platforms. The THB Healthcare Sync Agent handles 150+ regional HIS formats natively, carrying the parsing, normalisation, code mapping, and validation logic that only accumulates through years of live clinical data exposure.

Schema fingerprinting detects field-level drift when a HIS vendor pushes an upgrade and either adapts automatically or flags the affected jobs for review. On a custom-built pipeline, the same event breaks the pipeline silently — and recovery time is measured in days.

Delivers Solved Use Cases

The real value is not the connectivity — it is the use cases that are already solved. Care gap detection, patient identity resolution, clinical metrics computation, cohort segmentation, engagement routing, revenue opportunity identification — these are production-grade capabilities that ship with the platform and can be configured per organisation.

Each use case represents accumulated engineering from years in production clinical environments — the HIS-specific quirks that only appear in production, the code mapping edge cases that break custom pipelines, the MDM failure modes that only surface at scale. That is what a greenfield build project has to rediscover.


HL7 and FHIR Don't Process Themselves

Hospital data does not arrive as structured CSV exports or REST API JSON responses. HL7 v2 is the integration standard for HIS, lab, radiology, and pharmacy systems across India and most of the emerging world. FHIR R4 is the modern interoperability standard mandated for national health exchange connectivity. Both require parsers, not just connectors.

An HL7 ORU message carrying a lab result needs to be parsed, field-mapped to a standard column structure, linked to the correct encounter, validated against LOINC reference identifiers, and evaluated against any open care gap protocols — before it reaches an analytics table. A generic connector can move the raw message. It cannot do any of the rest.

THB DataCloud ships with the THB Healthcare Sync Agent — a connector built and refined across a decade of production hospital integrations. It handles 150+ regional HIS formats natively, parsing, normalising, code mapping, and validating clinical data before it reaches the intelligence layer.


Patient Identity Across Source Systems

A hospital network with five source systems has five patient identifier namespaces. The same person is an MRN in the HIS, an account number in billing, a sample ID in the lab, and a phone number in the pharmacy. Resolving those to a single identity is a prerequisite for every downstream process that depends on a complete patient view — care gap detection, cohort segmentation, risk scoring, engagement routing.

THB DataCloud's MDM runs as a continuous process rather than a one-time ETL job. When a new record arrives, it is evaluated against the existing identity graph. The confidence threshold is configurable per deployment — markets where national IDs are consistently present can run tighter thresholds than markets where only phone and DOB are reliable. Records that fall below threshold stay separate and carry their own MDM ID rather than being force-merged. Every downstream table — dimensions, facts, care gap assignments, cohort memberships, engagement profiles — carries the resolved MDM ID.


Care Gaps Are Not a Report. They Are a Continuous Process.

A care gap is a specific clinical condition: a defined patient population, a required action, a time window, and an evidence requirement. In a large hospital network's patient population, there are typically thousands of active gaps at any point — each one a patient who needs follow-up and a revenue opportunity that hasn't closed.

Building care gap detection from scratch requires someone to write the clinical logic — ICD-10 codes for the relevant diagnoses, LOINC codes for the relevant lab tests, the time window that defines overdue, and the encounter record that constitutes evidence of closure. An experienced clinical analyst writes one protocol correctly in a few days. The full set takes months. The protocols need to stay current when clinical guidelines update.

THB DataCloud ships 200+ protocol definitions covering chronic disease management, preventive screening, medication adherence, and specialist follow-up. The engine runs on every data refresh cycle. Coordinators get a named patient list, not a percentage.


Data That Stays With You

THB DataCloud runs on your infrastructure. On-premise hardware, a private cloud environment, or any public cloud you choose. Patient records are stored as Apache Parquet files — open columnar format, readable by any analytics tool, any ML framework, any BI platform. If your team wants to run analytics notebooks against the THB fact tables, the Parquet files are there. If you want to connect Tableau or Power BI directly to the metrics layer, the API is open. The data model is yours, on your storage, without a migration project when requirements change.

For hospital networks that have already negotiated data centre agreements or have on-premise infrastructure requirements from their regulatory authority, this is not a marginal architectural preference — it is a deployment requirement.


Flat Platform License, Not Consumption-Based Billing

Consumption-based pricing models — where costs scale with usage — compound in ways that are difficult to forecast at contract time. At healthcare scale — continuous care gap evaluation against millions of patient records, high-frequency HIS ingestion, real-time API serving for downstream applications — the monthly bill grows with every new hospital, every new protocol, every new cohort evaluation.

THB DataCloud is a flat platform license. The Care Gap Engine, clinical ELT pipeline, MDM, versioned API layer, and prebuilt clinical metrics are included. Adding a hospital doesn't move the license cost. The cost is fixed at the point of contract.


Performance Benchmarks

0x
Faster bulk patient record transport vs generic data platforms
0 min
MDM dedup — 1M records (custom builds typically take hours)
0ms
Clinical query — 5M appointments with diagnosis filter via versioned API
0+
Purpose-built clinical ELT jobs — HIS normalisation, ICD mapping, LOINC validation, claims reconciliation

Already Have a Data Platform? DataCloud Connects to It.

THB DataCloud does not ask you to abandon your existing infrastructure. If your organisation already has a data warehouse, a cloud data platform, or a data lake — DataCloud connects to it. It ingests data from whatever sources you have, layers clinical intelligence on top, and delivers the solved use cases your care management, operations, and engagement teams actually need.

The 150+ clinical data processing jobs in THB DataCloud represent accumulated engineering from years in production clinical environments. That is what a greenfield build project has to rediscover — and what DataCloud delivers in 12-16 weeks.


0+
Regional HIS formats — HL7 v2, FHIR R4, and flat-file variants across India, South Asia, and the Middle East
0+
Care gap protocol definitions — chronic disease, preventive screening, medication adherence, specialist follow-up
0-16 wks
Deployment to operational clinical intelligence for first hospital
0
Version of truth — single fact layer read by dashboard, AI agent, API consumer, and HMIS endpoint

THB DataCloud is the healthcare data solution platform built for this specific problem. Explore the architecture or see what healthcare organisations need from a data platform.