AgileMD

The model is the cleared device and the filing says so directly: the primary functions of the system are imparted by the Gradient Boosted Machine learning algorithm that takes input from the EHR in real time. Remove the model and there is no eCART. SCOPING NOTE, stated so the grade is not read wider than it is: AgileMD also sells a separate Clinical Pathways product, a content and workflow tool with more than 4,800 pathways live, whose asset is curated clinical logic rather than a model. This record is scoped to eCART, following the same product scoping used for Luminare and VirtuSense VSTOne. A buyer evaluating the pathways line alone is looking at a different centrality picture, closer to the content led vendors in clinical decision support.

The second A on this axis in the category and it rests on a structural property nothing else here has. THE CLEARED INDICATION RESTRICTS THE MODEL TO DATA A HUMAN HAS ALREADY VALIDATED: eCART calculates risk only from validated EHR data such as vitals confirmed by a registered nurse, and unvalidated data streaming from monitors and devices is not used until a healthcare professional confirms it. That places a licensed human between the raw signal and the model, which is the inverse of the automation bias problem and a direct answer to the substrate quality exposure the Sickbay record raises. Three further supports. The indication is explicitly adjunctive, stating that predictions are for reference only and that no therapeutic decision should be made solely on an eCART score. The user is shown the observed event rate at their score rather than only a colour, so the clinician calibrates their own response. And THERE IS NO LOW RISK OR DE ESCALATION OUTPUT, so eCART avoids the invisible failure surface carried by CLEWLR, by Etiometry step down and by Healthplus.ai discharge support, in the same way PeriGen does. Held honestly rather than uncritically: the moderate threshold fires on 7.5 percent of observations, which is a real volume, and nothing is published about what clinicians actually do with those alerts or how many are dismissed.

Best in this category, and it earns the grade by a different route from Etiometry. THE MODEL CLASS IS NAMED IN THE FILING, a Gradient Boosted Machine, where the Epic Sepsis Model discloses nothing and CLEW discloses everything except the model class. The score construction is published: a 0 to 100 composite scaled on specificity rather than raw predicted probability. The default alerting thresholds are published, 93 for moderate risk and 97 for high risk. THE DECISIVE PROPERTY IS THAT THE OBSERVED RATE OF DETERIORATION AT EACH SCORE THRESHOLD IS DISPLAYED TO THE CLINICIAN AS ODDS OF DETERIORATION IN THE NEXT 24 HOURS, ALONGSIDE THE SCORE. That is calibration surfaced at the point of care, and nothing else in this index does it. A risk number a clinician can read as an actual event rate is the practical form of the falsifiability test this index applies to every model. Supporting candour: the group published Less is More in Resuscitation 2021, showing that age, heart rate and respiratory rate alone recover much of the performance, which complicates its own 97 variable pitch. Held short of a clean sweep by two gaps stated on the record: there is no model card, and the 97 input variables are never enumerated.

The deepest evidence base in this category and one of the deepest in the index, spanning more than fifty peer reviewed publications from 2011 to 2025 in Critical Care Medicine, the American Journal of Respiratory and Critical Care Medicine, JAMA Internal Medicine, JAMA Network Open, Chest, Resuscitation and Annals of Surgery. THREE ITEMS CARRY THE GRADE. First, an outcome study rather than a validation: The Impact of a Machine Learning Early Warning Score on Hospital Mortality, A Multicenter Clinical Intervention Trial, Crit Care Med 2022;50(9):1339-1347. Nothing else in this category has a multicentre intervention trial with a mortality endpoint. Second, prospective external validation, published as Multicenter Development and Prospective Validation of eCARTv5, Crit Care Explor 2025;7(4):e1232, and independently visible in the 510(k) on 205,946 prospective encounters. Third, the score has been used as a comparator by other groups, including Australian evaluations against Between the Flags, Q-ADDS, NEWS and MEWS in Resuscitation 2018;123:86-91 and Resuscitation 2020;153:28-34. FOUR CAVEATS STATED RATHER THAN IMPLIED: the literature is overwhelmingly authored by the founders, who are co inventors; the intervention trial is not randomised; the item the company features first is a conference abstract, Am J Respir Crit Care Med 2025;211:A5678, the same precision issue recorded against Etiometry and PeriGen; and the retrospective cohort spans 2009 to 2023, fourteen years across which ward practice changed materially.

A privacy policy, terms of service and separate terms and conditions for organisations are all published and linked, which is better than most of this category, but NONE WAS OPENED THIS PASS and that is recorded explicitly rather than left implicit, per the lesson taken from the Droxi and Sickbay records. Architecture is described at a useful level: a hosted cloud CDS engine requiring no on site hardware, operating behind multiple layers of protection, encryption and network security, with advanced audit logging and monitoring. THE MATERIAL DIFFERENCE FROM ITS PEERS IS THE DIRECTION OF TRAVEL FOR PHI. CLEW, Etiometry and Sickbay all run on infrastructure the hospital provides, so data can stay inside the institution. eCART is vendor hosted, so patient data leaves the hospital by design. That is a legitimate architecture and it is what makes the days to weeks deployment claim credible, but it is a different risk conversation and no data residency commitment, region statement or retention limit is published. Open and unaddressed: whether customer data is used to develop or retrain the model, which matters because the product is on its fifth version.

The company states plainly that the AgileMD Cloud CDS engine is HIPAA compliant, which is more than CLEW, AITRICS or Etiometry publish, so this is not Not Rated. But the claim stops at the assertion. No business associate agreement terms, no tier, no execution path, no statement of which entity signs, and no detail on subprocessors for a cloud hosted product that necessarily has them. A bare compliance assertion from a vendor holding PHI for hundreds of hospitals is the floor rather than the standard, and the gap is easy to close.

Something is published and it is unverifiable in exactly the way this index asks about. THE SOC 2 CLAIM DOES NOT SPECIFY THE TYPE. The site displays a SOC 2 logo and states the engine is SOC-II compliant, without saying Type 1 or Type 2, which is the single question this index puts to every SOC 2 claim and which Etiometry answered to earn an A on this axis. A Type 1 report describes controls at a point in time; a Type 2 tests them over a period. They are not interchangeable. No ISO 27001, no HITRUST, no trust centre and no report request path was located. TWO GENUINE CREDITS, both rare in this category and both recorded: the company publishes a VULNERABILITY DISCLOSURE POLICY, which almost nothing in this index does and which signals a real security function rather than a compliance badge, and it operates a public system status page. Specifying the SOC 2 type would move this grade immediately.

K233253, decided 21 June 2024, 21 CFR 870.2210 Adjunctive Predictive Cardiovascular Indicator, Class II, product code QNL, the same regulation and product code as CLEW. PREDICATE DEVICE IS CLEWICU, K200717, so this product was cleared against another vendor in this same category, and the reference device is PeraServer and PeraTrend, K172959, the Rothman Index. THIS IS THE POSITIVE CASE FOR THE TEST THAT CAUGHT AITRICS, and it is why the grade is A. Read the filing on the three questions this index now asks of every clearance. Does the device description match the marketing: yes, the cleared device is the gradient boosted machine learning model the company sells, not a rule based dashboard sitting behind it. What settings are excluded: hospitalised ward patients aged 18 and over, which is a precise and genuinely narrow indication rather than an open ended deterioration claim. Was clinical data required: yes and extensively, retrospective validation on 1,769,461 encounters and prospective validation on 205,946 further encounters across three geographically distinct health systems. One thing a buyer should ask about rather than assume: the 510(k) summary describes no Predetermined Change Control Plan, so unlike CLEW there is no published regulator reviewed commitment governing how the model may be updated after purchase.

THE FIRST RACE STRATIFIED PERFORMANCE DISCLOSURE IN THIS CATEGORY AND THE BENCHMARK EVERY OTHER VENDOR HERE SHOULD NOW BE ASKED TO MATCH. Table D of the 510(k) summary reports AUROC, sensitivity, specificity, PPV and NPV at both alerting thresholds for five race categories, with unique patient counts: American Indian or Alaska Native, Asian or Mideast Indian, Black or African American, Native Hawaiian or Other Pacific Islander, and White or Caucasian. Comorbidity subgroups for congestive heart failure, COVID-19, chronic pulmonary disease and sepsis are reported the same way. AITRICS previously set the category benchmark with a subgroup floor across age and sex only and explicitly no race or ethnicity; Epic, CLEW and Etiometry publish none at all. THE GRADE IS FOR PUBLISHING, NOT FOR THE RESULT, AND THE RESULT DESERVES READING, which is the same separation this index applied to the Epic record. The vendor states that all five groups met the performance thresholds, and that is accurate. It is also true that sensitivity at the moderate threshold runs from 46.6 percent for American Indian or Alaska Native patients and 48.1 percent for Black or African American patients up to 56.5 percent for Native Hawaiian or Other Pacific Islander patients, so the two lowest values fall on groups already subject to access disparities, and the smallest groups rest on 1,427 and 3,282 unique patients so their intervals are wide. A SECOND EXPOSURE IS UNADDRESSED ANYWHERE: the outcome is death or ICU TRANSFER, and transfer is a decision rather than a physiological fact, so differential willingness to transfer particular patients is learned as signal. Same action defined label mechanism recorded against Healthplus.ai and Kinometrix. Credit also for a candid published limitation, that comparative effectiveness against existing or future SARS-CoV-2 strains is unknown.

Functionally deep and evidentially thin, which is the same shape that held Sickbay at B. The product is embedded in native EHR workflows rather than presented as a separate application, and the pathways layer does real bidirectional work: ordering directly from within a pathway, aligning order sets and other decision support, embedding live labs and vitals from the record, generating clinical documentation and integrating clinical calculators. Deployment is claimed in days to weeks without heavy IT involvement, which is only credible with genuine integration depth. THE GAP IS THAT NO EHR VENDOR IS NAMED ANYWHERE. No Epic or Oracle Health partnership is stated, no FHIR or SMART on FHIR support is described, and no marketplace or Toolbox listing was located, which matters more since the Connexall record established Epic Toolbox designation as the stronger credential. The 510(k) states only that the health system must supply an EHR connection and data interfaces. Naming the integrations would move this to A immediately given the install base.

The broadest named install base in this category by a wide margin. Twenty health systems are named on the site including Advocate Aurora, BJC, Children's Hospital Colorado, Children's Nebraska, Corewell Health, Johns Hopkins Medicine, Mercy, MUSC, Penn Medicine, UCHealth, UChicago Medicine, UC Health Cincinnati, UF Health, UNC, UVA Health, UW Health, Vanderbilt and Yale. Cloud hosted with no on site hardware, and deployment claimed at scale in days to weeks rather than months to years, which is a real differentiator in a category where every competitor needs a bespoke real time data feed built first. Reporting is offered at health system, facility, unit and provider level. TWO THINGS HOLD IT AT B. The install base count is internally inconsistent across the vendor's own material: the site meta description says more than 200 US hospitals while the statistics block on the same page says 400 plus, and the 2024 clearance announcement said over 250. Publication counts run 80, 85 plus and 88 plus across the same sources. This is the bookkeeping check first recorded against Etiometry, and it bites hardest on vendors whose pitch is evidentiary rigour. Second, nothing is published on implementation shape, readiness gates, training or data residency, which is what earned Etiometry an A here.

No pricing published at any level. No rate card, no stated unit of pricing such as per bed, per monitored patient day or per hospital, no indicative band, and no implementation or integration fee. All routes lead to a demo request form. THE ASYMMETRY IS THE FINDING AND THIS IS ITS FIFTH INSTANCE IN THIS CATEGORY, after Droxi, Healthplus.ai, Kinometrix and HealthLeap: the company presented a conference abstract specifically titled Measuring the Return on Investment of an Artificial Intelligence Early Warning System, Circulation 2023;148(Suppl 1: Abstract 350), and markets decreased mortality, length of stay and direct variable costs, so it has quantified the customer's return while publishing nothing at all about the cost side of that calculation. Two cost factors a buyer should raise directly: whether the eCART licence and the Clinical Pathways licence are separate lines, and whether pathway authoring and content maintenance are included or billed as services.

The cleared scope is precise and narrow, which this index credits: hospitalised ward patients aged 18 years or older. That is an explicit negative scope statement ruling out paediatric use and, like AITRICS, it places the product on the general ward rather than in the ICU, which is the harder problem because ward patients are measured intermittently rather than monitored continuously. Comorbidity coverage is evidenced rather than asserted, with published subgroup performance for sepsis, congestive heart failure, chronic pulmonary disease and COVID-19, and the wider literature adds validations in postoperative surgical inpatients and long term acute care hospitals. A QUESTION A BUYER SHOULD PUT DIRECTLY, and it is a milder relative of the cleared versus marketed problem found at AITRICS and Biobeat: the FDA indication covers adults only, yet the company publishes a paediatric implementation outcome study in Pediatric Critical Care Medicine 2025;26(2):e146-e154, names two children's hospitals among its customers, and its pathways product covers neonatal topics. Establish which product a paediatric site is actually running and on what regulatory basis. Held at B rather than A because validation sits in three health systems, all of which appear to be academic, so community and safety net performance is unestablished, which is exactly the gap the Epic county emergency department study exposed.