Skip to content
Home » FAQs from Digital Health Innovators

FAQs from Digital Health Innovators

From the webinar: Quality assure your digital health technology

On October 18th 2022 N!P and ORCHA organised the webinar: The Nordic Digital Health Evaluation Criteria, quality assure your digital health technology.

During this interactive webinar our speakers discussed how the NordDEC will benefit digital health innovators, and answered some of the most common questions around the NordDEC. If you wish to view the full webinar recording you can request access to the recordings here.

A large number of questions were asked and we weren’t able to answer them all during the webinar. Below you can find an overview of all these questions with the answers provided by the panelists.

 

Great question! In developing the NordDEC assessment we have focused on developing an objective assessment that focuses on yes/no criteria and in doing so promote an approach focused on objectivity. Our goal is to create an assessment framework that promotes consistency, objectivity and removes bias.

It is also a broad assessment framework that does not discriminate against technologies that do not classify themselves as medical devices.

It refers to various international standards for usability, including Web Content Accessibility Guidelines (WCAG 2.0 AA and WCAG 2.1 AA), as well as ISO9241, Apple HIG and Android App Quality Guidelines.

In the context of risk management, ISO14971 is the standard for the Application of Risk Management for Medical Devices. It is important to note however that not all apps we review are Medical Devices so they may have no need to have this ISO. Therefore, its inclusion would move to a narrower view of digital health technologies which we think leaves large swathes of the market not applicable and therefore unchecked. For those products that do have this ISO, they will pass our question set on Risk Management as they will have all the documentation we require in this space.

We are focused on ensuring that every digital technology that has the potential to be used by patients, citizens and healthcare professionals is safe, not just those covered by existing regulations and that there are safeguards in place to monitor technology, where there are delays to regulators.

We agree but we also know from our digital health suppliers that the MDR can be tricky to navigate, timely and costly. Our approach is not to replace existing guidelines, frameworks and regulations rather to enhance with a clear step-by-step process that promotes compliance.

As explained in the previous response we know that not all digital health technologies fall within this criteria and seek compliance against the regulations. The risk being that if they do not fall within this category they go largely unchecked.

Equally, for a product that started out as a non-medical device but over time has introduced new features and functionality, we provide an assessment that highlights necessary areas of compliance, including MDR, thus making the NordDEC supportive of these frameworks. It provides a collaborative approach that promotes and supports relevant compliance with relevant regulations.

Our processes also allow for continuous review and monitoring of product updates and upgrades to ensure ongoing compliance.

We are also focused on supporting those unfamiliar with MDR and similar requirements who have no specialist interest to still be able to distinguish between good and bad products and the NordDEC has been designed with this in mind.

The ORCHA Baseline Review as a foundation level assessment has been designed to reflect guidelines, best practice and regulations from across the world. This has therefore identified a range of common criteria that has fed into the NordDEC.

However, the NordDEC goes beyond the ORCHA assessment focusing on a range of additional enhanced assessment criteria that have been identified by Nordic stakeholders as important to their decision making process. This includes technical stability and security. In this regard it is similar to the NHS DTAC process in England.

Slides and a copy of the webinar video will be made available to all those who registered via email and the webinar recording is available by request here.

The NordDEC, powered by ORCHA, operates in International English for our assessments. As the Nordic data warehouse grows in volume our platform is flexible to ensure that the information presented to HCP’s is relevant and understandable to the context.

There is a wide range of Digital Health Technologies, with a wide range of features, and setting a single bar risks setting it too high or too low. By using an adapted version of the NICE Evidence Standards Framework for Digital Technologies, we introduce proportionality. Of course, as part of that, the bar includes "traditional" clinical evidence in some cases (Tier 3a/b or Tier C).

When these are necessary, we do look at measures of significance, sample size, comparators used, and we ensure these are appropriate, so that if an app is going to be used as a treatment, we ensure there is evidence of its effectiveness. There are frameworks, such as GRADE which can go further into this, but they require specialist involvement.

The ORCHA Baseline Review, provided by our partners ORCHA, has been designed as a global foundation level assessment that supports digital health products work towards compliance against a range of national assessment schemes including the NordDEC and the NHS DTAC. The OBR is a pre-requisite to entry on to the London Procurement Partnership Dynamic Purchasing System for Health and Care Apps and ORCHA provide libraries across 70% NHS regions, making products visible to health care systems, healthcare professionals, patients and citizens.

Similarly, in the Nordics the intention is that upon passing the NordDEC assessment criteria your product will be surfaced on the Nordic Formulary from which health care systems can draw down from. The intention is to support digital health suppliers to distinguish themselves and demonstrate to healthcare providers across the Nordics that their product meets quality assurance standards, meet technical requirements and provide tangible benefits to their healthcare system, healthcare professionals and citizens.

The assessment frameworks, similar to MDR, is not a substitute for sales and marketing activities while these frameworks are not linked to national reimbursement mechanisms. That is ultimately a policy level decision at national government level. It does however provide you with an opportunity to seek external quality assurance which governments, healthcare systems, patients and citizens welcome in making choices about which apps to use.

Currently, the NordDEC is powered by our partners ORCHA who complete the assessments. The timeline is largely determined by the product owner’s readiness to submit evidence against each assessment domain however it is estimated to take up to three months to complete assessment, dependent on a product’s readiness.

The assessment framework is available for use by national bodies and healthcare systems across the Nordics to use as a vital first step in deciding whether to purchase and deploy these technologies.

 

Yes, absolutely! We welcome interested parties to submit details to info@norddec.org and we can discuss with you potential opportunities for assessment.