Interactive Multimedia Report (IMR)
1.0.0 - Trial-Implementation International flag

This page is part of the IHE Interactive Multimedia Report (IMR) (v1.0.0: Trial Implementation) based on FHIR R4. This is the current published version. For a full list of available versions, see the Directory of published versions

2:4.141 Store Multimedia Report [RAD-141]

2:4.141.1 Scope

This transaction is used to store diagnostic reports that contain hyperlinked references to media such as images or measurements.

2:4.141.2 Actors Roles

The roles in this transaction are defined in the following table and may be played by the actors shown here:

Table 2:4.141.2-1: Actor Roles

Role Description Actor(s)
Sender Send Reports Report Creator
Receiver Receives and handles reports Report Repository
Report Reader
Rendered Report Reader

Transaction text specifies behavior for each role. The behavior of specific actors may also be specified when it goes beyond that of the general role.

2:4.141.3 Referenced Standards

FHIR-R4: HL7 FHIR Release 4.0

FHIR ImagingSelection: ImagingSelection

DICOM WADO-RS: DICOM Studies Service Retrieve Transaction

HTML 5: HTML Living Standard

HTML Custom Element: HTML Custom Element

PDF/A: ISO 19005-1:2005

2:4.141.4 Messages

SenderReceiverStore Multimedia Report Bundle RequestStore Multimedia Report Bundle Response

Figure 2:4.141.4-1: Interaction Diagram

2:4.141.4.1 Store Multimedia Report Bundle Request Message

The Sender sends a multimedia report bundle to the Receiver. The Sender shall support sending such messages to more than one Receiver.

The Receiver shall support handling such messages from more than one Sender.

2:4.141.4.1.1 Trigger Events

The Sender determines that a multimedia report is ready to be sent. For example, a radiologist completed a dictation on a study and signed off the report. This trigger is associated with an intention that the Receiver stores the multimedia report contents and makes it available for subsequent query and retrieve requests.

2:4.141.4.1.2 Message Semantics

This message is an HTTP POST request. The Sender is the User Agent. The Receiver is the Origin Server.

The Sender shall initiate a FHIR “transaction” using a “create” action by sending an HTTP POST request method composed of an IMR Bundle Resource containing the following:

  • one DiagnosticReport Resource
  • zero or more ServiceRequest Resources
  • zero or more ImagingStudy Resources
  • zero of more ImagingSelection Resources

Note: The DiagnosticReport resource depends on other critical resources such as Patient, Organization, Practitioner or PractitionerRole. These resources are not part of the bundle because they are expected to already exist in the enterprise; hence, they are referenced by the resources in the bundle, rather than created by the Sender. See Section 1:52.4.1.6 DiagnosticReport Referenced Resources for more details.

Additional considerations are needed for these referenced resources in the inter-enterprise use case. See Section 1:52.4.1.7 Inter-Enterprise Use Case for details.

The media type of the HTTP body shall be either application/fhir+json or application/fhir+xml.

See http://hl7.org/fhir/http.html#transaction for complete requirements of a FHIR transaction. See http://hl7.org/fhir/bundle-transaction.html for an example of a transaction bundle.

The Sender shall send the message to the base URL as defined in FHIR. See http://hl7.org/fhir/R4/http.html for the definition of “HTTP” access methods and “base”.

The following subsections contain additional constraints on the contents of the IMR Bundle.

2:4.141.4.1.2.1 IMR Bundle Resource

For complete information on constructing a FHIR Bundle Resource, see http://hl7.org/fhir/bundle.html.

The Sender shall include in Bundle.meta.profile the value of https://profiles.ihe.net/RAD/IMR/StructureDefinition/imr-store-multimedia-report-bundle. The Sender may include other profiles in Bundle.meta.profile.

The IMR Bundle:

The ImagingSelection resource shall conform to the following additional IMR constraints:

  • subject, if present, shall be a reference to a Patient resource
  • endpoint shall have one or more ImagingStudyEndpoint

Note: FHIR ImagingSelection resource is in development and not defined in FHIR R4. Therefore the resource profile is specified above. Follow this announcement for the scheduled release date of FHIR R5. Once the FHIR R5 ballot is published (tentatively mid-October 2022), there will be a defined specification for ImagingSelection available with a maturity level of 1.

The Sender may set meta.profile of each resource to be the corresponding IMR Profile. This enables a Receiver to validate the received resource against the IMR resource profile specification.

Note: A Sender may choose not to set meta.profile to a specific profile, or may set it to multiple profiles.

The Sender shall create corresponding properly identifiable resources. In other words, the Sender shall not use contained resources (see http://hl7.org/fhir/references.html#contained).

2:4.141.4.1.2.2 IMR DiagnosticReport Resource

The Sender shall construct the IMR DiagnosticReport Resource according to the IMR DiagnosticReport StructureDefinition.

Section 2:4.141.4.1.2.2.1 contains mapping requirements.

Section 2:4.141.4.1.2.2.3 contains requirements for including a rendered report in an IMR DiagnosticReport Resource.

A complete example of an IMR DiagnosticReport Resource is available in IMR DiagnosticReport Example.

2:4.141.4.1.2.2.1 Mapping of Attributes in a Diagnostic Report

Table 2:4.141.4.1.2.2.1-1 specifies a set of attributes commonly included in radiology diagnostic reports, and how the Sender shall map these attributes to the IMR DiagnosticReport Resource and other referenced resources. Refer to the StructureDefinition for these resources on the Artifacts page for details.

Table 2:4.141.4.1.2.2.1-1: Mapping of Attributes in DiagnosticReport

Conceptual Attribute FHIR Resource Mapping Additional Constraint Note
Performing Organization DiagnosticReport.performer See IMR DiagnosticReport for details The organization which is responsible for the diagnostic report.

See Note 1
Results Interpreter DiagnosticReport.resultsInterpreter Can be either Practitioner or PractitionerRole

See IMR DiagnosticReport for details
The primary result interpreter(s)

See Note 1
Patient Name DiagnosticReport.subject(Patient).name See IMR DiagnosticReport for details See Note 1
Patient ID DiagnosticReport.subject(Patient).identifier See IMR DiagnosticReport for details See Note 1
Accession Number DiagnosticReport.basedOn(IMRServiceRequest).identifier See IMR DiagnosticReport and IMR ServiceRequest for details Identified by the identifier.type
Study Date DiagnosticReport.imagingStudy(IMRImagingStudy).started See IMR ImagingStudy for details  
Study Type DiagnosticReport.imagingStudy(IMRImagingStudy).procedureCode See IMR ImagingStudy for details  
Report Status DiagnosticReport.status partial, preliminary, final, amended, corrected, appended, cancelled

See IMR DiagnosticReport for details
A subset from what is defined in FHIR
Report Sign-off Time DiagnosticReport.issued See IMR DiagnosticReport for details  
Examination DiagnosticReport.text See IMR DiagnosticReport for details  
Indication DiagnosticReport.text See IMR DiagnosticReport for details  
Technique DiagnosticReport.text See IMR DiagnosticReport for details  
Associated Study DiagnosticReport.extension[associatedStudy] Can be either an ImagingStudy or DiagnosticReport

See IMR DiagnosticReport for details
 
Report Content Section(s) DiagnosticReport.text See IMR DiagnosticReport for details e.g., Findings and Impressions. See Note 2

Note 1: This transaction does not define a FHIR resource profile for the resource. An implementation may use other FHIR resource profiles applicable for their deployment.

In addition to the common set above, there are also a number of useful optional attributes that the Sender may included.

Table 2:4.141.4.1.2.1-2: Useful Optional Attributes in Radiology Diagnostic Report

Report Attribute FHIR Resource Mapping Additional Constraint Note
Referring Physician DiagnosticReport.imagingStudy(IMRImagingStudy).referrer    
Reason For Study DiagnosticReport.imagingStudy(IMRImagingStudy).reasonCode    
Study Description DiagnosticReport.imagingStudy(IMRImagingStudy).description    
Body Part DiagnosticReport.result(IMRObservation).bodySite Note 1  
Structured content DiagnosticReport.result(IMRObservation) Note 2  

Note 1: See HIMSS-SIIM White Paper: The Importance of Body Part Labeling to Enable Enterprise Imaging for the importance of body part labeling.

Note 2: The DiagnosticReport.text is required and is used to capture report content section(s) among other narrative content. Additionally, the Sender may include the experimental IMR Observation resource to encode atomic data items for the equivalent contents (such as findings and impressions) in various report sections.

Coded observation for radiology reporting has not been defined. IHE Radiology is interested in your feedback if you use it. Please send your feedback to radiology@ihe.net.

2:4.141.4.1.2.2.2 Observation Imaging Context in an IMR DiagnosticReport Resource

For narrative content, the Sender may directly embed one or more image references inline within the text.

The Sender shall specify each inline image reference using the <span> HTML element and the corresponding </span> end element. This <span> element shall have the attributes as defined in Table 2:4.141.4.1.2.3.1-1.

The display text is the text enclosed by the <span> element.

Table 2:4.141.4.1.2.2.2-1: Attributes for the <span> element

Attribute Type Optionality Description
class String R Type of multimedia content. The value shall have the “imr-ref-“ prefix appended to the data type.

For example, for date type of ImagingSelection, the value shall be ‘imr-ref-ImagingSelection’. (See Note 1)
id String RC Reference to an ImagingSelection resource. Required if the class is imr-ref-ImagingSelection

Note 1: Custom type may be used but they are out of scope of IMR.

Example 1: An image reference is specified with the finding, with a simple string “image” as the hyperlink display text

Trace fluid or debris is seen in the distal lumen of the stent <span class="imr-ref-ImagingSelection" id="ImagingSelection/1234">image</span>.

Example 2: An image reference is specified adjacent to the corresponding measurements, with a simple description of the series and instance number as the hyperlink display text

The imaged portion of a thyroid gland is unremarkable. Prominent or mildly enlarged mediastinal and bilateral hilar lymph node measure up to 1.2 x 0.8 cm in the right paratracheal station <span class="imr-ref-ImagingSelection" id="ImagingSelection/1234">(Series 2, Image 10)</span>.

Example 3: Multiple image references are specified adjacent to the measurements, with each measurement as the corresponding hyperlink display text

The imaged portion of a thyroid gland is unremarkable. Prominent or mildly enlarged mediastinal and bilateral hilar lymph nodes measure up to <span class="imr-ref-ImagingSelection" id="ImagingSelection/1234">1.2 x 0.8 cm in the right paratracheal station</span>, <span class="imr-ref-ImagingSelection" id="ImagingSelection/1567>2.3 x 1.4 cm in the subcarinal station</span>, and <span class="imr-ref-ImagingSelection" id="Imagingselection/1890>1.4 x 0.9 cm in the right hilar stations</span>. No significant axillary lymphadenopathy is detected.

For the examples above, each reference uses a span of class imr-ref-ImagingSelection. Each ImagingSelection resource may reference one or more imaging objects as well as DICOM SR, segmentation, or include region of interest directly. See ImagingSelection examples for various examples of the ImagingSelection resource, including image references as well as non-image references.

2:4.141.4.1.2.2.3 Rendered Report in IMR DiagnosticReport Resource

The Sender shall include in DiagnosticReport.presentedForm the report rendered in HTML format. The corresponding DiagnosticReport.presentedForm.contentType shall have the value “text/html”.

The Sender may include other renderings of the same report (e.g., PDF) in DiagnosticReport.presentedForm and shall set the DiagnosticReport.presentedForm.contentType with a value corresponding to the rendered report format.

The Sender shall encode the rendered report that is referenced by DiagnosticReport.presentedForm in one of the following ways:

  • As a base64Binary in DiagnosticReport.presentedForm.data.
  • As a base64Binary in a Binary Resource and this Binary Resource is referenced in DiagnosticReport.presentedForm.url.
  • Host the rendered report somewhere and provide the url in DiagnosticReport.presentedForm.url.

The Sender shall populate accurate values for hash and size for the rendered report content in DiagnosticReport.presentedForm.hash and DiagnosticReport.presentedForm.size:

  • Where the presentedForm is a Binary Resource instance, the .hash and .size shall represent the raw artifact prior to base64 encoding in the Binary.data element.
  • Where the presentedForm is hosted elsewhere, not as a Binary Resource, the .hash and the .size shall represent the rendered report content that would be retrieved using the mime-type specified in DiagnosticReport.presentedForm.contentType.
2:4.141.4.1.2.2.3.1 Image References in Rendered Report

This section contains requirements for Senders that include observation imaging context in the rendered report in HTML format in DiagnosticReport.presentedForm

For inline observation imaging context references in DiagnosticReport.text, the Sender shall substitute each <span class="imr-ref-*"></span> markup with an HTML anchor element. The href attribute shall correspond to the content specified in the referenced ImagingSelection resource:

  • The service root for the URL shall derive from ImagingSelection.endpoint.
  • The rest of the URL path shall derive from the remaining content of ImagingSelection according to the protocol specified in ImagingSelection.endpoint.connectionType.

The Sender shall construct the resulting URLs such that the contents returned to the Receiver upon invocation are ready to be presented, rather than contents that would require any processing by the Receiver. For example, using a WADO-RS URL with a rendered image or using an IID compliant URL to launch a viewer meet the requirements, whereas a plain WADO-RS URL to retrieve a DICOM object does not. In other words, the Sender shall not presume that the Receiver can download and render the linked content on its own.

2:4.141.4.1.2.2.3.2 Rendered Report in PDF Format

A Sender that supports the PDF Report Option, if configured, shall also include a semantically equivalent diagnostic report in PDF format in the DiagnosticReport.presentedForm attribute. The corresponding presentedForm.contentType shall have the value “application/pdf”.

The Sender shall include in the PDF report all text and linked contents as in the HTML report. The Sender may preserve the linked contents as hyperlinks, or substitute the linked contents with the actual rendered contents and embedded them in the PDF file.

2:4.141.4.1.2.3 Patient, Organization, Practitioner, PractitionerRole Resources

The Patient, Organization, Practitioner or PractitionerRole Resources are required resources as defined by IMR DiagnosticReport. However, IMR does not specify any FHIR resource profiles on these resources. These resources are not radiology or imaging specific. Real world deployment may specify constraints on these resources.

2:4.141.4.1.3 Expected Actions

The Receiver shall accept both media types application/fhir+json and application/fhir+xml.

On receipt of the request message, the Receiver shall validate the resources and respond with one of the HTTP codes defined in the response Message Semantics.

The Receiver shall process the transaction bundle atomically as specified in http://hl7.org/fhir/http.html#transaction.

Note: Local policy might reject bundles containing resources such as Patient, Organization, Practitioner, etc. referenced that are unknown to the Receiver. Therefore, the actual behavior is at the discretion of the Receiver Actor policy.

The Receiver shall retrieve any Resources referenced by absolute URLs in the FHIR Bundle Resource.

The Receiver shall validate the bundle first against the FHIR specification. Guidance on what FHIR considers a valid Resource can be found at http://hl7.org/fhir/validation.html.

Once the bundle is validated, the Receiver shall store the report and all associated resources.

The Receiver shall not send a success response until the multimedia report is completely processed and persisted as appropriate to the Receiver configuration.

If the Receiver encounters any errors or if any validation fails, the Receiver shall return an appropriate error.

2:4.141.4.1.3.1 Additional Expected Actions for Report Repository

The Report Repository shall be able to retrieve the hosted rendered report in DiagnosticReport.presentedForm.url. The Report Repository shall be able to embed the retrieved report in the corresponding DiagnosticReport.presentedForm.data, or substitute the corresponding DiagnosticReport.presentedForm.url with a value where the report can be retrieved from the Report Repository.

Note: This functionality is necessary in case the Sender stores the report to the Report Repository with a URL that is inaccessible to other subsequent consumers of the reports.

The Report Repository may extract the embedded rendered report in DiagnosticReport.presentedForm.data, store it and substitute the corresponding DiagnosticReport.presentedForm with a URL (i.e., DiagnosticReport.presentedForm.url) instead.

The Report Repository shall maintain the integrity of the report if the report access method is modified (i.e., from embedded to hosted, or vice versa).

Note: Multiple formats of rendered reports may exist in DiagnosticReport.presentedForm.

2:4.141.4.2 Store Multimedia Report Bundle Response Message

The Receiver sends a response message describing the message outcome to the Sender.

2:4.141.4.2.1 Trigger Events

The Receiver receives a Store Multimedia Report Bundle Request message.

2:4.141.4.2.2 Message Semantics

This message is an HTTP POST response. The Sender is the User Agent. The Receiver is the Origin Server.

The Receiver returns an HTTP Status code appropriate to the processing outcome, conforming to the transaction specification requirements in http://hl7.org/fhir/http.html#trules to the Sender. This enables the Sender to know the outcome of processing the FHIR transaction, and the identities assigned to the resources by the Receiver.

The Receiver shall construct a Bundle, with type set to transaction-response, that contains one entry for each entry in the request, in the same order as received, with the Bundle.entry.response.outcome indicating the results of processing the entry warnings such as PartialFolderContentNotProcessed. The Receiver shall comply with FHIR http://hl7.org/fhir/bundle.html#transaction-response and http://hl7.org/fhir/http.html#transaction-response.

To indicate success, the Receiver shall return an HTTP status 200. The Receiver shall include in the HTTP response header the location element, and the etag element if the Receiver supports FHIR resource versioning.

The Bundle.entry.response.status shall be 201 to indicate the Resource has been created.

If the Receiver cannot find any referenced resources in the bundle, then the Receiver shall return an HTTP status ‘404 Not Found’.

If the Receiver cannot handle the method for each resource in the bundle, then the Receiver shall return an HTTP status ‘405 Method Not Allowed’.

If the Sender is not authorized to store the bundle, then the Receiver shall return an HTTP status either ‘401 Unauthorized’ or ‘403 Forbidden’.

For other request related errors, the Receiver shall return an HTTP status ‘400 Bad Request’. For other Receiver processing related errors, the Receiver shall return an appropriate 5xx HTTP status.

An informative StructureDefinition is found at IMR Store Multimedia Report Bundle Message.

2:4.141.4.2.3 Expected Actions

If the Receiver returns an HTTP redirect response (HTTP status codes 301, 302, 303, or 307), the Sender shall follow the redirect, but may stop processing if it detects a loop. See RFC7231 Section 6.4 Redirection 352.

The Sender processes the results according to application-defined rules.

2:4.141.4.3 CapabilityStatement Resource

Receiver shall provide a CapabilityStatement Resource as described in ITI TF-2: Appendix Z.3 indicating which resources associated with an IMR report have been implemented.

2:4.141.5 Security Considerations

The Sender may use external URLs in presentedForm.url. In this case, the Receiver should consider validating the URL to ensure that it is a valid URL referencing a known legitimate host to avoid phishing attack.

2:4.141.5.1 Security Audit Considerations

This transaction is associated with a ‘Patient-record-event’ ATNA Trigger Event on both the Sender and the Receiver. See ITI TF-2: 3.20.4.1.1.1.