Kelie Williams

Medical imaging in oncology trials is already well documented. Techniques such as computed tomography (CT), magnetic resonance imaging (MRI), and conventional radiography can provide insights into drug safety and efficacy faster than traditional clinical endpoints. Adopting an imaging strategy, however, introduces challenges, particularly around the potential variability of imaging data collected in multicenter trials and the interpretation of that data. Centralized independent review of imaging data can reduce the variability and bias inherent in these types of trials. 

Ensuring consistency and lack of bias in clinical trials is a critical issue for sponsors and regulatory authorities such as the FDA. This is particularly relevant when medical imaging is utilized for the evaluation of surrogate endpoints in multicenter trials, a practice increasingly adopted in the management of oncology trials. Image acquisition protocols can vary across sites, and each center may interpret data somewhat differently according to local practice. Radiological assessment of images is often subjective, resulting in high interobserver variability among radiologists viewing the same images. In a study involving 50, 60, or 100 sites, significant variability and inconsistency with interpretation is inevitable. While there remains a requirement for on-site evaluation by the local oncologist and radiologist when making a diagnosis or providing patient care, a central review allows an auditable, rigorous, and uniform process of evaluation.  This provides greater consistency across sites, patients, and timepoints, achieving higher confidence levels in data generated. 

Trials involving medical imaging and the associated need for independent review require a significant operational and technological infrastructure, considerable expertise and foresight, as well as the ability to coordinate such undertakings. The process should include: 					

Standardization of imaging and image management at the sites

Image collection at a central location and management of the blinding process

Developing and documenting the independent review criteria and independent reviewer roles and responsibilities

Coordinating the overall logistics of independent review.

The format of the independent review and the makeup of the panel of experts is dependent on many factors, including disease indication and study phase. For registration studies, the independent review process may require a double read by two independent radiologists, unassociated with the study sites or sponsor. A third radiologist acts as adjudicator to resolve differences of interpretation between the two readers. There may also be a requirement for a separate review of clinical and laboratory data by an independent oncologist. 

The process must demonstrate that no bias was introduced during the administration of the independent review. Highly qualified therapeutic experts with no vested interest in the outcome of the study should serve as independent reviewers. When designing an independent review process for an imaging trial, certain factors should be considered, such as the implications of different types of indications within oncology, suitability of assessment criteria, regulatory preferences, lesion selection rules, the appropriate modality for the image used to document disease response, and proper blinding of the reviewer. The study team must also decide how the study objectives and endpoints impact the type of independent review recommended, by addressing questions such as: Is it appropriate to implement a modification to a published response criterion? Is it appropriate to use more than one reviewer? What specific interpretations should the reviewers make so that the necessary data is collected to derive all study endpoints? 

When applying independent review to oncology trials, the study team must take into account the type of cancer and the characteristics of lesions inherent to that type of cancer, the type and schedule of images for assessing disease, and the clinical data that the independent reviewers should consider to make an accurate, unbiased assessment (see Table 1). 

Table 1. An overview of oncology indications and assessments from an independent review perspective 			

 Rules for what constitutes a measurable lesion at baseline or a new lesion, how lesions that become confluent or split will be handled, and how nonmeasurable lesions such as pleural effusions and ascites will be assessed must be defined prospectively. In lung cancer, mediastinal nodes can be clustered, limiting a reviewer's ability to accurately measure these lesions, while atelectasis and pleural fluid can blur margins of a tumor. Likewise, head and neck cancers can produce lesions in the neck that are often matted and small, also limiting an accurate measurement of these lesions. Conversely, colorectal cancer produces tumors that are ideal for measurement since they are typically large and round. 

A finite number of lesions can be selected as measurable based on their size, location, shape, and relationship to other lesions. All remaining lesions should also be accounted for and followed qualitatively. The radiologist follows both lesion types throughout the review process; however, the types of assessments that can be made are dependent on the nature of the lesion and whether the reviewer is making a qualitative or quantitative assessment. Further complexity arises when skin lesions are involved, which are common in melanoma and breast cancer trials. These may be assessed and even measured by an independent oncologist, who will then take both the assessments made by the radiologist as well as his/her own assessment of skin lesions into account along with the clinical data history of the case. 

 Since a radiologist reviews cases with little or no clinical data available on the subject, an oncologist may be employed to review the results of the radiology assessment, as well as clinical data on the subject, for a more comprehensive independent review that mimics the clinical environment, without the inherent bias. For some oncology trials the clinical data may have a significant impact on the overall assessment of the case. The oncologist may assess clinically detected lesions, performance status, the results of pathology or cytology reports, tumor markers, as well as any abnormal laboratory results taken at the investigative site. Ovarian cancer trials will often require that the tumor marker, CA-125, return to normal in order for a response to be considered a complete response. In lymphoma and leukemia trials, clinical data such as organ size and bone marrow biopsy results may be required to make a truly accurate response assessment. 

Case Study-Independent Review of Bone Lesions			

 Missing or incomplete images can dramatically impact study outcomes by resulting in unconfirmed responses as well as multiple assessments of "unknown" and in some cases progressive disease called earlier than actually present. The review of an image that is not part of the required imaging outlined in the study protocol can change the outcome of an assessment. This impacts study endpoints, such as overall response assessments, and affects time-driven endpoints derived from imaging review, such as time to progression, progression-free survival, and time to response. For example, breast cancer may infiltrate the skin, lung, liver, and bone. As a result, imaging for breast cancer may require bone scans and skin lesion photographs in addition to CT or MRI. If any of these modalities were present at screening but then missing at follow-up timepoints, the reviewer may not be able to make a clear assessment for the case, resulting in a call of "unknown." Conversely, a lesion seen on an image at a follow-up timepoint that was not imaged at baseline may result in a call of progressive disease. Hence, ensuring clear assessment rules for all modalities and the implications of missing imaging are key to a successful independent review. 

 Prospectively defining the process for independent review early on in the study start-up process is of utmost importance in oncology trials. The Independent Review Charter (IRC) is the cornerstone of the independent review process and allows the sponsor and imaging CRO to not only define the process up front, but also present a document to the regulatory authorities for review and agreement. The IRC is particularly important in pivotal trials for registration where the primary endpoint or important secondary endpoints are based on imaging data. 

The IRC is a document that the imaging core lab and sponsor develop together, which: 					

Describes the role and responsibilities of the imaging contract research organization

Outlines the process for the independent review of imaging and clinical data to ensure consistency and objectivity of the independent reviewers

Serves as good business practice for the sponsor in order to understand and be critical of the independent review process.

A primary challenge in developing a solid independent review process is to anticipate unforeseen problems that may arise during the independent review. Hence, writing a successful IRC requires a fine balance between describing the process comprehensively and providing as much detail as possible, while also allowing flexibility for problems that may not be foreseen. 

Process control and independent review play an important and ever increasing role in the clinical development of oncology therapeutics. A review of the imaging and clinical data by independent experts skilled in the therapeutic area is critical to reducing variability and bias, thus giving the data greater validity. Throughout the process, careful thought must be given to the collection, processing, reporting, and export of data for final statistical analysis and integration into the full submission. 

Independent review in oncology trials is influenced not only by sponsor requirements and the phase of the study, but also by the complexity of the review process, which is impacted by the type of cancer. The assessment criteria, type and number of reviewers, and methodology of the review process are affected by the clinical particulars indicative of the disease. Anticipating the unexpected is a critical aspect of independent review in oncology clinical trials. Prospectively defining the process as comprehensively as possible, while keeping in mind that other unanticipated scenarios may arise, is key to a successful independent review in oncology clinical trials. Furthermore, by allowing the process to be reviewed and approved by regulatory authorities, the sponsor can further ensure the validity of the independent review.  

Gaurav Sawhney,* Barbara Chandler, Kelie Williams

, MD, are with Perceptive Informatics, Inc., 200 West Street, Waltham, MA 02451, (866) 289-4464, email: 

*To whom all correspondence should be sent.

1. B.D. Cheson, S.J. Horning, B. Coiffier et al., "IWC: Report of an International Workshop to Standardize Response Criteria for Non-Hodgkin's Lymphomas," 

2. M.E. Juweid, G.A. Wiseman, J.M. Vose et al., "Response Assessment of Aggressive Non-Hodgkin's Lymphoma by Integrated International Workshop Criteria and Fluorine-18-Fluorodeoxyglucose Positron Emission Tomography," 

3. B.D. Cheson, J.M. Bennett, M. Grever et al., "National Cancer Institute-sponsored Working Group Guidelines for Chronic Lymphocytic Leukemia: Revised Guidelines for Diagnosis and Treatment," 

4. P. Therasse, S.G. Arbuck, E.A. Eisenhauer et al., "New Guidelines to Evaluate the Response to Treatment in Solid Tumors," 

WHO Handbook for Reporting Results of Cancer Treatment

, Offset Publication No. 48 (Geneva, Switzerland, 1979). 

Articles

Independent experts help reduce variability and bias in trials that use medical imaging.

Kelie Williams

Articles

The Role of Independent Review in Oncology Trials