Answers to questions regarding proficiency testing
As a joint venture of the German Society for Pathology (Deutschen Gesellschaft für Pathologie e.V.) and the Federal Association of German Pathologists (Bundesverband Deutscher Pathologen e.V.), "QuIP®" - “Quality Assurance Initiative in Pathology” offers, for quality assurance purposes, proficiency testing to pathology institutes and practices. It supports pathologists in optimizing their examination methods and results. QuIP offers proficiency testing for immunohistochemical and molecular pathological methods as an external laboratory control.
A proficiency test is a method of external quality assurance for investigational procedures in pathology. Basically, identical samples are tested either with identical or varying methods. The comparison of the results allows statements regarding the diagnostic accuracy in general or the quality of the results of the participating institutes and practices to be made.
Create Account and Log In
Yes, you need to create an account to be able to access the internal area on the QuIP homepage. Once logged in, you can access the internal area of the QuIP homepage to register for a proficiency test. Invoices, certificates and participation certificates are only available in your personal access area on the QuIP homepage.
To create an account, click on " Login" in the top right corner of the QuIP homepage. Now you can register a new account by clicking on the button "Sign-Up Now!". Please fill in your data and accept the terms and conditions.
After you have registered, QuIP needs to activate your account - you will receive an email as soon as your account is activated.
For further information please click here.
After you’ve created an account, log in and click on "Proficiency Test Registration". You can search for the proficiency test by entering the name of the test in the search field or you can browse the program list. Click on the proficiency test of your choice for information on the test. You will see the ‘Enroll in Test’ button at the bottom right. Click here to register for the test. You will receive an email confirming your registration in the proficiency test shortly afterwards.
The program with detailed information is available as a PDF, which you’ll find under Proficiency Tests/Program.
Shipment of Test Sets
Test sets are shipped with GLS within Germany and with Intertrex to other European countries. The delivery with Intertrex usually takes about 3 to 5 working days. The eventual return of samples from participants to QuIP is at the participants' expense.
If the test sets arrive damaged, please document the condition by taking a picture and contact us immediately. We have, as a rule, two reserve sets for each proficiency test in our office (QuIP GmbH). We can send you a replacement set as long as they’re still available. The replacement of individual slides is also possible (not as a set). Please inform us if you receive the replacement slide/set with a delay (i.e. after the start of the test period), you will still be given 10 working days after receipt to complete the proficiency test.
You will find the shipment date under Test Set Shipment in the proficiency test program. The shipping time varies from country to country. It is therefore possible that you will receive the test sets a few days before the begin of the proficiency test period. We will also track the shipment of test sets and note when they are delivered. If the test sets are delivered late, the test period of 10 working days or 14 calendar days will start on the date you receive them.
Execution of the Proficiency Test
The proficiency tests organized by QuIP GmbH are first and foremost aimed at patient care facilities (registered pathologists/ private practices) and inpatient health care facilities (hospitals, clinics) that are managed by a specialist in pathology/neuropathology. QuIP GmbH will approve the admission of other participants (e.g. companies) on a case-by-case basis.
QuIP GmbH sends the test sets out to the participants a week before the test period starts. The participants will have 10 working /14 calendar days (see scheduled test period date) to perform the tests and submit the results in the internal user area of the QuIP homepage.
Access to the internal user area requires a user account (see FAQ "Create Account and Log In"). Participants can enter their results and make changes until the last day of the scheduled test period, after which the system will be closed for further entries or changes.
For quality assurance, participants are required to return all stained sections in their original packaging, i.e. blue QuIP box or pink tube with the set number to the QuIP office by the specified deadline. QuIP GmbH will check and evaluate the participants' results. The participants will be notified by email upon completion of the evaluation. A certificate of successful participation or confirmation of participation (if participant is unsuccessful) can then be downloaded and printed out from the internal user area of the QuIP homepage.
You will find a "Print" button at the end of the survey. You can click on it at any time before submitting the completed survey. If you want page numbers on your printout, please adjust your individual printer settings accordingly and also change the "margins" to "user-defined". The margins must then be increased as needed in the print preview. This unfortunately cannot be pre-set in our software, as it depends on the individual printer.
Where do I enter my results?
You will find the survey under "Enrollments & Invoices" once the test period has started. Click on the proficiency test you’ve registered for and then the " Survey” button. You can enter and make changes to your results at any time during the entire test period, even after you have clicked "Save". Your last saved results will be submitted to QuIP GmbH at the end of the scheduled test period.
Invoices and Costs
Where do I find and generate my invoice?
After logging in, go to " Enrollments & Invoices " and click on the proficiency test. Current invoices are available here by default. To view older invoices, check the box for "Show completed trials". Then use the filter (by year) and search (by test name) function to find the completed proficiency test you’re looking for. When you click on the proficiency test, you will find the invoice button below the proficiency test information. Please check and make sure your data is correct, particularly the invoice address, before generating your invoice.
Please note: Once the invoice has been generated, the invoice address cannot be changed. To change the invoice address after the invoice is generated, please contact the QuIP GmbH (email@example.com). Please note that it is your responsibility to ensure that the invoice is forwarded to the correct department within your organization for payment (e.g.: your accounting department). QuIP GmbH does not send any invoices out by email or post.
Please pay the invoice by bank transfer/credit card payment/SEPA direct debit/immediate transfer directly after creation in the system. Payment must be received by QuIP GmbH no later than 14 days after registration to secure your participation in the proficiency test.
The shipping address will, by default, be used to create the invoice if an invoice address was not provided. Make sure you check the invoice data stored in your institute’s data in the internal user area by following this path: Account/Delivery Address/Invoice Address/Certificate Address) before creating (generating) the invoice.
You will not be able to change the invoice address once the invoice has been generated. To make changes after the invoice is generated, please send QuIP Gmbh (firstname.lastname@example.org) an email stating customer and invoice number to request the cancellation of the invoice. Once cancelled, QuIP GmbH will send you an email with the cancelled invoice. Make sure you update the invoice address before trying to create a new invoice in your internal area (see instructions provided above). Please note: When you cancel the invoice, your payment will automatically be cancelled. You will be required to complete the entire payment process again. Processing costs if any, will also be charged to your account.
If you select payment by credit card/immediate bank transfer, you will automatically be redirected to our payment provider BS Payone. After entering your account details, you will return to the QuIP webpage where you can generate the invoice for your accounting department. Please note: It is important to click through all windows in order to generate the invoice. Once generated, it is your responsibility to forward the invoice to the correct department within your organization for payment (e.g. accounts payable department). QuIP GmbH does not send invoices out by email or post.
If you choose to pay by SEPA Direct Debit, QuIP or our payment provider BS Payone will be granted a one-time permission to withdraw the invoiced amount from the account you specified. We do not have the permission to debit any amount from your account other than that which is stated on the invoice you generated. You can be assured that choosing this payment method on BS Payone will not result in an ongoing subscription payment to QuIP GmbH.
After choosing the payment method, you will be redirected to the BS Payone website, where you’ll be required to provide your account details and click on proceed to payment. Once completed, you will be taken back to the QuIP page where you can generate the invoice for your accounting department. Once generated, it is your responsibility to forward the invoice to the correct department within your organization for payment (e.g. accounts payable department). QuIP GmbH does not send invoices out by email or post.
If you select payment by invoice, you will be automatically redirected to the website of our payment provider BS Payone. After checking your personal data and clicking on "Execute payment", you will return to the QuIP page where you can generate the invoice for your accounting department.
Please Note: Generating the invoice does not trigger the invoice payment, you need to forward the invoice to your internal accounting department for payment processing. QuIP GmbH does not send the invoices out by email or post. The invoice payment is due 14 days after your registration and invoice generation.
Some hospitals/organizations assign/reference internal cost centers/order numbers; their financial accounting departments usually would not accept an invoice without this number. This entry is optional. If your institute administration does not require this number, the field can be left empty.
When generating an invoice under "Enrollments & Invoices" you will be asked to enter your order number. This input is optional. If you forget to provide an order number before you click "Download invoice", the invoice will be generated without an order number. In this case we ask that you either enter the order number by hand (recommended!) or request an invoice cancellation by sending QuIP GmbH (email@example.com) an email stating customer and invoice number.
Please note: if you cancel the invoice, your payment will automatically be cancelled and you will be required to complete the entire payment process again. Processing costs if any, will also be charged to your account.
Should you need to cancel an invoice because you have withdrawn your participation in the proficiency test or want to correct the invoice data, please inform us by email (firstname.lastname@example.org) with the customer and invoice number in the subject line.
Please Note: if you cancel the invoice, your payment will automatically be cancelled. You’ll need to complete the entire payment process again (for correcting the invoice data). Processing costs, if any will also be charged to your account.
Banks in countries that do not belong to the European Monetary Union charge a fee for financial transactions in euros. The administrative and financial charges are passed on to the customer via this fee.
Participant Results and Certificates
Where can I find my certificate(s)/certificate(s) of participation?
As soon as we have completed the evaluation of your entered results and created your certificate, you will receive a notification to the email address(es) you have provided. You’ll need to log in, go to "Certificates" in your internal user area and click on the proficiency test. This is where your certificate(s) are stored. Use the filter and search function to find the proficiency test - you can select the relevant year at the top or enter the first letters of the proficiency test.
In order to pass our multi-marker proficiency tests, you must in general have a passing score in all sections/markers. If you do not complete a section/marker, e.g. because you do not use the antibody in your established methods of analysis, you will receive a partial certificate. Partial certificates are certificates of participation, which show the section/marker you were successful in, as well as incomplete section(s). If you receive a partial certificate, it means you were unsuccessful in the proficiency test and will therefore, not be listed as a certified institute the QuIP homepage.
How do I read the evaluation?
In addition to your certificate, you can also view the evaluation after each proficiency test, i.e. the statistical distribution of the answers for better self-assessment. If you see "Section 0" this means there is only one section/marker in the proficiency test. Otherwise you can switch between the different sections e.g. between different markers. The evaluation scheme is explained below in the examples shown. Most proficiency tests adopt this scheme.
Some proficiency tests are more complicated in the evaluation than others, such as the HER-2 Gastric Carcinoma IHC proficiency test:
What are review results and review comments?
The review involves an assessment of the participants’ results. This may apply to the scoring of molecular pathology proficiency tests, where for example, the points cannot be mapped from the ground truth because the answers are provided as free texts.
In immunohistochemical proficiency tests, the stained sections might be reviewed by the lead panel institute.
In educational proficiency tests (e.g. Keratine Prostate Carcinoma and Lymphoma), the review apply to all sections, while in other tests only to cases where participants have indicated "technically not evaluable" or situations (cases or test sets) where participants had a failing score. During the review, the lead institute will evaluate your answers that deviate from the target values and, where applicable, award additional points e.g. if you answered the tumor is heterogeneous, which therefore is correct despite the deviation. Feedback regarding the staining or evaluation is usually provided in the comment field.
Numbers in red are answers for which, no points were awarded, while dark green indicate answers for which you received points, and light green are answers for which, you received additional points through the review.
Why did I receive review points for each case in my evaluation?
In the case of educational proficiency tests, the evaluation would also include the assignment of points for your tissue staining technique. Presently, this is only relevant to two proficiency tests, Lymphoma and Keratine Prostate Carcinoma. In addition to receiving points for each case in the survey, 5 further points for sensitivity/reaction strength or specificity/preparation quality and tissue preservation are assigned. You must achieve 80% in the survey part and 80% in the review part per marker to pass the proficiency test. The passing score is subject to changes, please check the proficiency test program for the current passing score.
You can change your address under Account (Delivery Address/Invoice Address/Certificate Address) in your internal area of the QuIP homepage if your certificate hasn’t been generated yet. Once the certificate has been generated, you won’t be able to change the address yourself. You will need to request a new certificate by email (make sure you state your customer number here). Processing costs, if applicable, would also be invoiced to you.
Once the evaluation of your test results is completed, you will be informed by email that your certificate/certificate of participation is ready for download. Please make sure you check your certificate data under Account (Delivery Address/Invoice Address/Certificate Address) before generating the certificate. You can generate and download your certificate in your internal area on the QuIP homepage under "Certificates". If you’ve pass the proficiency test, your institute will be listed as a "certified institute" on the QuIP homepage under the corresponding proficiency test and year.
You cannot repeat a proficiency test in the same year but you can register for the next possible date, which is usually in the following year.
Exception: In the case of mammary carcinoma proficiency test, you can register anew to redo a proficiency test at the next scheduled date(s) in the same year.
QuIP GmbH issues certificates primarily to the institute. The certificates are also valid without the name of the institute management. When you create your user account for the first time, you have the opportunity to provide the name and address that should appear on the certificate (certificate data). If you do not provide any certificate data, your institute data will be shown on the certificate. If you wish to change this for future certificates, please log in and go to Account, then click on the "Edit Delivery Address/Invoice Address/Certificate Address" button to make these changes. To correct a certificate that has already been generated (changes to certificate data is no longer possible) please contact us at email@example.com or by phone at +49 30 9210717-0.
Notifications/Information about the Program
You can disable all email notifications in your internal area under Account. First click on Edit User, then check the box for Disable E-Mail Notifications and save. You should not receive any more emails from QuIP after this. However, this will also prevent us from sending you reminders (e.g. end of evaluation period) or contacting you when your certificates are available for download.
News about proficiency tests are posted regularly on our homepage under News. The proficiency test program PDF is updated regularly as prototype proficiency test dates are confirmed. You can download the current program here. Please pay attention to the date of the program when you download it. Subscribe to our newsletter under Account/Account Data, if you want to receive news and announcement by email.
Mammary carcinoma proficiency tests: ER, PR, HER2 IHC, HER2 ISH, Ki67
If you have any questions regarding the evaluation, status of your test set order or technical issues related to the homepage (invoice/download, certificates/access data etc.) please contact QuiP GmbH at firstname.lastname@example.org or call us +49 (03) 92107170 (Mo-Fr 08.30-15.00h).
The deadline for returning the tissue sections and the completed questionnaire is 5 weeks after the official start of the proficiency test. If we do not receive the test set and completed questionnaire by then, your participation in the proficiency test would be considered unsuccessful. The following return deadlines therefore apply to the 4 splits:
Receipt by QuIP at the latest on:
- Split 1: 14.08.2020
- Split 2: 04.09.2020
- Split 3: 25.09.2020
- Split 4: 16.10.2020
Please send all your documents to:
Qualitätssicherungs-Initiative Pathologie QuIP GmbH;
The test sets will be sent out one week before the official start of the proficiency test. You can begin with your evaluation as soon as you receive them.
The slides returned to QuIP GmbH are reviewed by the lead panel institute within 6 weeks before certificates/certificates of participation can be issued. We will inform you by email as soon as they are available.
In the laboratory test, only the laboratory performance is considered based on the provided unstained slide. Your result is determined solely by the review process. In the readout test, the comparison is made between the proficiency test slides stained by you and how your evaluation differs from that of the reviewers’ at the reference institutes (panel institutes). You will receive a comparison table and a weighted kappa value as the result. The readout test can be ordered for any number of participants of an institute or practice (only in connection with participation in a laboratory test). Repeat orders of evaluation tests without interlaboratory comparisons are not possible.
How can I order a readout test?
The readout test can be ordered for any number of participants of an institute or practise (only in connection with participation in the laboratory test). Readout tests must be ordered at the same time as the proficiency test and data to be included on the certificates can also be completed at the same time. Subsequent orders of readout tests without proficiency testing are not possible.
You can register for the mammary carcinoma proficiency tests twice at the most. However, you cannot order readout tests without enrolling in a proficiency test (by the way: You can only register once per year and account in all other QuIP proficiency tests). The last possible registration date for the mammary tests is 04.09.2020.
There is a another split you can register for in October if you have failed in the previous test and decide you want to repeat this proficiency test. This is planned to take place in January 2021 but registration in Oct 2020 will ensure the evaluation will still be carried out in 2020 and your certificate will show 2020 as the year of participation. We therefore recommend that you register as soon as possible so that you can register to repeat the proficiency test in case you do not pass the first time.
You can only cancel your registration shortly after you register, as the tissue sections will be ordered at this point. Please do so by contacting QuIP GmbH and referencing the account the registration was made under and the name of the proficiency test to be cancelled. Cancellation is not possible once the preparation of tissue sections are already in progress.
Questions Regarding Proficiency Tests
Freedom in choice of methodology applies to all our proficiency tests. This means we do not stipulate how you obtain your test results. You may combine the equipment (e.g. automatic IHC stainer) of your choice with the antibodies of your choice. However, we might indicate in our instructions for certain proficiency tests if some equipment (e.g. automatic IHC stainer)/antibodies did not produce ideal results in the past.
We request this information for quality assurance reasons. The data you provide us will allow us to gather statistical information on the methods and equipment used. Should you narrowly fail the proficiency test, this information will also help us assess your test result individually with you (see next FAQ question “Our institute/practice did not pass the proficiency test. Why?"). We therefore ask you to complete this section for each case.
In your internal user area on the QuIP homepage you will find the button "Evaluation" under the respective proficiency test. Here you can view the statistics of the proficiency test, as well as, the review points and comments you received and compare them with the results you submitted (see " How do I read the evaluation?"). Furthermore, QuIP will send the final report to the participants after the evaluation is completed. Should you have any questions, please feel free to contact us by email at email@example.com or by phone at +49 30 9210717-0. We will be happy to provide personal feedback and check your test results.
You can edit your results up until the end of the evaluation period. The last result you entered will be used for the evaluation by QuIP GmbH.