Dohoo I, Martin S, Stryhn H (2003) Veterinary Epidemiologic Research. AVC Inc, Charlottetown, Prince Edward Island, Canada. pp 85 - 120.
Toma B, Dufour B, Sanaa M, Benet J, Ellis P, Moutou F, Louza A (1999) Applied Veterinary Epidemiology and the Control of Disease in Populations. AEEMA, Maisons-Alfort, France. pp 71 - 86.
Presentations
Characteristics of tests (sensitivity, specificity, accuracy, precision).
Positive and negative predictive values.
Comparing tests and selection of appropriate diagnostic tests.
Use of likelihood ratios.
Herd level sensitivity and specificity.
Exercises
Two methods are being compared for the diagnosis of fascioliasis in cattle from the region around Hanoi in Vietnam. Between 3 and 8 samples are collected each week at a local abattoir from cattle of different age groups. These samples include whole liver and gall bladder for total counts of fluke, samples of faeces for fluke egg counts and blood for serum, to be used for an indirect antibody ELISA. So far, 95 livers have been collected, but of these, on 93 have matching serum samples and 65 have matching faecal samples. Of the animals with one or more fluke, 58 had positive and 15 negative results in the ELISA test, whereas in animals with no detectable fluke, 5 sera were positive and 15 negative for the ELISA. Similarly, 38 of the animals infected with fluke had positive egg counts for Fasciola species and 16 had zero counts. Eleven animals were not infected by fluke and all had zero counts for fluke eggs. Calculate the sensitivity and specificity for both tests, determine the apparent and true prevalence of fascioliasis in this population and decide on the usefulness of these tests for the diagnosis of fascioliasis in this region.
Read the following paper by Dionysius (1991) cited below. For cattle, calculate the positive and negative predictive values for diagnosis of pregnancy using the Enzygost Vet test kit (Table 3). Assume a normal conception rate of 55% and no follow-up heat detection for determination of pregnancy status. On the basis of these calculations, how would you advise a farmer to interpret a positive and negative test result?
A test with a sensitivity at the individual level of 99% is to be applied to a population, testing different numbers of animals according to the size of the herd: (1) all the animals in herds of less than 20 head; (2) 50% of the animals in herds of 20 - 50 head; and (3) 30% of the animals in herds of more than 50 head. What is the probability of missing herds with a low level of infection (only one infected animal). Adapted from from Toma et al. (1999).
Example examination questions
Give a definition of test Se, Sp, PPV, NPV and describe the effect of the prevalence of disease on these values (2005 oral).
How can you improve PPV or NPV? (2005 oral).
Describe the important attributes of screening tests (2005 oral).
What are the important features of tests used at the beginning and the end of an eradication program? How might you improve the test performance at the end of the eradication program? (2005 oral).
How would you compare two diagnostic tests? (2005 oral).
What is the difference between precision and accuracy of diagnostic tests? (2005 oral).
What is a ROC curve and what is it used for? (2005 oral).
Write brief notes to demonstrate your understanding of: (a) interpretation of herd level sensitivity and specificity, and (b) parallel and series testing (2003 written).
Two test for ovine paratuberculosis (Mycobacterium avium subsp. paratuberculosis) have been developed. One test is an absorbed enzyme linked immunosorbent assay (ELISA) while the other is an agar-gel immuno-diffusino (AGID) test. You have been asked to evaluate these tests. To assist with the study sheep have been made available from farms where ovine paratuberculosis is known to be present and from farms in an area thought to be free. Histologic examination of internal tissue is regarding as the definitive test for ovine paratuberculosis. Describe how you would evaluate the performance of these tests (70% of marks). Include in your answer a discussion of how you might compare the performance of the tests (30% of marks).
Additional reading
Loong T-W (2003) Understanding sensitivity and specificity with the right side of the brain. British Medical Journal 327: 716 - 719.
Dionysius D (1991) Pregnancy diagnosis in dairy goats and cows using progesterone assay kits. Australian Veterinary Journal 68: 14 - 16.
Jacobson R (1998), Validation of serological assays for diagnosis of infectious diseases. Revue Scientifique et Technique de l'Office International des Epizooties 17: 469 - 486.
Christensen J, Gardner I (2000) Herd level interpretation of test results for epidemiologic studies of animal disease. Preventive Veterinary Medicine 45: 83 - 106
Martin S (1990) The use and interpretation of tests at the individual and herd level. In: Epidemiological Skills in Animal Health, Univerisity of Sydney, Australia, pp. 87 - 95.
Lehane R, Beating the odds in a big country, the eradication of bovine brucellosis and tuberculosis in Australia pp 46 - 49, 108 - 109, 240 - 241
Sergent E et al. (2004) Epidemiological problem solving, AusVet Series in Epidemiological Skills for Animal Health Professionals. pp 37- 57 (application of diagnostic tests).
Pitt D et al. (2002) An estimate of specificity for a Johne's disease absorbed ELISA in northern Australian cattle. Australian Veterinary Journal 80: 57 - 60.
Sergeant E et al. (2002) Sensitivity and specificity of pooled faecal culture and serology as flock-screening tests for detection of ovine paratuberculosis in Australia. Preventive Veterinary Medicine 52: 199 - 211.
Enoe C et al. (2000) Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Medicine 45: 23 - 41.
Greiner M et al. (2000) Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Preventive Veterinary Medicine 45: 23 - 41.
Jordan D (1995) Aggregate testing for the evaluation of Johne's disease herd status. Australian Veterinary Journal 73: 16 - 19.
Nerette P et al. (2005) Estimation of the repeatability and reproducibility of three diagnostic tests for infectious salmon anaemia virus. Journal of Fish Diseases 28: 101 - 110.
Jafarzadeh S et al. (2004) The sensitivities and specificities of total plasma protein and plasma fibrinogen for the diagnosis of traumatic reticuloperitonitis in cattle. Preventive Veterinary Medicine 65: 1 - 7.