|
|
||||||||
1 Segalab Laboratório de Sanidade Animal e Segurança Alimentar, 4465-732 Leça do Bailio, Portugal
2 Department of Farm Animal Health, Utrecht University, Utrecht, The Netherlands
3 Department of Chemical Engineering, IST, Technical University of Lisbon, 1049-001 Lisbon, Portugal
Corresponding author: J. Niza-Ribeiro; e-mail: niza.ribeiro{at}agros.pt.
| ABSTRACT |
|---|
|
|
|---|
Key Words: udder health control capability index statistical process control dairy farm
Abbreviation key: AAVG = annual average of BMSCC, AVG = monthly average of BMSCC, BMSCC = bulk milk somatic cell count, BMT = bulk milk tank, Cpk = capability index, EU = European Union, HACCP = hazard analysis and critical control point, R' = annual average of the monthly range of the BMSCC, Ri = monthly range of the BMSCC, SMP = annual subclinical mastitis prevalence, SMPe = estimated annual subclinical mastitis prevalence, SPC = statistical process control
| INTRODUCTION |
|---|
|
|
|---|
Because SCC is currently easy and cheap to test, farmers, the industry, and authorities use different types of more or less elaborated means such as arithmetic or geometric (International Dairy Federation, 1997) to monitor the herd health status and to define milk quality and udder health goals (Radostits et al., 1994; Schukken et al., 1996) as well as premiums or penalties for the milk that leaves the farm. Every mean, regardless of the way it is calculated, is a measure of central tendency. However, any population needs at least 2 parameters, the mean and the variance, to be properly described. As a consequence, the parameters used today to evaluate the BMSCC have a few drawbacks: the first is that the parameter does not adequately describe the herds BMSCC distribution throughout the year, the second is that the BMSCC average is a poor indicator for compliance of the herd with the legal standard for SCC and, last, no predictive information about the expected future performance of the BMSCC can be derived from it.
To overcome these deficiencies, the herd was considered to be a production process unit, designed to produce milk from its various inputs (feed, genetics, infrastructures, and management) that goes through the "machine" (cow) into the bulk milk tank. The outputs of this process are the batches of milk leaving the herd, each batch being the bulk milk tanks content. It is necessary to consider the herd as a system of processes to facilitate a comparison between the herd production process and any type of industrial process and to apply total quality control methods at the herd level. Statistical process control (SPC) was developed by process control engineers to monitor, evaluate, and predict industrial process behavior (Wadsworth, 1998). Some authors have already made some incursions in this area (Reneau, 2000). The capability index (Cpk) is a main SPC tool currently used by engineers to evaluate the performance of processes or machines and to describe its current behavior as well as to predict the expected future performance (Mitra, 1993). The Cpk concept lumps together process performance statistics of the herd (a central tendency parameter and a dispersion one) with process performance specification criteriain this case the European Union (EU) legal standard for SCC in the bulk milk tank (BMT). Therefore, the Cpk makes a direct relation between the herd performance and the legal standard.
A process with a Cpk value equal to or greater than one is a good process because it consistently complies with the products quality specifications. On the other hand, values of Cpk below one, especially the negative ones, represent inadequate processes (Ford, 1987; Mitra, 1993). We looked at the Cpk as a potential tool to connect herd udder health status and milk quality of the herd using the SCC of the bulk milk tank.
The purpose of this work was to evaluate the capability index, Cpk, as an instrument to measure dairy herd compliance with regulations as a replacement for the traditional herd BMSCC. The potential of Cpk to be used by veterinarians and farmers in udder health control programs, as well as its ability for vendor rating purposes in payment schemes, is also evaluated.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Data set 2 was composed of the SCC of the individual lactating cows. These were taken from the DHIA database. Because only 264 of the previous 414 herds included in the data set 1 were registered in the DHIA, data set 2 contains cow data from only 264 herds. Eleven months per year the DHIA collects one milk sample from every cow in the herd and records, among other data, the cows daily production and SCC results. From the database received from the DHIA, the number of the herd, the identity of the cow, the month of the record, and the corresponding SCC from a period corresponding to the same 13 mo recorded in data set 1 were selected. We then calculated cumulative annual subclinical mastitis prevalence (SMP), at the cow level, for each herd, as number of counts above 200,000 SCC/mL and the total number of cows tested in the herd in the period under evaluation (13 mo). The herd prevalence from data set 2 was combined with the Cpk calculated from data set 1 using the herds identification number as the key for merging both databases. The herds not recorded at the DHIA, hence herds without prevalence estimate, were discarded from data set 2.
Statistical Treatment of Data Set 1
Process control statistics.
The statistics of the capability index were derived from literature (Mitra, 1993; Wadsworth, 1998) and adapted to the purpose of the work. The upper limit of the process specification criteria was 400,000 cells/mL. This limit was taken from EU legislation.
The Cpk was calculated as:
![]() |
The value of d2 is tabulated. It is a function of the number of samples in each month, in our case n = 4. The tabulated value for n = 4 is d2 = 2.059. The standard deviation of the process can be estimated from R'/d2.
The annual average of BMSCC (AAVG) is calculated with the monthly averages of BMSCC (AVG) as follows:
![]() |
The AVG is the monthly average and was calculated using 4 bulk milk SCC results (SCCi) randomly taken from the database of the laboratory as:
![]() |
The annual average of the monthly range of the BMSCC (R') is the average of the monthly range of the BMSCC (Ri) and was calculated as follows:
![]() |
The monthly range Ri is the difference between the highest BMSCC (SCCmax) and the lowest (SCCmin) of each month and was calculated as:
![]() |
These statistics were performed using the data set 1.
Further statistical treatment of the data.
Three classes of the Cpk, 4 classes of the annual average, and 4 classes of average range were defined to perform a nonparametric analysis of the data. For the capability index the defined classes were: "Cpk class 1" with Cpk < 0; and "Cpk class 2" with 0
Cpk < 1; "Cpk class 3" with Cpk
1. For the annual average the classes were "AAVG class 1" with AAVG < 200,000 BMSCC/mL; "AAVG class 2" with 200,000
AAVG < 400,000; "AAVG class 3" with 400,000
AAVG < 500,000; and "AAVG class 4" with AAVG 4
500,000. For the average range, the classes defined were as: "R' class 1" with R' < 150,000 BMSCC; "R' class 2" with 150,000
R' < 200,000; "R' class 3" with 200,000
R' < 300,000; "R' class 4" with R'
300,000. The significance of differences between the counts was evaluated with the Kruskal-Wallis test or with the ANOVA and Scheffés test as appropriate.
Statistical Treatment of Data Set 2
Data set 2 comprised 264 herds, each one with an estimated annual herd prevalence of subclinical mastitis and a Cpk score. The annual herd prevalence of subclinical mastitis (SMP) was calculated as a proportion, using the number of individual SCC
200,000 divided by the total number of individual SCC results from the 13 consecutive months of each herd. Several authors use this threshold for subclinical mastitis detection in composite milk samples of all quarters of the cow (Radostits, 1994; Schukken et al., 1996).
To establish the relationship between the Cpk of each herd and its observed SMP, linear, exponential, logistic, and polynomial models were investigated. The best correlation was found for the logistic regression model used. The validation of the logistic regression model was carried out through the following steps: first the herds in data set 2 were split into 2 groups made up of randomly selected herds (one with 176 farms and the other with the remaining 88). The group with 176 farms was used to build the model, and the other one was used for the models fitting validation test. In the second step, the initialization parameters of the logistic model were calculated with the 176 herds data, using the least square method in the SOLVER algorithm for Excel. In the third step we have estimated the annual subclinical mastitis prevalence (SMPe) of the second group of herds (88 herds) using their Cpk and the logistic model calculated in the previous step. Finally (step 4), predicted and observed SMP were compared, in terms of R2 and the mean squared error of prediction.
| RESULTS |
|---|
|
|
|---|
1, while the remaining 168 herds in the group had a "class 2" Cpk (i.e., 0
Cpk < 1). One hundred and sixty four herds in the sample had AAVG higher than 400,000 cells/mL. Of these, 162 had a Cpk less than zero and 2 had a Cpk equal to zero. In our sample, 3 herds showed a Cpk equal to zero. Of these, 2 allocated in Cpk class 2 belonged to AAVG class 3 (with annual average values of 400,720 and 400,100). The third herd also found in the class 2 of Cpk had an annual average of 398,850 BMSCC and was placed in AAVG class 2. The average range values (R') for these 3 herds were of 273,310, 324,460, and 242,460 SCC/mL, respectively.
|
|
In Table 2
, the 414 herds are classified in one of the 3 Cpk classes and grouped under combinations of their AAVG and R' classes. The overall differences of the counts of farms in Table 2
tested with the Kruskal-Wallis test were significant (P < 0.001). Table 2
shows that of the 84.5% of the 84 herds classified in the best Cpk class had averages under 200,000. The great majority of these 71 herds had range averages under 150,000 SCC and only one had an average range between 150,000 and 200,000 SCC. It was possible, however, to find 13 herds with Cpk in class 3 and annual averages above 200,000 (AAVG class 2), but they had narrow ranges always under 150,000 SCC (R' class 1). Further examining these 13 herds showed that they had annual averages less than 250,000 SCC.
|
The 162 herds with values of Cpk below 0 in Table 2
belonged to class 1 of Cpk. Herds with annual averages of less than 400,000 SCC are, of course, not found in this class. The average ranges most frequently found for these herds (90.7%) are those above 200,000 SCC, although one herd with an average range of less than 150,000 SCC can be found as well as 5 with ranges going from 150,000 to 200,000 SCC.
Table 3
shows the average of the Cpk by the different combinations of annual average classes (in columns) and average range classes (rows). There are some empty cells in this table when there were no farms represented within the combination of the 2 classes. As the annual average class increases, the average Cpk decreases, and within each average class the Cpk worsens as the average range increases. The overall differences in the average of Cpk values either within the class AAVG or of the class R' were significant at P < 0.05 using the ANOVA test.
|
|
|
| DISCUSSION |
|---|
|
|
|---|
1 (n = 84). With the Cpk equation it becomes clear that the 84 herds with Cpk
1 (classified in class Cpk 3) never delivered milk out of the specification criteria (i.e., above the legal limit of SCC) during the year under evaluation with 99.75% confidence. The other 166 farms from the group of 250 (Figure 1a
Another issue is how the AAVG and the average range (R') interact to influence the Cpk. The results presented in Tables 2
and 3
show how this interaction works. It can be seen that the herds with AAVG less than 200,000 and R' less than 150,000 have the highest Cpk mean (Table 3
). Additionally, the herds within AAVG class 2 (average values between 200,000 and 400,000 SCC) only have Cpk
1 if they have a narrow variation in their BMSCC (class R' 1). An interesting observation (Table 2
) is that in AAVG classes 2, 3, and 4 there are farms with the whole range of R' classes, creating empirical evidence that the AAVG contributes more to the Cpk outcome of a farm than the R'. But Table 3
also shows that for each AAVG class as the range worsens when the mean Cpk decreases. The differences in the Cpk mean in Table 3
are statistically significant (P < 0.05). Even though the 3 classes of Cpk have groups of farms with significantly different AAVG and R', among all the possible combinations of AAVG and R' classes some are, of course, impossible to find, e.g., AAVG class 1 with R' of class 3 or 4 (Tables 2
and 3
).
An important advantage of the use of the Cpk over the annual average of BMSCC is that it enables the creation of 3 mathematically and statistically significant different groups of farms: the farms with Cpk below zero, between zero and one, and above one. According to the results from the ANOVA test in Tables 2
and 3
, these 3 groups are statistically different and they represent different levels of milk quality. Remember that the Cpk was calculated for each farm using its AAVG of the monthly BMSCC averages and the annual average range (R') based on the monthly ranges of the BMSCC and also took into account the legal EU limit for BMSCC, 400,000 cells/mL. Using the Cpk equation, it is therefore possible to take into consideration, simultaneously, the legal limit of the SCC and both statistical parameters that describe its behavior in the BMT: central tendency (AAVG) and dispersion (R'). That is why it can be stated that the farms in each group have statistically different consistency in their milk SCC and comply differently from a legal perspective.
The results discussed above provide evidence that the use of SCC averages to describe, monitor, or evaluate the somatic cell content in a farms output of milk could be replaced with advantage by the use of the Cpk. The Cpk is a robust indicator of the herd milk quality performance, since it is calculated using a representative sampling procedure intended not only to represent 1 yr of production of the farm, batch after batch of BMT, but also to predict the expected BMT behavior of the following year.
Validation of the Cpk to Predict Subclinical Mastitis Prevalence
The majority of the somatic cells present in the bulk milk tank are shed in the milk by infected cow quarters. To enable the farmer or the veterinarian to keep the BMSCC below the legal limit instead of reacting to an existing situation requires the possibility of acting on the producing cows of the herd in a quantitative way. It was therefore necessary to relate the prevalence of subclinical mastitis with not only the average of the BMSCC but also with the variation associated to it. Since the Cpk takes account of both the average and the variation of the somatic cell level in the BMT, we looked for a model to relate the Cpk and the herd subclinical mastitis prevalence.
The logistic regression model presented above has shown an excellent ability to relate the Cpk of dairy herds with their SMP (Figure 2
). It was then decided to validate the model by testing its ability to predict the herd subclinical mastitis prevalence from the respective Cpk score and by comparing the predicted with the observed annual SMP. Two comparisons were made, one with data from 88 herds not previously used in the calculation of the model and the other with the data from all herds. The correlations obtained, 0.87 and 0.85, respectively, showed that the calculated logistic model has good ability to predict the herds annual mastitis prevalence.
Figure 3
shows some discrepancy in the herds located at the extreme values of the model and shows a good fit for SMP between 0.2 and 0.5. These herds can also be seen as outliers in Figure 2
. In the case of the extreme values related with high and very low Cpk, the deviation of the SMP from what could be expected is probably related to the fact that farmers involved discard the milk of many subclinically and clinically affected quarters. The same situation occurs at the highest SMP, where some Cpk scores are better than the expected. These procedures at some farms affect the Cpk estimation because the milk sample taken from the BMT does not reflect the SCC of all the cows in the herd. Therefore, some farms perform differently than what would have been expected considering the udder health status of the herd. In a way, these farmers are already implementing measures to reduce the number of their farm violations regarding the SCC in the BMT.
The 2 linear models used to evaluate the precision of the logistic regression model to estimate the annual subclinical mastitis prevalence (see Figure 3
) show excellent correlation. The fact that the correlation between the observed and the estimated prevalence in the subgroup of 88 herds (not used to build the logistic model) was statistically significant provides strong evidence of the goodness of our model.
Use of the Cpk to Support the Herd Udder Health Management
Specification of an objective of SCC to the BMT.
This subject often poses problems because it is not easy to calculate the associated variability. A target of between 200,000 and 250,000 is recommended to ensure that the herd remains under the penalty levels of 400,000 SCC/mL (Schuken et al, 1996). This is a very general recommendation that ignores knowledge of each individual herd. The Cpk can be very useful in helping to solve this problem at the level of the individual herd. This is possible because although the distribution of the individual bulk milk SCC results is generally not normal, the BMT AAVG, calculated as above, is expected to follow the central limit theorem. According to this theorem (Dudewicz, 1998), when a population is sampled several times, the population average of the averages, calculated with the averages from each sample, follows a normal distribution even if the parameter is not normally distributed in the source population. Because the annual average of SCC (AAVG) is an average of the averages of 13 mo, it is expected to follow the normal distribution. Consequently it allows a statistical inference about the probability of occurrence of any values of SCC from the particular bulk milk tank the sample was taken from.
Each herd has its own Cpk as a result of a particular combination of AAVG and R' of its process. We calculated some of the possible combinations of AAVG and R' that give Cpk equal to one and plotted them in Figure 4
. It is possible to draw a straight line under which area the combination of values that are compatible with Cpk greater than one lie. Its equation is AAVG = 274,533 + (0.6863 x R'). This equation is useful to calculate the objective of BMSCC for each herd, taking the specific farm variation mathematically into account.
|
Objective setting for SMP.
Herd health managers need to set objectives in udder health prevention and control plans (Schukken et al., 1996). To be accomplished, they have to rely on the control of mastitis prevalence. According to our results, it is possible to predict the herds annual SMP using the respective Cpk with a good level of confidence. The opposite is also true, i.e., it is possible to assign goals of SMP to the herd in order to achieve the objectives set for SCC in the bulk milk tank. If the objectives in the BMSCC are specified according to the European Union standard limit of 400,000 SCC/mL, a goal of SMP derived from a Cpk equal to or greater than one will be enough to comply consistently. Therefore, goals on SMP can be assigned to herds using the logistic regression model presented in this paper. It is possible to propose a critical limit of 0.26 to the annual SMP at the dairy herd. According to our results, a SMP below 0.26 would be sufficient to allow the compliance of the herd with the legal limit allowed for BMSCC by preventing the excess of contamination of the milk with somatic cells. This is an important target for managers responsible for udder health control and prevention programs such as the ones proposed by Radostits et al. (1994) and Schukken et al. (1996).
Use of Cpk by Other Actors Involved in the Milk Chain
As already noted, the Cpk can be used by either the industry or by the official inspection services to evaluate and to follow the farm as a food chain supplier in terms of both the quality and consistency of its production.
The industry.
In many countries, the industry already pays for milk quality using the SCC, through BMSCC averages. If the Cpk were used instead, discrimination between consistent and irregular farms would be allowed and would be reflected in the bonuses or payment schemes. The adoption of Cpk would provide an important orientation to the farm managers stressing the need for the adoption of effective prevention programs. The underlying rationale is that farms consistent and compliant with the standard show a Cpk equal to or greater than one and are statistically different from some herds presenting acceptable annual averages but with monthly unacceptable fluctuations (see Figure 1a and b
and Table 3
). The former need to have effective mastitis control and well managed and monitored prevention programs (of course, more investment and expert knowledge is necessary to maintain the system), whereas the latter are mainly reacting to the occurrence of mastitis. Another issue of increasing importance is that many dairy plants are adopting quality systems and hazard analysis and critical control point (HACCP) plans combined with good hygiene practices. The raw material coming into the plant has to comply with legal standards, and vendor rating schemes are commonly adopted to evaluate the quality of the supplier. Shifting the vendor rating systems for SCC from BMSCC average to the Cpk will provide an increased confidence that, for herds with a annual Cpk equal to or greater than one, the farm supply will permanently comply with the regulations.
The adoption of the Cpk by legal authorities in charge of the verification of dairy farm compliance with the regulations and standards will enable them to easily detect the farms that are not complying among those with good averages. This will save a lot of hard labor and time in expensive sampling plans to detect noncompliant farms. It also will provide an overall picture of dairy farms regional or national herd udder health status.
The Cpk could also be used in international disputes.
Because the Cpk allows comparisons between several different milk supply systems, from different countries with different herd health managements, the Cpk can be used to apply the equivalence principle for udder health issues at the farm.
A final advantage of the Cpk is that it can be implemented with SCC data, which are already generated under current milk pricing systems worldwide so that no additional costs are to be expected from its use.
Further Investigation
Further investigation should be carried on the influence and interactions of mastitis pathogens on the Cpk. The possibilities of further use of the Cpk to help in critical control point management at the herd level should also be highlighted, because there seems to be potential for this SPC tool to be effective with the quantitative aspects of the HACCP system. In the last few years, the HACCP concept has been proposed as an effective way to enhance food safety along the food chain including the dairy farm (Codex Alimentarius Commission, 2001). Although the preharvest sector has been considered a step during which HACCP systems seemed to be difficult to implement (Cullor, 1997), the Codex Alimentarius Commission (2001) still recommends the pursuit of an HACCP compatible approach, whenever possible, at every step of the food chain.
| CONCLUSIONS |
|---|
|
|
|---|
1, farms that comply intermittently had 0
Cpk < 1, and farms that did not comply at all showed a Cpk < 0. It was shown that the Cpk can be advantageously used as a predictive tool for udder health management programs in dairy farms, replacing the BMSCC average. With the use of Cpk it is possible to produce objectives to the BMSCC and goals of SMP oriented to comply with the hygiene standards for SCC in ex-farm milk. A set of equations was developed for that purpose. The first is a logistic regression model to estimate the target for annual subclinical mastitis prevalence for the desired Cpk. The second is an equation that allows the calculation of the average of BMSCC using the range of BMSCC, in order to have a permanent BMSCC under the SCC limit.
It was shown that the Cpk is an ideal tool for vendor rating in quality management systems and can be used by either the industry or the official inspection services to evaluate and to verify the farm compliance as a supplier in terms of the safety and consistency of its production. Another use of the Cpk can be in international disputes, because it allows the comparison of several different milk supply systems.
| ACKNOWLEDGEMENTS |
|---|
|
|
|---|
Received for publication June 7, 2003. Accepted for publication January 16, 2004.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. E. Davis, T. Parrott, D. C. Brown, B. Z. de Rodas, Z. B. Johnson, C. V. Maxwell, and T. Rehberger Effect of a Bacillus-based direct-fed microbial feed supplement on growth performance and pen cleaning characteristics of growing-finishing pigs J Anim Sci, June 1, 2008; 86(6): 1459 - 1467. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Lukas, J. K. Reneau, C. Munoz-Zanzi, and M. L. Kinsel Predicting Somatic Cell Count Standard Violations Based on Herd's Bulk Tank Somatic Cell Count. Part II: Consistency Index J Dairy Sci, January 1, 2008; 91(1): 433 - 441. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Lukas, D. M. Hawkins, M. L. Kinsel, and J. K. Reneau Bulk Tank Somatic Cell Counts Analyzed by Statistical Process Control Tools to Identify and Monitor Subclinical Mastitis Incidence J Dairy Sci, November 1, 2005; 88(11): 3944 - 3952. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |