JDS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Interpretive Summary
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Powell, R. L.
Right arrow Articles by Norman, H. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Powell, R. L.
Right arrow Articles by Norman, H. D.
J. Dairy Sci. 87:2621-2626
© American Dairy Science Association, 2004.

Accuracy of Foreign Dairy Bull Evaluations in Predicting United States Evaluations for Yield

R. L. Powell, A. H. Sanders and H. D. Norman

Animal Improvement Programs Laboratory, ARS, USDA, Beltsville, MD 20705-2350

Corresponding author: R. L. Powell; e-mail: rpowell{at}aipl.arsusda.gov.


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 
Combining foreign daughter data with domestic information in dairy bull genetic evaluations has been shown to improve prediction of future domestic evaluations for US bulls. This study focused on the accuracy of Interbull evaluations of bulls with only foreign daughters, in predicting the latest domestic evaluations (based on US daughters). August 2003 USDA evaluations based only on US daughters were matched with the most recent February or August Interbull evaluations without US daughters. A minimum reliability of at least 80% for yield and 70% for somatic cell score (SCS) was required in both evaluations. This provided pairs of evaluations based on different daughters (foreign or US) for 286 bulls (60 bulls for SCS). Mean Interbull reliabilities on the US scale were 88% for yield and 84% for SCS, and the mean US reliability for the current evaluations was 91% for yield and 80% for SCS. Correlations between the Interbull and domestic evaluations were 0.90, 0.87, 0.90, and 0.87 for milk, fat, protein, and SCS respectively. Expected correlations were 0.89 for yield and 0.82 for SCS. Mean differences between the Interbull and current domestic evaluations were near zero. These foreign bulls had graduated from progeny test programs (selected for positive Mendelian sampling) before being marketed in the United States. Thus, parent average was a substantial underestimate of merit. The small average differences between evaluations from foreign and US daughters and high correlations indicate that Interbull evaluations based solely on foreign daughters are useful predictors of the US evaluations for yield and SCS, providing accuracy in agreement with reliabilities and much better estimates than the alternative, parent averages.

Key Words: Interbull • sire evaluation

Abbreviation key: ASI = Australian selection index, PA = parent average, REL = reliability


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 
The inclusion of additional data from other countries has been shown to improve the accuracy of domestic dairy bull evaluations (Powell and Norman, 1998; Powell et al., 2000). Studies investigating the current quality of Interbull procedures also showed the value of including foreign data in dairy bull evaluations (Powell and Norman, 2000; Weigel and Powell, 2000). These 4 studies included mainly US bulls and did not evaluate the accuracy of foreign data alone. In the case of foreign bulls, the earliest information available for breeding decisions in the United States beyond pedigree usually comes from foreign daughters, and they often provide the large majority of data available later. Thus, an investigation of the accuracy of predicting future US evaluations using only foreign data is worthwhile.

McClintock et al. (2003) used the 2003 Australian selection index (ASI), which combined evaluations of milk, fat, and protein, for 62 bulls having at least 150 daughters to examine the predictive accuracy of Interbull evaluations from the year 2000 that included no Australian daughters. The Interbull evaluations were found to be reasonably good predictors of the later ASI. Overall, the Interbull evaluations tended to be optimistic. However, whereas the lowest-ranked bulls were overestimated, the top bulls were underestimated (regression of 2003 ASI on 2000 ASI from foreign daughters of 1.27).

The objectives of this study were to investigate 1) the usefulness of Interbull evaluations, based only on foreign daughters in predicting future US evaluations for yield and SCS, in comparison with concurrent US parent average (PA), and 2) the accuracy of Interbull reliability (REL) in indicating the precision of prediction of future US domestic genetic evaluations.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 
Data were August 2003 US domestic evaluations (based only on US daughters) and earlier February or August Interbull evaluations from two times: 1) the latest evaluation without US daughters, included to assess accuracy with the maximal amount of independent foreign data, and 2) 3.5 yr before the first US evaluation, the approximate time semen was imported into the United States. Traits examined were milk, fat, protein, and SCS for Holstein bulls. The earliest Interbull evaluations were February 1995 for yield and August 2001 for SCS. Schaeffer (1994) provides a discussion of methods used in the Interbull evaluations. Selected evaluations were on the US scale, and bulls were included only when the Interbull REL was at least 80% for yield or 70% for SCS in analysis of that trait. The US PA from the same evaluation dates were also obtained. Methods used in US evaluations are described by VanRaden and Wiggans (1991). All evaluations and PA were converted to the current US base to allow the comparison of evaluations across time.

The August 2003 US (current domestic) evaluation was used to represent the "best" evaluations. Although REL was likely higher in the August 2003 official evaluation, the domestic evaluation was used because it provided a completely independent data source (daughters in the foreign-only evaluations are likely included in the August 2003 official evaluation). A REL of at least 80% for yield, or 70% for SCS in that trait analysis, was required in the current domestic evaluation for a bull to be included.

Interbull (foreign) evaluations and concurrent US PA were compared with the current domestic evaluations for milk, fat, protein, and SCS for difference, standard deviation of difference, and correlation. Expected correlation was the square root of the product of the mean REL. Actual correlations were all product-moment correlations. A majority of bulls included in the study had the greatest number of their foreign daughters in Canada. Analyses were repeated separately for Canadian bulls, Dutch bulls, and all other bulls to determine whether the source of foreign data influenced results. Country was determined by the country of most daughters included in the foreign evaluation.

Over the years covered by this study, changes to Interbull procedures have been made in estimated genetic correlations, birth year edits, reliability estimations, weighting of effective daughter contribution, and sire variance estimation. These refinements had more impact on individual bull evaluations than on overall rankings or correlations. The most significant change, incorporation of genetic correlations in August 1995, changed the set of top bulls, but the correlation with February 1995 was 0.99. Based on Interbull evaluations spanning 9 yr, during which time methodology has changed, this study may present a conservative picture of the value of foreign evaluations relative to Interbull evaluations computed with current methodology. To determine whether these changes had an impact on the comparison of foreign PTA and concurrent PA, differences in foreign evaluations and PA from August 2003 evaluations were examined separately for each Interbull run.


    RESULTS AND DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 
The number of bulls and mean REL are given in Table 1Go. The number of bulls was considerably reduced for SCS due to the reduced time Interbull evaluations have been available. About two-thirds of the bulls (193) had most of their milking daughters in Canada at the time of their latest Interbull evaluation without US daughters. Of the other 93 bulls included for yield, 43 had most daughters in The Netherlands, 14 in France, and 12 in Germany. Due to limited observations per country, the 50 bulls from France, Germany, and 7 other countries were grouped together. Mean REL were very similar among the 3 bull groups. The Canadian bulls had slightly lower foreign REL for yield but higher for SCS. Canadian bulls also had slightly higher PA REL for yield, and PA REL for SCS was considerably higher than for Dutch bulls. This may reflect additional efforts in the earlier years to incorporate Canadian ancestral data, or more dams may have had US pedigree. The REL for current domestic PTA were highest for the Dutch bulls.


View this table:
[in this window]
[in a new window]
 
Table 1. Numbers of bulls and mean reliabilities (REL) of PTA and parent averages (PA) for yield traits and SCS.
 
The number of bulls from the various Interbull runs is shown in Table 2Go. The two runs with the highest representation deserve explanations. From August 1995 through August 2002, Holstein bulls used in the United States following progeny testing in another country were required to have at least 75 daughters in at least 50 US herds before US data were included in Interbull evaluations. Beginning in November 2002, a US evaluation for these second-crop foreign bulls contributed to the Interbull evaluations if coded as official (i.e., all bulls with daughters in at least 10 US herds). Thus, for a large number of bulls, August 2002 was the latest Interbull evaluation without US daughters. In addition, a relatively large number of bulls had their latest foreign evaluation in August 2003 (the latest evaluation used in this study). These bulls have US daughters, and thus a current domestic evaluation, but those data are not included in the Interbull data because they did not meet the additional Interbull usability requirements. Primarily, this included bulls not coded as AI sampled in the United States. Although this results in a comparison of evaluations calculated at the same time, the contributing daughter groups in the August 2003 foreign and domestic evaluations are completely different for the bulls considered.


View this table:
[in this window]
[in a new window]
 
Table 2. Numbers of bulls having genetic evaluations for yield by date of latest Interbull evaluation that included no US daughters (foreign evaluation).
 
Mean differences between foreign PTA or concurrent US PA and current domestic PTA and SD of those differences are in presented in Table 3Go. Mean current domestic PTA were 126 kg for milk, 8.2 kg for fat, and 6.7 kg for protein, with SD of 381, 12.3, and 10.4, respectively. Mean differences were near zero for foreign PTA but were substantially negative for yield PA, indicating that PA was an underestimate of the later US PTA. Typically, PA are found to be overestimates of true merit (usually attributed to bias in dam PTA). However, bulls graduated from foreign sampling are expected to have highly positive Mendelian sampling deviation, thus overwhelming any positive bias in PA.


View this table:
[in this window]
[in a new window]
 
Table 3. Mean differences and SD of differences of the latest Interbull PTA including no US daughters (foreign PTA) or concurrent U.S. parent average (PA) with August, 2003 US domestic PTA for yield and SCS for all bulls or Canadian,1 Dutch,1 and other bulls.
 
For SCS, mean current domestic PTA was 3.12 (SD = 0.24). Mean differences were the same between either the foreign PTA or concurrent US PA and current domestic PTA. The lack of bias may reflect the lack of emphasis on SCS in determining graduates from progeny testing in these data.

The SD of differences for foreign PTA were less than the SD of differences for PA, but still may seem slightly larger than typically observed for changes in evaluations over time. In interpreting those SD, it must be remembered that the foreign PTA and current domestic PTA include completely independent sets of daughters, whereas comparisons are typically between an early evaluation and a subsequent evaluation that includes the same early daughters.

Differences for foreign PTA, grouped by country of most daughters in the foreign evaluation are also in Table 3Go. They were close to zero for Canadian bulls. Dutch bulls showed a tendency for the foreign PTA to underestimate current domestic PTA, whereas the tendency for the other bulls was for overestimation. Mean differences were generally small, though some were statistically significant (P < 0.05). Mean SCS differences for Dutch and other bulls were near zero. Canadian bulls had higher current domestic PTA for SCS (undesirable) than expected from the foreign data (i.e., merit was overestimated, though not significantly). The SD of differences were nearly identical between the Canadian bulls and the combination of the other 2 groups of bulls for all traits. However, separating the Dutch and other bulls showed lower SD for Dutch bulls and higher for other bulls for yield, and the reverse for SCS. The lower SD for yield traits of Dutch bulls was likely because they had the highest mean REL for both the latest foreign and current domestic evaluations.

Regressions of foreign PTA or concurrent PA, minus current domestic PTA, on time of the Interbull run were calculated. The regressions of foreign PTA were significantly positive for milk, fat, and protein (12, 0.4, and 0.4 kg/yr, respectively), meaning that the more recent foreign evaluations were higher relative to the current domestic PTA than the earlier foreign evaluations. However, these regressions are not particularly large even when the effect is multiplied across a few years. When calculated separately for bulls with the most daughters in Canada, The Netherlands, or other countries, results were significant (P < 0.05) only for Canadian bulls. The trends for absolute differences were also small and significantly positive only for milk (P < 0.05) overall (5 kg/yr), and for the bulls from countries other than Canada or The Netherlands. No significant trend was found for SCS.

Relative to current domestic PTA, PA also increased significantly with time (P < 0.01) for milk and protein for Canadian and Dutch bulls, indicating that the degree to which PA underestimated current domestic PTA lessened over time. This is likely due to the closer agreement between more recent PA and the current PA used in calculating current PTA. The absolute difference between yield PA and current domestic PTA significantly decreased (P < 0.01) for Canadian and Dutch bulls, also likely due to the part-whole relationship increasing with time. No significant trend was found for SCS.

Correlations (Table 4Go) were essentially as expected for the yield traits but higher than expected for SCS. Expected correlations for Canadian, Dutch, and other bulls were similar, ranging from 0.88 to 0.91 for yield and 0.80 to 0.82 for SCS. Correlations for yield for Canadian bulls were lower than expected, especially for fat, whereas correlations for Dutch bulls were uniformly higher than expected values. For other bulls, correlations were above expected values for milk and protein and lower for fat. The higher yield correlations for the Dutch and other bulls relative to Canadian bulls might be related to their larger variation in foreign PTA (20% more for Dutch bulls, 7% more for others) and current domestic PTA (29% for Dutch bulls, 26% more for others). This hypothesis was tested by limiting the bulls to those having evaluations above the mean for each trait, thus mimicking a more uniformly selected group of bulls. The SD for foreign and domestic PTA were greatly reduced for this group as were the correlations between the Interbull and US evaluations. It is not unexpected that the Dutch and other bulls would be more diverse groups relative to the Canadian bulls that have a longer history of importation into the US and whose pedigrees and evaluation system are more familiar to US breeders.


View this table:
[in this window]
[in a new window]
 
Table 4. Correlations of the latest Interbull PTA including no US daughters (foreign PTA) with August 2003 US domestic PTA for yield and SCS for all countries and Canadian,1 Dutch,1 and other bulls.
 
Actual correlations for SCS were higher than expected for Canadian bulls and especially for the group of other bulls. VanRaden et al. (1997) reported a regression of SCS PTA on the corresponding estimate 3 yr earlier of 1.16 ± 0.10. The change in PTA was 31% larger than expected. Conservative estimation of heritability could partly explain those findings and the low reliability estimates for the evaluations used in this study. Regardless of expectation, actual correlation for SCS for the group of other bulls is the highest among all traits and country-groups. The small ratio of bulls (17) to countries (7) may have an unknown impact.

A second part of the study examined Interbull evaluations of 64 bulls available 3.5 yr before their first US evaluation. Those evaluations were assumed to reflect the information available at the time of semen importation that resulted in the US evaluation. Thus, they should represent the basis of the decision to use the bulls in the United States. Because Interbull evaluations for SCS began only in 2001, there were no SCS data to consider. The mean Interbull and concurrent PA REL were lower (Table 5Go), as the yield evaluations were earlier in bulls’ lives. The mean REL for the August 2003 US evaluations was higher, likely because the qualifying bulls were older. The Interbull evaluations at the time of importation tended to overestimate the current US evaluation and the concurrent US PA were even more of an underestimate than those from the time of the latest foreign evaluation (Table 2Go). For these same 64 bulls, overestimation by Interbull PTA was reduced to near zero with the latest Interbull evaluations without US daughters. Thus, although Table 2Go shows an unbiased prediction, the Interbull evaluations did exaggerate yield merit by about 48 kg for milk and 1 kg for fat and protein (significantly for milk and protein, P < 0.05) at the time that the decision was made to use those bulls in the United States. This is in agreement with the observation by McClintock et al. (2003) that foreign evaluations overestimated later domestic evaluations.


View this table:
[in this window]
[in a new window]
 
Table 5. Statistics on Interbull yield evaluations from 3.5 yr prior to first US evaluation, concurrent US parent average (PA), and August 2003 (current) US PTA.1
 
Standard deviations of differences for estimated merit at time of initial use of these bulls in the United States (Table 5Go) were nearly the same as for the latest Interbull evaluation with only foreign daughters of the larger set of bulls. Actual correlations were slightly lower than the expected correlations.


    CONCLUSIONS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 
Interbull evaluations based solely on foreign daughters are useful predictors of the US evaluations for yield and SCS, in particular, providing better estimates than the alternative, parent averages. Differences for the latest such Interbull evaluation averaged near zero for milk, fat, and protein for all bulls. In contrast, PA was a considerable underestimate due to the bulls in question being graduates of foreign progeny testing programs and selected for positive Mendelian sampling. Thus, PA are not a viable alternative to the Interbull evaluations from foreign daughters. The foreign evaluations ranked bulls essentially as well as expected based on the REL. Conclusions regarding Interbull evaluations available to select semen for US importation were generally the same, although these earlier evaluations were moderate overestimates of the later US PTA.

Interbull evaluations of Canadian, Dutch, and other foreign bulls showed similar predictive ability, and although the Interbull evaluations underestimated the US evaluations for Dutch bulls and overestimated them for the group of other bulls, the differences were not significant. Standard deviations of those differences were largest for the group of other bulls and least for Dutch bulls for yield but the reverse was true for SCS. Although mean REL for August 2003 SCS evaluations was higher for Dutch than for the other bulls, REL for foreign SCS evaluations was lower, and overall REL for SCS were considerably lower than for yield. Correlations with the August 2003 US evaluations were higher for Dutch or other bulls than for Canadian bulls, perhaps related to higher variation. These results clearly show that evaluations based on foreign data, specifically that from Interbull, are useful in selecting bulls for use in the United States.

Received for publication December 31, 2003. Accepted for publication March 16, 2004.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS AND DISCUSSION
 CONCLUSIONS
 REFERENCES
 


McClintock, A., K. Beard, and R. Poole. 2003. Interbull proofs are a reasonably unbiased prediction of future performance in Australia for imported bulls. Pages 169–170 in Proc. Interbull Annu. Mtg., Rome, Italy. Interbull No. 31, Uppsala, Sweden.

Powell, R. L., and H. D. Norman. 1998. Use of multinational data to improve national evaluations of Holstein bulls. J. Dairy Sci. 81:2257–2263.[Abstract]

Powell, R. L., and H. D. Norman. 2000. Impact of genetic correlations on accuracy of predicting future evaluations. Online. Available: http://www.adsa.org/jds/.

Powell, R. L., H. D. Norman, and G. Banos. 2000. Improving prediction of national evaluations by use of data from other countries. Online. Available: http://www.adsa.org/jds/.

Schaeffer, L. R. 1994. Multiple-country comparison of dairy sires. J. Dairy Sci. 77:2671–2678.[Abstract]

VanRaden, P. M., R. J. Starkenburg, and T. J. Lawlor. 1997. Stability of genetic evaluations for productive life, somatic cell score, and yield over time. J. Dairy Sci. 80(Suppl. 1):253.

VanRaden, P. M., and G. R. Wiggans. 1991. Derivation, calculation, and use of national animal model information. J. Dairy Sci. 74:2737–2746.[Abstract]

Weigel, K. A., and R. L. Powell. 2000. Retrospective analysis of the accuracy of conversion equations and multiple-trait, across-country evaluations of Holstein bulls used internationally. J. Dairy Sci. 83:1081–1088.[Abstract]


This article has been cited by other articles:


Home page
J DAIRY SCIHome page
R. L. Powell, A. H. Sanders, and H. D. Norman
Investigation of Country Bias in International Genetic Evaluations Using Full-Brother Information
J Dairy Sci, July 1, 2008; 91(7): 2885 - 2892.
[Abstract] [Full Text] [PDF]


Home page
J DAIRY SCIHome page
R. L. Powell and H. D. Norman
Major advances in genetic evaluation techniques.
J Dairy Sci, April 1, 2006; 89(4): 1337 - 1348.
[Abstract] [Full Text] [PDF]


Home page
J DAIRY SCIHome page
R. L. Powell, A. H. Sanders, and H. D. Norman
Impact of Estimated Genetic Correlations on International Evaluations to Predict Milk Traits
J Dairy Sci, October 1, 2005; 88(10): 3679 - 3687.
[Abstract] [Full Text] [PDF]


Home page
J DAIRY SCIHome page
R. L. Powell, A. H. Sanders, and H. D. Norman
Accuracy and Stability of National and International Somatic Cell Score Evaluations
J Dairy Sci, July 1, 2005; 88(7): 2624 - 2631.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Interpretive Summary
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Powell, R. L.
Right arrow Articles by Norman, H. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Powell, R. L.
Right arrow Articles by Norman, H. D.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS