Let me try to address a few of the topics discussed here. Some of this has already been said but I will repeat it: WAR is LITERALLY trying to estimate the wins a particular player's performance over a certain time was worth over an average replacement level player. It is just a framework, however. That framework can be implemented in any number of ways and Fangraphs and BF have come up with two such implementations. I am sure there will be more and hopefully they will continue to improve the methodology. WAR is attempting to estimate the value of performance, not the skill level of a player. If a 9 year vet with a career .200 BA throws up a .300 BA in his 10th year, we say he was a .250 batter last year but we estimate his actual skill level at something much closer to .200. We know that a player does not always player at their true skill level and the most significant reason for that is the uncertainty associated with sample size. UZR has a much larger uncertainty over one season than the offensive component of WAR. Two reasons. First, players get significantly less defensive opportunities than offensive opportunities over a given season. Lower sample size equals higher uncertainty. No metric can remove that uncertainty. Second, offensive metrics record what actually happened, play-by-play defensive metrics (like UZR) attempt to estimate the likelihood of an average defender making a particular play. That is based on a somewhat subjective estimate of ball trajectory and speed. Even if that estimate is unbiased, it will lower the precision (not accuracy) of the UZR estimate. If it is biased (and there is some evidence that it might be), it will lower both. In summary, WAR probably represents the best framework available for estimating the value of performance that is publicly available, and Fangraphs and BR offers a reasonable implementation of that framework. There will be more, probably better implementations of it in the future and the WAR framework will probably be supplanted altogether by something better someday. Combine that with whatever observational (scouting) based evidence you think yo have on a player and that's going to be your best guess.