Exploring Jim Leyland's bullpen usage
Which Tigers' bullpen resident has been pitching in the biggest pressure situation for the Tigers this season? Hint: It's not the closer.
Technology is wonderful. I can ignore scripted television to watch live sporting events because I can watch any scripted show later on DVR or online. I can get instant feedback on an umpire's strike zone, find out how the opposing pitcher is carving up our lineup (will someone please swing at Francisco Liriano's freakin' slider on the outside corner with 2 strikes? ANYONE AT ALL!) or lurk the interaction of very smart people bouncing ideas off one-another from hundreds (or thousands) of miles apart in this country.
For the latter situation I described, The Book Blog is my hang out of choice. Instant feedback on the ideas that bounce around the sabermetric circle of Fangraphs, The Hardball Times, Baseball Musings, Baseball Analysts, Beyond the Boxscore, Baseball Prospectus, etc etc.
Yesterday, Steve Sommer posted an article at Fangraphs discussing how managers use their relievers. This tickled the fancy of Tom Tango at The Book Blog early in the morning. Tom, though, always wanting to improve, well, everything, offered up some suggestions. David Pinto wrote code into his day-by-day database four hours later. Tom still wasn't quite fulfilled, and then Jeff Zimmerman stepped in to quench his graphic thirst. All of this within a typical work day. If only their bosses knew what they were up to (hopefully none of them are Air Traffic Controllers or something). It's things like this that make me love the internet (especially for baseball research), because I can now take this method and apply it to the Detroit Tigers.
To look at Jim Leyland's bullpen usage through Wednesday, I'll turn to the wonderful Leverage Index which I don't use enough. It is the difference between situations in the game. Bases loaded in the top of the 8th when your team is down by one run is a higher leverage situation than top of the 9th, 0 out and down by 1 run. Fangraphs defines the following leverage index numbers as such:
pLI: A player's average LI for all game events.
phLI: A batter's average LI in only pinch hit events.
gmLI: A pitcher's average LI when he enters the game.
exLI: A pitchers average LI when he exits the game.
Pretty straight forward, no? What I'm using is the gmLI which I extracted from the relievers play logs. It's the leverage index (LI) of the first batter faced in each outing for a reliever. This is Jose Valverde's play log page. I use gmLI over pLI because I'm looking for what situation Jim Leyland brings what reliever into. pLI will change because the leverage index changes as a pitcher continues to pitch. For instance, lets say Joel Zumaya comes into the game in the top of the 8th inning with 0 out and no one on base in a tied game -- he's got a clean inning to work with. That has a leverage index of 1.9 -- 1.0 is average, below/above that is low/high pressure situations. Now, if Zumaya in this situation gets the first batter he faces out, the leverage index drops to 1.4. His gmLI in this situation is 1.9, but his pLI is 1.65. The pLI will change the longer the pitcher pitches.
So, graphically, this is what Jim Leyland's bullpen usage looks like when you graph each relievers gmLI by date:
Click the image to enlarge. I know, this is, at first glance, like some 2-D Dippin Dots container. I made Valverde's dots the biggest because he is the closer. Many managers say the closer is the "ace" of the bullpen and, one would think they'd pitch in the highest leverage situations possible, right? Wrong. Few managers do that and some even think that the ninth with no one on base and a 3-run lead is a tougher spot than the 7th or 8th inning with less than a 3-run lead.
Judging by this graph, Ryan Perry has actually come into the highest leverage situations of any reliever in the bullpen as he sports an average gmLI of 2.18 (note: I did not include Dontrelle Willis' single relief appearance or Brad Thomas' emergency start in Texas). Valverde is second, however, with an average gmLI of 1.89 followed by, surprisingly enough, Phil Coke at 1.49. That makes sense if you think about it; Coke often comes in to face the tough left-handed hitter in crucial situations.
Also, if you look at the graph above, you can see who is least trusted in the bullpen: Thomas. This also makes sense given that he's the third LOOGY (Left-handed One Out Guy) in the 'pen behind Coke and Fu-Te Ni. Also, when you remove his emergency start, Thomas has only appeared in 5 times in nearly a month.
For those that get nothing out of the graph, here's a table with pertinent information.
| Player | ERA | FIP | xFIP | pLI | gmLI | exLI |
|---|---|---|---|---|---|---|
| Joel Zumaya | 1.42 | 0.90 | 2.52 | 0.95 | 1.25 | 2.14 |
| Jose Valverde | 0.90 | 4.81 | 4.06 | 1.42 | 1.81 | N/A |
| Phil Coke | 1.38 | 2.81 | 4.59 | 1.39 | 1.49 | 2.04 |
| Fu-Te Ni | 1.69 | 3.58 | 4.61 | 0.83 | 1.02 | 1.45 |
| Eddie Bonine | 1.50 | 6.20 | 4.94 | 0.55 | 0.58 | 1.15 |
| Ryan Perry | 3.12 | 5.42 | 5.18 | 2.51 | 2.18 | 1.63 |
| Brad Thomas | 5.40 | 4.41 | 5.64 | 0.59 | 0.58 | 0.60 |
Just because someone is being brought into crucial situations doesn't always mean that they're performing well. I've got a couple of metrics for judging their pitching talent. ERA, Fielding Independent Pitch (FIP) and Expected FIP (xFIP). Personally, I use xFIP for relievers because they pitch so few innings, that two or three rocky outings will skew their ERA or even their FIP.
Perry has been getting the crucial situations but has pitched the worst thus far by any metric (save for Thomas if you're going by ERA). This is because Perry's walked almost as many as he's struck out (7 to 6) but it hasn't come back to bite him yet given he's got a great 54.5% ground ball rate. This has led to an 88.1% Left On Base Percentage which is likely to drop -- league average is around 71-72%.
Perry's pitched poorly in general, but Zumaya's been beyond fantastic. His xFIP is higher than his FIP because he's yet to give up a homer this year where if you apply league-average home run per fly ball rate (HR/FB, league average is around 10.6%) he "should" have given up 1-2 so far. However, that 2.52 xFIP is great -- and sustainable if he can continue to walk as few batters as he is doing this year.
I give Jim Leyland's decisions a lot of guff, as I don't particularly agree with them much of the time -- though I can follow his reasoning for most of the moves he makes. That said, Leyland's been pretty good at his bullpen usage in 2010, though I'd like to see Zumaya and Perry switch rolls if their current trends continue. I'd suspect, though, that if Zumaya continues to be lights out, their roles will get switched soon enough.
38 comments
|
2 recs |
Do you like this story?
Comments
In other words . . .
. . . Leyland is using the bullpen more-or-less correctly?
Basically, yes.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
I've read in numerous places through the years
that managing a bullpen may be Leyland’s greatest strength, for whatever that’s worth.
I think that's media speak
I believe that Leyland’s strength is the way that he manages his players in a personal way. For the most part, they’d go through a wall for him.
Leyland’s use of the bullpen seems excessive to me. Not necessarily in the total number of innings, but pulling out effective pitchers to get a lefty/ righty match up. The media heaps praise on Leyland for everything he does, and he changes pitchers quite often- putting himself on camera quite often. But he’s as good as the personnel that he has in the bullpen. JL needs a pen FULL of good pitchers for his methods to work. He seems oblivious to the idea that there’s a risk to taking out an effective pitcher, just as there is a risk in leaving a lefty in to face a righty. I’d rather he left well enough alone more often than he does.
Maybe so
I’ll admit I was a little surprised on Monday when he left Coke in to face Guerrero. Perry was warmed up and ready to go.
Also, FWIW Keith Law has praised Leyland’s bullpen management in the past, and he never says anything nice about anybody. Which is why I like him.
by ChrisDTX on Apr 30, 2010 11:41 AM EDT via mobile up reply actions
"JL needs a pen FULL of good pitchers for his methods to work."
. . . and fortunately, he has them.
And a couple more in Toledo and Erie
President, Vice President and Secretary of the Casey Crosby Fanclub.
Assist. Editor, Minor League Division, Bless You Boys
by David Tokarz on Apr 30, 2010 2:58 PM EDT up reply actions
Agreed.
I’m not a Leyland fan, but I’m not a fan of most managers. I also don’t know if chemistry affects baseball players given it’s such an individual sport, but if it did, I would want no one else managing the team, because Leyland’s great at how he handles his players personally.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
I'd say it does.
I’ve always found that the teams I played on did better when everyone was clicking in the dugout/clubby/off the field. In college, it was actually kind of amazing how much better some guys played after one bad apple would graduate and was no longer there to dog them all the time.
I don’t know what Leyland does with the guys off the field because I don’t hang out in the clubby or see anything first hand but it certainly sounds like he’s a player’s manager. I don’t know why you don’t like him (or managers at all for that matter), and maybe I’m clouded because the Tigers turned it around when he took over, but I always seem to think more positive things than negative — in terms of his managerial decisions. Of course, our idea of good managerial decisions also differ sometimes as evidenced by our little quarrel over Ni/Perry usage in Texas.
Detroit Bad Boys- SB Nation's Detroit Pistons Blog
Twitter
It's just the decisions they make.
I hate bunting, too, so that doesn’t help. I don’t want to turn this into chemistry: does it exist/affect baseball players but I wonder if it’s more tied to winning than tied to players. I don’t have an answer to that.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
A masterful job
of using several advanced metrics in very understandable ways to make an excellent and succinct point. Well done Mr. Rogers.
Thanks!
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
Very nice work, Rec'd
and by the way… my handle’s .90 FIP is impressive. I think if he continues to show this type of control, we have a bullpen that can really be a rock, especially 7-8-9 with the possibility of both Perry and Zumaya going 2 innings, you could cover 6-7-8-9 and only use four pitchers on a given day. Not ideal, but with our SP starts this year, its great to have a bullpen like we do.
VP of Membership, Casey Crosby Fanclub.
by JoelZumayaKegStand on Apr 30, 2010 11:29 AM EDT reply actions
Agreed.
Joel’s control thus far has stunned me. He’s easily the biggest surprise of the bullpen because, well, I had put him in as the bullpen Dontrelle Willis – whatever positive contributions he gives you, it’s gravy.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
I'm not that stunned. Actually, I'm worried.
Zumaya started last season with 12 walkless innings and ended up with 22 of them in 31 innings. Granted he may have been throwing through some pain there, but still…
by ChrisDTX on Apr 30, 2010 4:41 PM EDT via mobile up reply actions
great post!
It fits what I have seen from the games so far. And I think it also shows that a person with Leyland’s knowledge and insight can, instinctively, understand these things even w/o the number crunching that we enjoy.
Leyland can drive me insane in some situations, but overall I think he is very good at getting the most out of players that they can give. His weaknesses (too much deference to veteran players is the biggest) can glare sometimes, but he has made a weaker team a contender for 3 of the last 4 years.
Yeah
In a big picture sense, it’s nice to have the Tigers as an actual competitive club. How quickly we forget that they were Pirates-esque for more than a decade. You can probably give leyland a small bit of credit for that. Of course, having actual good players helps…
by ChrisDTX on Apr 30, 2010 12:27 PM EDT via mobile up reply actions
Yes, don't get me wrong. No manager can overcome an inferior team
but a good manager gets the best out of what they are given. DD and Illitch have put together the pieces to make a competitive team. Leyland has used what he has well (for the most part).
Those Piratesque years were the result of the owner(s)/ GMs’ mistakes more so than the managers.
This is good news
And I think that some of the guys in the ‘pen can surpass their numbers as they stand currently (Perry won’t continue to post a 5 FIP, for instance, and if Ni is used right, he’ll be a good asset).
Finally. we have a strong bullpen!
President, Vice President and Secretary of the Casey Crosby Fanclub.
Assist. Editor, Minor League Division, Bless You Boys
I like Perry if he can keep the BOB Monster at bay.
And Ni/Thomas have at least soaked up some innings. If the offense continues this whole comeback thing, it’s important that you have guys who can at least stem the bleeding a little bit when necessary.
by ChrisDTX on Apr 30, 2010 12:31 PM EDT via mobile up reply actions
I still would like to see Perry's BB's come down. He's always had problems with them, going back to college.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
Of course
But he’s what, 23? He’s got time.
President, Vice President and Secretary of the Casey Crosby Fanclub.
Assist. Editor, Minor League Division, Bless You Boys
by David Tokarz on Apr 30, 2010 5:54 PM EDT up reply actions
Nice post...consider this...
If a reliever is effective, you would hope that the game is less stressful when he leaves the game than when he enters. Without digging into this metric too much myself, it seems like there would be a metric that would show the difference in leverage between entrance and exit (exLI – gmLI). If Zoom enters a game with a 1.9 and leaves the game at 0.6, I would think that he’s done a good job of making it less stressful.
However, I guess if he blows up and gives up 12 runs, the leverage would probably drop….so I’d like to drop leverage in a GOOD way for your team. Any ideas on how this could be measured?
Kind of.
The game moving into a later inning automatically starts to increase the leverage index, so it makes it somewhat difficult for the exLI to be lower than the gmLI for relievers. I think something that you would like is Win Probability Added which is just the contribution a player makes. Then there’s WPA/LI on Fangraphs.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
2006
I’d love to see this done for 2006 and see if I’ve been right when saying Zumaya threw the most cruicial innings that year out of the pen.
Zumaya - Perry switching roles.
I feel like Leyland as already started to switch their roles these past few games.
I think both are going to be 8th inning guys
Leyland has used Zumaya for a lot of 2 inning appearances, which makes him unavailable for the next day. So Perry gets the 8th on those days, if necessary.
I said when we signed Valverde our bullpen would be strong as hail (especially if Zoom stayed healthy). It’s playing out so far, which is pretty evident.
You say that top chart is for gmLi but it’s labeled completely wrong. And then, for example, I look at Perry’s gmLi for 4/22 and I’m not getting 7.5 as the chart indicates (I also worked his pLi out to be a 4.65? for that game – I could be wrong). I assume the bottom chart is right, though (and if you go through and do this all manually, I’m quite impressed and apologize for my nitpick).
Some random thoughts
- Being in a crucial spot can be pretty subjective – I’d say getting through the bottom of the 8th when you’re down 1 is sometimes just as crucial as getting out of the inning when you’re up 1 (especially when you have Miguel Cabrera coming up in the 9th). Of course, the chart suggests otherwise.
*I’d like Perry and Zoom to switch roles, too, down the road. Assuming our starters start throwing starter innings again one day, I’d like Zoom to be the 8th inning stopper before Valverde. I agree with Chris though that they both have the potential to flip flop either way.
Detroit Bad Boys- SB Nation's Detroit Pistons Blog
Twitter
I did have to do it manually. No worries on the nitpick.
It’s entirely possible that I mis-read/typed the numbers in. I’ll double check it later
The chart doesn’t necessarily suggest the opposite of the situation you’ve described.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
fuck sakes man.
Kudos to you. I sat down and did Perry’s – it took me 25 minutes and I wanted to stab myself in the eye after.
Detroit Bad Boys- SB Nation's Detroit Pistons Blog
Twitter
I did completely mislabel the graph.
It should be gmLI not pLI. The data is right, though.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
Well, wrong. The 4/22 point on Perry is wrong.
Damn. Fangraphs sucks at sorting … I should’ve just exported the data to excel but didn’t. I’ll change it later, I think. Instead of 7.61, it was a 3.79 gmLI. that shouldn’t have passed the sniff test. Bah. Thanks for fact checking though, ‘cause I wouldn’t have given it a second though.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
yeah I had 3.8 from doing it manually with that first link you provided. And I’m an idiot – when you said manually, I thought you meant you went into every box score for each reliever and cross-referenced that chart. That’s what I did for Perry and it was painful. I didn’t realize FanGraphs has most of it at your fingertips, sort of.
This is my first time getting an in depth look at this stat, so I was trying to get a feel for it. The mislabeled axes and Perry outlier in the first chart threw me way off. Either way, thanks for putting it all together – great work – and in hindsight sorry for calling you out on something so nugatory.
Detroit Bad Boys- SB Nation's Detroit Pistons Blog
Twitter
No problem, man.
I’m glad you did, because for some reason I completely over looked it and mislabeling the graph was a big oversight, as well. I want/expect people to call out something that I’ve done wrong – no sense in just letting things slide.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
Realized you couldn't enlarge the graph if you clicked on it.
That has been fixed.
My old blog is Tigers By The Numbers.
Now I write at Bless You Boys.
Like music? See what I'm listening to at my Last.fm account.
Zumaya
Sure he’s bound to give up a few dingers and walks but his BABIP is currently inflated way beyond league and career averages. If he continues to basically walk almost no one while striking out people at this clip, he’ll be one of the best relievers in the league.
As it is, I’d keep using the bullpen, and Zumaya in particular, in the same way, I f a guy is in a groove, he’s in a groove, and the 6-7 or 7-8 2 inning combo that Leyland had Zumaya on has him in a major groove.
Statistically speaking...
…would it be better to report the median pLI rather than the mean? One crazy-stressful situation could throw off the average — but then again, maybe it should, seeing as how a situation like that could very well increase JL’s confidence in a particular reliever, should it turn out well — and that would affect his future use of that arm.
1. I love statistics, and
2. I love baseball, ergo
3. I LOVE BASEBALL STATISTICS!
Nice analysis. Well done. Very thought-provoking. :)

by 



















