Which is why I enjoyed getting a little of the opposite perspective from two great writers I follow, who have chosen not to podcast:
“A few people have asked me why I don't host a podcast. 1) too much work 2) I would only host a podcast as an excuse to record the background music (see #1).” — Austin Kleon
“I didn't start writing books as a back way to get into the radio business.” — Ryan Holiday
Get better at what makes sense for you. At this point, no one is going to get excited for your podcast if you're not absolutely dying to make one. Plus, the project you do really love could use the extra hours.