As a young curmudgeon myself, I might *grumble* seem discouraging.  But really, I'd encourage you to take on convolution externals... but don't create a monster.

In the context of threading/part. conv, I had an idea to compute ahead.  Most of the calculations for a given block can be computed ahead.  Only the most recent block of samples needs to be actually convolved, right away.

Then, once you've summed the most recent block with the other partitions, you'd start a thread to "compute ahead" the next cycle's partitions.  If the load is low enough, it would complete by the next cycle--of course, you'd need to wait/join the background thread to make sure that it completes.