Tough! Not a lot of plants likes red clay. Aside from the very fine texture which discourage root growth, it's also acidic. Maybe, you can layout boulders and flag stones to form walks and borders then work some garden soil and compost on bare ground.

We have planted fruit and shade trees in inhospitable soil by digging a hole large enough to accommodate root expansion until they're strong enough to push through the dirt.

You're right though, hard work.