Freelancing requires that "what you love" includes entrepreneurship / running a business. If you don't want to "take care of your clients" you're definitely in for a world of hurt.

If all you want to do is the most fun parts of a job, you're going to fail at any job, not just freelancing.

I think you'd also find that once you've done it long enough all the extra admin, sales, etc. get more and more efficient, and they whittle down into such a small part of the job that you really do spend most of your time doing what you love.

As you say, it takes going all in. If you want to run a serious freelance business and make a long-term career out of it, you can. But if you lack the commitment to go all in, you're just a person doing random gigs, and that's not a good job or career.