I use it but only when the car or van is pretty mucky; as mentioned it softens the dirt.
Then cleaning is far less abrasive.
The main thing is to keep rinsing your wash mitt (don't use a sponge!) with a second bucket of fresh water; a grit guard at the bottom is even better.
The aim is to reduce any chances of scratching and/or swirling. The dirtier your car, the more you need to rinse.
I do a lot of fairly geeky cleaning/detailing as have a garage full of products. While I like having clean, shiny vehicles my main aim is to make regular washing easier and to protect them.
It doesn't have to take all day; a few simple steps and you'll look after your paint properly and make it easier to look after.