Silica dust can cause silicosis, a serious and irreversible lung disease. It can also cause lung cancer. Cutting, breaking, crushing, drilling, grinding, or blasting concrete or stone releases the dust. As workers breathe in the dust the silica settles in their lungs.
https://www.cdc.gov/niosh/engcontrols/ecd/detail2.html
I wouldn't wear ordinary clothes to grind cement if I was forced to. I'd wear paper disposable jump suits