Yup.It's a traumatic job/task that gets farmed to the cheapest supplier which is extremely unlikely to have suitable safe guards and care for their employees.
If I were implementing this, I would use a safer/stricter model with a human backed appeal system.I would then use some metrics to generate an account reputation (verified ID, interaction with friends network, previous posts/moderation/appeals), and use that to either: auto-approve AI actions with no appeals (low rep); auto-approve AI actions with human appeal (moderate rep); AI actions must be approved by humans (high rep).
This way, high reputation accounts can still discuss & raise awareness of potentially moderatable topics as quickly as they happen (think breaking news kinda thing). Moderate reputation accounts can argue their case (in case of false positives). Low reputation accounts don't traumatize the moderators.
If everyone is replacing low level jobs with AI in order to pump next quarters numbers, they are gonna be fucked in 5-10 years when there is a skilled labour shortage - those very skills learned and developed while doing the lower level jobs.
This is a gargantuan gamble on AI being able to progressively replace more an more complicated jobs, and stay in line with this curve as the skill ages out of the population.
Oh, and nobody will be able to pay for the services provided by these companies because nobody will have money because they can't get jobs because all the low skill jobs are done by AI, and nobody can develop skills because there is no entry to industries/careers via low skilled jobs.
Replacing jobs with AI is so fucking stupid.