Credit bureaus will have to hold off on reporting delinquent medical bills and supply actual human beings to review disputes under an agreement announced today with New York’s attorney general.

The Wall Street Journal reported that the agreement, to be announced later today, will change how credit bureaus operate nationally. Bureaus will have to wait 180 days before reporting any medical debt on people’s credit reports. When an insurance company pays a medical bill, all references to it will have to be deleted from the individual’s reports.

This is a big deal, since the Consumer Financial Protection Bureau estimates about 43 million Americans medical collection accounts on their credit reports. One such collection can devastate an otherwise pristine credit report and cause credit scores to plunge.

Having human beings review disputes is another significant change. Currently, humans stick a code on disputes before they’re sent to lenders, but the process is highly automated. Errors that have been removed from a report can crop up again (and again and again) when the lenders upload their data files to the bureaus. Getting problems fixed can be a frustrating process when you can’t get a human being to intervene.

The changes won’t happen overnight. The bureaus have three and a half years to roll them out.