New Strategies Long Overdue on Measuring Child Welfare Risk

As The Chronicle of Social Change has been reporting over the past two years, various jurisdictions have been exploring new tools to focus the attention of child welfare systems on the children most at risk of subsequent abuse or neglect. The mainstream media has begun to notice, as demonstrated by CNBC’s recent report on Los Angeles’ contract with software company SAS to develop such a tool for its child welfare system.

These new approaches generally rely on predictive analytics, which means using patterns in data to predict future outcomes. Despite the recent media coverage, there is still some confusion about what is meant by this term, how it differs from current approaches like Structured Decision Making (SDM), and the distinctions between the various new approaches.

To understand these new approaches, it is important to understand how child protective services (CPS) works now. I can describe the process in the District of Columbia, where I once served as a caseworker.

CPS workers in the District use checklists to interview children, parents, teachers, and others about an allegation of abuse and neglect. They generally rely on the verbal answers to these questions, although they do receive access to data from schools and public assistance agencies.

The District of Columbia, like jurisdictions in over 20 states, uses an SDM tool to help social workers decide how to proceed at the conclusion of an investigation. Social workers fill out checklists on the computer. SDM assigns points to each risk factor, such as “primary caregiver has historic or current drug or alcohol problem.”

Based on the worker’s checkoffs, the software spits out a recommendation to remove the child or keep her at home.

SDM has at least two major flaws. First, it can be manipulated to recommend the action that the social worker wants to take. Second, it does not obtain any new data but simply uses what the social worker plugs in. That’s why in my experience in D.C., SDM was treated as a meaningless form to be filled out, not as a tool for making decisions.

A new set of predictive tools, known as predictive analytics, is being developed for governments in Los Angeles, Allegheny County, Pennsylvania, and New Zealand. These tools are designed to produce a numeric risk score for each child assessed. A high risk score would target the child and family for special attention, which might include intensive services and monitoring.

Unlike SDM, predictive analytics tools access data directly from other systems rather than relying on self-report from parents and caregivers. These systems might include mental health, substance abuse treatment and criminal justice, among others. Clearly, the information obtained this way would be more accurate than simply asking the parent or caregiver, who has to rely on memory and might have an incentive to withhold information.

Los Angeles County’s Department of Child and Family Services has contracted with software giant SAS to develop a risk assessment tool called AURA. As described by The Chronicle, SAS identified child deaths, near fatalities and severe injuries (called “AURA events”) in 2011-2012 among children referred to CPS within six months of these events.

Programmers then developed an algorithm that calculated the risk of an AURA event in the six months following a referral based on the characteristics of the children and their families. The predictive power of the algorithm was tested against child abuse reports in 2013 (data that was not used to develop the algorithm.)

AURA proved to be a powerful tool for predicting deaths and serious injuries to children. Among those cases that had at least one referral before the current one, the 1 percent of referrals with the highest AURA scores experienced 57 percent of the AURA events. The 20 percent of referrals with the highest risk accounted for 83 percent of total AURA events.

Florida has chosen to use a different approach. It is using a tool called Rapid Safety Feedback (RSF), developed by a nonprofit called Eckerd Kids for Hillsborough County, which had experienced nine deaths among children in open cases receiving services at home over three years.

Rather than a risk assessment algorithm, RSF is a quality assurance tool that is used to target a set of high-risk cases for special treatment and review. RSF targets cases with characteristics associated with a high probability of serious injury or death to a child.

In Florida, RSF is used only for families with in-home cases. Cases designated high-risk are reviewed quarterly to make sure workers are using specific practices that have been shown to increase child safety.

According to Eckerd, there have been no maltreatment-related deaths of children in open cases in Hillsborough County since implementation of RSF in January 2013. Several states are working with Eckerd to adapt and implement RSF in their child welfare investigations.

The new tools discussed above are in their infancy in child welfare. It is important for policymakers and advocates to understand the nature of the tools that are available and the differences between them before making decisions about which if any to support.

Print Friendly, PDF & Email

Marie K. Cohen
About Marie K. Cohen 68 Articles
Marie K. Cohen (MPA, MSW) is a child advocate, researcher, and policy analyst. She worked as social worker in the District of Columbia's child welfare system for five years. She is a member of the Citizen's Review Committee for the DC Child and Family Services Agency and the DC Child Fatality Review Commission and a mentor to a foster youth. Follow her blog at fosteringreform.blogspot.org, on Facebook at Fostering Reform or on Twitter@fosteringreform.

1 Comment

  1. What would also help tremendously to reduce neglect/ abuse:

    1.The system protecting children fails due to lack of accountability as a result of protecting families’ privacy. There must be some modification of this absolute silence.
    People who abuse animals OFTEN get in more trouble than parents abusing kids due to this silence….and guess why you never hear about it?

    2. The DA should have to answer to the general public for refusing to prosecute cases of abuse or neglect (like those well documented either by admission or multiple complaints)

    3. CPS should be required to report to the general public case facts and justify action (not) taken and justify reunification or terminationot of parental rights (for instance returning a child to a meth using parent 3, 4, 5 or even 6 times)

    4. There needs to be an internal affairs for investigation of all the above and more. (Fear of upsetting a foster care coordinator prevents even the investigation of abusive foster patents)

    5. More frequent drug testing of parents who use and legally mandating longer cases with extended supervision for repeat offending parents (one would falsely assume this to be a given). Also there should be mandatory hair follicle testing of all parents and kids at the beginning of a custody case even when drug use is not suspected. It is often missed in the first couple of cases CPS has with a family.

    6. There should be legally mandated procedures for giving drug urine tests that prevent false negatives. For example: squat and cough to expelled inserted items, stop midstream, one hand on the wall and hold cup with thumb and pointy finger only. Missed drug tests should always be considered a positive.

    7. Funding is wholly inadequate. If you look at your state budget for CPS versus education and divide it by their number of total employees you’ll get an idea of why we lose so many of the good CPS workers. Assume each caseworker is working with more clients than teachers do students.

    8. It would be helpful if there was oversight by the general public who are not as jaded as the CPS system and would be less accepting of neglect, abuse, and relapse. Or perhaps erhaps something along the lines of a grand jury… or have states review other states’ decisions and make recommendations regarding policy and procedure.

Comments are closed.