‘Citizen-centric’ demolished by NDIS algorithms


Marie Johnson
Contributor

After more than twenty years of ‘citizen centric’ strategies by governments around the world, this week saw the demolition in Australia of any pretence of citizen-centric, participant-centric, person-centric – or any other version strategy based on ‘human’ centricity.

The theatre of citizen-centric has now run its course. And in the year 2021, citizen-centric has been replaced by the ungoverned rise of machine-centric algorithms.

Last week under questioning at the Joint Standing Committee on the NDIS Inquiry into Independent Assessments, the NDIA revealed for the first time the architecture of the algorithms to be used in robo-planning.

Also in evidence, commentators including myself have raised serious concerns on the application of algorithms, and the additive impact of algorithms, on people with a disability.

NDIS NDIA
Reduced to personas: The NDIA and its algorithms increasingly under fire

Lacking any transparency or ethics, the broad-brush description of the algorithm architecture involves the construction by the agency of 400 personas based on disability, age and other factors.

Would indigeneity, language, culturally and linguistically diverse (CALD) people and homelessness be factors? We don’t know. The determinants of the algorithm personas have not been subject to any independent external scrutiny.

The agency indicated that a technical paper would be released, and it is understood that the sector and academic and legal community will forensically examine it.

But given the timeframes promulgated by the government, any feedback is likely to be too late. The assumptions and determinants will have already been baked into the algorithm – or algorithms, as there will be more than one.

Algorithms that include debt recovery. And algorithms that include the extensive and yet to be legislated changes that the community only found out about because the draft legislation had been leaked.

And a cautionary word about ‘personas’.

Personas are typically the collaborative outcome of a co-design process, used to tell a story from the person’s perspective of their experience, with all the uncomfortable, confronting, and messy details of life. More controversially, they are often used in HCI design although with issues of stereotyping a major concern.

But the apparent use of personas in the construction of the NDIS robo-planning algorithms, is a perverted application of this method.

With the lack of transparency and ethics – and the absence of co-design – the algorithms become a construction of internal modelling where bias is inescapable.

Not only will bias be baked in, but the operation of these powerful algorithms is not subject to independent scrutiny or appeal.

And all this has arisen because the agency has created a seething mess of administrative and conceptual complexity that it cannot manage.

Sliding doors of complexity so unfathomable that the scheme itself has become manifestly unjust.

So their answer is to put over 530,000 Australians with disability into 400 persona boxes and wipe out any pretence of the notion “participant centric”.

We could see this coming over recent years when the word “co-design” disappeared from key corporate documents. I was criticised for pointing this out.

In reality, it matters not whether the number is 400 or 4,000 personas, as this approach treats Australians with disability as an amorphous data mass and not as individuals with rights, and with unique lives and needs.

And it is a harbinger of things to come for those on welfare, aged care and veterans.

Certainly data analytics is critical. And better and transparent data analytics is urgently needed.

But the political arguments around scheme sustainability not only ignore the benefits side of the equation, but completely ignore complexity as a most significant factor impacting sustainability.

The original 2011 Productivity Commission Report referred to complexity as “confusopoly”.

And an overwhelming number of the more than 260 submissions to the Inquiry on Independent Assessments describe the injustice and human rights impact of complexity on all communities, especially First Nations people, CALD communities, and people with psychosocial disability.

The Victorian Council of Social Service (VCOSS) Submission (number 153) for example describes the barriers of complexity, literacy and “magic words”.

The complexity sees documents and highly personal information, lost. This is the experience of a great many people evidenced in submissions to this Senate Inquiry and other inquiries including the Tune Review.

A recent poll on the NDIS Grassroots Facebook group (with 55,000 members), indicated as many as 80 per cent of people experience lost documents. This would be an enormous cost driver across the whole system.

Imagine if 80 per cent of people undergoing an Independent Assessment, had their documents lost. There is no guarantee that this will not happen.

So an end-to-end co-designed time-and-motion study would be immensely revealing. And this should be done before any structural changes to the scheme are made.

Automation and the application of algorithms, which will be inherently biased, do not overcome complexity nor the injustice, disadvantage and cost this causes.

To the contrary, there is international evidence that algorithms deployed by the state cause harm and compound injustice.

So, all up, it is not clear what ‘problem’ the personas are intended to address.

Except the effect of this is to digitally institutionalise people with disability into boxes, and to subject them to lifelong examination, study and control.

In response to the proposed changes that have been unanimously slammed by every sector of the community, Minister Reynolds challenged: “if somebody could come up with a better option…”

As if that challenge had not been well anticipated, in the more than 260 submissions to the Senate Inquiry into Independent Assessments.

People with disability, experts, health professionals, NGOs, service providers, state and territory governments, advocates: thousands of hours of documented evidence and insightful thoughtful solutions and recommendations.

Like many people, my family found the process of writing a submission detailing our harrowing experience, very painful.

But we, and hundreds of thousands of Australians have a vested interest in the sustainability of the NDIS.

And in stirring testimony at the Senate hearing, Mr Dougie Herd Chair of the ACT Disability Reference Group and one of the original campaigners for the NDIS, challenged back “…this is super personal.”

It is personal and yet we have been reduced to personas, components in algorithms.

The upending of the NDIS social contract has precipitated an insidious episode of servicing by algorithm, in which no Australian has had a say.

Until the government publishes the design of the algorithms and intended applications, their use must stop immediately.

Marie Johnson was the Chief Technology Architect of the Health and Human Services Access Card program; formerly Microsoft World Wide Executive Director Public Services and eGovernment; and former Head of the NDIS Technology Authority. Marie is an inaugural member of the ANU Cyber Institute Advisory Board.

Photo credit: NoDisadvantage Community on Facebook

Do you know more? Contact James Riley via Email.

5 Comments
  1. KG 3 years ago

    Interesting parallels to the problems with the COVID vaccine roll out. Instead of tapping into, engaging and supporting an existing Infrastructure of GP, Clinics, mobile.immunisation services and pharmacists, they tried to do something more efficient and it was a failure for all concerned.

    As a parent of a person with a psychosocial disability – our early experience in using the public health system was not good as we could not get in to see the occupational and speech therapists etc and when we did it was a new person each time. When the NDIS was introduced it was great to be able to work with a selected provider and have continuity so that my child built a rapport, trust and the therapists really got to understand the complexity of needs. Feels like we are taking a step backwards now in the name of efficiency but ignoring the benefit side of the equation.

    There are definitely some shonks out their providing “services” through the NDIS but there are thousands of therapists (physio, psychology, OT, speech) who are fantastic and who would agree that an individualised approach has enabled more regular session and continuity which drives better outcomes.

    Being data driven is crucial, but let’s not loose the best thing about the NDIS, which is examples of where a therapist/client connection has been created and a true understanding of needs is developed and we achieve great outcomes. Let people choose which specialists they work with to provide the data and determine their needs. Surely then the problem is technological – design a system that can capture input from a range of trusted specialists and put a plan together?

  2. Frank 3 years ago

    Nothing good is going to come from this path. We are desperately needing leadership to bind us humans together rather than this ongoing policy of separating people into their tribes, clans, boxes or specific personas.

  3. Peter Simpson 3 years ago

    I am a NDIS participant changing medical needs how does this cater for that. I did not put in a submission (been involved like Dougi from the word go) because I knew it would be a waste of my time. As I said earlier to people trust these pollies as far as I could kick them from my wheelchair

  4. David Brown 3 years ago

    “Citizen centric” may once have implied that an initiative was in the citizen’s interest, but these days it means that the citizen-customer is the primary object of surveillance and control.

  5. Greg Morrison 3 years ago

    So they are Targeting the Individuals as usual.
    When are they going to Target the Supply Companies that are Gouging the System with unbelievable Prices on the Products that they Supply.
    And don’t forget to look at some of the unrealistic Prices that are being paid to Professional Services while they are at it.

    Don’t get me Wrong here, there are some Suppliers and Providers doing the right thing.

    We all want to see the NDIS, and the People it was created to help, getting a fair go.
    I am beginning to think this whole thing is a Con by our Government and is purely a cost cutting exercise.

    One minute Ms Reynolds is saying that the Government will wait for the results of the Trials and the Consultation Process, but do not hold your Breath – because it turns out that our Trusted Government has already let Contracts to Eight companies that have been chosen to conduct independent assessments with a total of $319 million on offer over three years. (with one of the Eight Companies chosen, being run by the former Boss of the NDIA) but do not panic, it has been checked out and all the proper requirements have been met, apparently.
    Now, the eight Companies chosen will divide the money between them, depending on how many assessments they complete.
    The Government expects the Eight companies to perform 518,000 assessments over 3 years. That is $615.83 per assessment.
    Now, the Smarter and Faster these eight companies work – the more they will get of the $319 Million Pot.
    Congratulations Australian Government – you have now encouraged Eight Companies to push these Assessments through, to the detriment of the Disabled population of Australia.
    But………… do not panic about any of this, because Ms Reynold is still gathering feedback and awaiting Trial results before she makes any decisions.
    Now I am not the Sharpest Tool in the Shed, but I feel I have 319 Million reasons to smell a little bit of Bullshit here. But hey, I have become used to this odour from our Government of late.

    Greg Morrison
    Brisbane

Leave a Comment

Related stories