ACORN
QAgradwhite.png

General

 

Q: How much time does it take to complete an ACORN questionnaire?

A: Our Questionnaires are 19 items on average, which takes about two minutes to complete. We also have a texting option under the Mobile Forms page that allows a client to fill out the form at any point before the session. 

 

Q: How often can the ACORN questionnaire be administered and still detect change?

A: At every session. 

 

Q: What will the set-up process be like?

A: We're an online platform so you won't need to worry about downloading any software or setting up licenses. After you sign up, we'll send your staff a new user email with all of the information necessary to log in to the Toolkit. 

 

Q: Do you have a form for addiction recovery?

A: Yes. Our Recovery forms come in individual and group therapy versions.

 

Q: How do you measure outcomes in group therapy?

A: Let us know you have groups at your agency. After the groups feature has been enabled for you, you will manage it under Admin>Organization Settings. 

 

Q: Can ACORN be used for Severely Mentally Ill (SMI) populations?

A: Yes. 

Q: What if a client transfers clinicians?

A: The Toolkit automatically tracks changes in the therapists. Anyone who has seen the patient at any time can track the outcome, but the Toolkit will display who the most recent clinician is. In the case of a clean transfer, this makes sense. 

Some are multidisciplinary, where a patient may see more than one provider (therapist & prescriber). In these cases, assigning the outcome to a particular clinician doesn't make much sense, as the case really belongs to the team.  So, depending on the nature of the clinic, the responsibility for the case may rest with a particular clinician, or really is seen as shared, team responsibility. 

Data and Summary Page

 
green people.png

Q: What does the green icon of people mean?

A: That icon means that the case represents the forms for a client that was filled out by a parent or guardian. The toolkit separates these cases from those that were filled out by the youth even though both entries will have the same ID number.

Untitled.png

Q: What does the blue checkmark icon mean?

A: The checkmark icon means that a registration form has been submitted for that client

 

Q: What is the case count?

A: The case count is the total number of clients that have completed at least one questionnaire within the time period specified.

 

 Q: What does effect size mean?

A: The effect size is a standardized method of measuring the magnitude of improvement among clients.

 

Q: How can I tell if my effect size is shows that I am providing effective treatment?

A: Effect sizes of 0.8 or larger are considered “providing highly effective treatment”, while effect sizes of 0.5 to 0.8 can be considered “providing effective treatment”.  Effect sizes less than .5 are considered “providing treatment that does not have a statistically meaningful impact with regard to improving outcomes”.'

 

Q: Does filling in the diagnosis details on the Client Registration form change the way effect size is calculated?

A: Yes, effect size does take into account the diagnosis(es) you provide on the client Registration form. In reality, diagnosis accounts for little of the variance in outcome, with the exception of psychotic disorders. In our predictive modeling (multivariate general linear modeling) the diagnosis cluster accounts for less than 2% of the variance in outcome. 

 

Q: Why can’t I see all of my data for all of my clients?

 A: There are a few reasons that could be causing you to be unable to see your data. Check the filters at the top of the main toolkit page. Make sure that the filters are not set in a way that might prohibit the data from being shown, Report Type and Date Range are particularly important filters to watch out for.

Go to the FAX/Forms Processed on the Home drop down menu for a complete list of your submitted forms.

If you're still having trouble after checking that your Org, Site, Clinician and Client IDs are correct, submit a request on the Help drop down menu.

pc.png

Q: What does the “Percentage of Client Improvement” graph show?

A: The Distribution of Change graph provides information on the percentage of patients who show change on the questionnaire.  The dark green represents clients who are reporting that they are benefitting from services. Change (or lack thereof) experienced by clients in the light green, yellow, and orange portions cannot be attributed reliably to the services they are receiving. Client in the dark red portion are significantly deteriorating in the context of the services they are receiving (i.e. the current design of services are not effective with this client).

2.png

Q: What is the “clinical message”?

A:  The clinical message is intended to help you identify clients who are at risk, clients who are on track, and clients who may be ready for discharge. It uses client reported data to highlight clients with specific risk factors, warn clinician of those patients at greatest risk for premature termination with a poor outcome, identify clients most likely to show gains with continued treatment, and those who are least likely to need continued services.

 

Q: How does a new episode of care get created? (Client Data page)

A: Any time you submit a Questionnaire for a new client the toolkit will create a new ‘case’ to track the data for the client over time. Any subsequent questionnaire that you submit for that client will also route into that case unless it is 120 days apart from any other questionnaire, in which event, it will be considered a separate treatment episode and will have its own case. The toolkit will also create separate cases for youth clients that were filled out by a child vs. those filled out by a guardian.

 

Graphs

 
 
graph.png

Q: How do I make/view a client graph?

A: How to create a graph (Go to1:23).

 

Q: What is the projected change (purple line)? 

A: It is the expected change your client will experience if services are helpful. This line is determined using your client’s age, initial distress score, and the information from all the other clients that are in the CCI database.

Q: What goes into calculating the Global Distress Score (GDS)?

A: The GDS is a simple average of scores from questionnaire items in four domains which include: symptoms; functionality; social; and risk. In other words, it represents the client’s perspective on how distressed they are as represented by their individual answers on the ACORN.

To calculate GDS, each rated item in the symptom section is assigned a value from 0 to 4. The values of all the items (excluding substance use questions) are added up and then divided by the total number of questions. The resulting number is the GDS value. 0 represents no distress and 4 represents the maximum level of distress.

 

Q: What is the minimum number of ACORNS needed to show progress in treatment?

A: Two

 

Q: in what direction do I want my client’s scores to be going on the graph, up or down?

A: Higher scores on the ACORN graph mean that clients are reporting that their overall level of distress is getting worse. When services are effective, we would expect the distress scores to go down and the direction of the graph to go down as well.  This means that if their graph is moving up/scores are getting higher, they are telling us that they are getting worse. In these cases we should see if changes to services or referral to a higher level of care is indicated.

 

Q: When I’m looking at the client graph page, is there anything that I should prioritize paying attention to?

A: The direction of change in Global Distress Score (if it’s going up it means the client is doing worse) and/or Self Harm score(s)

 
 

Reports

 
HR.png

Q: How does a client end up on the “high risk cases” report?

A: The high risk cases report is informed by six variables including: current GDS; change on GDS Score; current risk of self harm; change on self harm score; current substance abuse; and change on substance abuse score.  Also a clinical message in red will result in a client being included in the high risk report. If you have a client who is on this list it may be beneficial to discuss the following in supervision or think about on your own:

1. What specific concerns has ACORN identified that put the client on this list,

2. Do we have a plan to address those concerns

3. Do we have other concerns about this client’s risk

4. Do we need to change anything about how we are delivering services (e.g. frequency, modality, location, goals, etc.)

cit.png

Q: How does someone end up on the “transition report”?

A: Four consecutive sessions with GDS scores that come in below the clinical boundary line will cause a client to be added to the transition report. If you have a client who is on this list it may be beneficial to discuss the following in supervision and in session with the client:

1. Is client ready for discharge? If not, how will we know when they are?

2. What is our discharge plan?

 
 

Form Creation

 

Q: How do I request a custom form?

A: Not all questionnaires are created equal. To maintain high reliability and validity ratings, every adult ACORN form needs a total of...

 

Adult Questionnaires

13 (or more) questions. 

Forms need at least:

●      5 questions from the symptom domain

●      2 questions from the social domain

●      1 question from the functioning domain

●      1 question from the risk domain

●      1 question from the substance domain

●      3 questions about alliance

●      Additional questions can be selected from any domains you want, provided you can fit it on one page

 

Youth Questionnaires

18 (or more) questions.

Forms need at least:

●      5 questions from the symptom domain

●      2 questions from the social domain

●      1 question from the functioning domain

●      1 question from the risk domain

●      1 question from the substance domain

●      3 questions about alliance

●      And then additional questions can be selected from any domains you want, provided you can fit it on one page

 

See the items available for use by clicking on the buttons below. 

 

 
 

Administering the Form

 

Q: Why is the form given to the client at the beginning of a session and not the end?

A: There are two reasons we recommend administering forms at the start of a session.

1. ACORN items are designed to assess global distress, substance abuse, suicidal ideation over the recent past. When a clinician has the client fill out the form on a tablet, all of these questions are there at the beginning of the session to view. It's important to ask about symptoms, but this can get skipped as not everyone does a thorough check of sleep, self harm, and problems with substance abuse at every session. The bubbles are meant to help you quickly assess symptoms before the session. 

For people who text their clients the questionnaire, we suggest they pull up the session form prior to the session via the toolkit. This can be done on your phone, or any device with a browser.

 

2. Because of the way the alliance section is designed. It asks about the client's last session (thus giving the form at the beginning gives you the most up to date information about how your therapeutic alliance is going.. are there red flags?). The reason for this is so to keep symptoms and alliance all on one form. 

The alliance section used to be given in a separate questionnaire at the end. Clients did not like having to do two questionnaires. Thus, it was combined into the form format you see today. 

 
 
 

Alliance

 

Q: How does the alliance section work?

A: Therapeutic alliance has been found to predict psychotherapy outcomes more that treatment approach or experience of the therapist. But, there are a few things to know about making the most of your alliance feedback.

1. People will be polite and this is a problem. Those who report and excellent alliance early in treatment, and then mark it worse (even by a small amount) at the end of treatment (about 14%) have the worse results (average effect size of .6). 

2. The pattern associated with the best outcomes is that the client gives feedback early in therapy that the alliance was not perfect...there is room for improvement in some area. As treatment progresses, the alliance scores then get better. Overall, about 41% of cases fit this pattern, with a mean effect size of .85.  Those who report excellent alliance throughout therapy (about 45%) have a mean effect size of .78.

3. How do you get honest feedback? Communicate that you actually look at it, and continue to reference it throughout treatment. Need some tips?