Creating, Refining, and Validating Automated Discourse Codes: An introduction to nCoder and rho

June 18th, 2019

Amanda Siebert-Evenstone, University of Wisconsin-Madison
Brendan Eagan, University of Wisconsin-Madison
Zachari Swiecki, University of Wisconsin-Madison
Seung Bok Lee, Pepperdine University
Eric Hamilton, Pepperdine University
 
Email: epistemicanalytics+code@gmail.com

Creating, Refining, and Validating Automated Discourse Codes is an interactive CSCL 2019 half-day pre-conference workshop where participants will work together to analyze their own data using the nCoder and rho toolkits.
 
The goals of the workshop are for each participant to:

1. Understand how to combine qualitative and quantitative perspectives for text analysis and use two key tools for conducting such analyses,
2. Create codebooks for code validation and publication,
3. Develop, test, and validate automated classifiers to code text data, and
4. Find a meaningful result from their own data that they can refine in future work, ideally leading to the publication of a special issue on current approaches to automated text analyses.

This workshop will provide an overview of the methodology and hands-on experience with two tools:  

1. nCoder, which helps researchers develop, refine, and validate automated coding schemes, and
2. Rho, a statistical method for establishing the generalizability of inter-rater reliability metrics.

This is a data-intensive workshop where you get to develop codes for your own data, and discuss your process and results with other participants and with experts in automated data analysis.
 
For more information, please visit our workshop website: https://ncoder2019.wordpress.com/

The workshop will first introduce you to the theoretical background of these methods. Afterward, you will work in small groups with other participants to analyze your own data or sample data using nCoder and rho; workshop organizers will be on hand to answer any questions and assist with analyses. The workshop will culminate in each group presenting one result of their analyses to the rest of the participants.

If you are interested in attending the workshop, please contact us at epistemicanalytics+code@gmail.com and we will respond with next steps. If you would like to be informed about your acceptance to participate in the workshop before the early bird deadline for the conference registration, please apply to the workshop not later than May 1^st.
 
If you have any other questions, feel free to send us an email and we would be more than happy to help. Looking forward to seeing you all in Lyon!
 
Sincerely,
Amanda Siebert-Evenstone, University of Wisconsin-Madison
Brendan Eagan, University of Wisconsin-Madison
Zachari Swiecki, University of Wisconsin-Madison
Seung Bok Lee, Pepperdine University
Eric Hamilton, Pepperdine University