Main
Dr. Abhik Roy
Education
Western Michigan University
Ph.D. in Program Evaluation
Kalamazoo, MI
N/A
Dissertation. Building an Evaluation Model of Academic Advising’s Impact on Progression, Persistence, and Retention Within University Settings
Michigan Technological University
M.S. in Mathematics
Houghton, MI
N/A
Thesis. Quotient Rings of the Eisenstein Integers
West Virginia Wesleyan College
B.S. in Mathematics
Buckhannon, WV
N/A
Terminal Study. 4-Cell Embedding on a \(n\)-genus Torus
Professional Experience
Assistant Professor
West Virginia University
Morgantown, WV
2023 - 2016
- Contributed to peer-reviewed publications by authoring and submitting scholarly papers.
- Conducted rigorous evaluations of a variety of programs, projects, and grants, contributing to their optimization and effectiveness.
- Designed and implemented dynamic and interactive surveys using HTML,CSS, and JavaScript in the Qualtrics platform.
- Extracted, wrangled, and cleaned data from various remote sources; developed a range of static, active, and interactive visualizations for public reporting and/or dissemination to clients, and built web apps in Shiny.
- Instructed classes in evaluation, measurement, research methods, and survey design with an emphasis on the application of data science techniques.
- Mentored Masters and Doctoral students, guiding their academic pursuits and research activities.
Data Analyst
University of Kansas
Lawrence, KS
2016 - 2014
- Authored detailed evaluation reports, catering to the requirements of diverse stakeholders.
- Conducted research and deployed predictive statistical models aimed at enhancing student retention and graduation efforts.
- Developed web applications using Shiny and Tableau, facilitating extraction, summarization, and visualization of data from the organization’s Oracle database.
- Spearheaded comprehensive qualitative, quantitative, and mixed-methods studies and delivered presentations on findings.
Select Publications
Is it accessible? Preservice teachers’ access to computational thinking.
Contemporary Issues in Technology and Teacher Education
N/A
2023
Kale U., Kooken, A., Yuan, J., & Roy, A. (accepted)
Program Evaluation Standards for Utility Facilitate Stakeholder Internalization of Evaluative Thinking in the West Virginia Clinical Translational Science Institute
Journal of Multidisciplinary Evaluation
N/A
2023
Curtis, R., Roy, A., Lewis, N., Dooty, E. N., & Mikalik, T. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/831
Thinking Processes in Code.org: A Relational Analysis Approach to Computational Thinking Computer Science Education
Computer Science Education
N/A
2022
Kale, U., Yuan, J., & Roy, A. https://doi.org/10.1080/08993408.2022.2145549
There’s So Much to Do and Not Enough Time to Do It! A Case for Sentiment Analysis to Derive Meaning From Open Text Using Student Reflections of Engineering Activities.
American Journal of Evaluation, 42 (4), 559–576.
N/A
2021
Roy, A., & Rambo-Hernandez, K.E. https://doi.org/10.1177/1098214020962576
To design or to integrate? Instructional design versus technology integration in developing learning interventions.
Education Tech Research Dev 68, 2473–2504.
N/A
2020
Kale, U., Roy, A. & Yuan, J. https://doi.org/10.1007/s11423-020-09771-8
Using Interactive Theater to Promote Inclusive Behaviors in Teams for First-year Engineering Students: A Sustainable Approach.
Development of A Holistic Cross-Disciplinary Project Course Experience as a Research Platform for the Professional Formation of Engineers.
N/A
2020
Dey, K.C., & Rahman, M.T., & Pyrialakou, V.D., & Martinelli, D., & Rambo-Hernandez, K.E., & Fraustino, J.D., & Deskins, J., & Plein, L.C., & Roy, A.R. https://peer.asee.org/29592
General chemistry student attitudes and success with use of online homework: Traditional-Responsive versus Adaptive-Responsive.
Journal of Chemical Education, 95 (5), 691-699.
N/A
2018
Richard-Babb, M., Curtis, R., Ratcliff, B., Roy, A.R., & Mikalik, T. https://doi.org/10.1021/acs.jchemed.7b00829
To go virtual or not to go virtual, that is the question: A comparative study of face-to-face versus virtual laboratories in a physical science course.
Journal of College Science Teaching, 48 (2), 59-67.
N/A
2018
Miller, T.A., Carver, J.S., & Roy, A.R. https://www.jstor.org/stable/26616271
Reasoning-and-proving in algebra: The case of two reform-oriented U.S. textbooks.
International Journal of Educational Research 64., 92-106
N/A
2014
Davis, J.D., Smith, D.O., Roy, A.R., & Bilgic, Y. K. https://doi.org/10.1016/j.ijer.2013.06.012
What’s in a Scriven number?
Journal of MultiDisciplinary Evaluation, 8 (19), 41-45.
N/A
2012
Roy, A.R., Hobson, K.A., & Coryn, C.L.S. https://doi.org/10.56645/jmde.v8i19.372
Book Chapters
Invited Contributions
What is a Scriven number?
The American Evaluation Association Newsletter
N/A
2012
Roy, A.R., Hobson, K.A., & Coryn, C.L.S.
Active Evaluations
Healthy Start Initiative (HRSA-19-049 Total Award: $5,470,000)
West Virginia University Research Corporation
Morgantown, WV
Current - 2023
- Lead Program Evaluator & Methodologist
- Building valid and reliable survey instruments to assess participant experiences.
- Implementing process, monitoring, and impact evaluations of programmatic activities.
- Utilizing mixed methods designs to study participant data.
Teaching Science with Computational Thinking: Preparing Preservice Elementary Educators of the Future STEM Workforce (2019-NSF 2142274 Total Award: $294,958.00)
West Virginia University
Morgantown, WV
Current - 2022
- Lead Program Evaluator & Mixed Methods Analyst
- Applying mixed methods text analysis of written and interview data using thematic analysis and various machine learning methods.
- Constructing and validating survey instruments used to assess progress and programmatic impact.
- Implementing process and impact evaluations of program activities.
Completed Evaluations
WVCTSI: West Virginia Clinical and Translational Science Institute (2017-NIH 2U54GM104942-02 Total Award: $20,000,000)
West Virginia University
Morgantown, WV
2022 - 2017
- Program Evaluator & Data Scientist
- Analyzed large data sets using frequentist and Bayesian methods.
- Conducted local and multi-site mutli-cluster evaluation studies.
- Developed/validated items and distributing customized Qualtrics surveys built with CSS and Javascript.
- Mentored future graduate social data scientists.
- Pulled, wrangled, and visualized secondary data
Appalachian Gerontology Experiences - Advancing Diversity in Aging Research (2020-NIH 1R25AG059558-01A1 Total Award: $678,000)
West Virginia University
Morgantown, WV
2020 - 2021
- Lead Program Evaluator
- Developed and distributing customized Qualtrics surveys built with CSS and Javascript.
- Performed various evaluative studies addressing program efficacy and engagement.
Research Initiative: A Holistic Cross-Disciplinary Project Experience as a Platform to Advance the Professional Formation of Engineers (2019-NSF 1927232 Total Award: $200,000)
West Virginia University
Morgantown, WV
2020 - 2022
- Methodological Advisor & Research Specialist
- Mentored engineering faculty and graduate students on the implementation of research methods.
- Conducted quantitative and qualitative studies on undergraduate student experiences within grant related programs.
Stepping UP with Avenue: Progress Monitoring: A Software Suite Helping Teachers Improve Literacy Progress For Deaf/Hard Of Hearing Students (2017-ED H327S170012 Total Award: $2,470,440)
Pennsylvania State University
State College, PA
2018 - 2017
- Lead Program Evaluator
- Administered product and program evaluations of existing tools and activities.
Cultivating Inclusive Identities of Engineers and Computer Scientists: Expanding Efforts to Infuse Inclusive Excellence in Undergraduate Curricula (2017-NSF 1725880 Total Award: $2,000,000)
West Virginia University
Morgantown, WV
2018 - 2017
- Lead Program Evaluator
- Conducted personnel and program evaluations of existing members and interventions.
- Created and implemented various text analysis methods.
GAUSSI: Generating, Analyzing, and Understanding Sensory and Sequencing Information: A Trans-Disciplinary Graduate Training Program in Biosensing and Computational Biology (2017-NSF 1450032 Total Award: $3,013,779)
Colorado State University
Fort Collins, CO
2020 - 2017
- Lead Program Evaluator
- Conducted unstructured and semi-structured interviews and focus groups assessing participant experiences.
- Implemented mixed methods evaluations to study program impacts on students and faculty.
Presentations
Let’s Get Sentimental: Machine Learning Aided Data Analysis for Large Qualitative Data Sets
American Evaluation Association Annual Conference
New Orleans, LA
2022
Seidel, T. , Ferguson, C.F., & Roy, A.R.
Best of Both Worlds: Affordances of Mixing Machine Learning and Qualitative Content Analysis
American Educational Research Association Annual Meeting
San Diego, CA
2022
Roy, A.R., Ferguson, C.F., Curtis, R., & Babb-Richards, M.
These Aren’t Random Words Just Strung Together?: Using Machine Learning and Pretty Visualizations to Discover Topics in Articles.
American Evaluation Association Annual Conference
virtual
2020
Roy, A.R.
Little Fish in a Big Pond, Only Fish in a Little Pond: How Roles Shape our Identities as Evaluators.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
M, Loomis, D.L., Mikalik, T.L., Curtis, R., Roy, A.R., & Bernstein, M.
Evolving Program Logic Models to Meet Shifting Program Needs: The Case of WV Clinical Translational Science Institute.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
Curtis, R., Roy, A.R., Bernstein, M, Loomis, D.L., & Mikalik, T.L.
The Value of External Evaluators When Building Clinical Translational Research Infrastructure.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
Curtis, R., Roy, A.R., Bernstein, M, Loomis, D.L., & Mikalik, T.L.
Using Associated Networks to Evaluate Content within Courses.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
Roy, A.R., Kale, U, & Yuan, J.
Why Is It That Writers Write but Fingers Don’t Fing? Using Machine Learning and Lexemes to Make Sense of Nonsense.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
Roy, A.R., Curtis, R., Mikalik, T.L., Loomis, D.L., & Bernstein, M.
Discovering the Underlying Meaning Behind Get Me Off Your F***ing Mailing List? and Most Other Narratives.
American Evaluation Association Annual Conference
Minneapolis, MN
2019
Roy, A.R., Curtis, R., Mikalik, T.L., Loomis, D.L., & Bernstein, M.
Assessing for Improvement: The Use of Artificial Intelligence to Uncover Potential Differential Impact of Assignments.
American Evaluation Association Annual Conference
Toronto, CN
2019
Roy, A.R. & Rambo-Hernandez, K.
Using a Mixed Methods Evaluation to Discover How an Interactive Theater Based Model Stimulates Inclusive Behaviors in Engineering.
American Evaluation Association Annual Conference
Cleveland, OH
2018
Roy, A.R., Rambo-Hernandez, K., Hensel, R.A., & Morris, M.L.
Examining the Past and Looking Forward: The Future of Evaluation Theory and Use.
American Evaluation Association Annual Conference
Cleveland, OH
2018
Roy, A.R. & Hobson, K.A.
Transforming Graduate STEM Education: A Theory-Driven Evaluation of the GAUSSI National Science Foundation Research Training (NRT) Program.
American Evaluation Association Annual Conference
Washington, DC
2017
Roy, A.R., Hernandez, P.A., Chen, T., & Paguyo, C.
Program Evaluation for Everyone! - Constructing an Online Foundational Course for Capacity Building using Theorists as a Focus.
American Evaluation Association Annual Conference
Washington, DC
2017
Roy, A.R. & Curtis, R.P.
Content in the Background: Using Evaluation Theorists as the Principal Motivator for Foundational Evaluation Courses.
Hawaii-Pacific Evaluation Association Annual Conference
Kane’ohe, HI
2017
Roy, A.R. & Curtis, R.P.
Survey Says! Students Getting Tired of Surveys.
National Academic Advising Association Annual Conference
Las Vegas, NV
2015
Roy, A.R. & Goetz, H.L.
Influences of Hierarchical Linear Modeling in Evaluation.
Aotearoa New Zealand Evaluation Association Annual Conference
Auckland, NZ
2013
Roy, A.R. & Goetz, H.L.
Survey sample methods: Evaluators’ toolbox refreshment.
American Evaluation Association Annual Conference
Minneapolis, MN
2012
Roy, A.R. & Hobson, K.A.
Teaching Experience in Evaluation and Methodology (2016 - 2023)
Data Visualization
West Virginia University
Morgantown, WV
2020 - 2018
2020, 2018
Educational Psychology
West Virginia University
Morgantown, WV
2017
2017
Educational Research
West Virginia University
Morgantown, WV
2016
2016
Introduction to Research
West Virginia University
Morgantown, WV
2022 - 2016
2022, 2018, 2017, 2016
Measurement/Evaluation in Educational Psychology
West Virginia University
Morgantown, WV
2020 - 2018
2022, 2020, 2018
Mixing Research Methodologies
West Virginia University
Morgantown, WV
2019 - 2017
2022, 2019, 2018, 2017
Program Evaluation
West Virginia University
Morgantown, WV
2023 - 2017
2023, 2022, 2021, 2020, 2019, 2018, 2017
Statistical Methods 1
West Virginia University
Morgantown, WV
2021 - 2017
2021, 2020, 2019, 2018, 2017
Survey Design
West Virginia University
Morgantown, WV
2020 - 2022
2022, 2020
Teaching Experience in Mathematics (2005 - 2015)
Business Calculus
Central Michigan University
Mount Pleasant, MI
2008
College Algebra
Central Michigan University
Mount Pleasant, MI
2009
Discrete Mathematics
Pittsburgh State University
Pittsburgh, KS
2012
Elementary Statistics
Pittsburgh State University
Pittsburgh, KS
2014
Foundations of Statistics
Pittsburgh State University
Pittsburgh, KS
2010 - 2009
2009, 2010
Intermediate Algebra
Central Michigan University
Mount Pleasant, MI
2008 - 2007
2007, 2008
Integral Calculus
Michigan Technological University
Houghton, MI
2007
Linear Algebra
University of Kansas
Lawrence, KS
2015 - 2014
2014, 2015
Mathematical Thinking Grades 6-12
Western Michigan University
Kalamazoo, MI
2013
Mathematics Curriculum Grades 6-12
Western Michigan University
Kalamazoo, MI
2014 - 2013
2013, 2014
Multivariable Calculus
Michigan Technological University
Houghton, MI
2005
Single Variable Calculus
Michigan Technological University
Houghton, MI
2007 - 2006
2006, 2007
Service
Memberships
American Evaluation Association
N/A
N/A
2022 - 2012
Social network analysis: Finding meaning in connections.
Nova Science Publishers, Inc.
N/A
2014
Roy, A.R. 978-1-53612-734-8