Neural representation dynamics reveal computational principles of cognitive task learning

Poster No:

941 

Submission Type:

Abstract Submission 

Authors:

Ravi Mill1, Michael Cole1

Institutions:

1Rutgers University-Newark, Newark, NJ

First Author:

Ravi Mill  
Rutgers University-Newark
Newark, NJ

Co-Author:

Michael Cole  
Rutgers University-Newark
Newark, NJ

Introduction:

Learning cognitive tasks is a ubiquitous feature of everyday life, yet the neural basis for this essential human skill remains unclear. During learning, neural task representations must be rapidly constructed for novel task performance, then optimized for robust practiced task performance. The present study interrogated changes to neural representational geometry that underpin this transition from novel to practiced task performance. We integrated computational ideas from multiple neuroscientific sub-fields (long-term memory, contextual decision-making and cognitive control) to test a task learning framework underpinned by subcortical-cortical representational dynamics (Figure 1). The core hypothesis of this framework is that practice involves a shift in the brain from compositional representations (task-general activity patterns that can be flexibly reused across tasks) to conjunctive representations (task-specific activity patterns specialized for the current task).
Supporting Image: Fig1.jpg
   ·Fig 1. Hypothesized cortical-subcortical dynamics underlying the transition from compositional to conjunctive neural representations over task learning.
 

Methods:

Multiband functional MRI (fMRI) data were recorded from 44 healthy young adults (age mean=22.25, age range=18-36; 23 female) as they performed 2 sessions of our newly developed concrete permuted rule operations (C-PRO2) paradigm. This allows for the presentation of 64 distinct multi-sensory tasks, based on permutations of individual logic, sensory and motor rules (Figure 2). In the first session (Practice), subjects practiced a subset of 4 tasks repeatedly. In the second session (Test), these practiced tasks were intermixed with the remaining 60 novel tasks. The design therefore enabled fMRI recording as multiple complex tasks were performed from first novel presentation through repeated practice. The resulting fMRI data underwent preprocessing (Glasser et al., 2013) and general linear modeling to estimate task activations for cortical vertices and subcortical voxels. A functional atlas (Glasser et al., 2016; Ji, Spronk et al., 2019) was used to affiliate these vertices/voxels to regions and large-scale functional networks, which was key for our multivariate analyses.
Supporting Image: Fig2.jpg
   ·Fig 2. C-PRO2 task design. Depicted is one example task trial and accompanying correct response. This format was preserved for all 64 tasks, across practiced/novel tasks and Practice/Test sessions.
 

Results:

We firstly observed behavioral evidence of learning, in the form of improvements to accuracy and reaction time as tasks were repeatedly practiced. We then developed analytic methods inspired by multivariate pattern analysis and machine learning to interrogate changes to neural representational geometry that underpinned these behavioral practice effects. Specifically, novel tasks presented in the held-out Test session were used to build neural templates of individual (i.e. compositional) rule types, and their non-linear interaction (i.e. conjunction). These were fit simultaneously via multiple linear regression to each of the practiced tasks in the Practice session, so as to dynamically quantify the strength of rule compositions and rule conjunctions over task learning. The results substantiated the hypothesized dynamic shift from compositional to conjunctive representations with repeated task practice. Further, we found that conjunctions originated in subcortex (hippocampus and cerebellum) and slowly spread to cortex. Critically, it was the strengthening of conjunctive representations in cortex that was uniquely associated with signatures of effective task practice (improved behavior and reduced task interference).

Conclusions:

Our findings reveal a precise neural mechanism underlying changes to neural representational geometry that occur over learning: increasing non-linear conjunction (binding) of task rule elements. This extends computational concepts from long-term memory (O'Reilly & Rudy, 2001) and contextual decision-making (Kikumoto & Mayr, 2020) to the domain of cognitive task learning. The formation of cortical conjunctive representations hence serves as a computational mechanism of effective task practice, reflecting cortical-subcortical dynamics that optimize task representations in the human brain.

Higher Cognitive Functions:

Executive Function, Cognitive Control and Decision Making 1

Learning and Memory:

Learning and Memory Other 2

Keywords:

Cognition
Cortex
Experimental Design
FUNCTIONAL MRI
Learning
Machine Learning
Memory
Motor
Sub-Cortical

1|2Indicates the priority used for review

Provide references using author date format

Glasser, M. F., Coalson, T. S., Robinson, E. C., Hacker, C. D., Harwell, J., Yacoub, E., Ugurbil, K., Andersson, J., Beckmann, C. F., Jenkinson, M., Smith, S. M., & Van Essen, D. C. (2016). A multi-modal parcellation of human cerebral cortex. Nature, 536(7615), 171–178. https://doi.org/10.1038/nature18933
Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., Xu, J., Jbabdi, S., Webster, M., Polimeni, J. R., Van Essen, D. C., Jenkinson, M., & WU-Minn HCP Consortium. (2013). The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage, 80, 105–124. https://doi.org/10.1016/j.neuroimage.2013.04.127
Ji, J. L., Spronk, M., Kulkarni, K., Repovš, G., Anticevic, A., & Cole, M. W. (2019). Mapping the human brain’s cortical-subcortical functional network organization. NeuroImage, 185, 35–57. https://doi.org/10.1016/j.neuroimage.2018.10.006
Kikumoto, A., & Mayr, U. (2020). Conjunctive representations that integrate stimuli, responses, and rules are critical for action selection. Proceedings of the National Academy of Sciences, 117(19), 10603–10608. https://doi.org/10.1073/pnas.1922166117
O’Reilly, R. C., & Rudy, J. W. (2001). Conjunctive representations in learning and memory: Principles of cortical and hippocampal function. Psychological Review, 108(2), 311–345. https://doi.org/10.1037/0033-295X.108.2.311