Cognitive Modeling - WS 2011/12
Holger Schultheis, Thomas Barkowsky, Christian Freksa
Winter 2011/12
Mondays 8:45 - 10:15h & 10:30 - 12:00h Cartesium Rotunde
4 SWS (ECTS: 6)
Syllabus
A Introduction
1) 31 Oct 11:
- Introduction to Cognitive Modeling (further reading: Sun (2008))
- Distribution of topics for the presentations
- Introduction to Production Systems (further reading: Davis & King (1985))
- Homework: Get Octave installed and running + Exercise 1
B Cognitive Architectures & ACT-R
2) 07 Nov 11:
- Why & How of Cognitive Architectures (Newell (1973); Lehman et al. (1996, pp. 1 - 4))
- Introduction to ACT-R (Anderson et al. (2004))
- Homework: Get ACT-R installed and running
- Practical introduction to ACT-R: ACT-R Tutorials I and II
- Practical introduction to ACT-R: ACT-R Tutorials III and IV (old)
- Presentation and discussion of solutions to Exercise 1
- Homework: Exercise 2
C Philosophical Considerations
4) 21 Nov 11:
- Can a machine think? (Copeland (1993), Chapter 3)
- Cognition as symbol manipulation?; Chinese Room argument (Copeland (1993), Chapters 4 & 6)
D Connectionism
5) 28 Nov 11:
- Connectionist Models of Cognition (Thomas & McClelland (2008))
- (Multi-Layer) Perceptrons and Backpropagation (Russell & Norvig (2003, pp. 736 - 748))
- Presentation and discussion of solutions to Exercise 2
- Homework: Exercise 3
6) 05 Dec 11:
- The nature of Connectionism and notes on computability (Copeland (1993))
- The role of Connectionism in Cognitive Science (McCloskey (1991))
E Parameter Estimation
7) 12 Dec 11:
- Markov Chain Monte Carlo Approaches (Madras (2002, chapter 4); Usher & McClelland (2001, Appendix E))
- Gradient Descent and related methods (Snyman (2005, chapters 1, 2.1, 2.3 (excluding 2.3.2)); Russel & Norvig (2003, pp. 110 - 122 (excluding "local beam search" and "genetic algorithms")))
- Presentation and discussion of solutions to Exercise 3
- Homework: Exercise 4
- Points for Exercise 4a: points.mat; function values for Exercise 4a: vals.mat
F Dynamic Systems
8) 19 Dec 11:
- Dynamic Systems in Cognitive Science (van Gelder (1998))
- Dynamic Field Theory (Schöner (2008))
- Homework: Install odepkg in Octave
9) 09 Jan 12:
- Formulation and Analysis of Dynamic Systems (Busemeyer (2003))
- Numerically Solving of ODEs: Generally and in Octave (Press et al. (2007, pp. 899 - 915 (excluding 17.0.2 & 17.0.3)); Octave stuff)
- Presentation and discussion of solutions to Exercise 4
- Homework: Exercise 5
G Model Evaluation
10) 16 Jan 12:
- Early thoughts on Evaluation (Grant (1962))
- Three criteria for Evaluation (Roberts & Pashler (2000))
11) 23 Jan 12:
- Model Complexity in Evaluation (Pitt & Myung (2002))
- Overview of Evaluation Methods (Schiffrin et al. (2008, pp. 1248 - 1260))
- Presentation and discussion of solutions to Exercise 5
12) 30 Jan 12:
- Bootstrapping for model evaluation: Basics (Efron & Tibshirani (1993, chapters 4 - 6 (excluding 4.4, 5.4, 6.5 - 6.7)))
- Bootstrapping for model evaluation: Estimating prediction errors (Efron & Tibshirani (1993, chapter 17), Efron & Tibshirani (1997, pp. 1 - 3))
- Homework: Exercise 6
H Advanced Topics & Applications
- An abstract language for cognitive modeling (Jones et al. (2006))
- Adaptive Mesh Refinement in cognitive modeling (Best et al. (2009))
- Presentation and discussion of solutions to Exercise 6
- Homework: Exercise 7
14) 13 Feb 12:
- Application 1: Improving cell phone interaction (St. Amant et al. (2007))
- Application 2: Tutoring students (Corbet et al. (1995))
- Presentation and discussion of solutions to Exercise 7
Reading Material
All reading material will be made available as pdf files once the course starts.
- Anderson, J. R. et al. (2004). An integrated theory of the mind. Psychological Review, 111.
- Best, B.J., Furjanic, C., Gerhart, N., Fincham, J. M., Gluck, K. A., Gunzelmann, G., Krusmark, M., (2009). Adaptive Mesh Refinement for Efficient Exploration of Cognitive Architectures and Cognitive Models. In Proceedings of the 9th International Conference of Cognitive Modeling, Manchester, United Kingdom.
- Busemeyer, J. R. (2003). Dynamic Systems. In L. Nadel (Ed.), Encyclopedia of cognitive science. London, UK: Macmillan Publishers.
- Copeland, J. (1993). Artificial intelligence: A philosophical introduction. , MA: Blackwell Publishing.
- Corbett, A.T., Anderson, J. R., & O'Brien, A.T. (1995). Student modeling in the ACT Programming Tutor. In P. Nichols, S. Chipman and B. Brennan (eds.) Cognitively Diagnostic Assessment. Hillsdale, NJ: Erlbaum.
- Davis, R., & King, J. J. (1985). The origin of rule-based systems in AI. In B. G. Buchanan and E. H. Shortliffe (Eds.), Rule-Based Expert Systems. Reading, MA: Addison-Wesley.
- Efron, B., & Tibshirani, R. J. (1993). An introduction to the Bootstrap. New York: Chapman & Hall.
- Efron, B. & Tibshirani, R. J. (1997). Improvements on Cross-Validation: The .632+ Bootstrap method. Journal of the American Statistical Association, 92.
- Grant, D. A. (1962). Testing the null hypothesis and the strategy and tactics of investigating theoretical models. Psychological Review, 69.
- Jones, R. M., Crossman, J. A., Lebiere, C., & Best, B. J. (2006). An abstract language for cognitive modeling. In Proceedings of the Seventh International Conference on Cognitive Modeling. Trieste, Italy.
- Lehman, J. F., Laird, J., & Rosenbloom, P. (1996). A gentle introduction to Soar, an architecture for human cognition.In S. Sternberg & D. Scarborough (Eds.), Invitation to cognitive science, Volume 4. Cambridge, MA: MIT Press.
- Madras, N. N. (2002). Lectures on Monte Carlo Methods. Providence, Rhode Island: American Mathematical Society.
- McCloskey, M. (1991). Networks and theories: The place of connectionism in cognitive science. Psychological Science, 2.
- Pitt, M. A., Myung, J. (2002). When a good fit can be bad. Trends in Cognitive Sciences, 6(10).
- Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. (2007). Numerical Recipes: The Art of Scientific Computing. Cambridge: Cambridge University Press.
- Newell, A. (1973). You can't play 20 questions with nature and win: Projective comments on the papers of this symposium. In W. G. Chase (Ed.), Visual Information Processing, New York: Academic Press.
- Roberts, S., & Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107.
- Russell, S., & Norvig, P. (2003). Artificial intelligence: A modern approach. Upper Saddle River, NJ: Pearson Education.
- Schöner, G. (2008). Dynamical systems approaches to cognition. In R. Sun (Ed.), The Cambridge Handbook of Computational Psychology. New York, NY: Cambridge University Press.
- Snyman, J. A. (2005). Practical Mathematical Optimization. Berlin: Springer.
- St. Amant, R., Horton, T. E., & Ritter, F. E. (2007). Model-based evaluation of expert cell phone menu interaction. ACM Transactions on Computer-Human Interaction, 14(1).
- Sun, R. (2008). Introduction to computational cognitive modeling. In R. Sun (Ed.), The Cambridge Handbook of Computational Psychology. New York, NY: Cambridge University Press.
- Thomas, M. S. C., & McClelland, J. L. (2008). Connectionist models of Cognition. In R. Sun (Ed.), The Cambridge Handbook of Computational Psychology. New York, NY: Cambridge University Press.
- Usher, M., & McClelland, J. L. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108.
- van Gelder, T. (1998). The dynamical hypothesis in cognitive science. Behavioral and Brain Sciences, 21.
- Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E.-J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32.
Assignments / Credits
- to read all papers,
- to prepare 2 questions regarding each topic (based on the reading material for this topic),
- to present at least one topic,
- to solve 7 exercises, and
- to present and discuss your solutions to the exercises.
Return dates for your completed exercises:
Collaboration vs. Cheating
We much encourage collaboration and collaborative work will be especially required when completing your exercises. However, collaboration is to be sharply distinguished from cheating. No forms of cheating (including plagiarism) will be tolerated! If you do, rest assured that we will find out about it. Should you be caught cheating, this will result in your automatic failure of the course.
Exam
Technical discussions ("Fachgespräche") in Cognitive Modeling are scheduled for Wednesday, 29 Feb 12 (and Friday, 23 Mar 12, for repeaters). To participate in a technical discussion, please register by 14 Feb 12 (or by 11 Mar 12, for repeaters) by sending an email to cosy@informatik.uni-bremen.de. The email should list the names of all participants of the group (one email per group is enough). Please note that the successful completion of the exercises is a precondition for registering for a technical discussion.
