1. Silver, R.A. Neuronal arithmetic. Nat. Rev. Neurosci. 2010, 11, 474–489. [CrossRef] [PubMed]
2. Ferguson, K.A.; Cardin, J.A. Mechanisms underlying gain modulation in the cortex. Nat. Neurosci. Rev. 2020,
21, 80–92. [CrossRef] [PubMed]
3. Salinas, E. Gain Modulation. In Encyclopedia of Neuroscience; Squire, L.R., Ed.; Academic Press: Oxford, UK,
2009; Volume 4, pp. 485–490.
4. Carandini, M.; Heeger, D.J. Normalization as a canonical neural computation. Nat. Rev. Neurosci. 2012, 13,
51–62. [CrossRef] [PubMed]
5. Eldar, E.; Cohen, J.D.; Niv, Y. The effects of neural gain on attention and learning. Nat. Neurosci. 2013, 16,
1146–1153. [CrossRef] [PubMed]
6. Phillips, W.A.; Clark, A.; Silverstein, S.M. On the functions, mechanisms, and malfunctions of intracortical
contextual modulation. Neurosci. Biobehav. Rev. 2015, 52, 1–20. [CrossRef]
7. Rolls, E.T. Cerebral Cortex: Principles of Operation; Oxford University Press: Oxford, UK, 2016.
8. Larkum, M.E.; Zhu, J.J.; Sakmann, B. A new cellular mechanism for coupling inputs arriving at different
cortical layers. Nature 1999, 98, 338–341. [CrossRef]
9. Larkum, M. A cellular mechanism for cortical associations: An organizing principle for the cerebral cortex.
Trends Neurosci. 2013, 36, 141–151. [CrossRef]
10. Major, G.; Larkum, M.E.; Schiller, J. Active properties of neocortical pyramidal neuron dendrites.
Annu. Rev. Neurosci. 2013, 36, 1–24. [CrossRef]
11. Jadi, J.P.; Behabadi, B.F.; Poleg-Polsky, A.; Schiller, J.; Mel, B.W. An augmented two-layer model captures
nonlinear analog spatial integration effects in pyramidal neuron dendrites. Proc. IEEE 2014, 102, 782–798.
[CrossRef]
12. Lamme, V.A.F. Beyond the classical receptive field: Contextual modulation of V1 responses. In The Visual
Neurosciences; Werner, J.S., Chalupa, L.M., Eds.; MIT Press: Cambridge, MA, USA, 2004; pp. 720–732.
13. Phillips, W.A. Cognitive functions of intracellular mechanisms for contextual amplification. Brain Cogn. 2017,
112, 39–53. [CrossRef]
14. Gilbert, C.; Li, W. Top-down influences on visual processing. Nat. Rev. Neurosci. 2013, 14, 350–363. [CrossRef]
15. Li, Z. Border ownership from intracortical interactions in visual area V2. Neuron 2005, 47, 143–153.
16. Mehrani, P.; Tsotsos, J.K. Early recurrence enables figure border ownership. arXiv 2019. arXiv:1901.03201.
17. Schwartz, O.; Hsu, A.; Dayan, P. Space and time in visual context. Nat. Rev. Neurosci. 2007, 8, 522–535.
[CrossRef] [PubMed]
18. Sharpee, T.O.; Victor, J.D. Contextual modulation of V1 receptive fields depends on their spatial symmetry.
J. Comput. Neurosci. 2008, 26, 203–218. [CrossRef] [PubMed]
19. Zhou, H.; Schafer, R.J.; Desimone, R. Pulvinar-cortex interactions in vision and attention. Neuron 2016, 89,
209–220. [CrossRef]
20. Reynolds, J.H.; Heeger, D.J. The normalization model of attention. Neuron 2009, 61, 168–185 [CrossRef]
21. Rothenstein, A.L.; Tsotsos, J.K. Attentional modulation and selection—An integrated approach. PLoS ONE
2014, 9. [CrossRef]
Symmetry 2020, 12, 815 25 of 26
22. Shipp, S.; Adams, D.L.; Moutoussis, K.; Zeki, S. Feature binding in the feedback layers of area V2. Cereb. Cortex 2009, 19, 2230–2239. [CrossRef]
23. Siegel, M.; Körding, K.P.; König, P. Integrating top-down and bottom-up sensory processing by somato-dendritic interactions. J. Comput. Neurosci. 2000, 8, 161–173. [CrossRef]
24. Spratling, M.W.; Johnson, M.H. A feedback model of visual attention. J. Cogn. Neurosci. 2004, 16, 219–237. [CrossRef] [PubMed]
25. Phillips, W.A.; Kay, J.; Smyth, D. The discovery of structure by multi-stream networks of local processors with contextual guidance. Netw. Comput. Neural Syst. 1995, 6, 225–246. [CrossRef]
26. Kay, J.; Floreano, D.; Phillips, W.A. Contextually guided unsupervised learning using local multivariate binary processors. Neural Netw. 1998, 11, 117–140. [CrossRef]
27. Kay, J.W.; Phillips, W.A. Coherent infomax as a computational goal for neural systems. Bull. Math. Biol. 2011, 73, 344–372. [CrossRef] [PubMed]
28. Lizier, J.T.; Bertschinger, N.; Jost, J.; Wibral, M. Information Decomposition of Target Effects from Multi-Source Interactions: Perspectives on Previous, Current and Future Work. Entropy 2018, 20, 307. [CrossRef]
29. Kay, J.W.; Ince, R.A.A.; Dering, B.; Phillips, W.A. Partial and Entropic Information Decompositions of a Neuronal Modulatory Interaction. Entropy 2017, 19, 560. [CrossRef]
30. Williams, P.L.; Beer, R.D. Nonnegative decomposition of multivariate information. arXiv 2010, arXiv:1004.2515.
31. Wibral, M.; Lizier, J.T.; Priesemann, V. Bits from brains for biologically inspired computing. Comput. Intell.
2015, 2, 5. [CrossRef]
32. Wibral, M.; Priesemann, V.; Kay, J.W.; Lizier, J.T.; Phillips, W.A. Partial information decomposition as a
unified approach to the specification of neural goal functions. Brain Cogn. 2017, 112, 25–38. [CrossRef]
33. Salinas, E. Fast remapping of sensory stimuli onto motor actions on the basis of contextual modulation.
J. Neurosci. 2004, 24, 1113–1118. [CrossRef]
34. Phillips, W.A.; Larkum, M.E.; Harley, C.W.; Silverstein, S.M. The effects of arousal on apical amplification
and conscious state. Neurosci. Conscious. 2016, 2016, 1–13. [CrossRef] [PubMed]
35. Helmholtz, H. Handbuch der Physiologischen Optik; Southall, J.P.C., Ed.; English trans.; Dover: New York, NY,
USA, 1962; Volume 3.
36. Sherman, S.M.; Guillery, R.W. On the actions that one nerve cell can have on another: Distinguishing ‘drivers’
from ‘modulators’. Proc. Natl. Acad. Sci. USA 1998, 95, 7121–7126. [CrossRef] [PubMed]
37. Phillips, W.A. Mindful neurons. Q. J. Exp. Psychol. 2019, 72, 661–672. [CrossRef]
38. Lillicrap, T.P.; Santoro, A.; Marris, L.; Akerman, C.J.; Hinton, G. Backpropagation and the brain.
Nat. Rev. Neurosci. 2020. [CrossRef]
39. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [CrossRef]
40. Cover, T.M.; Thomas, J.A. Elements of Information Theory; Wiley-Interscience: New York, NY, USA, 1991.
41. McGill, W.J. Multivariate Information Transmission. Psychometrika 1954, 19, 97–116. [CrossRef]
42. Schneidman, E.; Bialek, W.; Berry, M.J. Synergy, Redundancy, and Population Codes. J. Neurosci. 2003, 23,
11539–11553. [CrossRef]
43. Gat, I.; Tishby, N. Synergy and redundancy among brain cells of behaving monkeys. In Proceedings of the
1998 Conference on Advances in Neural Information Processing Systems 2, Denver, CO, USA, 30 November–5
December 1998; MIT Press: Cambridge, MA, USA, 1999; pp. 111–117.
44. Wibral, M.; Finn, C.; Wollstadt, P.; Lizier, J.T.; Priesemann, V. Quantifying Information Modification in
Developing Neural Networks via Partial Information Decomposition. Entropy 2017, 19, 494. [CrossRef]
45. Ince, R.A.A.; Giordano, B.L.; Kayser, C.; Rousselet, G.A.; Gross, J.; Schyns, P.G. A Statistical Framework for Neuroimaging Data Analysis Based on Mutual Information Estimated via a Gaussian Copula.
Hum. Brain Mapp. 2017, 38, 1541–1573. [CrossRef]
46. Park, H.; Ince, R.A.A.; Schyns, P.G.; Thut, G.; Gross, J. Representational interactions during audiovisual
speech entrainment: Redundancy in left posterior superior temporal gyrus and synergy in left motor cortex.
PLoS Biol. 2018, 16, e2006558. [CrossRef]
47. James, R.G.; Ellison, C.J.; Crutchfield, J.P. A Python package for discrete information theory. J. Open
Source Softw. 2018, 25, 738. [CrossRef]
48. Harder, M.; Salge, C.; Polani, D. Bivariate measure of redundant information. Phys. Rev. E 2013, 87.
[CrossRef] [PubMed]
Symmetry 2020, 12, 815 26 of 26
49. Bertschinger, N.; Rauh, J.; Olbrich, E.; Jost, J.; Ay, N. Quantifying Unique Information. Entropy 2014, 16, 2161–2183. [CrossRef]
50. Griffith, V.; Koch, C. Quantifying synergistic mutual information. In Guided Self-Organization: Inception. Emergence, Complexity and Computation; Springer: Berlin/Heidelberg, Germany, 2014; Volume 9, pp.159–190.
51. Ince, R.A.A. Measuring multivariate redundant information with pointwise common change in surprisal.
Entropy 2017, 19, 318. [CrossRef]
52. James, R.G.; Emenheiser, J.; Crutchfield, J.P. Unique Information via Dependency Constraints. J. Phys.
Math. Theor. 2018, 52, 014002. [CrossRef]
53. Finn, C.; Lizier, J.T. Pointwise Partial Information Decomposition Using the Specificity and Ambiguity
Lattices. Entropy 2018, 20, 297. [CrossRef]
54. Makkeh, A.; Gutknecht, A.J; Wibral, M. A differentiable measure of pointwise shared information. arXiv
2020, arXiv:2002.03356.
55. Lizier, J.T. Measuring the Dynamics of Information Processing on a Local Scale. In Directed Information
Measures in Neuroscience; Wibral, M., Vicente, R., Lizier, J.T., Eds.; Springer: Heidelberg, Germany, 2014;
pp. 161–193.
56. Shai, A.S.; Anastassiou, C.A.; Larkum, M.E.; Koch, C. Physiology of Layer 5 Pyramidal Neurons in Mouse
Primary Visual Cortex: Coincidence Detection through Bursting. PLoS Comput. Biol. 2015, 1, e1004090.
[CrossRef]
57. Available online: https://senselab.med.yale.edu/ModelDB/ShowModel.cshtml?model=180373&file=
/ShaiEtAl2015/data/spikes_.dat#tabs-2 (accessed on 2 May 2020).
58. Salinas, E.; Their, P. Gain modulation: A major computational principle of the central nervous system. Neuron
2000, 27, 15–21. [CrossRef]
59. Salinas, E.; Sejnowski, T.J. Gain modulation in the central nervous system: Where behavior, neurophysiology,
and computation meet. Neuroscientist 2001, 7, 430–440. [CrossRef]
60. Timme, N.M.; Ito, S.; Myroshnychenko, M.; Nigam, S.; Shimono, M.; Yeh, F.C.; Hottowy, P.; Litke, A.M.;
Beggs, J.M. High-Degree Neurons Feed Cortical Computations. PLoS Comput. Biol. 2016, 12, 1–31. [CrossRef] [PubMed]
References
References