{"id":114148,"date":"2025-09-04T14:21:21","date_gmt":"2025-09-04T14:21:21","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/114148\/"},"modified":"2025-09-04T14:21:21","modified_gmt":"2025-09-04T14:21:21","slug":"training-of-physical-neural-networks","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/114148\/","title":{"rendered":"Training of physical neural networks"},"content":{"rendered":"

Samborska, V. Scaling up: how increasing inputs has made artificial intelligence more capable. Our World in Data https:\/\/ourworldindata.org\/scaling-up-ai<\/a> (2025).<\/p>\n

Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R. & Eleftheriou, E. Memory devices and applications for in-memory computing. Nat. Nanotechnol. 15, 529\u2013544 (2020).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Wetzstein, G. et al. Inference in artificial intelligence with deep optics and photonics. Nature 588, 39\u201347 (2020).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Wright, L. G. et al. Deep physical neural networks trained with backpropagation. Nature 601, 549\u2013555 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Tanaka, G. et al. Recent advances in physical reservoir computing: a review. Neural Netw. 115, 100\u2013123 (2019).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hughes, T. W., Williamson, I. A., Minkov, M. & Fan, S. Wave physics as an analog recurrent neural network. Sci. Adv. 5, eaay6946 (2019).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Onodera, T. et al. Scaling on-chip photonic neural processors using arbitrarily programmable wave propagation. Preprint at https:\/\/arxiv.org\/abs\/2402.17750<\/a> (2024).<\/p>\n

Momeni, A., Rahmani, B., Mall\u00e9jac, M., del Hougne, P. & Fleury, R. Backpropagation-free training of deep physical neural networks. Science 382, 1297\u20131303 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Xu, Z. et al. Large-scale photonic chiplet Taichi empowers 160-TOPS\/W artificial general intelligence. Science 384, 202\u2013209 (2024).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Rumelhart, D. E., Hinton, G. E. & Williams, R. J. Learning representations by back-propagating errors. Nature 323, 533\u2013536 (1986).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Lin, X. et al. All-optical machine learning using diffractive deep neural networks. Science 361, 1004\u20131008 (2018).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Le Gallo, M. et al. A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference. Nat. Electron. 6, 680\u2013693 (2023).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Chen, Z. et al. Deep learning with coherent VCSEL neural networks. Nat. Photon. 17, 723\u2013730 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Mengu, D. et al. Misalignment resilient diffractive optical networks. Nanophotonics 9, 4207\u20134219 (2020).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Matsushima, K. & Shimobaba, T. Band-limited angular spectrum method for numerical simulation of free-space propagation in far and near fields. Opt. Express 17, 19662\u201319673 (2009).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Launay, J., Poli, I., Boniface, F. & Krzakala, F. Direct feedback alignment scales to modern deep learning tasks and architectures. Adv. Neural Inf. Process. Syst. 33, 9346\u20139360 (2020).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Cramer, B. et al. Surrogate gradients for analog neuromorphic computing. Proc. Natl Acad. Sci. 119, e2109194119 (2022).<\/p>\n

Article<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Spall, J., Guo, X. & Lvovsky, A. I. Hybrid training of optical neural networks. Optica 9, 803\u2013811 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Lillicrap, T. P., Cownden, D., Tweed, D. B. & Akerman, C. J. Random synaptic feedback weights support error backpropagation for deep learning. Nat. Commun. 7, 13276 (2016).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Brunton, S. L. & Kutz, J. N. Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control (Cambridge Univ. Press, 2022).<\/p>\n

Hinton, G. The forward-forward algorithm: some preliminary investigations. Preprint at https:\/\/arxiv.org\/abs\/2212.13345<\/a> (2022).<\/p>\n

Laydevant, J., Lott, A., Venturelli, D. & McMahon, P. L. The benefits of self-supervised learning for training physical neural networks. In Proc. 37th First Workshop on Machine Learning with New Compute Paradigms at NeurIPS 2023 (MLNPCP 2023) https:\/\/openreview.net\/forum?id=Fik4cO7FXd<\/a> (OpenReview, 2023).<\/p>\n

Refinetti, M., d\u2019Ascoli, S., Ohana, R. & Goldt, S. Align, then memorise: the dynamics of learning with feedback alignment. In Proc. 38th International Conference on Machine Learning, 8925\u20138935 (MLR Press, 2021).<\/p>\n

Lillicrap, T. P., Cownden, D., Tweed, D. B. & Akerman, C. J. Random feedback weights support learning in deep neural networks. Preprint at https:\/\/arxiv.org\/abs\/1411.0247<\/a> (2014).<\/p>\n

Launay, J. et al. Hardware beyond backpropagation: a photonic co-processor for direct feedback alignment. Preprint at https:\/\/arxiv.org\/abs\/2012.06373<\/a> (2020).<\/p>\n

Nakajima, M. et al. Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware. Nat. Commun. 13, 7847 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hinton, G. E., Dayan, P., Frey, B. J. & Neal, R. M. The \u201cwake-sleep\u201d algorithm for unsupervised neural networks. Science 268, 1158\u20131161 (1995).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

L\u00f6we, S., O\u2019Connor, P. & Veeling, B. Putting an end to end-to-end: gradient-isolated learning of representations. In Proc. Advances in Neural Information Processing Systems 32 (NeuroIPS 2019), 3039\u20133051 (ACM, 2019).<\/p>\n

N\u00f8kland, A. & Eidnes, L. H. Training neural networks with local error signals. In Proc. 36th International Conference on Machine Learning, 4839\u20134850 (MLR Press, 2019).<\/p>\n

Siddiqui, S. A., Krueger, D., LeCun, Y. & Deny, S. Blockwise self-supervised learning at scale. Preprint at https:\/\/arxiv.org\/abs\/2302.01647v1<\/a> (2023).<\/p>\n

Oguz, I. et al. Forward\u2013forward training of an optical neural network. Opt. Lett. 48, 5249\u20135252 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Xue, Z. et al. Fully forward mode training for optical neural networks. Nature 632, 280\u2013286 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Spall, J. C. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans. Autom. Control 37, 332\u2013341 (1992).<\/p>\n

Article<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

McCaughan, A. N. et al. Multiplexed gradient descent: fast online training of modern datasets on hardware neural networks without backpropagation. APL Mach. Learn. 1, 026118 (2023).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Bandyopadhyay, S. et al. Single-chip photonic deep neural network with forward-only training. Nat. Photon. 18, 1335\u20131343 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Oguz, I. et al. Programming nonlinear propagation for efficient optical learning machines. Adv. Photonics 6, 016002 (2024).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Skalli, A. et al. Annealing-inspired training of an optical neural network with ternary weights. Commun. Phys. 8, 68 (2025).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Bueno, J. et al. Reinforcement learning in a large-scale photonic recurrent neural network. Optica 5, 756\u2013760 (2018).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Kanno, K., Naruse, M. & Uchida, A. Adaptive model selection in photonic reservoir computing by reinforcement learning. Sci. Rep. 10, 10062 (2020).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hermans, M., Burm, M., Van Vaerenbergh, T., Dambre, J. & Bienstman, P. Trainable hardware for dynamical computing using error backpropagation through physical media. Nat. Commun. 6, 6729 (2015).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Burr, G. W. et al. Neuromorphic computing using non-volatile memory. Adv. Phys. X 2, 034092 (2017).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Pai, S. et al. Experimentally realized in situ backpropagation for deep learning in photonic neural networks. Science 380, 398\u2013404 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Morichetti, F. et al. Non-invasive on-chip light observation by contactless waveguide conductivity monitoring. IEEE J. Sel. Top. Quantum Electron. 20, 292\u2013301 (2014).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Zhou, T. et al. In situ optical backpropagation training of diffractive optical neural networks. Photonics Res. 8, 940\u2013953 (2020).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Guo, X., Barrett, T. D., Wang, Z. M. & Lvovsky, A. Backpropagation through nonlinear units for the all-optical training of neural networks. Photonics Res. 9, B71\u2013B80 (2021).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Wanjura, C. C. & Marquardt, F. Fully nonlinear neuromorphic computing with linear wave scattering. Nat. Phys. 20, 1434\u20131440 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Yildirim, M., Dinc, N. U., Oguz, I., Psaltis, D. & Moser, C. Nonlinear processing with linear optics. Nat. Photon. 18, 1076\u20131082 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Xia, F. et al. Nonlinear optical encoding enabled by recurrent linear scattering. Nat. Photon. 18, 1067\u20131075 (2024).<\/p>\n

Scellier, B. & Bengio, Y. Equilibrium propagation: bridging the gap between energy-based models and backpropagation. Front. Comput. Neurosci. 11, 24 (2017).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Ackley, D. H., Hinton, G. E. & Sejnowski, T. J. A learning algorithm for Boltzmann machines. Cogn. Sci. 9, 147\u2013169 (1985).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Stern, M., Hexner, D., Rocks, J. W. & Liu, A. J. Supervised learning in physical networks: from machine learning to learning machines. Phys. Rev. X 11, 021045 (2021).<\/p>\n

CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Scellier, B., Ernoult, M., Kendall, J. & Kumar, S. Energy-based learning algorithms for analog computing: a comparative study. In Proc. 37th International Conference on Neural Information Processing Systems (NIPS \u201923), 52705\u201352731 (ACM, 2023).<\/p>\n

Kendall, J., Pantone, R., Manickavasagam, K., Bengio, Y. & Scellier, B. Training end-to-end analog neural networks with equilibrium propagation. Preprint at https:\/\/arxiv.org\/abs\/2006.01981<\/a> (2020).<\/p>\n

Wang, Q., Wanjura, C. C. & Marquardt, F. Training coupled phase oscillators as a neuromorphic platform using equilibrium propagation. Neuromorph. Comput. Eng. 4, 034014 (2024).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Yi, S.-i, Kendall, J. D., Williams, R. S. & Kumar, S. Activity-difference training of deep neural networks using memristor crossbars. Nat. Electron. 6, 45\u201351 (2023).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Laydevant, J., Markovi\u0107, D. & Grollier, J. Training an Ising machine with equilibrium propagation. Nat. Commun. 15, 3671 (2024).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Altman, L. E., Stern, M., Liu, A. J. & Durian, D. J. Experimental demonstration of coupled learning in elastic networks. Phys. Rev. Appl. 22, 024053 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Dillavou, S., Stern, M., Liu, A. J. & Durian, D. J. Demonstration of decentralized physics-driven learning. Phys. Rev. Appl. 18, 014040 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Dillavou, S. et al. Machine learning without a processor: emergent learning in a nonlinear analog network. Proc. Natl Acad. Sci. 121, e2319718121 (2024).<\/p>\n

Stern, M., Dillavou, S., Jayaraman, D., Duria, D. J. & Liu, A. J. Training self-learning circuits for power-efficient solutions. APL Mach. Learn. 2, 016114 (2024).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Anisetti, V. R., Kandala, A., Scellier, B. & Schwarz, J. Frequency propagation: multimechanism learning in nonlinear physical networks. Neural Comput. 36, 596\u2013620 (2024).<\/p>\n

Article<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Murugan, A., Strupp, A., Scellier, B. & Falk, M. Contrastive learning through non-equilibrium memory. In APS March Meeting Abstracts 2023, F02.005 (APS, 2023).<\/p>\n

Laborieux, A. & Zenke, F. Holomorphic equilibrium propagation computes exact gradients through finite size oscillations. In Proc. 36th International Conference on Neural Information Processing Systems (NIPS \u201922), 12950\u201312963 (ACM, 2022).<\/p>\n

Scellier, B., Mishra, S., Bengio, Y. & Ollivier, Y. Agnostic physics-driven deep learning. Preprint at https:\/\/arxiv.org\/abs\/2205.15021<\/a> (2022).<\/p>\n

Lopez-Pastor, V. & Marquardt, F. Self-learning machines based on Hamiltonian echo backpropagation. Phys. Rev. X 13, 031020 (2023).<\/p>\n

CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Touvron, H. et al. LLaMA: open and efficient foundation language models. Preprint at https:\/\/arxiv.org\/abs\/2302.13971<\/a> (2023).<\/p>\n

Chowdhery, A. et al. PaLM: scaling language modeling with pathways. J. Mach. Learn. Res. 24, 1\u2013113 (2023).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Achiam, J. et al. GPT-4 technical report. Preprint at https:\/\/arxiv.org\/abs\/2303.08774v1<\/a> (2023).<\/p>\n

Team, G. Gemini: a family of highly capable multimodal models. Preprint at https:\/\/arxiv.org\/abs\/2312.11805v1<\/a> (2024).<\/p>\n

Radford, A. et al. Learning transferable visual models from natural language supervision. In Proc. 38th International Conference on Machine Learning, 8748\u20138763 (MLR Press, 2021).<\/p>\n

Liu, H., Li, C., Wu, Q. & Lee, Y. J. Visual instruction tuning. In Proc. 37th Conference on Neural Information Processing Systems (NeurIPS 2023) https:\/\/openreview.net\/forum?id=w0H2xGHlkw<\/a> (OpenReview, 2023).<\/p>\n

Radford, A. et al. Language models are unsupervised multitask learners. OpenAI Blog 1, 9 (2019).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Katharopoulos, A., Vyas, A., Pappas, N. & Fleuret, F. Transformers are RNNs: fast autoregressive transformers with linear attention. In Proc. 37th International Conference on Machine Learning, 5156\u20135165 (MLR Press, 2020).<\/p>\n

Gu, A. & Dao, T. Mamba: linear-time sequence modeling with selective state spaces. Preprint at https:\/\/arxiv.org\/abs\/2312.00752v1<\/a> (2023).<\/p>\n

Wang, H. et al. BitNet: scaling 1-bit transformers for large language models. Preprint at https:\/\/arxiv.org\/abs\/2310.11453<\/a> (2023).<\/p>\n

Hu, E. J. et al. LoRA: low-rank adaptation of large language models. Preprint at https:\/\/arxiv.org\/abs\/2106.09685<\/a> (2021).<\/p>\n

Dao, T., Fu, D., Ermon, S., Rudra, A. & R\u00e9, C. FLASHATTENTION: fast and memory-efficient exact attention with IO-awareness. In Proc. 36th Conference on Neural Information Processing Systems (NeurIPS 2022) 35, 16344\u201316359 (ACM, 2022).<\/p>\n

Juravsky, J. et al. Hydragen: high-throughput LLM inference with shared prefixes. Preprint at https:\/\/arxiv.org\/abs\/2402.05099<\/a> (2024).<\/p>\n

Anderson, M. G., Ma, S.-Y., Wang, T., Wright, L. G. & McMahon, P. L. Optical transformers. Preprint at https:\/\/arxiv.org\/abs\/2302.10360<\/a> (2023).<\/p>\n

Shen, Y. et al. Deep learning with coherent nanophotonic circuits. Nat. Photon. 11, 441\u2013446 (2017).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hamerly, R., Bernstein, L., Sludds, A., Solja\u010di\u0107, M. & Englund, D. Large-scale optical neural networks based on photoelectric multiplication. Phys. Rev. X 9, 021032 (2019).<\/p>\n

CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Tait, A. N. Quantifying power in silicon photonic neural networks. Phys. Rev. Appl. 17, 054029 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Laydevant, J., Wright, L. G., Wang, T. & McMahon, P. L. The hardware is the software. Neuron 112, 180\u2013183 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hooker, S. The hardware lottery. Commun. ACM 64, 58\u201365 (2021).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Stroev, N. & Berloff, N. G. Analog photonics computing for information processing, inference, and optimization. Adv. Quantum Technol. 6, 2300055 (2023).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Cerezo, M., Verdon, G., Huang, H.-Y., Cincio, L. & Coles, P. J. Challenges and opportunities in quantum machine learning. Nat. Comput. Sci. 2, 567\u2013576 (2022).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Kashif, M. & Shafique, M. Hqnet: harnessing quantum noise for effective training of quantum neural networks in NISQ era. Preprint at https:\/\/arxiv.org\/abs\/2402.08475v1<\/a> (2024).<\/p>\n

Zhou, M.-G. et al. Quantum neural network for quantum neural computing. Research 6, 0134 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Tian, J. et al. Recent advances for quantum neural networks in generative learning. IEEE Trans. Pattern. Anal. Mach. Intell. 45, 12321\u201312340 (2023).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Cerezo, M. et al. Variational quantum algorithms. Nat. Rev. Phys. 3, 625\u2013644 (2021).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Niazi, S. et al. Training deep Boltzmann networks with sparse Ising machines. Nat. Electron. 7, 610\u2013619 (2024).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Ma, S. Y., Wang, T., Laydevant, J., Wright, L. G. & McMahon, P. L. Quantum-limited stochastic optical neural networks operating at a few quanta per activation. Nat. Commun. 16, 359 (2025).<\/p>\n

Pierangeli, D., Marcucci, G., Brunner, D. & Conti, C. Noise-enhanced spatial-photonic Ising machine. Nanophotonics 9, 4109\u20134116 (2020).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

McMahon, P. L. The physics of optical computing. Nat. Rev. Phys. 5, 717\u2013734 (2023).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Keeling, J. & Berloff, N. G. Exciton\u2013polariton condensation. Contemp. Phys. 52, 131\u2013151 (2011).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Berloff, N. G. et al. Realizing the classical XY Hamiltonian in polariton simulators. Nat. Mater. 16, 1120\u20131126 (2017).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Johnston, A. & Berloff, N. G. Macroscopic noise amplification by asymmetric dyads in non-Hermitian optical systems for generative diffusion models. Phys. Rev. Lett. 132, 096901 (2024).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Wang, T. et al. Image sensing with multilayer nonlinear optical neural networks. Nat. Photon. 17, 408\u2013415 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Zhou, F. & Chai, Y. Near-sensor and in-sensor computing. Nat. Electron. 3, 664\u2013671 (2020).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

del Hougne, P., F. Imani, M., Diebold, A. V., Horstmeyer, R. & Smith, D. R. Learned integrated sensing pipeline: reconfigurable metasurface transceivers as trainable physical layer in an artificial neural network. Adv. Sci. 7, 1901913 (2020).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Vaswani, A. et al. Attention is all you need. In Proc. 31st International Conference on Neural Information Processing Systems (NIPS \u201917), 6000\u20136010 (ACM, 2017).<\/p>\n

Wu, C. et al. Harnessing optoelectronic noises in a photonic generative network. Sci. Adv. 8, eabm2956 (2022).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Bonnet, D. et al. Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks. Nat. Commun. 14, 7530 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Olin-Ammentorp, W., Beckmann, K., Schuman, C. D., Plank, J. S. & Cady, N. C. Stochasticity and robustness in spiking neural networks. Neurocomputing 419, 23\u201336 (2021).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n","protected":false},"excerpt":{"rendered":"Samborska, V. Scaling up: how increasing inputs has made artificial intelligence more capable. Our World in Data https:\/\/ourworldindata.org\/scaling-up-ai…\n","protected":false},"author":2,"featured_media":114149,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,35334,4230,11959,4231,55000,90,86,56,54,55],"class_list":["post-114148","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-electronics","tag-humanities-and-social-sciences","tag-mathematics-and-computing","tag-multidisciplinary","tag-photonics-and-device-physics","tag-science","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/114148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=114148"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/114148\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/114149"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=114148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=114148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=114148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}