No Access
Published Online: 21 March 2019
Accepted: March 2019
Chaos 29, 033128 (2019); https://doi.org/10.1063/1.5057379
We present a model-free forecast algorithm that dynamically combines multiple forecasts using multivariate time series data. The underlying principle is based on the fact that forecast performance depends on the position in the state space. This property is exploited to weight multiple forecasts via a local loss function. Specifically, additional weights are assigned to appropriate forecasts depending on their positions in a state space reconstructed via delay coordinates. The function evaluates the forecast error discounted by the distance in the space, whereas most existing methods discount the error in relation to time. In addition, forecasts are selected with the function for each time step based on the existing multiview embedding approach; by contrast, the original multiview embedding selects the reconstructions in advance before starting the forecast. The proposed prediction method has the smallest mean squared error among conventional ensemble methods for the Rössler and the Lorenz'96I models. The results of comparison of the proposed method with conventional machine-learning methods using a flood forecast example indicate that the proposed method yields superior accuracy. We also demonstrate that the proposed method might even correctly forecast the maximum water level of rivers without any prior knowledge.
We thank Professor Christian W. Dawson (Loughborough University) for permission to use the flood datasets (which can be obtained by contacting him directly). We thank Dr. Takahiro Omi for suggestions and feedback on early drafts of this work. We thank the anonymous reviewers for suggestions to improve our work, especially ensemble interpretations and sensitivity analysis. This research is partially supported by Kozo Keikaku Engineering Inc., JSPS KAKENHI (Grant No. JP15H05707) and the World Premier International Research Center Initiative (WPI), MEXT, Japan.
  1. 1. F. Takens, Lect. Notes Math. 898, 366 (1981). https://doi.org/10.1007/BFb0091924, Google ScholarCrossref
  2. 2. E. R. Deyle and G. Sugihara, PLoS One 6, e18295 (2011). https://doi.org/10.1371/journal.pone.0018295, Google ScholarCrossref
  3. 3. J. Runge, R. V. Donner, and J. Kurths, Phys. Rev. E 91, 1 (2015). https://doi.org/10.1103/PhysRevE.91.052909, Google ScholarCrossref
  4. 4. I. Vlachos and D. Kugiumtzis, in Topics on Chaotic Systems: Selected Papers from Chaos 2008 International Conference (World Scientific, 2009), pp. 378–387. Google ScholarCrossref
  5. 5. M. Shen, W.-N. Chen, J. Zhang, H. S.-H. Chung, and O. Kaynak, IEEE Trans. Cybern. 43, 790 (2013). https://doi.org/10.1109/TSMCB.2012.2219859, Google ScholarCrossref
  6. 6. H. Ye and G. Sugihara, Science 353, 922 (2016). https://doi.org/10.1126/science.aag0863, Google ScholarCrossref
  7. 7. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games (Cambridge University Press, 2006). Google ScholarCrossref
  8. 8. A. Chernov and F. Zhdanov, in Lecture Notes in Computer Science (Including its Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Springer Berlin Heidelberg, 2010), Vol. 6331, pp. 255–269. Google Scholar
  9. 9. S. Okuno, T. Takeuchi, S. Horai, K. Aihara, and Y. Hirata, Mathematical Engineering Technical Reports METR 2017-22, 2017. Google Scholar
  10. 10. L. A. Smith, Philos. Trans. R. Soc., A 348, 371 (1994). https://doi.org/10.1098/rsta.1994.0097, Google ScholarCrossref
  11. 11. E. N. Lorenz, J. Atmos. Sci. 26, 636 (1969). https://doi.org/10.1175/1520-0469(1969)26<636:APARBN>2.0.CO;2, Google ScholarCrossref
  12. 12. Y. Hirata, T. Takeuchi, S. Horai, H. Suzuki, and K. Aihara, Sci. Rep. 5, 15736 (2015). https://doi.org/10.1038/srep15736, Google ScholarCrossref
  13. 13. H. Du and L. A. Smith, Phys. D Nonlinear Phenom. 353–354, 31 (2017). https://doi.org/10.1016/j.physd.2017.06.001, Google ScholarCrossref
  14. 14. O. E. Rössler, Phys. Lett. A 57, 397 (1976). https://doi.org/10.1016/0375-9601(76)90101-8, Google ScholarCrossref
  15. 15. E. N. Lorenz, in Seminar on Predictability (ECMWF, Reading, 1996), pp. 1–18. Google Scholar
  16. 16. C. W. Dawson, L. M. See, R. J. Abrahart, R. L. Wilby, A. Y. Shamseldin, F. Anctil, A. N. Belbachir, G. Bowden, G. Dandy, N. Lauzon, H. Maier, and G. Mason, in Proceedings of the International Joint Conference on Neural Networks (IEEE, Montreal, 2005), pp. 2666–2670. Google Scholar
  17. 17. F. A. Gers, D. Eck, and J. Schmidhuber, in Lecture Notes in Computer Science (Springer Berlin Heidelberg, 2001), Vol. 2130, pp. 669–676. Google Scholar
  18. 18. H. Ma, S. Leng, K. Aihara, W. Lin, and L. Chen, Proc. Natl. Acad. Sci. U. S. A. 115, E9994 (2018). https://doi.org/10.1073/pnas.1802987115, Google ScholarCrossref
  19. 19. M. Suzuki, N. Takatsuki, J. I. Imura, Y. Hirata, and K. Aihara, in IFAC Proceedings Volumes (Elsevier, 2012), pp. 40–44. Google Scholar
  20. 20. F. Hamilton, T. Berry, and T. Sauer, Phys. Rev. X  6, 1 (2016). https://doi.org/10.1103/PhysRevX.6.011021, Google ScholarCrossref
  21. 21. F. Hamilton, T. Berry, and T. Sauer, Eur. Phys. J. Spec. Top. 226, 3239 (2017). https://doi.org/10.1140/epjst/e2016-60363-2, Google ScholarCrossref
  22. 22. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and É Duchesnay, J. Mach. Learn. Res. 12, 2825 (2012). Google Scholar
  23. 23. M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, M. Kudlur, J. Levenberg, R. Monga, S. Moore, D. G. Murray, B. Steiner, P. Tucker, V. Vasudevan, P. Warden, M. Wicke, Y. Yu, X. Zheng, and G. Brain, in 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI ‘16) (USENIX Association, 2016), pp. 265–284. Google Scholar
  24. 24. E. N. Lorenz, J. Atmos. Sci. 20, 130 (1963). https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2, Google ScholarCrossref
  25. 25. Y. Hirata, M. Shiro, N. Takahashi, K. Aihara, H. Suzuki, and P. Mas, Chaos 25, 013114 (2014). https://doi.org/10.1063/1.4906746, Google ScholarScitation
  26. 26. I. J. Good, J. R. Stat. Soc. B 14, 107 (1952). Google Scholar
  27. 27. M. S. Roulston and L. A. Smith, Mon. Weather Rev. 130, 1653 (2002). https://doi.org/10.1175/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2, Google ScholarCrossref
  28. 28. J. M. Bernardo, Ann. Stat. 7, 686 (1979). https://doi.org/10.1214/aos/1176344689, Google ScholarCrossref
  29. 29. A. E. Raftery, T. Gneiting, F. Balabdaoui, M. Polakowski, A. E. Raftery, T. Gneiting, F. Balabdaoui, and M. Polakowski, Mon. Weather Rev. 133, 1155 (2005). https://doi.org/10.1175/MWR2906.1, Google ScholarCrossref
  30. 30. J. Bröcker and L. A. Smith, Weather Forecast. 22, 382 (2007). https://doi.org/10.1175/WAF966.1, Google ScholarCrossref
  1. Published under license by AIP Publishing.