ABSTRACT
We present a model-free forecast algorithm that dynamically combines multiple forecasts using multivariate time series data. The underlying principle is based on the fact that forecast performance depends on the position in the state space. This property is exploited to weight multiple forecasts via a local loss function. Specifically, additional weights are assigned to appropriate forecasts depending on their positions in a state space reconstructed via delay coordinates. The function evaluates the forecast error discounted by the distance in the space, whereas most existing methods discount the error in relation to time. In addition, forecasts are selected with the function for each time step based on the existing multiview embedding approach; by contrast, the original multiview embedding selects the reconstructions in advance before starting the forecast. The proposed prediction method has the smallest mean squared error among conventional ensemble methods for the Rössler and the Lorenz'96I models. The results of comparison of the proposed method with conventional machine-learning methods using a flood forecast example indicate that the proposed method yields superior accuracy. We also demonstrate that the proposed method might even correctly forecast the maximum water level of rivers without any prior knowledge.
ACKNOWLEDGMENTS
We thank Professor Christian W. Dawson (Loughborough University) for permission to use the flood datasets (which can be obtained by contacting him directly). We thank Dr. Takahiro Omi for suggestions and feedback on early drafts of this work. We thank the anonymous reviewers for suggestions to improve our work, especially ensemble interpretations and sensitivity analysis. This research is partially supported by Kozo Keikaku Engineering Inc., JSPS KAKENHI (Grant No. JP15H05707) and the World Premier International Research Center Initiative (WPI), MEXT, Japan.
- 1. F. Takens, Lect. Notes Math. 898, 366 (1981). https://doi.org/10.1007/BFb0091924, Google ScholarCrossref
- 2. E. R. Deyle and G. Sugihara, PLoS One 6, e18295 (2011). https://doi.org/10.1371/journal.pone.0018295, Google ScholarCrossref
- 3. J. Runge, R. V. Donner, and J. Kurths, Phys. Rev. E 91, 1 (2015). https://doi.org/10.1103/PhysRevE.91.052909, Google ScholarCrossref
- 4. I. Vlachos and D. Kugiumtzis, in Topics on Chaotic Systems: Selected Papers from Chaos 2008 International Conference (World Scientific, 2009), pp. 378–387. Google ScholarCrossref
- 5. M. Shen, W.-N. Chen, J. Zhang, H. S.-H. Chung, and O. Kaynak, IEEE Trans. Cybern. 43, 790 (2013). https://doi.org/10.1109/TSMCB.2012.2219859, Google ScholarCrossref
- 6. H. Ye and G. Sugihara, Science 353, 922 (2016). https://doi.org/10.1126/science.aag0863, Google ScholarCrossref
- 7. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games (Cambridge University Press, 2006). Google ScholarCrossref
- 8. A. Chernov and F. Zhdanov, in Lecture Notes in Computer Science (Including its Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Springer Berlin Heidelberg, 2010), Vol. 6331, pp. 255–269. Google Scholar
- 9. S. Okuno, T. Takeuchi, S. Horai, K. Aihara, and Y. Hirata, Mathematical Engineering Technical Reports METR 2017-22, 2017. Google Scholar
- 10. L. A. Smith, Philos. Trans. R. Soc., A 348, 371 (1994). https://doi.org/10.1098/rsta.1994.0097, Google ScholarCrossref
- 11. E. N. Lorenz, J. Atmos. Sci. 26, 636 (1969). https://doi.org/10.1175/1520-0469(1969)26<636:APARBN>2.0.CO;2, Google ScholarCrossref
- 12. Y. Hirata, T. Takeuchi, S. Horai, H. Suzuki, and K. Aihara, Sci. Rep. 5, 15736 (2015). https://doi.org/10.1038/srep15736, Google ScholarCrossref
- 13. H. Du and L. A. Smith, Phys. D Nonlinear Phenom. 353–354, 31 (2017). https://doi.org/10.1016/j.physd.2017.06.001, Google ScholarCrossref
- 14. O. E. Rössler, Phys. Lett. A 57, 397 (1976). https://doi.org/10.1016/0375-9601(76)90101-8, Google ScholarCrossref
- 15. E. N. Lorenz, in Seminar on Predictability (ECMWF, Reading, 1996), pp. 1–18. Google Scholar
- 16. C. W. Dawson, L. M. See, R. J. Abrahart, R. L. Wilby, A. Y. Shamseldin, F. Anctil, A. N. Belbachir, G. Bowden, G. Dandy, N. Lauzon, H. Maier, and G. Mason, in Proceedings of the International Joint Conference on Neural Networks (IEEE, Montreal, 2005), pp. 2666–2670. Google Scholar
- 17. F. A. Gers, D. Eck, and J. Schmidhuber, in Lecture Notes in Computer Science (Springer Berlin Heidelberg, 2001), Vol. 2130, pp. 669–676. Google Scholar
- 18. H. Ma, S. Leng, K. Aihara, W. Lin, and L. Chen, Proc. Natl. Acad. Sci. U. S. A. 115, E9994 (2018). https://doi.org/10.1073/pnas.1802987115, Google ScholarCrossref
- 19. M. Suzuki, N. Takatsuki, J. I. Imura, Y. Hirata, and K. Aihara, in IFAC Proceedings Volumes (Elsevier, 2012), pp. 40–44. Google Scholar
- 20. F. Hamilton, T. Berry, and T. Sauer, Phys. Rev. X 6, 1 (2016). https://doi.org/10.1103/PhysRevX.6.011021, Google ScholarCrossref
- 21. F. Hamilton, T. Berry, and T. Sauer, Eur. Phys. J. Spec. Top. 226, 3239 (2017). https://doi.org/10.1140/epjst/e2016-60363-2, Google ScholarCrossref
- 22. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and É Duchesnay, J. Mach. Learn. Res. 12, 2825 (2012). Google Scholar
- 23. M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, M. Kudlur, J. Levenberg, R. Monga, S. Moore, D. G. Murray, B. Steiner, P. Tucker, V. Vasudevan, P. Warden, M. Wicke, Y. Yu, X. Zheng, and G. Brain, in 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI ‘16) (USENIX Association, 2016), pp. 265–284. Google Scholar
- 24. E. N. Lorenz, J. Atmos. Sci. 20, 130 (1963). https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2, Google ScholarCrossref
- 25. Y. Hirata, M. Shiro, N. Takahashi, K. Aihara, H. Suzuki, and P. Mas, Chaos 25, 013114 (2014). https://doi.org/10.1063/1.4906746, Google ScholarScitation
- 26. I. J. Good, J. R. Stat. Soc. B 14, 107 (1952). Google Scholar
- 27. M. S. Roulston and L. A. Smith, Mon. Weather Rev. 130, 1653 (2002). https://doi.org/10.1175/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2, Google ScholarCrossref
- 28. J. M. Bernardo, Ann. Stat. 7, 686 (1979). https://doi.org/10.1214/aos/1176344689, Google ScholarCrossref
- 29. A. E. Raftery, T. Gneiting, F. Balabdaoui, M. Polakowski, A. E. Raftery, T. Gneiting, F. Balabdaoui, and M. Polakowski, Mon. Weather Rev. 133, 1155 (2005). https://doi.org/10.1175/MWR2906.1, Google ScholarCrossref
- 30. J. Bröcker and L. A. Smith, Weather Forecast. 22, 382 (2007). https://doi.org/10.1175/WAF966.1, Google ScholarCrossref
Please Note: The number of views represents the full text views from December 2016 to date. Article views prior to December 2016 are not included.


