Statistical reasoning and statistical inference have strong historical connections with philosophy of science. In this talk, the new paradigm of data-driven science is examined through comparison with principled statistical approaches. I will review the merits and shortcomings of principled statistical inference. I will offer some comments on post-selection inference, inference for black box algorithms, and a survey of future challenges.