The Madden-Julian oscillation (MJO) is one of the most important sources of predictability on subseasonal to seasonal (S2S) time scales. Many previous studies have explored the impact of the present state of the MJO on the future evolution and predictability of extratropical weather patterns. What is still unclear, however, is the importance of the accumulated influence of past MJO activity on these results. In this study, the importance of past MJO activity in determining the future state of extratropical circulations is examined by using a linear baroclinic model (LBM) and one of the simplest machine learning algorithms: logistic regression. By increasing the complexity of the logistic regression model with additional information about the past activity of the MJO, it is demonstrated that the past 15 days play a dominant role in determining the state of MJO teleconnections more than 15 days into the future. This conclusion is supported by numerical LBM simulations. It is further shown that the past 15 days of additional information are only important for some MJO phases/lead times and not others, and the physical basis for this result is explored.